[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:16:40.443917 23151 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.155.254:43651
I20260709 12:16:40.445732 23151 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:16:40.446913 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:40.466668 23158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:40.466674 23157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:40.469007 23151 server_base.cc:1061] running on GCE node
W20260709 12:16:40.468266 23160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:41.701723 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:41.701983 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:41.702147 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599401702130 us; error 0 us; skew 500 ppm
I20260709 12:16:41.703016 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:41.708675 23151 webserver.cc:533] Webserver started at http://127.22.155.254:36873/ using document root <none> and password file <none>
I20260709 12:16:41.709568 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:41.709779 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:41.710186 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:41.716312 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599400258298-23151-0/minicluster-data/master-0-root/instance:
uuid: "813e6e6d2359416ea3078f44d505a5f6"
format_stamp: "Formatted at 2026-07-09 12:16:41 on dist-test-slave-p7fg"
I20260709 12:16:41.724834 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.002s	sys 0.005s
I20260709 12:16:41.730453 23166 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:41.731959 23151 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:16:41.732380 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599400258298-23151-0/minicluster-data/master-0-root
uuid: "813e6e6d2359416ea3078f44d505a5f6"
format_stamp: "Formatted at 2026-07-09 12:16:41 on dist-test-slave-p7fg"
I20260709 12:16:41.732798 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599400258298-23151-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599400258298-23151-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599400258298-23151-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:41.819841 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:41.821523 23151 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:16:41.822052 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:41.901185 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.254:43651
I20260709 12:16:41.901289 23217 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.254:43651 every 8 connection(s)
I20260709 12:16:41.910024 23218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.933981 23218 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 813e6e6d2359416ea3078f44d505a5f6: Bootstrap starting.
I20260709 12:16:41.940691 23218 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 813e6e6d2359416ea3078f44d505a5f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:41.942754 23218 log.cc:826] T 00000000000000000000000000000000 P 813e6e6d2359416ea3078f44d505a5f6: Log is configured to *not* fsync() on all Append() calls
I20260709 12:16:41.948060 23218 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 813e6e6d2359416ea3078f44d505a5f6: No bootstrap required, opened a new log
I20260709 12:16:41.969981 23218 raft_consensus.cc:359] T 00000000000000000000000000000000 P 813e6e6d2359416ea3078f44d505a5f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813e6e6d2359416ea3078f44d505a5f6" member_type: VOTER }
I20260709 12:16:41.970613 23218 raft_consensus.cc:385] T 00000000000000000000000000000000 P 813e6e6d2359416ea3078f44d505a5f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:41.970829 23218 raft_consensus.cc:740] T 00000000000000000000000000000000 P 813e6e6d2359416ea3078f44d505a5f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 813e6e6d2359416ea3078f44d505a5f6, State: Initialized, Role: FOLLOWER
I20260709 12:16:41.971879 23218 consensus_queue.cc:260] T 00000000000000000000000000000000 P 813e6e6d2359416ea3078f44d505a5f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813e6e6d2359416ea3078f44d505a5f6" member_type: VOTER }
I20260709 12:16:41.972398 23218 raft_consensus.cc:399] T 00000000000000000000000000000000 P 813e6e6d2359416ea3078f44d505a5f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:16:41.972729 23218 raft_consensus.cc:493] T 00000000000000000000000000000000 P 813e6e6d2359416ea3078f44d505a5f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:16:41.973047 23218 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 813e6e6d2359416ea3078f44d505a5f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:41.977737 23218 raft_consensus.cc:515] T 00000000000000000000000000000000 P 813e6e6d2359416ea3078f44d505a5f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813e6e6d2359416ea3078f44d505a5f6" member_type: VOTER }
I20260709 12:16:41.978506 23218 leader_election.cc:304] T 00000000000000000000000000000000 P 813e6e6d2359416ea3078f44d505a5f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 813e6e6d2359416ea3078f44d505a5f6; no voters: 
I20260709 12:16:41.980485 23218 leader_election.cc:290] T 00000000000000000000000000000000 P 813e6e6d2359416ea3078f44d505a5f6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:16:41.981134 23221 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 813e6e6d2359416ea3078f44d505a5f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:41.983984 23221 raft_consensus.cc:697] T 00000000000000000000000000000000 P 813e6e6d2359416ea3078f44d505a5f6 [term 1 LEADER]: Becoming Leader. State: Replica: 813e6e6d2359416ea3078f44d505a5f6, State: Running, Role: LEADER
I20260709 12:16:41.985251 23221 consensus_queue.cc:237] T 00000000000000000000000000000000 P 813e6e6d2359416ea3078f44d505a5f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813e6e6d2359416ea3078f44d505a5f6" member_type: VOTER }
I20260709 12:16:41.986373 23218 sys_catalog.cc:565] T 00000000000000000000000000000000 P 813e6e6d2359416ea3078f44d505a5f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:16:41.999596 23223 sys_catalog.cc:455] T 00000000000000000000000000000000 P 813e6e6d2359416ea3078f44d505a5f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 813e6e6d2359416ea3078f44d505a5f6. Latest consensus state: current_term: 1 leader_uuid: "813e6e6d2359416ea3078f44d505a5f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813e6e6d2359416ea3078f44d505a5f6" member_type: VOTER } }
I20260709 12:16:41.999523 23222 sys_catalog.cc:455] T 00000000000000000000000000000000 P 813e6e6d2359416ea3078f44d505a5f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "813e6e6d2359416ea3078f44d505a5f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813e6e6d2359416ea3078f44d505a5f6" member_type: VOTER } }
I20260709 12:16:42.000437 23222 sys_catalog.cc:458] T 00000000000000000000000000000000 P 813e6e6d2359416ea3078f44d505a5f6 [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:42.002516 23223 sys_catalog.cc:458] T 00000000000000000000000000000000 P 813e6e6d2359416ea3078f44d505a5f6 [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:42.005333 23230 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:16:42.018354 23230 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:16:42.033233 23151 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:16:42.040819 23230 catalog_manager.cc:1383] Generated new cluster ID: 83299ac71f6a4889a36429f0ef04ed2c
I20260709 12:16:42.041154 23230 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:16:42.060297 23230 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:16:42.062240 23230 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:16:42.078052 23230 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 813e6e6d2359416ea3078f44d505a5f6: Generated new TSK 0
I20260709 12:16:42.079420 23230 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:16:42.104542 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:42.114938 23240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:42.116305 23241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:42.121197 23151 server_base.cc:1061] running on GCE node
W20260709 12:16:42.121152 23243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:42.122291 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:42.122561 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:42.122807 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599402122788 us; error 0 us; skew 500 ppm
I20260709 12:16:42.123507 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:42.128232 23151 webserver.cc:533] Webserver started at http://127.22.155.193:41539/ using document root <none> and password file <none>
I20260709 12:16:42.128911 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:42.129138 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:42.129462 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:42.130846 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599400258298-23151-0/minicluster-data/ts-0-root/instance:
uuid: "653d221b042e4553b69ee069f7768959"
format_stamp: "Formatted at 2026-07-09 12:16:42 on dist-test-slave-p7fg"
I20260709 12:16:42.137579 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:16:42.142850 23248 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:42.143997 23151 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:16:42.144495 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599400258298-23151-0/minicluster-data/ts-0-root
uuid: "653d221b042e4553b69ee069f7768959"
format_stamp: "Formatted at 2026-07-09 12:16:42 on dist-test-slave-p7fg"
I20260709 12:16:42.144994 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599400258298-23151-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599400258298-23151-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599400258298-23151-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:42.176576 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:42.178661 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:42.181936 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:42.188238 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:42.188617 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:42.189023 23151 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:42.189275 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:42.301142 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.193:45731
I20260709 12:16:42.301277 23310 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.193:45731 every 8 connection(s)
I20260709 12:16:42.310777 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:42.329182 23315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:42.331516 23316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:42.341598 23151 server_base.cc:1061] running on GCE node
W20260709 12:16:42.343731 23318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:42.345188 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:42.345530 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:42.345757 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599402345735 us; error 0 us; skew 500 ppm
I20260709 12:16:42.346427 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:42.346318 23311 heartbeater.cc:344] Connected to a master server at 127.22.155.254:43651
I20260709 12:16:42.347087 23311 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:42.348356 23311 heartbeater.cc:507] Master 127.22.155.254:43651 requested a full tablet report, sending...
I20260709 12:16:42.353343 23151 webserver.cc:533] Webserver started at http://127.22.155.194:37835/ using document root <none> and password file <none>
I20260709 12:16:42.353303 23183 ts_manager.cc:194] Registered new tserver with Master: 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731)
I20260709 12:16:42.354211 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:42.354544 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:42.354935 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:42.356766 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599400258298-23151-0/minicluster-data/ts-1-root/instance:
uuid: "6158309d5094456cb4548d7568b28ce6"
format_stamp: "Formatted at 2026-07-09 12:16:42 on dist-test-slave-p7fg"
I20260709 12:16:42.356868 23183 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37502
I20260709 12:16:42.364328 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:16:42.369890 23323 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:42.370872 23151 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:16:42.371181 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599400258298-23151-0/minicluster-data/ts-1-root
uuid: "6158309d5094456cb4548d7568b28ce6"
format_stamp: "Formatted at 2026-07-09 12:16:42 on dist-test-slave-p7fg"
I20260709 12:16:42.371447 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599400258298-23151-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599400258298-23151-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599400258298-23151-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:42.397838 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:42.399348 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:42.401893 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:42.405900 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:42.406162 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:42.406456 23151 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:42.406654 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:42.520112 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.194:34329
I20260709 12:16:42.520241 23385 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.194:34329 every 8 connection(s)
I20260709 12:16:42.527596 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:42.538550 23389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:42.538573 23390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:42.546379 23386 heartbeater.cc:344] Connected to a master server at 127.22.155.254:43651
I20260709 12:16:42.546900 23386 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:42.548136 23386 heartbeater.cc:507] Master 127.22.155.254:43651 requested a full tablet report, sending...
I20260709 12:16:42.550360 23151 server_base.cc:1061] running on GCE node
W20260709 12:16:42.550395 23392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:42.551350 23183 ts_manager.cc:194] Registered new tserver with Master: 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329)
I20260709 12:16:42.552052 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:42.552333 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:42.552536 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599402552517 us; error 0 us; skew 500 ppm
I20260709 12:16:42.553342 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:42.553329 23183 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37518
I20260709 12:16:42.557114 23151 webserver.cc:533] Webserver started at http://127.22.155.195:38297/ using document root <none> and password file <none>
I20260709 12:16:42.557667 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:42.557902 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:42.558202 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:42.559337 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599400258298-23151-0/minicluster-data/ts-2-root/instance:
uuid: "acc8af67993a40b4b831b0648627df4a"
format_stamp: "Formatted at 2026-07-09 12:16:42 on dist-test-slave-p7fg"
I20260709 12:16:42.564471 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260709 12:16:42.570111 23397 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:42.571053 23151 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:16:42.571357 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599400258298-23151-0/minicluster-data/ts-2-root
uuid: "acc8af67993a40b4b831b0648627df4a"
format_stamp: "Formatted at 2026-07-09 12:16:42 on dist-test-slave-p7fg"
I20260709 12:16:42.571662 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599400258298-23151-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599400258298-23151-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599400258298-23151-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:42.585431 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:42.586772 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:42.588833 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:42.591238 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:42.591440 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:42.591758 23151 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:42.591919 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:42.706281 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.195:37153
I20260709 12:16:42.706487 23459 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.195:37153 every 8 connection(s)
I20260709 12:16:42.726491 23460 heartbeater.cc:344] Connected to a master server at 127.22.155.254:43651
I20260709 12:16:42.726939 23460 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:42.727923 23460 heartbeater.cc:507] Master 127.22.155.254:43651 requested a full tablet report, sending...
I20260709 12:16:42.730178 23183 ts_manager.cc:194] Registered new tserver with Master: acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:16:42.730774 23151 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016408814s
I20260709 12:16:42.732025 23183 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37520
I20260709 12:16:42.792542 23183 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37522:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:16:42.796695 23183 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:16:42.911321 23425 tablet_service.cc:1511] Processing CreateTablet for tablet 118c992384fb4066acc1d04490d2239b (DEFAULT_TABLE table=test-workload [id=0e92d0fd3c2e4f51b383b22c71b89f1c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:42.911563 23424 tablet_service.cc:1511] Processing CreateTablet for tablet 0d675dc4d2174178a63abad38736adfd (DEFAULT_TABLE table=test-workload [id=0e92d0fd3c2e4f51b383b22c71b89f1c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:42.911648 23423 tablet_service.cc:1511] Processing CreateTablet for tablet e85e09af0aa44ee09ccc4b71e1843fe9 (DEFAULT_TABLE table=test-workload [id=0e92d0fd3c2e4f51b383b22c71b89f1c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:42.913182 23425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 118c992384fb4066acc1d04490d2239b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.914182 23423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85e09af0aa44ee09ccc4b71e1843fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.917088 23424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d675dc4d2174178a63abad38736adfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.930330 23422 tablet_service.cc:1511] Processing CreateTablet for tablet bd92f8c45fc8467d896f5a99d6248a83 (DEFAULT_TABLE table=test-workload [id=0e92d0fd3c2e4f51b383b22c71b89f1c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:42.934293 23422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd92f8c45fc8467d896f5a99d6248a83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.945327 23274 tablet_service.cc:1511] Processing CreateTablet for tablet e85e09af0aa44ee09ccc4b71e1843fe9 (DEFAULT_TABLE table=test-workload [id=0e92d0fd3c2e4f51b383b22c71b89f1c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:42.942965 23276 tablet_service.cc:1511] Processing CreateTablet for tablet 118c992384fb4066acc1d04490d2239b (DEFAULT_TABLE table=test-workload [id=0e92d0fd3c2e4f51b383b22c71b89f1c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:42.943035 23275 tablet_service.cc:1511] Processing CreateTablet for tablet 0d675dc4d2174178a63abad38736adfd (DEFAULT_TABLE table=test-workload [id=0e92d0fd3c2e4f51b383b22c71b89f1c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:42.947484 23273 tablet_service.cc:1511] Processing CreateTablet for tablet bd92f8c45fc8467d896f5a99d6248a83 (DEFAULT_TABLE table=test-workload [id=0e92d0fd3c2e4f51b383b22c71b89f1c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:42.950773 23274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85e09af0aa44ee09ccc4b71e1843fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.952498 23272 tablet_service.cc:1511] Processing CreateTablet for tablet 57cac032df10494799e2fd4bd94aac17 (DEFAULT_TABLE table=test-workload [id=0e92d0fd3c2e4f51b383b22c71b89f1c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:42.954506 23275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d675dc4d2174178a63abad38736adfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.956255 23272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57cac032df10494799e2fd4bd94aac17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.959848 23273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd92f8c45fc8467d896f5a99d6248a83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.962486 23276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 118c992384fb4066acc1d04490d2239b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.963883 23271 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab8f653ff9e44e9a34ef9bee94e4a05 (DEFAULT_TABLE table=test-workload [id=0e92d0fd3c2e4f51b383b22c71b89f1c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:42.964028 23421 tablet_service.cc:1511] Processing CreateTablet for tablet 57cac032df10494799e2fd4bd94aac17 (DEFAULT_TABLE table=test-workload [id=0e92d0fd3c2e4f51b383b22c71b89f1c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:42.970289 23421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57cac032df10494799e2fd4bd94aac17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.971451 23271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab8f653ff9e44e9a34ef9bee94e4a05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.016038 23348 tablet_service.cc:1511] Processing CreateTablet for tablet bd92f8c45fc8467d896f5a99d6248a83 (DEFAULT_TABLE table=test-workload [id=0e92d0fd3c2e4f51b383b22c71b89f1c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:43.028931 23351 tablet_service.cc:1511] Processing CreateTablet for tablet 118c992384fb4066acc1d04490d2239b (DEFAULT_TABLE table=test-workload [id=0e92d0fd3c2e4f51b383b22c71b89f1c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:43.026124 23346 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab8f653ff9e44e9a34ef9bee94e4a05 (DEFAULT_TABLE table=test-workload [id=0e92d0fd3c2e4f51b383b22c71b89f1c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:43.034595 23350 tablet_service.cc:1511] Processing CreateTablet for tablet 0d675dc4d2174178a63abad38736adfd (DEFAULT_TABLE table=test-workload [id=0e92d0fd3c2e4f51b383b22c71b89f1c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:43.032018 23348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd92f8c45fc8467d896f5a99d6248a83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.026842 23347 tablet_service.cc:1511] Processing CreateTablet for tablet 57cac032df10494799e2fd4bd94aac17 (DEFAULT_TABLE table=test-workload [id=0e92d0fd3c2e4f51b383b22c71b89f1c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:43.031550 23349 tablet_service.cc:1511] Processing CreateTablet for tablet e85e09af0aa44ee09ccc4b71e1843fe9 (DEFAULT_TABLE table=test-workload [id=0e92d0fd3c2e4f51b383b22c71b89f1c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:43.046547 23420 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab8f653ff9e44e9a34ef9bee94e4a05 (DEFAULT_TABLE table=test-workload [id=0e92d0fd3c2e4f51b383b22c71b89f1c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
W20260709 12:16:43.049142 23231 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:43.051112 23420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab8f653ff9e44e9a34ef9bee94e4a05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.051004 23346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab8f653ff9e44e9a34ef9bee94e4a05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.063045 23351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 118c992384fb4066acc1d04490d2239b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.063762 23347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57cac032df10494799e2fd4bd94aac17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.067456 23349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85e09af0aa44ee09ccc4b71e1843fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.076290 23350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d675dc4d2174178a63abad38736adfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.078389 23270 tablet_service.cc:1511] Processing CreateTablet for tablet 8ea8a85ced6f47deae3785a1e3c6c57c (DEFAULT_TABLE table=test-workload [id=0e92d0fd3c2e4f51b383b22c71b89f1c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:43.083128 23270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ea8a85ced6f47deae3785a1e3c6c57c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.112932 23479 tablet_bootstrap.cc:492] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959: Bootstrap starting.
I20260709 12:16:43.118090 23478 tablet_bootstrap.cc:492] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a: Bootstrap starting.
I20260709 12:16:43.121464 23345 tablet_service.cc:1511] Processing CreateTablet for tablet 8ea8a85ced6f47deae3785a1e3c6c57c (DEFAULT_TABLE table=test-workload [id=0e92d0fd3c2e4f51b383b22c71b89f1c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:43.125571 23345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ea8a85ced6f47deae3785a1e3c6c57c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.130508 23423 tablet_service.cc:1511] Processing CreateTablet for tablet 8ea8a85ced6f47deae3785a1e3c6c57c (DEFAULT_TABLE table=test-workload [id=0e92d0fd3c2e4f51b383b22c71b89f1c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:43.132723 23423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ea8a85ced6f47deae3785a1e3c6c57c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.164907 23479 tablet_bootstrap.cc:654] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:43.165254 23275 tablet_service.cc:1511] Processing CreateTablet for tablet 2cee52613ef54d57831a22f94dc04557 (DEFAULT_TABLE table=test-workload [id=0e92d0fd3c2e4f51b383b22c71b89f1c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:43.174314 23275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cee52613ef54d57831a22f94dc04557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.174229 23344 tablet_service.cc:1511] Processing CreateTablet for tablet 2cee52613ef54d57831a22f94dc04557 (DEFAULT_TABLE table=test-workload [id=0e92d0fd3c2e4f51b383b22c71b89f1c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:43.178715 23344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cee52613ef54d57831a22f94dc04557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.190511 23422 tablet_service.cc:1511] Processing CreateTablet for tablet 2cee52613ef54d57831a22f94dc04557 (DEFAULT_TABLE table=test-workload [id=0e92d0fd3c2e4f51b383b22c71b89f1c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:43.192652 23422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cee52613ef54d57831a22f94dc04557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.217541 23478 tablet_bootstrap.cc:654] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:43.230631 23480 tablet_bootstrap.cc:492] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6: Bootstrap starting.
I20260709 12:16:43.231024 23276 tablet_service.cc:1511] Processing CreateTablet for tablet e7e39859435c4af59be53206dacf3cdb (DEFAULT_TABLE table=test-workload [id=0e92d0fd3c2e4f51b383b22c71b89f1c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:43.233834 23276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e39859435c4af59be53206dacf3cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.238624 23479 tablet_bootstrap.cc:492] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959: No bootstrap required, opened a new log
I20260709 12:16:43.239488 23479 ts_tablet_manager.cc:1403] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959: Time spent bootstrapping tablet: real 0.128s	user 0.012s	sys 0.009s
I20260709 12:16:43.243230 23351 tablet_service.cc:1511] Processing CreateTablet for tablet e7e39859435c4af59be53206dacf3cdb (DEFAULT_TABLE table=test-workload [id=0e92d0fd3c2e4f51b383b22c71b89f1c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:43.245231 23351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e39859435c4af59be53206dacf3cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.256340 23421 tablet_service.cc:1511] Processing CreateTablet for tablet e7e39859435c4af59be53206dacf3cdb (DEFAULT_TABLE table=test-workload [id=0e92d0fd3c2e4f51b383b22c71b89f1c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:43.257834 23421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e39859435c4af59be53206dacf3cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.278790 23479 raft_consensus.cc:359] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.284750 23479 raft_consensus.cc:385] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:43.285210 23479 raft_consensus.cc:740] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 653d221b042e4553b69ee069f7768959, State: Initialized, Role: FOLLOWER
I20260709 12:16:43.286585 23478 tablet_bootstrap.cc:492] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a: No bootstrap required, opened a new log
I20260709 12:16:43.287724 23478 ts_tablet_manager.cc:1403] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a: Time spent bootstrapping tablet: real 0.203s	user 0.033s	sys 0.022s
I20260709 12:16:43.291126 23478 raft_consensus.cc:359] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } } peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } }
I20260709 12:16:43.291730 23478 raft_consensus.cc:385] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:43.292044 23478 raft_consensus.cc:740] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acc8af67993a40b4b831b0648627df4a, State: Initialized, Role: FOLLOWER
I20260709 12:16:43.286244 23479 consensus_queue.cc:260] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.287211 23480 tablet_bootstrap.cc:654] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:43.294716 23311 heartbeater.cc:499] Master 127.22.155.254:43651 was elected leader, sending a full tablet report...
I20260709 12:16:43.294955 23479 ts_tablet_manager.cc:1434] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 12:16:43.296094 23479 tablet_bootstrap.cc:492] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959: Bootstrap starting.
I20260709 12:16:43.296540 23478 consensus_queue.cc:260] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } } peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } }
I20260709 12:16:43.302850 23479 tablet_bootstrap.cc:654] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:43.306069 23460 heartbeater.cc:499] Master 127.22.155.254:43651 was elected leader, sending a full tablet report...
I20260709 12:16:43.307825 23478 ts_tablet_manager.cc:1434] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.001s
I20260709 12:16:43.309134 23478 tablet_bootstrap.cc:492] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a: Bootstrap starting.
W20260709 12:16:43.315073 23312 tablet.cc:2406] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:16:43.318323 23480 tablet_bootstrap.cc:492] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6: No bootstrap required, opened a new log
I20260709 12:16:43.318874 23480 ts_tablet_manager.cc:1403] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6: Time spent bootstrapping tablet: real 0.099s	user 0.011s	sys 0.008s
I20260709 12:16:43.319372 23479 tablet_bootstrap.cc:492] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959: No bootstrap required, opened a new log
I20260709 12:16:43.319963 23479 ts_tablet_manager.cc:1403] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.007s
I20260709 12:16:43.323068 23480 raft_consensus.cc:359] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.323226 23479 raft_consensus.cc:359] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.323992 23480 raft_consensus.cc:385] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:43.324155 23479 raft_consensus.cc:385] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:43.324381 23480 raft_consensus.cc:740] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6158309d5094456cb4548d7568b28ce6, State: Initialized, Role: FOLLOWER
I20260709 12:16:43.324542 23479 raft_consensus.cc:740] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 653d221b042e4553b69ee069f7768959, State: Initialized, Role: FOLLOWER
I20260709 12:16:43.327458 23479 consensus_queue.cc:260] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.329733 23479 ts_tablet_manager.cc:1434] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 12:16:43.330694 23479 tablet_bootstrap.cc:492] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959: Bootstrap starting.
I20260709 12:16:43.331981 23478 tablet_bootstrap.cc:654] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:43.335692 23480 consensus_queue.cc:260] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.342406 23480 ts_tablet_manager.cc:1434] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.006s
I20260709 12:16:43.343364 23386 heartbeater.cc:499] Master 127.22.155.254:43651 was elected leader, sending a full tablet report...
I20260709 12:16:43.343691 23480 tablet_bootstrap.cc:492] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6: Bootstrap starting.
I20260709 12:16:43.343828 23479 tablet_bootstrap.cc:654] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:43.351591 23479 tablet_bootstrap.cc:492] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959: No bootstrap required, opened a new log
I20260709 12:16:43.352102 23479 ts_tablet_manager.cc:1403] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959: Time spent bootstrapping tablet: real 0.022s	user 0.002s	sys 0.009s
I20260709 12:16:43.352931 23480 tablet_bootstrap.cc:654] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:43.355607 23479 raft_consensus.cc:359] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.356340 23479 raft_consensus.cc:385] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:43.356621 23479 raft_consensus.cc:740] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 653d221b042e4553b69ee069f7768959, State: Initialized, Role: FOLLOWER
I20260709 12:16:43.357156 23478 tablet_bootstrap.cc:492] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a: No bootstrap required, opened a new log
I20260709 12:16:43.357705 23478 ts_tablet_manager.cc:1403] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.005s
I20260709 12:16:43.357725 23479 consensus_queue.cc:260] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.358930 23483 raft_consensus.cc:493] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:43.359401 23483 raft_consensus.cc:515] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.361265 23478 raft_consensus.cc:359] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.362035 23478 raft_consensus.cc:385] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:43.362370 23478 raft_consensus.cc:740] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acc8af67993a40b4b831b0648627df4a, State: Initialized, Role: FOLLOWER
I20260709 12:16:43.363355 23478 consensus_queue.cc:260] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.365710 23483 leader_election.cc:290] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:16:43.381775 23478 ts_tablet_manager.cc:1434] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 12:16:43.384204 23478 tablet_bootstrap.cc:492] T e85e09af0aa44ee09ccc4b71e1843fe9 P acc8af67993a40b4b831b0648627df4a: Bootstrap starting.
I20260709 12:16:43.395222 23479 ts_tablet_manager.cc:1434] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.029s
I20260709 12:16:43.396338 23479 tablet_bootstrap.cc:492] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 653d221b042e4553b69ee069f7768959: Bootstrap starting.
I20260709 12:16:43.402841 23479 tablet_bootstrap.cc:654] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 653d221b042e4553b69ee069f7768959: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:43.404520 23490 raft_consensus.cc:493] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:43.405243 23490 raft_consensus.cc:515] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.415258 23490 leader_election.cc:290] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:16:43.420233 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d675dc4d2174178a63abad38736adfd" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6158309d5094456cb4548d7568b28ce6" is_pre_election: true
I20260709 12:16:43.423652 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85e09af0aa44ee09ccc4b71e1843fe9" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6158309d5094456cb4548d7568b28ce6" is_pre_election: true
W20260709 12:16:43.424919 23249 leader_election.cc:343] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:43.426729 23249 leader_election.cc:343] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:43.427835 23479 tablet_bootstrap.cc:492] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 653d221b042e4553b69ee069f7768959: No bootstrap required, opened a new log
I20260709 12:16:43.427781 23485 raft_consensus.cc:493] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:43.425146 23480 tablet_bootstrap.cc:492] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6: No bootstrap required, opened a new log
I20260709 12:16:43.428745 23480 ts_tablet_manager.cc:1403] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6: Time spent bootstrapping tablet: real 0.085s	user 0.011s	sys 0.008s
I20260709 12:16:43.428377 23485 raft_consensus.cc:515] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } } peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } }
I20260709 12:16:43.432750 23485 leader_election.cc:290] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731), 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329)
I20260709 12:16:43.432067 23480 raft_consensus.cc:359] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.433367 23480 raft_consensus.cc:385] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:43.433792 23480 raft_consensus.cc:740] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6158309d5094456cb4548d7568b28ce6, State: Initialized, Role: FOLLOWER
I20260709 12:16:43.433868 23478 tablet_bootstrap.cc:654] T e85e09af0aa44ee09ccc4b71e1843fe9 P acc8af67993a40b4b831b0648627df4a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:43.434810 23480 consensus_queue.cc:260] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.428399 23479 ts_tablet_manager.cc:1403] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 653d221b042e4553b69ee069f7768959: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.004s
I20260709 12:16:43.444862 23479 raft_consensus.cc:359] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.445667 23479 raft_consensus.cc:385] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:43.445667 23480 ts_tablet_manager.cc:1434] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
I20260709 12:16:43.446055 23479 raft_consensus.cc:740] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 653d221b042e4553b69ee069f7768959, State: Initialized, Role: FOLLOWER
I20260709 12:16:43.450318 23480 tablet_bootstrap.cc:492] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6: Bootstrap starting.
I20260709 12:16:43.475445 23485 raft_consensus.cc:493] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:43.446817 23479 consensus_queue.cc:260] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 653d221b042e4553b69ee069f7768959 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.476070 23485 raft_consensus.cc:515] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.477764 23478 tablet_bootstrap.cc:492] T e85e09af0aa44ee09ccc4b71e1843fe9 P acc8af67993a40b4b831b0648627df4a: No bootstrap required, opened a new log
I20260709 12:16:43.479245 23485 leader_election.cc:290] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731), 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329)
I20260709 12:16:43.481823 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d675dc4d2174178a63abad38736adfd" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acc8af67993a40b4b831b0648627df4a" is_pre_election: true
I20260709 12:16:43.478281 23478 ts_tablet_manager.cc:1403] T e85e09af0aa44ee09ccc4b71e1843fe9 P acc8af67993a40b4b831b0648627df4a: Time spent bootstrapping tablet: real 0.094s	user 0.014s	sys 0.010s
I20260709 12:16:43.483376 23435 raft_consensus.cc:2468] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 653d221b042e4553b69ee069f7768959 in term 0.
I20260709 12:16:43.487128 23480 tablet_bootstrap.cc:654] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:43.488312 23479 ts_tablet_manager.cc:1434] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 653d221b042e4553b69ee069f7768959: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.013s
I20260709 12:16:43.492025 23479 tablet_bootstrap.cc:492] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959: Bootstrap starting.
I20260709 12:16:43.493121 23478 raft_consensus.cc:359] T e85e09af0aa44ee09ccc4b71e1843fe9 P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.493922 23478 raft_consensus.cc:385] T e85e09af0aa44ee09ccc4b71e1843fe9 P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:43.494216 23478 raft_consensus.cc:740] T e85e09af0aa44ee09ccc4b71e1843fe9 P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acc8af67993a40b4b831b0648627df4a, State: Initialized, Role: FOLLOWER
I20260709 12:16:43.494942 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85e09af0aa44ee09ccc4b71e1843fe9" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acc8af67993a40b4b831b0648627df4a" is_pre_election: true
I20260709 12:16:43.495137 23478 consensus_queue.cc:260] T e85e09af0aa44ee09ccc4b71e1843fe9 P acc8af67993a40b4b831b0648627df4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.496726 23435 raft_consensus.cc:2468] T e85e09af0aa44ee09ccc4b71e1843fe9 P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 653d221b042e4553b69ee069f7768959 in term 0.
I20260709 12:16:43.497902 23478 ts_tablet_manager.cc:1434] T e85e09af0aa44ee09ccc4b71e1843fe9 P acc8af67993a40b4b831b0648627df4a: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:16:43.499867 23252 leader_election.cc:304] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 653d221b042e4553b69ee069f7768959, acc8af67993a40b4b831b0648627df4a; no voters: 6158309d5094456cb4548d7568b28ce6
I20260709 12:16:43.501204 23490 raft_consensus.cc:2804] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:43.501574 23490 raft_consensus.cc:493] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:43.501910 23490 raft_consensus.cc:3060] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:43.502002 23479 tablet_bootstrap.cc:654] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:43.503494 23480 tablet_bootstrap.cc:492] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6: No bootstrap required, opened a new log
I20260709 12:16:43.504148 23480 ts_tablet_manager.cc:1403] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.007s
I20260709 12:16:43.508204 23480 raft_consensus.cc:359] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.509222 23480 raft_consensus.cc:385] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:43.509624 23480 raft_consensus.cc:740] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6158309d5094456cb4548d7568b28ce6, State: Initialized, Role: FOLLOWER
I20260709 12:16:43.510574 23480 consensus_queue.cc:260] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.511935 23478 tablet_bootstrap.cc:492] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a: Bootstrap starting.
I20260709 12:16:43.514715 23479 tablet_bootstrap.cc:492] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959: No bootstrap required, opened a new log
I20260709 12:16:43.515216 23479 ts_tablet_manager.cc:1403] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.006s
I20260709 12:16:43.518239 23479 raft_consensus.cc:359] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.518999 23479 raft_consensus.cc:385] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:43.519248 23480 ts_tablet_manager.cc:1434] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 12:16:43.519275 23479 raft_consensus.cc:740] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 653d221b042e4553b69ee069f7768959, State: Initialized, Role: FOLLOWER
I20260709 12:16:43.520325 23480 tablet_bootstrap.cc:492] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6: Bootstrap starting.
I20260709 12:16:43.520196 23479 consensus_queue.cc:260] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.522552 23478 tablet_bootstrap.cc:654] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:43.522730 23479 ts_tablet_manager.cc:1434] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:16:43.523726 23479 tablet_bootstrap.cc:492] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959: Bootstrap starting.
I20260709 12:16:43.530685 23479 tablet_bootstrap.cc:654] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:43.532582 23480 tablet_bootstrap.cc:654] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:43.539897 23478 tablet_bootstrap.cc:492] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a: No bootstrap required, opened a new log
I20260709 12:16:43.540901 23478 ts_tablet_manager.cc:1403] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.005s
I20260709 12:16:43.544898 23478 raft_consensus.cc:359] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.545889 23478 raft_consensus.cc:385] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:43.546283 23478 raft_consensus.cc:740] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acc8af67993a40b4b831b0648627df4a, State: Initialized, Role: FOLLOWER
I20260709 12:16:43.548571 23252 leader_election.cc:304] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 653d221b042e4553b69ee069f7768959, acc8af67993a40b4b831b0648627df4a; no voters: 6158309d5094456cb4548d7568b28ce6
I20260709 12:16:43.549568 23483 raft_consensus.cc:2804] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:43.549964 23483 raft_consensus.cc:493] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:43.550184 23488 raft_consensus.cc:493] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:43.550347 23483 raft_consensus.cc:3060] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:43.550669 23488 raft_consensus.cc:515] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.551163 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "118c992384fb4066acc1d04490d2239b" candidate_uuid: "acc8af67993a40b4b831b0648627df4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6158309d5094456cb4548d7568b28ce6" is_pre_election: true
I20260709 12:16:43.553463 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d675dc4d2174178a63abad38736adfd" candidate_uuid: "acc8af67993a40b4b831b0648627df4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6158309d5094456cb4548d7568b28ce6" is_pre_election: true
I20260709 12:16:43.555799 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "118c992384fb4066acc1d04490d2239b" candidate_uuid: "acc8af67993a40b4b831b0648627df4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "653d221b042e4553b69ee069f7768959" is_pre_election: true
I20260709 12:16:43.557206 23488 leader_election.cc:290] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:16:43.557767 23483 raft_consensus.cc:515] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.549154 23478 consensus_queue.cc:260] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.561311 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85e09af0aa44ee09ccc4b71e1843fe9" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6158309d5094456cb4548d7568b28ce6"
I20260709 12:16:43.563019 23478 ts_tablet_manager.cc:1434] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 12:16:43.563310 23360 raft_consensus.cc:3060] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:43.560427 23483 leader_election.cc:290] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 election: Requested vote from peers 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:16:43.566423 23478 tablet_bootstrap.cc:492] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P acc8af67993a40b4b831b0648627df4a: Bootstrap starting.
I20260709 12:16:43.574069 23479 tablet_bootstrap.cc:492] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959: No bootstrap required, opened a new log
I20260709 12:16:43.575690 23479 ts_tablet_manager.cc:1403] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.016s
I20260709 12:16:43.577339 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d675dc4d2174178a63abad38736adfd" candidate_uuid: "acc8af67993a40b4b831b0648627df4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "653d221b042e4553b69ee069f7768959" is_pre_election: true
I20260709 12:16:43.583761 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85e09af0aa44ee09ccc4b71e1843fe9" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acc8af67993a40b4b831b0648627df4a"
I20260709 12:16:43.584605 23435 raft_consensus.cc:3060] T e85e09af0aa44ee09ccc4b71e1843fe9 P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:43.587687 23360 raft_consensus.cc:2468] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 653d221b042e4553b69ee069f7768959 in term 1.
I20260709 12:16:43.589675 23249 leader_election.cc:304] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6158309d5094456cb4548d7568b28ce6, 653d221b042e4553b69ee069f7768959; no voters: 
I20260709 12:16:43.592584 23483 raft_consensus.cc:2804] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:43.581274 23490 raft_consensus.cc:515] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
W20260709 12:16:43.592370 23398 leader_election.cc:343] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:43.600859 23286 raft_consensus.cc:2393] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate acc8af67993a40b4b831b0648627df4a in current term 1: Already voted for candidate 653d221b042e4553b69ee069f7768959 in this term.
I20260709 12:16:43.605101 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d675dc4d2174178a63abad38736adfd" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6158309d5094456cb4548d7568b28ce6"
I20260709 12:16:43.607429 23479 raft_consensus.cc:359] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.608531 23479 raft_consensus.cc:385] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:16:43.606786 23249 leader_election.cc:343] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:43.610170 23480 tablet_bootstrap.cc:492] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6: No bootstrap required, opened a new log
I20260709 12:16:43.610767 23480 ts_tablet_manager.cc:1403] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6: Time spent bootstrapping tablet: real 0.091s	user 0.018s	sys 0.008s
I20260709 12:16:43.608968 23479 raft_consensus.cc:740] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 653d221b042e4553b69ee069f7768959, State: Initialized, Role: FOLLOWER
W20260709 12:16:43.604264 23398 leader_election.cc:343] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:43.616781 23480 raft_consensus.cc:359] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } } peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } }
I20260709 12:16:43.618891 23490 leader_election.cc:290] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 election: Requested vote from peers 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:16:43.613739 23479 consensus_queue.cc:260] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.620885 23483 raft_consensus.cc:697] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [term 1 LEADER]: Becoming Leader. State: Replica: 653d221b042e4553b69ee069f7768959, State: Running, Role: LEADER
W20260709 12:16:43.621079 23398 leader_election.cc:343] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:43.621750 23480 raft_consensus.cc:385] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:43.623206 23480 raft_consensus.cc:740] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6158309d5094456cb4548d7568b28ce6, State: Initialized, Role: FOLLOWER
I20260709 12:16:43.623261 23398 leader_election.cc:304] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acc8af67993a40b4b831b0648627df4a; no voters: 6158309d5094456cb4548d7568b28ce6, 653d221b042e4553b69ee069f7768959
I20260709 12:16:43.625581 23485 raft_consensus.cc:2749] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:43.625658 23479 ts_tablet_manager.cc:1434] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.002s
I20260709 12:16:43.625083 23480 consensus_queue.cc:260] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } } peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } }
I20260709 12:16:43.627004 23398 leader_election.cc:304] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acc8af67993a40b4b831b0648627df4a; no voters: 6158309d5094456cb4548d7568b28ce6, 653d221b042e4553b69ee069f7768959
I20260709 12:16:43.622675 23435 raft_consensus.cc:2468] T e85e09af0aa44ee09ccc4b71e1843fe9 P acc8af67993a40b4b831b0648627df4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 653d221b042e4553b69ee069f7768959 in term 1.
I20260709 12:16:43.628126 23485 raft_consensus.cc:3060] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:43.631233 23479 tablet_bootstrap.cc:492] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959: Bootstrap starting.
I20260709 12:16:43.630327 23483 consensus_queue.cc:237] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.633716 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d675dc4d2174178a63abad38736adfd" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acc8af67993a40b4b831b0648627df4a"
I20260709 12:16:43.639274 23478 tablet_bootstrap.cc:654] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P acc8af67993a40b4b831b0648627df4a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:43.650039 23485 raft_consensus.cc:2749] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:43.652709 23480 ts_tablet_manager.cc:1434] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.005s
I20260709 12:16:43.657740 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab8f653ff9e44e9a34ef9bee94e4a05" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acc8af67993a40b4b831b0648627df4a" is_pre_election: true
I20260709 12:16:43.659273 23480 tablet_bootstrap.cc:492] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6: Bootstrap starting.
W20260709 12:16:43.666869 23327 leader_election.cc:343] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:43.688205 23479 tablet_bootstrap.cc:654] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:43.688467 23435 raft_consensus.cc:2468] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 653d221b042e4553b69ee069f7768959 in term 1.
I20260709 12:16:43.692016 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab8f653ff9e44e9a34ef9bee94e4a05" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "653d221b042e4553b69ee069f7768959" is_pre_election: true
I20260709 12:16:43.696201 23286 raft_consensus.cc:2468] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6158309d5094456cb4548d7568b28ce6 in term 0.
I20260709 12:16:43.698318 23324 leader_election.cc:304] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6158309d5094456cb4548d7568b28ce6, 653d221b042e4553b69ee069f7768959; no voters: acc8af67993a40b4b831b0648627df4a
I20260709 12:16:43.702260 23480 tablet_bootstrap.cc:654] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:43.699549 23488 raft_consensus.cc:2804] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:43.708087 23479 tablet_bootstrap.cc:492] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959: No bootstrap required, opened a new log
I20260709 12:16:43.710557 23488 raft_consensus.cc:493] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:43.709805 23182 catalog_manager.cc:5697] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 reported cstate change: term changed from 0 to 1, leader changed from <none> to 653d221b042e4553b69ee069f7768959 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "653d221b042e4553b69ee069f7768959" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:43.711143 23488 raft_consensus.cc:3060] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:43.699244 23478 tablet_bootstrap.cc:492] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P acc8af67993a40b4b831b0648627df4a: No bootstrap required, opened a new log
I20260709 12:16:43.711711 23252 leader_election.cc:304] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 653d221b042e4553b69ee069f7768959, acc8af67993a40b4b831b0648627df4a; no voters: 6158309d5094456cb4548d7568b28ce6
I20260709 12:16:43.712535 23478 ts_tablet_manager.cc:1403] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P acc8af67993a40b4b831b0648627df4a: Time spent bootstrapping tablet: real 0.149s	user 0.028s	sys 0.023s
I20260709 12:16:43.712668 23479 ts_tablet_manager.cc:1403] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959: Time spent bootstrapping tablet: real 0.083s	user 0.014s	sys 0.005s
I20260709 12:16:43.713440 23483 raft_consensus.cc:2804] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:43.714416 23483 raft_consensus.cc:697] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [term 1 LEADER]: Becoming Leader. State: Replica: 653d221b042e4553b69ee069f7768959, State: Running, Role: LEADER
I20260709 12:16:43.715358 23483 consensus_queue.cc:237] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.718703 23478 raft_consensus.cc:359] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.721936 23478 raft_consensus.cc:385] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:43.722421 23478 raft_consensus.cc:740] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acc8af67993a40b4b831b0648627df4a, State: Initialized, Role: FOLLOWER
I20260709 12:16:43.723325 23478 consensus_queue.cc:260] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P acc8af67993a40b4b831b0648627df4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.726405 23505 raft_consensus.cc:493] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:43.729372 23505 raft_consensus.cc:515] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.731978 23478 ts_tablet_manager.cc:1434] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P acc8af67993a40b4b831b0648627df4a: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:16:43.738526 23479 raft_consensus.cc:359] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } } peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } }
I20260709 12:16:43.749667 23478 tablet_bootstrap.cc:492] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a: Bootstrap starting.
I20260709 12:16:43.751328 23509 raft_consensus.cc:493] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:43.745877 23479 raft_consensus.cc:385] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:43.752041 23488 raft_consensus.cc:515] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.752439 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac032df10494799e2fd4bd94aac17" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6158309d5094456cb4548d7568b28ce6" is_pre_election: true
I20260709 12:16:43.751929 23509 raft_consensus.cc:515] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.753165 23479 raft_consensus.cc:740] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 653d221b042e4553b69ee069f7768959, State: Initialized, Role: FOLLOWER
I20260709 12:16:43.755246 23505 leader_election.cc:290] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:16:43.757663 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac032df10494799e2fd4bd94aac17" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acc8af67993a40b4b831b0648627df4a" is_pre_election: true
I20260709 12:16:43.764263 23480 tablet_bootstrap.cc:492] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6: No bootstrap required, opened a new log
I20260709 12:16:43.807132 23480 ts_tablet_manager.cc:1403] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6: Time spent bootstrapping tablet: real 0.150s	user 0.023s	sys 0.019s
I20260709 12:16:43.807215 23513 raft_consensus.cc:493] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:43.807921 23513 raft_consensus.cc:515] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } } peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } }
I20260709 12:16:43.795827 23485 raft_consensus.cc:493] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:43.809899 23485 raft_consensus.cc:515] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.759997 23360 raft_consensus.cc:2468] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 653d221b042e4553b69ee069f7768959 in term 0.
W20260709 12:16:43.782109 23252 leader_election.cc:343] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:43.805258 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac032df10494799e2fd4bd94aac17" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acc8af67993a40b4b831b0648627df4a" is_pre_election: true
I20260709 12:16:43.827849 23505 raft_consensus.cc:493] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:43.760531 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab8f653ff9e44e9a34ef9bee94e4a05" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "653d221b042e4553b69ee069f7768959"
I20260709 12:16:43.764323 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac032df10494799e2fd4bd94aac17" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "653d221b042e4553b69ee069f7768959" is_pre_election: true
I20260709 12:16:43.781759 23479 consensus_queue.cc:260] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } } peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } }
I20260709 12:16:43.833657 23285 raft_consensus.cc:2468] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6158309d5094456cb4548d7568b28ce6 in term 0.
I20260709 12:16:43.834478 23488 leader_election.cc:290] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 1 election: Requested vote from peers 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:16:43.835256 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab8f653ff9e44e9a34ef9bee94e4a05" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acc8af67993a40b4b831b0648627df4a"
I20260709 12:16:43.835788 23479 ts_tablet_manager.cc:1434] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959: Time spent starting tablet: real 0.122s	user 0.004s	sys 0.020s
I20260709 12:16:43.835917 23434 raft_consensus.cc:3060] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:43.833463 23480 raft_consensus.cc:359] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.836406 23478 tablet_bootstrap.cc:654] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:43.837932 23479 tablet_bootstrap.cc:492] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959: Bootstrap starting.
I20260709 12:16:43.800661 23509 leader_election.cc:290] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
W20260709 12:16:43.838683 23327 leader_election.cc:343] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:43.836784 23505 raft_consensus.cc:515] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.844774 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea8a85ced6f47deae3785a1e3c6c57c" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6158309d5094456cb4548d7568b28ce6" is_pre_election: true
I20260709 12:16:43.843245 23286 raft_consensus.cc:3060] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:43.847198 23249 leader_election.cc:343] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:43.848011 23505 leader_election.cc:290] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:16:43.840875 23480 raft_consensus.cc:385] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:43.848769 23480 raft_consensus.cc:740] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6158309d5094456cb4548d7568b28ce6, State: Initialized, Role: FOLLOWER
I20260709 12:16:43.849148 23324 leader_election.cc:304] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6158309d5094456cb4548d7568b28ce6, 653d221b042e4553b69ee069f7768959; no voters: acc8af67993a40b4b831b0648627df4a
I20260709 12:16:43.849581 23434 raft_consensus.cc:2468] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P acc8af67993a40b4b831b0648627df4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6158309d5094456cb4548d7568b28ce6 in term 1.
I20260709 12:16:43.850250 23485 leader_election.cc:290] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731), 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329)
I20260709 12:16:43.852387 23509 raft_consensus.cc:2804] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:16:43.837044 23252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:37153, user_credentials={real_user=slave}} blocked reactor thread for 52451.6us
I20260709 12:16:43.857781 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "118c992384fb4066acc1d04490d2239b" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acc8af67993a40b4b831b0648627df4a" is_pre_election: true
I20260709 12:16:43.855316 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea8a85ced6f47deae3785a1e3c6c57c" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acc8af67993a40b4b831b0648627df4a" is_pre_election: true
I20260709 12:16:43.849593 23480 consensus_queue.cc:260] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.857992 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd92f8c45fc8467d896f5a99d6248a83" candidate_uuid: "acc8af67993a40b4b831b0648627df4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6158309d5094456cb4548d7568b28ce6" is_pre_election: true
I20260709 12:16:43.859972 23361 raft_consensus.cc:2468] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acc8af67993a40b4b831b0648627df4a in term 0.
I20260709 12:16:43.861238 23480 ts_tablet_manager.cc:1434] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6: Time spent starting tablet: real 0.054s	user 0.010s	sys 0.000s
I20260709 12:16:43.862542 23480 tablet_bootstrap.cc:492] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6: Bootstrap starting.
I20260709 12:16:43.857996 23327 leader_election.cc:304] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6158309d5094456cb4548d7568b28ce6, acc8af67993a40b4b831b0648627df4a; no voters: 
I20260709 12:16:43.863938 23398 leader_election.cc:304] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6158309d5094456cb4548d7568b28ce6, acc8af67993a40b4b831b0648627df4a; no voters: 
I20260709 12:16:43.852986 23509 raft_consensus.cc:493] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:43.869654 23485 raft_consensus.cc:2804] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:43.866230 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "118c992384fb4066acc1d04490d2239b" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "653d221b042e4553b69ee069f7768959" is_pre_election: true
I20260709 12:16:43.870124 23485 raft_consensus.cc:493] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:43.880872 23485 raft_consensus.cc:3060] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:43.869845 23509 raft_consensus.cc:3060] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:43.859016 23435 raft_consensus.cc:2468] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6158309d5094456cb4548d7568b28ce6 in term 0.
I20260709 12:16:43.866771 23513 leader_election.cc:290] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153), 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731)
I20260709 12:16:43.869992 23488 raft_consensus.cc:2804] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:43.884912 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd92f8c45fc8467d896f5a99d6248a83" candidate_uuid: "acc8af67993a40b4b831b0648627df4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "653d221b042e4553b69ee069f7768959" is_pre_election: true
I20260709 12:16:43.887701 23327 leader_election.cc:304] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6158309d5094456cb4548d7568b28ce6, acc8af67993a40b4b831b0648627df4a; no voters: 
I20260709 12:16:43.870231 23249 leader_election.cc:304] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6158309d5094456cb4548d7568b28ce6, 653d221b042e4553b69ee069f7768959; no voters: acc8af67993a40b4b831b0648627df4a
I20260709 12:16:43.892948 23505 raft_consensus.cc:2804] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:43.893009 23513 raft_consensus.cc:2804] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:43.893744 23505 raft_consensus.cc:493] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:43.893971 23513 raft_consensus.cc:493] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:43.894253 23505 raft_consensus.cc:3060] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:43.889256 23252 leader_election.cc:343] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:43.894835 23252 leader_election.cc:304] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 653d221b042e4553b69ee069f7768959; no voters: 6158309d5094456cb4548d7568b28ce6, acc8af67993a40b4b831b0648627df4a
I20260709 12:16:43.885828 23285 raft_consensus.cc:2468] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6158309d5094456cb4548d7568b28ce6 in term 0.
W20260709 12:16:43.899573 23398 leader_election.cc:343] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:43.894390 23513 raft_consensus.cc:3060] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:43.886839 23488 raft_consensus.cc:697] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6 [term 1 LEADER]: Becoming Leader. State: Replica: 6158309d5094456cb4548d7568b28ce6, State: Running, Role: LEADER
I20260709 12:16:43.901011 23483 raft_consensus.cc:2749] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:43.907342 23485 raft_consensus.cc:515] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.910765 23485 leader_election.cc:290] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [CANDIDATE]: Term 1 election: Requested vote from peers 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731), 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329)
I20260709 12:16:43.912134 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd92f8c45fc8467d896f5a99d6248a83" candidate_uuid: "acc8af67993a40b4b831b0648627df4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6158309d5094456cb4548d7568b28ce6"
I20260709 12:16:43.912910 23478 tablet_bootstrap.cc:492] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a: No bootstrap required, opened a new log
I20260709 12:16:43.912843 23360 raft_consensus.cc:3060] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:43.911883 23505 raft_consensus.cc:515] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.913823 23478 ts_tablet_manager.cc:1403] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a: Time spent bootstrapping tablet: real 0.177s	user 0.025s	sys 0.060s
I20260709 12:16:43.913466 23479 tablet_bootstrap.cc:654] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:43.914407 23488 consensus_queue.cc:237] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.917855 23286 raft_consensus.cc:2468] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6158309d5094456cb4548d7568b28ce6 in term 1.
I20260709 12:16:43.924091 23505 leader_election.cc:290] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 election: Requested vote from peers 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:16:43.924651 23509 raft_consensus.cc:515] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.924952 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac032df10494799e2fd4bd94aac17" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6158309d5094456cb4548d7568b28ce6"
I20260709 12:16:43.927260 23361 raft_consensus.cc:2393] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 653d221b042e4553b69ee069f7768959 in current term 1: Already voted for candidate 6158309d5094456cb4548d7568b28ce6 in this term.
I20260709 12:16:43.931280 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac032df10494799e2fd4bd94aac17" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acc8af67993a40b4b831b0648627df4a"
W20260709 12:16:43.934433 23252 leader_election.cc:343] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:43.934891 23252 leader_election.cc:304] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 653d221b042e4553b69ee069f7768959; no voters: 6158309d5094456cb4548d7568b28ce6, acc8af67993a40b4b831b0648627df4a
I20260709 12:16:43.935173 23360 raft_consensus.cc:2468] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acc8af67993a40b4b831b0648627df4a in term 1.
I20260709 12:16:43.935679 23505 raft_consensus.cc:2749] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:43.928056 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd92f8c45fc8467d896f5a99d6248a83" candidate_uuid: "acc8af67993a40b4b831b0648627df4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "653d221b042e4553b69ee069f7768959"
W20260709 12:16:43.939023 23398 leader_election.cc:343] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:43.939771 23398 leader_election.cc:304] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6158309d5094456cb4548d7568b28ce6, acc8af67993a40b4b831b0648627df4a; no voters: 653d221b042e4553b69ee069f7768959
I20260709 12:16:43.940308 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac032df10494799e2fd4bd94aac17" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acc8af67993a40b4b831b0648627df4a"
I20260709 12:16:43.940622 23485 raft_consensus.cc:2804] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:43.942135 23509 leader_election.cc:290] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 1 election: Requested vote from peers 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:16:43.941727 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac032df10494799e2fd4bd94aac17" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "653d221b042e4553b69ee069f7768959"
I20260709 12:16:43.935564 23478 raft_consensus.cc:359] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.943209 23478 raft_consensus.cc:385] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:43.943387 23285 raft_consensus.cc:2393] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6158309d5094456cb4548d7568b28ce6 in current term 1: Already voted for candidate 653d221b042e4553b69ee069f7768959 in this term.
I20260709 12:16:43.943554 23478 raft_consensus.cc:740] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acc8af67993a40b4b831b0648627df4a, State: Initialized, Role: FOLLOWER
I20260709 12:16:43.930342 23480 tablet_bootstrap.cc:654] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:43.945899 23478 consensus_queue.cc:260] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.946879 23435 raft_consensus.cc:3060] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:43.949857 23181 catalog_manager.cc:5697] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6158309d5094456cb4548d7568b28ce6 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "6158309d5094456cb4548d7568b28ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:43.948166 23182 catalog_manager.cc:5697] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 reported cstate change: term changed from 0 to 1, leader changed from <none> to 653d221b042e4553b69ee069f7768959 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "653d221b042e4553b69ee069f7768959" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:43.955742 23435 raft_consensus.cc:2468] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6158309d5094456cb4548d7568b28ce6 in term 1.
I20260709 12:16:43.944619 23513 raft_consensus.cc:515] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } } peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } }
I20260709 12:16:43.958585 23479 tablet_bootstrap.cc:492] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959: No bootstrap required, opened a new log
I20260709 12:16:43.959048 23479 ts_tablet_manager.cc:1403] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959: Time spent bootstrapping tablet: real 0.122s	user 0.010s	sys 0.012s
I20260709 12:16:43.960067 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "118c992384fb4066acc1d04490d2239b" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acc8af67993a40b4b831b0648627df4a"
I20260709 12:16:43.960778 23433 raft_consensus.cc:3060] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:43.961227 23513 leader_election.cc:290] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 1 election: Requested vote from peers acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153), 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731)
I20260709 12:16:43.965689 23479 raft_consensus.cc:359] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.966595 23479 raft_consensus.cc:385] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:43.967135 23479 raft_consensus.cc:740] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 653d221b042e4553b69ee069f7768959, State: Initialized, Role: FOLLOWER
I20260709 12:16:43.966531 23327 leader_election.cc:304] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6158309d5094456cb4548d7568b28ce6, acc8af67993a40b4b831b0648627df4a; no voters: 653d221b042e4553b69ee069f7768959
I20260709 12:16:43.968001 23513 raft_consensus.cc:2804] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:43.968772 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "118c992384fb4066acc1d04490d2239b" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "653d221b042e4553b69ee069f7768959"
I20260709 12:16:43.967875 23479 consensus_queue.cc:260] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.969262 23513 raft_consensus.cc:697] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 1 LEADER]: Becoming Leader. State: Replica: 6158309d5094456cb4548d7568b28ce6, State: Running, Role: LEADER
I20260709 12:16:43.971167 23513 consensus_queue.cc:237] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.972223 23479 ts_tablet_manager.cc:1434] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:16:43.969424 23285 raft_consensus.cc:3060] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:43.969139 23485 raft_consensus.cc:697] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 1 LEADER]: Becoming Leader. State: Replica: acc8af67993a40b4b831b0648627df4a, State: Running, Role: LEADER
I20260709 12:16:43.973515 23479 tablet_bootstrap.cc:492] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959: Bootstrap starting.
I20260709 12:16:43.973754 23485 consensus_queue.cc:237] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:43.988808 23479 tablet_bootstrap.cc:654] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:43.990736 23480 tablet_bootstrap.cc:492] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6: No bootstrap required, opened a new log
I20260709 12:16:43.994517 23480 ts_tablet_manager.cc:1403] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6: Time spent bootstrapping tablet: real 0.132s	user 0.011s	sys 0.007s
I20260709 12:16:43.993808 23285 raft_consensus.cc:2468] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6158309d5094456cb4548d7568b28ce6 in term 1.
I20260709 12:16:43.994525 23182 catalog_manager.cc:5697] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6158309d5094456cb4548d7568b28ce6 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "6158309d5094456cb4548d7568b28ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:43.998418 23324 leader_election.cc:304] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6158309d5094456cb4548d7568b28ce6, 653d221b042e4553b69ee069f7768959; no voters: 
I20260709 12:16:43.999361 23509 raft_consensus.cc:2804] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:43.999858 23509 raft_consensus.cc:697] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [term 1 LEADER]: Becoming Leader. State: Replica: 6158309d5094456cb4548d7568b28ce6, State: Running, Role: LEADER
I20260709 12:16:44.001329 23479 tablet_bootstrap.cc:492] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959: No bootstrap required, opened a new log
I20260709 12:16:44.000697 23509 consensus_queue.cc:237] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } } peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } }
I20260709 12:16:44.005162 23479 ts_tablet_manager.cc:1403] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.008s
I20260709 12:16:43.992033 23433 raft_consensus.cc:2468] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6158309d5094456cb4548d7568b28ce6 in term 1.
I20260709 12:16:44.014389 23181 catalog_manager.cc:5697] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a reported cstate change: term changed from 0 to 1, leader changed from <none> to acc8af67993a40b4b831b0648627df4a (127.22.155.195). New cstate: current_term: 1 leader_uuid: "acc8af67993a40b4b831b0648627df4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:44.020577 23505 raft_consensus.cc:493] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:44.021131 23479 raft_consensus.cc:359] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.021502 23505 raft_consensus.cc:515] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.021927 23479 raft_consensus.cc:385] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:44.022294 23479 raft_consensus.cc:740] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 653d221b042e4553b69ee069f7768959, State: Initialized, Role: FOLLOWER
I20260709 12:16:44.016973 23480 raft_consensus.cc:359] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.023069 23480 raft_consensus.cc:385] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:44.023504 23480 raft_consensus.cc:740] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6158309d5094456cb4548d7568b28ce6, State: Initialized, Role: FOLLOWER
I20260709 12:16:44.023149 23479 consensus_queue.cc:260] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.025713 23479 ts_tablet_manager.cc:1434] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.004s
I20260709 12:16:44.025755 23505 leader_election.cc:290] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:16:44.027581 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd92f8c45fc8467d896f5a99d6248a83" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6158309d5094456cb4548d7568b28ce6" is_pre_election: true
I20260709 12:16:44.028610 23360 raft_consensus.cc:2393] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 653d221b042e4553b69ee069f7768959 in current term 1: Already voted for candidate acc8af67993a40b4b831b0648627df4a in this term.
I20260709 12:16:44.028499 23480 consensus_queue.cc:260] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.031093 23480 ts_tablet_manager.cc:1434] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:16:44.027573 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd92f8c45fc8467d896f5a99d6248a83" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acc8af67993a40b4b831b0648627df4a" is_pre_election: true
I20260709 12:16:44.033834 23480 tablet_bootstrap.cc:492] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6: Bootstrap starting.
I20260709 12:16:44.041769 23252 leader_election.cc:304] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 653d221b042e4553b69ee069f7768959; no voters: 6158309d5094456cb4548d7568b28ce6, acc8af67993a40b4b831b0648627df4a
I20260709 12:16:44.042599 23483 raft_consensus.cc:3060] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:44.033428 23182 catalog_manager.cc:5697] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6158309d5094456cb4548d7568b28ce6 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "6158309d5094456cb4548d7568b28ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:44.036104 23505 consensus_queue.cc:1048] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:44.037546 23478 ts_tablet_manager.cc:1434] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a: Time spent starting tablet: real 0.123s	user 0.010s	sys 0.026s
I20260709 12:16:44.048173 23483 raft_consensus.cc:2749] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:44.051362 23231 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:44.051815 23478 tablet_bootstrap.cc:492] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a: Bootstrap starting.
I20260709 12:16:44.052747 23480 tablet_bootstrap.cc:654] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:44.060204 23478 tablet_bootstrap.cc:654] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:44.068025 23478 tablet_bootstrap.cc:492] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a: No bootstrap required, opened a new log
I20260709 12:16:44.068547 23478 ts_tablet_manager.cc:1403] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 12:16:44.071550 23478 raft_consensus.cc:359] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.072351 23478 raft_consensus.cc:385] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:44.072909 23478 raft_consensus.cc:740] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acc8af67993a40b4b831b0648627df4a, State: Initialized, Role: FOLLOWER
I20260709 12:16:44.073617 23480 tablet_bootstrap.cc:492] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6: No bootstrap required, opened a new log
I20260709 12:16:44.074158 23480 ts_tablet_manager.cc:1403] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6: Time spent bootstrapping tablet: real 0.042s	user 0.006s	sys 0.011s
I20260709 12:16:44.074137 23478 consensus_queue.cc:260] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.077230 23478 ts_tablet_manager.cc:1434] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:16:44.078200 23478 tablet_bootstrap.cc:492] T 8ea8a85ced6f47deae3785a1e3c6c57c P acc8af67993a40b4b831b0648627df4a: Bootstrap starting.
I20260709 12:16:44.079002 23480 raft_consensus.cc:359] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.079792 23480 raft_consensus.cc:385] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:44.080103 23480 raft_consensus.cc:740] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6158309d5094456cb4548d7568b28ce6, State: Initialized, Role: FOLLOWER
I20260709 12:16:44.084470 23480 consensus_queue.cc:260] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.086126 23478 tablet_bootstrap.cc:654] T 8ea8a85ced6f47deae3785a1e3c6c57c P acc8af67993a40b4b831b0648627df4a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:44.092546 23490 raft_consensus.cc:493] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:44.093104 23490 raft_consensus.cc:515] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.095232 23490 leader_election.cc:290] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:16:44.097486 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cee52613ef54d57831a22f94dc04557" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6158309d5094456cb4548d7568b28ce6" is_pre_election: true
I20260709 12:16:44.098054 23480 ts_tablet_manager.cc:1434] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
W20260709 12:16:44.099043 23249 leader_election.cc:343] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:44.101214 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cee52613ef54d57831a22f94dc04557" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acc8af67993a40b4b831b0648627df4a" is_pre_election: true
I20260709 12:16:44.102205 23433 raft_consensus.cc:2468] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 653d221b042e4553b69ee069f7768959 in term 0.
I20260709 12:16:44.104295 23480 tablet_bootstrap.cc:492] T e7e39859435c4af59be53206dacf3cdb P 6158309d5094456cb4548d7568b28ce6: Bootstrap starting.
I20260709 12:16:44.104137 23252 leader_election.cc:304] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 653d221b042e4553b69ee069f7768959, acc8af67993a40b4b831b0648627df4a; no voters: 6158309d5094456cb4548d7568b28ce6
I20260709 12:16:44.105965 23490 raft_consensus.cc:2804] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:44.106828 23490 raft_consensus.cc:493] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:44.107345 23490 raft_consensus.cc:3060] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:44.124281 23490 raft_consensus.cc:515] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.132959 23483 consensus_queue.cc:1048] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:44.135011 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cee52613ef54d57831a22f94dc04557" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6158309d5094456cb4548d7568b28ce6"
W20260709 12:16:44.136581 23249 leader_election.cc:343] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:44.137171 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cee52613ef54d57831a22f94dc04557" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acc8af67993a40b4b831b0648627df4a"
I20260709 12:16:44.137809 23433 raft_consensus.cc:3060] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:44.141544 23478 tablet_bootstrap.cc:492] T 8ea8a85ced6f47deae3785a1e3c6c57c P acc8af67993a40b4b831b0648627df4a: No bootstrap required, opened a new log
I20260709 12:16:44.142027 23478 ts_tablet_manager.cc:1403] T 8ea8a85ced6f47deae3785a1e3c6c57c P acc8af67993a40b4b831b0648627df4a: Time spent bootstrapping tablet: real 0.064s	user 0.029s	sys 0.022s
I20260709 12:16:44.138990 23490 leader_election.cc:290] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 election: Requested vote from peers 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:16:44.150605 23478 raft_consensus.cc:359] T 8ea8a85ced6f47deae3785a1e3c6c57c P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.151171 23478 raft_consensus.cc:385] T 8ea8a85ced6f47deae3785a1e3c6c57c P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:44.151412 23478 raft_consensus.cc:740] T 8ea8a85ced6f47deae3785a1e3c6c57c P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acc8af67993a40b4b831b0648627df4a, State: Initialized, Role: FOLLOWER
I20260709 12:16:44.152073 23478 consensus_queue.cc:260] T 8ea8a85ced6f47deae3785a1e3c6c57c P acc8af67993a40b4b831b0648627df4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.153761 23433 raft_consensus.cc:2468] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 653d221b042e4553b69ee069f7768959 in term 1.
I20260709 12:16:44.154868 23478 ts_tablet_manager.cc:1434] T 8ea8a85ced6f47deae3785a1e3c6c57c P acc8af67993a40b4b831b0648627df4a: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:16:44.156015 23478 tablet_bootstrap.cc:492] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a: Bootstrap starting.
I20260709 12:16:44.159358 23252 leader_election.cc:304] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 653d221b042e4553b69ee069f7768959, acc8af67993a40b4b831b0648627df4a; no voters: 6158309d5094456cb4548d7568b28ce6
I20260709 12:16:44.158529 23480 tablet_bootstrap.cc:654] T e7e39859435c4af59be53206dacf3cdb P 6158309d5094456cb4548d7568b28ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:44.161656 23490 raft_consensus.cc:2804] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:44.162341 23478 tablet_bootstrap.cc:654] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:44.162508 23490 raft_consensus.cc:697] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [term 1 LEADER]: Becoming Leader. State: Replica: 653d221b042e4553b69ee069f7768959, State: Running, Role: LEADER
I20260709 12:16:44.163754 23490 consensus_queue.cc:237] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.171670 23480 tablet_bootstrap.cc:492] T e7e39859435c4af59be53206dacf3cdb P 6158309d5094456cb4548d7568b28ce6: No bootstrap required, opened a new log
I20260709 12:16:44.173203 23480 ts_tablet_manager.cc:1403] T e7e39859435c4af59be53206dacf3cdb P 6158309d5094456cb4548d7568b28ce6: Time spent bootstrapping tablet: real 0.069s	user 0.005s	sys 0.011s
I20260709 12:16:44.177404 23480 raft_consensus.cc:359] T e7e39859435c4af59be53206dacf3cdb P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.178144 23480 raft_consensus.cc:385] T e7e39859435c4af59be53206dacf3cdb P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:44.178481 23480 raft_consensus.cc:740] T e7e39859435c4af59be53206dacf3cdb P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6158309d5094456cb4548d7568b28ce6, State: Initialized, Role: FOLLOWER
I20260709 12:16:44.179165 23480 consensus_queue.cc:260] T e7e39859435c4af59be53206dacf3cdb P 6158309d5094456cb4548d7568b28ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.182624 23478 tablet_bootstrap.cc:492] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a: No bootstrap required, opened a new log
I20260709 12:16:44.183164 23478 ts_tablet_manager.cc:1403] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.002s
I20260709 12:16:44.185860 23478 raft_consensus.cc:359] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.186563 23478 raft_consensus.cc:385] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:44.186642 23480 ts_tablet_manager.cc:1434] T e7e39859435c4af59be53206dacf3cdb P 6158309d5094456cb4548d7568b28ce6: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:16:44.186885 23478 raft_consensus.cc:740] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acc8af67993a40b4b831b0648627df4a, State: Initialized, Role: FOLLOWER
I20260709 12:16:44.187217 23509 raft_consensus.cc:493] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:44.187919 23480 tablet_bootstrap.cc:492] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6: Bootstrap starting.
I20260709 12:16:44.187667 23509 raft_consensus.cc:515] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.192610 23509 leader_election.cc:290] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:16:44.194301 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d675dc4d2174178a63abad38736adfd" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acc8af67993a40b4b831b0648627df4a" is_pre_election: true
I20260709 12:16:44.195091 23435 raft_consensus.cc:2393] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6158309d5094456cb4548d7568b28ce6 in current term 1: Already voted for candidate 653d221b042e4553b69ee069f7768959 in this term.
I20260709 12:16:44.197194 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d675dc4d2174178a63abad38736adfd" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "653d221b042e4553b69ee069f7768959" is_pre_election: true
I20260709 12:16:44.197497 23480 tablet_bootstrap.cc:654] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:44.198601 23324 leader_election.cc:304] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6158309d5094456cb4548d7568b28ce6; no voters: 653d221b042e4553b69ee069f7768959, acc8af67993a40b4b831b0648627df4a
I20260709 12:16:44.198870 23360 raft_consensus.cc:3060] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:44.204180 23182 catalog_manager.cc:5697] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 reported cstate change: term changed from 0 to 1, leader changed from <none> to 653d221b042e4553b69ee069f7768959 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "653d221b042e4553b69ee069f7768959" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:44.207010 23509 raft_consensus.cc:2749] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:44.187805 23478 consensus_queue.cc:260] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.209538 23478 ts_tablet_manager.cc:1434] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.004s
I20260709 12:16:44.205981 23490 raft_consensus.cc:493] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:44.211999 23480 tablet_bootstrap.cc:492] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6: No bootstrap required, opened a new log
I20260709 12:16:44.212256 23522 raft_consensus.cc:493] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:44.211580 23490 raft_consensus.cc:515] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.212528 23480 ts_tablet_manager.cc:1403] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.000s
I20260709 12:16:44.212759 23522 raft_consensus.cc:515] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.214290 23490 leader_election.cc:290] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:16:44.214780 23522 leader_election.cc:290] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731), 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329)
I20260709 12:16:44.215986 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e39859435c4af59be53206dacf3cdb" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6158309d5094456cb4548d7568b28ce6" is_pre_election: true
I20260709 12:16:44.216589 23361 raft_consensus.cc:2468] T e7e39859435c4af59be53206dacf3cdb P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 653d221b042e4553b69ee069f7768959 in term 0.
I20260709 12:16:44.216727 23480 raft_consensus.cc:359] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.217460 23480 raft_consensus.cc:385] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:44.217717 23480 raft_consensus.cc:740] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6158309d5094456cb4548d7568b28ce6, State: Initialized, Role: FOLLOWER
I20260709 12:16:44.218360 23480 consensus_queue.cc:260] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.219246 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e39859435c4af59be53206dacf3cdb" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acc8af67993a40b4b831b0648627df4a" is_pre_election: true
I20260709 12:16:44.219911 23435 raft_consensus.cc:2468] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 653d221b042e4553b69ee069f7768959 in term 0.
I20260709 12:16:44.222136 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e39859435c4af59be53206dacf3cdb" candidate_uuid: "acc8af67993a40b4b831b0648627df4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "653d221b042e4553b69ee069f7768959" is_pre_election: true
I20260709 12:16:44.222963 23285 raft_consensus.cc:2468] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acc8af67993a40b4b831b0648627df4a in term 0.
I20260709 12:16:44.223748 23490 consensus_queue.cc:1048] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:44.225744 23480 ts_tablet_manager.cc:1434] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 12:16:44.228149 23249 leader_election.cc:304] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6158309d5094456cb4548d7568b28ce6, 653d221b042e4553b69ee069f7768959; no voters: 
I20260709 12:16:44.230335 23398 leader_election.cc:304] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 653d221b042e4553b69ee069f7768959, acc8af67993a40b4b831b0648627df4a; no voters: 
I20260709 12:16:44.234238 23490 raft_consensus.cc:2804] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:44.234627 23490 raft_consensus.cc:493] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:44.234965 23490 raft_consensus.cc:3060] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:44.237053 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e39859435c4af59be53206dacf3cdb" candidate_uuid: "acc8af67993a40b4b831b0648627df4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6158309d5094456cb4548d7568b28ce6" is_pre_election: true
I20260709 12:16:44.237671 23361 raft_consensus.cc:2468] T e7e39859435c4af59be53206dacf3cdb P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acc8af67993a40b4b831b0648627df4a in term 0.
I20260709 12:16:44.239396 23522 raft_consensus.cc:2804] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:44.239818 23522 raft_consensus.cc:493] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:44.240212 23522 raft_consensus.cc:3060] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:44.242631 23490 raft_consensus.cc:515] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.246850 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e39859435c4af59be53206dacf3cdb" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6158309d5094456cb4548d7568b28ce6"
I20260709 12:16:44.247416 23361 raft_consensus.cc:3060] T e7e39859435c4af59be53206dacf3cdb P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:44.250741 23522 raft_consensus.cc:515] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.254015 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e39859435c4af59be53206dacf3cdb" candidate_uuid: "acc8af67993a40b4b831b0648627df4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "653d221b042e4553b69ee069f7768959"
I20260709 12:16:44.254949 23285 raft_consensus.cc:2393] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate acc8af67993a40b4b831b0648627df4a in current term 1: Already voted for candidate 653d221b042e4553b69ee069f7768959 in this term.
I20260709 12:16:44.259585 23361 raft_consensus.cc:2468] T e7e39859435c4af59be53206dacf3cdb P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 653d221b042e4553b69ee069f7768959 in term 1.
I20260709 12:16:44.260874 23249 leader_election.cc:304] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6158309d5094456cb4548d7568b28ce6, 653d221b042e4553b69ee069f7768959; no voters: 
I20260709 12:16:44.261744 23505 raft_consensus.cc:2804] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:44.262313 23505 raft_consensus.cc:697] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [term 1 LEADER]: Becoming Leader. State: Replica: 653d221b042e4553b69ee069f7768959, State: Running, Role: LEADER
I20260709 12:16:44.262557 23522 leader_election.cc:290] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [CANDIDATE]: Term 1 election: Requested vote from peers 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731), 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329)
I20260709 12:16:44.263386 23505 consensus_queue.cc:237] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.265897 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e39859435c4af59be53206dacf3cdb" candidate_uuid: "acc8af67993a40b4b831b0648627df4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6158309d5094456cb4548d7568b28ce6"
I20260709 12:16:44.266637 23359 raft_consensus.cc:2393] T e7e39859435c4af59be53206dacf3cdb P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate acc8af67993a40b4b831b0648627df4a in current term 1: Already voted for candidate 653d221b042e4553b69ee069f7768959 in this term.
I20260709 12:16:44.267827 23398 leader_election.cc:304] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acc8af67993a40b4b831b0648627df4a; no voters: 6158309d5094456cb4548d7568b28ce6, 653d221b042e4553b69ee069f7768959
I20260709 12:16:44.269874 23522 raft_consensus.cc:2749] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:44.277033 23490 leader_election.cc:290] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 1 election: Requested vote from peers 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:16:44.278956 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e39859435c4af59be53206dacf3cdb" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acc8af67993a40b4b831b0648627df4a"
I20260709 12:16:44.280918 23433 raft_consensus.cc:2393] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 653d221b042e4553b69ee069f7768959 in current term 1: Already voted for candidate acc8af67993a40b4b831b0648627df4a in this term.
I20260709 12:16:44.284094 23181 catalog_manager.cc:5697] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 reported cstate change: term changed from 0 to 1, leader changed from <none> to 653d221b042e4553b69ee069f7768959 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "653d221b042e4553b69ee069f7768959" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:44.286556 23505 consensus_queue.cc:1048] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:44.321696 23509 consensus_queue.cc:1048] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:44.337756 23513 consensus_queue.cc:1048] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:44.391675 23513 consensus_queue.cc:1048] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:44.408352 23509 consensus_queue.cc:1048] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:44.425041 23488 raft_consensus.cc:493] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:44.425628 23488 raft_consensus.cc:515] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.427939 23488 leader_election.cc:290] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:16:44.429571 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea8a85ced6f47deae3785a1e3c6c57c" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "653d221b042e4553b69ee069f7768959" is_pre_election: true
I20260709 12:16:44.429917 23488 consensus_queue.cc:1048] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:44.430562 23285 raft_consensus.cc:2468] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6158309d5094456cb4548d7568b28ce6 in term 0.
I20260709 12:16:44.429577 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea8a85ced6f47deae3785a1e3c6c57c" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acc8af67993a40b4b831b0648627df4a" is_pre_election: true
I20260709 12:16:44.431542 23433 raft_consensus.cc:2468] T 8ea8a85ced6f47deae3785a1e3c6c57c P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6158309d5094456cb4548d7568b28ce6 in term 0.
I20260709 12:16:44.431874 23324 leader_election.cc:304] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6158309d5094456cb4548d7568b28ce6, 653d221b042e4553b69ee069f7768959; no voters: 
I20260709 12:16:44.432928 23488 raft_consensus.cc:2804] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:44.433332 23488 raft_consensus.cc:493] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:44.433681 23488 raft_consensus.cc:3060] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:44.441155 23488 raft_consensus.cc:515] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.443435 23488 leader_election.cc:290] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 1 election: Requested vote from peers 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:16:44.447093 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea8a85ced6f47deae3785a1e3c6c57c" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acc8af67993a40b4b831b0648627df4a"
I20260709 12:16:44.447778 23434 raft_consensus.cc:3060] T 8ea8a85ced6f47deae3785a1e3c6c57c P acc8af67993a40b4b831b0648627df4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:44.449327 23513 consensus_queue.cc:1048] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:44.447117 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea8a85ced6f47deae3785a1e3c6c57c" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "653d221b042e4553b69ee069f7768959"
I20260709 12:16:44.450166 23285 raft_consensus.cc:3060] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:44.455514 23434 raft_consensus.cc:2468] T 8ea8a85ced6f47deae3785a1e3c6c57c P acc8af67993a40b4b831b0648627df4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6158309d5094456cb4548d7568b28ce6 in term 1.
I20260709 12:16:44.456911 23327 leader_election.cc:304] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6158309d5094456cb4548d7568b28ce6, acc8af67993a40b4b831b0648627df4a; no voters: 
I20260709 12:16:44.458148 23516 raft_consensus.cc:2804] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:44.458709 23516 raft_consensus.cc:697] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [term 1 LEADER]: Becoming Leader. State: Replica: 6158309d5094456cb4548d7568b28ce6, State: Running, Role: LEADER
I20260709 12:16:44.459604 23516 consensus_queue.cc:237] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.463195 23285 raft_consensus.cc:2468] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6158309d5094456cb4548d7568b28ce6 in term 1.
I20260709 12:16:44.470817 23513 raft_consensus.cc:493] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:44.471455 23513 raft_consensus.cc:515] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:44.474380 23513 leader_election.cc:290] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:16:44.476584 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cee52613ef54d57831a22f94dc04557" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acc8af67993a40b4b831b0648627df4a" is_pre_election: true
I20260709 12:16:44.477571 23434 raft_consensus.cc:2393] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6158309d5094456cb4548d7568b28ce6 in current term 1: Already voted for candidate 653d221b042e4553b69ee069f7768959 in this term.
I20260709 12:16:44.479218 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cee52613ef54d57831a22f94dc04557" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "653d221b042e4553b69ee069f7768959" is_pre_election: true
I20260709 12:16:44.481807 23324 leader_election.cc:304] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6158309d5094456cb4548d7568b28ce6; no voters: 653d221b042e4553b69ee069f7768959, acc8af67993a40b4b831b0648627df4a
I20260709 12:16:44.482739 23516 raft_consensus.cc:3060] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:44.483894 23181 catalog_manager.cc:5697] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6158309d5094456cb4548d7568b28ce6 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "6158309d5094456cb4548d7568b28ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:44.489035 23522 consensus_queue.cc:1048] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:44.504155 23516 raft_consensus.cc:2749] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:44.513010 23552 consensus_queue.cc:1048] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:44.617023 23540 consensus_queue.cc:1048] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:44.631409 23540 consensus_queue.cc:1048] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:44.671726 23540 consensus_queue.cc:1048] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:44.687707 23540 consensus_queue.cc:1048] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:44.724449 23359 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "118c992384fb4066acc1d04490d2239b"
dest_uuid: "6158309d5094456cb4548d7568b28ce6"
mode: GRACEFUL
new_leader_uuid: "653d221b042e4553b69ee069f7768959"
 from {username='slave'} at 127.0.0.1:45456
I20260709 12:16:44.725281 23359 raft_consensus.cc:606] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [term 1 LEADER]: Received request to transfer leadership to TS 653d221b042e4553b69ee069f7768959
I20260709 12:16:44.749176 23434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd92f8c45fc8467d896f5a99d6248a83"
dest_uuid: "acc8af67993a40b4b831b0648627df4a"
mode: GRACEFUL
new_leader_uuid: "653d221b042e4553b69ee069f7768959"
 from {username='slave'} at 127.0.0.1:49908
I20260709 12:16:44.749945 23434 raft_consensus.cc:606] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 1 LEADER]: Received request to transfer leadership to TS 653d221b042e4553b69ee069f7768959
I20260709 12:16:44.775604 23286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2cee52613ef54d57831a22f94dc04557"
dest_uuid: "653d221b042e4553b69ee069f7768959"
mode: GRACEFUL
new_leader_uuid: "6158309d5094456cb4548d7568b28ce6"
 from {username='slave'} at 127.0.0.1:36668
I20260709 12:16:44.776291 23286 raft_consensus.cc:606] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [term 1 LEADER]: Received request to transfer leadership to TS 6158309d5094456cb4548d7568b28ce6
I20260709 12:16:44.783244 23286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7e39859435c4af59be53206dacf3cdb"
dest_uuid: "653d221b042e4553b69ee069f7768959"
mode: GRACEFUL
new_leader_uuid: "acc8af67993a40b4b831b0648627df4a"
 from {username='slave'} at 127.0.0.1:36668
I20260709 12:16:44.783799 23286 raft_consensus.cc:606] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [term 1 LEADER]: Received request to transfer leadership to TS acc8af67993a40b4b831b0648627df4a
I20260709 12:16:44.860230 23516 consensus_queue.cc:1048] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:44.875674 23509 consensus_queue.cc:1048] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:45.010643 23513 raft_consensus.cc:993] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6: : Instructing follower 653d221b042e4553b69ee069f7768959 to start an election
I20260709 12:16:45.011216 23513 raft_consensus.cc:1081] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [term 1 LEADER]: Signalling peer 653d221b042e4553b69ee069f7768959 to start an election
I20260709 12:16:45.013626 23286 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "118c992384fb4066acc1d04490d2239b"
dest_uuid: "653d221b042e4553b69ee069f7768959"
 from {username='slave'} at 127.0.0.1:36656
I20260709 12:16:45.014174 23286 raft_consensus.cc:493] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:45.014501 23286 raft_consensus.cc:3060] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:45.019389 23286 raft_consensus.cc:515] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } } peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } }
I20260709 12:16:45.021497 23286 leader_election.cc:290] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 2 election: Requested vote from peers acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153), 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329)
I20260709 12:16:45.022305 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "118c992384fb4066acc1d04490d2239b" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "acc8af67993a40b4b831b0648627df4a"
I20260709 12:16:45.022758 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "118c992384fb4066acc1d04490d2239b" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6158309d5094456cb4548d7568b28ce6"
I20260709 12:16:45.022977 23434 raft_consensus.cc:3060] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:45.023326 23359 raft_consensus.cc:3055] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:45.023658 23359 raft_consensus.cc:740] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6158309d5094456cb4548d7568b28ce6, State: Running, Role: LEADER
I20260709 12:16:45.024576 23359 consensus_queue.cc:260] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } } peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } }
I20260709 12:16:45.026095 23359 raft_consensus.cc:3060] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:45.030380 23434 raft_consensus.cc:2468] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 653d221b042e4553b69ee069f7768959 in term 2.
I20260709 12:16:45.032326 23252 leader_election.cc:304] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 653d221b042e4553b69ee069f7768959, acc8af67993a40b4b831b0648627df4a; no voters: 
I20260709 12:16:45.033334 23541 raft_consensus.cc:2804] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:45.033958 23541 raft_consensus.cc:697] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 [term 2 LEADER]: Becoming Leader. State: Replica: 653d221b042e4553b69ee069f7768959, State: Running, Role: LEADER
I20260709 12:16:45.033973 23359 raft_consensus.cc:2468] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 653d221b042e4553b69ee069f7768959 in term 2.
I20260709 12:16:45.034988 23541 consensus_queue.cc:237] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } } peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } }
I20260709 12:16:45.043431 23181 catalog_manager.cc:5697] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 reported cstate change: term changed from 1 to 2, leader changed from 6158309d5094456cb4548d7568b28ce6 (127.22.155.194) to 653d221b042e4553b69ee069f7768959 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "653d221b042e4553b69ee069f7768959" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:45.080477 23552 raft_consensus.cc:993] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a: : Instructing follower 653d221b042e4553b69ee069f7768959 to start an election
I20260709 12:16:45.080983 23552 raft_consensus.cc:1081] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 1 LEADER]: Signalling peer 653d221b042e4553b69ee069f7768959 to start an election
I20260709 12:16:45.082690 23286 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd92f8c45fc8467d896f5a99d6248a83"
dest_uuid: "653d221b042e4553b69ee069f7768959"
 from {username='slave'} at 127.0.0.1:36644
I20260709 12:16:45.083320 23286 raft_consensus.cc:493] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:45.083734 23286 raft_consensus.cc:3060] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:45.089613 23286 raft_consensus.cc:515] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:45.091482 23286 leader_election.cc:290] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 2 election: Requested vote from peers 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:16:45.092672 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd92f8c45fc8467d896f5a99d6248a83" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6158309d5094456cb4548d7568b28ce6"
I20260709 12:16:45.092826 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd92f8c45fc8467d896f5a99d6248a83" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "acc8af67993a40b4b831b0648627df4a"
I20260709 12:16:45.093421 23359 raft_consensus.cc:3060] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:45.093570 23434 raft_consensus.cc:3055] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:45.094113 23434 raft_consensus.cc:740] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: acc8af67993a40b4b831b0648627df4a, State: Running, Role: LEADER
I20260709 12:16:45.094915 23434 consensus_queue.cc:260] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:45.095933 23434 raft_consensus.cc:3060] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:45.100837 23359 raft_consensus.cc:2468] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 653d221b042e4553b69ee069f7768959 in term 2.
I20260709 12:16:45.101310 23434 raft_consensus.cc:2468] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 653d221b042e4553b69ee069f7768959 in term 2.
I20260709 12:16:45.102278 23249 leader_election.cc:304] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6158309d5094456cb4548d7568b28ce6, 653d221b042e4553b69ee069f7768959; no voters: 
I20260709 12:16:45.104751 23505 raft_consensus.cc:2804] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:45.105288 23505 raft_consensus.cc:697] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [term 2 LEADER]: Becoming Leader. State: Replica: 653d221b042e4553b69ee069f7768959, State: Running, Role: LEADER
I20260709 12:16:45.106274 23505 consensus_queue.cc:237] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:45.108402 23541 raft_consensus.cc:993] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959: : Instructing follower acc8af67993a40b4b831b0648627df4a to start an election
I20260709 12:16:45.108973 23541 raft_consensus.cc:1081] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [term 1 LEADER]: Signalling peer acc8af67993a40b4b831b0648627df4a to start an election
I20260709 12:16:45.110903 23435 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7e39859435c4af59be53206dacf3cdb"
dest_uuid: "acc8af67993a40b4b831b0648627df4a"
 from {username='slave'} at 127.0.0.1:49890
I20260709 12:16:45.111481 23435 raft_consensus.cc:493] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:45.111830 23435 raft_consensus.cc:3060] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:45.118904 23435 raft_consensus.cc:515] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:45.121042 23181 catalog_manager.cc:5697] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 reported cstate change: term changed from 1 to 2, leader changed from acc8af67993a40b4b831b0648627df4a (127.22.155.195) to 653d221b042e4553b69ee069f7768959 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "653d221b042e4553b69ee069f7768959" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:45.121978 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e39859435c4af59be53206dacf3cdb" candidate_uuid: "acc8af67993a40b4b831b0648627df4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "653d221b042e4553b69ee069f7768959"
I20260709 12:16:45.122442 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e39859435c4af59be53206dacf3cdb" candidate_uuid: "acc8af67993a40b4b831b0648627df4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6158309d5094456cb4548d7568b28ce6"
I20260709 12:16:45.122691 23286 raft_consensus.cc:3055] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:45.123039 23286 raft_consensus.cc:740] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 653d221b042e4553b69ee069f7768959, State: Running, Role: LEADER
I20260709 12:16:45.123172 23359 raft_consensus.cc:3060] T e7e39859435c4af59be53206dacf3cdb P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:45.121013 23435 leader_election.cc:290] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [CANDIDATE]: Term 2 election: Requested vote from peers 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731), 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329)
I20260709 12:16:45.124035 23286 consensus_queue.cc:260] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:45.125352 23286 raft_consensus.cc:3060] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:45.134192 23359 raft_consensus.cc:2468] T e7e39859435c4af59be53206dacf3cdb P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acc8af67993a40b4b831b0648627df4a in term 2.
I20260709 12:16:45.134675 23286 raft_consensus.cc:2468] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acc8af67993a40b4b831b0648627df4a in term 2.
I20260709 12:16:45.135656 23398 leader_election.cc:304] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6158309d5094456cb4548d7568b28ce6, acc8af67993a40b4b831b0648627df4a; no voters: 
I20260709 12:16:45.136567 23552 raft_consensus.cc:2804] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:45.137203 23552 raft_consensus.cc:697] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [term 2 LEADER]: Becoming Leader. State: Replica: acc8af67993a40b4b831b0648627df4a, State: Running, Role: LEADER
I20260709 12:16:45.138087 23552 consensus_queue.cc:237] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:45.145654 23181 catalog_manager.cc:5697] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a reported cstate change: term changed from 1 to 2, leader changed from 653d221b042e4553b69ee069f7768959 (127.22.155.193) to acc8af67993a40b4b831b0648627df4a (127.22.155.195). New cstate: current_term: 2 leader_uuid: "acc8af67993a40b4b831b0648627df4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:45.214727 23540 raft_consensus.cc:993] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959: : Instructing follower 6158309d5094456cb4548d7568b28ce6 to start an election
I20260709 12:16:45.215269 23505 raft_consensus.cc:1081] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [term 1 LEADER]: Signalling peer 6158309d5094456cb4548d7568b28ce6 to start an election
I20260709 12:16:45.217159 23359 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2cee52613ef54d57831a22f94dc04557"
dest_uuid: "6158309d5094456cb4548d7568b28ce6"
 from {username='slave'} at 127.0.0.1:45450
I20260709 12:16:45.217725 23359 raft_consensus.cc:493] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:45.218044 23359 raft_consensus.cc:3060] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:45.223738 23359 raft_consensus.cc:515] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:45.225617 23359 leader_election.cc:290] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:16:45.226976 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cee52613ef54d57831a22f94dc04557" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "acc8af67993a40b4b831b0648627df4a"
I20260709 12:16:45.227068 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cee52613ef54d57831a22f94dc04557" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "653d221b042e4553b69ee069f7768959"
I20260709 12:16:45.227733 23435 raft_consensus.cc:3060] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:45.227856 23286 raft_consensus.cc:3055] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:45.228286 23286 raft_consensus.cc:740] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 653d221b042e4553b69ee069f7768959, State: Running, Role: LEADER
I20260709 12:16:45.229151 23286 consensus_queue.cc:260] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:45.230470 23286 raft_consensus.cc:3060] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:45.233685 23435 raft_consensus.cc:2468] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6158309d5094456cb4548d7568b28ce6 in term 2.
I20260709 12:16:45.234853 23327 leader_election.cc:304] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6158309d5094456cb4548d7568b28ce6, acc8af67993a40b4b831b0648627df4a; no voters: 
I20260709 12:16:45.235608 23513 raft_consensus.cc:2804] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:45.236023 23513 raft_consensus.cc:697] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [term 2 LEADER]: Becoming Leader. State: Replica: 6158309d5094456cb4548d7568b28ce6, State: Running, Role: LEADER
I20260709 12:16:45.236546 23286 raft_consensus.cc:2468] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6158309d5094456cb4548d7568b28ce6 in term 2.
I20260709 12:16:45.236871 23513 consensus_queue.cc:237] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:45.243448 23181 catalog_manager.cc:5697] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 reported cstate change: term changed from 1 to 2, leader changed from 653d221b042e4553b69ee069f7768959 (127.22.155.193) to 6158309d5094456cb4548d7568b28ce6 (127.22.155.194). New cstate: current_term: 2 leader_uuid: "6158309d5094456cb4548d7568b28ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:45.449407 23359 raft_consensus.cc:1275] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Refusing update from remote peer 653d221b042e4553b69ee069f7768959: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:45.450752 23505 consensus_queue.cc:1048] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:45.462940 23435 raft_consensus.cc:1275] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a [term 2 FOLLOWER]: Refusing update from remote peer 653d221b042e4553b69ee069f7768959: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:45.464607 23490 consensus_queue.cc:1048] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:45.546196 23359 raft_consensus.cc:1275] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Refusing update from remote peer 653d221b042e4553b69ee069f7768959: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:45.547773 23490 consensus_queue.cc:1048] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:45.558692 23435 raft_consensus.cc:1275] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 2 FOLLOWER]: Refusing update from remote peer 653d221b042e4553b69ee069f7768959: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:45.560194 23505 consensus_queue.cc:1048] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:45.576361 23359 raft_consensus.cc:1275] T e7e39859435c4af59be53206dacf3cdb P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Refusing update from remote peer acc8af67993a40b4b831b0648627df4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:45.578125 23552 consensus_queue.cc:1048] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:45.587782 23286 raft_consensus.cc:1275] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [term 2 FOLLOWER]: Refusing update from remote peer acc8af67993a40b4b831b0648627df4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:45.589900 23567 consensus_queue.cc:1048] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:45.732236 23435 raft_consensus.cc:1275] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a [term 2 FOLLOWER]: Refusing update from remote peer 6158309d5094456cb4548d7568b28ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:45.733626 23286 raft_consensus.cc:1275] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [term 2 FOLLOWER]: Refusing update from remote peer 6158309d5094456cb4548d7568b28ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:45.733918 23516 consensus_queue.cc:1048] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:45.735154 23513 consensus_queue.cc:1048] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:47.814060 23151 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:16:47.814785 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:47.837646 23359 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57cac032df10494799e2fd4bd94aac17"
dest_uuid: "6158309d5094456cb4548d7568b28ce6"
mode: GRACEFUL
new_leader_uuid: "acc8af67993a40b4b831b0648627df4a"
 from {username='slave'} at 127.0.0.1:45472
I20260709 12:16:47.838358 23359 raft_consensus.cc:606] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 1 LEADER]: Received request to transfer leadership to TS acc8af67993a40b4b831b0648627df4a
I20260709 12:16:47.849552 23286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd92f8c45fc8467d896f5a99d6248a83"
dest_uuid: "653d221b042e4553b69ee069f7768959"
mode: GRACEFUL
new_leader_uuid: "acc8af67993a40b4b831b0648627df4a"
 from {username='slave'} at 127.0.0.1:36682
I20260709 12:16:47.850154 23286 raft_consensus.cc:606] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [term 2 LEADER]: Received request to transfer leadership to TS acc8af67993a40b4b831b0648627df4a
I20260709 12:16:47.851431 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:16:47.851963 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:47.989156 23513 raft_consensus.cc:993] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6: : Instructing follower acc8af67993a40b4b831b0648627df4a to start an election
I20260709 12:16:47.989698 23583 raft_consensus.cc:1081] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 1 LEADER]: Signalling peer acc8af67993a40b4b831b0648627df4a to start an election
I20260709 12:16:47.991539 23435 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57cac032df10494799e2fd4bd94aac17"
dest_uuid: "acc8af67993a40b4b831b0648627df4a"
 from {username='slave'} at 127.0.0.1:49900
I20260709 12:16:47.992091 23435 raft_consensus.cc:493] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:47.992405 23435 raft_consensus.cc:3060] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.996835 23435 raft_consensus.cc:515] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:47.998373 23435 leader_election.cc:290] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [CANDIDATE]: Term 2 election: Requested vote from peers 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731), 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329)
I20260709 12:16:47.999344 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac032df10494799e2fd4bd94aac17" candidate_uuid: "acc8af67993a40b4b831b0648627df4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "653d221b042e4553b69ee069f7768959"
I20260709 12:16:47.999559 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac032df10494799e2fd4bd94aac17" candidate_uuid: "acc8af67993a40b4b831b0648627df4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6158309d5094456cb4548d7568b28ce6"
I20260709 12:16:48.000027 23286 raft_consensus.cc:3060] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.000146 23359 raft_consensus.cc:3055] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:48.000586 23359 raft_consensus.cc:740] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6158309d5094456cb4548d7568b28ce6, State: Running, Role: LEADER
I20260709 12:16:48.001286 23359 consensus_queue.cc:260] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:48.002774 23359 raft_consensus.cc:3060] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.005977 23286 raft_consensus.cc:2468] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acc8af67993a40b4b831b0648627df4a in term 2.
I20260709 12:16:48.007375 23398 leader_election.cc:304] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 653d221b042e4553b69ee069f7768959, acc8af67993a40b4b831b0648627df4a; no voters: 
I20260709 12:16:48.008159 23578 raft_consensus.cc:2804] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:48.009043 23359 raft_consensus.cc:2468] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acc8af67993a40b4b831b0648627df4a in term 2.
I20260709 12:16:48.009581 23578 raft_consensus.cc:697] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [term 2 LEADER]: Becoming Leader. State: Replica: acc8af67993a40b4b831b0648627df4a, State: Running, Role: LEADER
I20260709 12:16:48.010525 23578 consensus_queue.cc:237] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:48.020171 23183 catalog_manager.cc:5697] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a reported cstate change: term changed from 1 to 2, leader changed from 6158309d5094456cb4548d7568b28ce6 (127.22.155.194) to acc8af67993a40b4b831b0648627df4a (127.22.155.195). New cstate: current_term: 2 leader_uuid: "acc8af67993a40b4b831b0648627df4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:48.204072 23505 raft_consensus.cc:993] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959: : Instructing follower acc8af67993a40b4b831b0648627df4a to start an election
I20260709 12:16:48.204583 23590 raft_consensus.cc:1081] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [term 2 LEADER]: Signalling peer acc8af67993a40b4b831b0648627df4a to start an election
I20260709 12:16:48.206333 23435 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd92f8c45fc8467d896f5a99d6248a83"
dest_uuid: "acc8af67993a40b4b831b0648627df4a"
 from {username='slave'} at 127.0.0.1:49890
I20260709 12:16:48.206982 23435 raft_consensus.cc:493] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:48.207315 23435 raft_consensus.cc:3060] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:48.211697 23435 raft_consensus.cc:515] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:48.213380 23435 leader_election.cc:290] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [CANDIDATE]: Term 3 election: Requested vote from peers 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731), 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329)
I20260709 12:16:48.214414 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd92f8c45fc8467d896f5a99d6248a83" candidate_uuid: "acc8af67993a40b4b831b0648627df4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "653d221b042e4553b69ee069f7768959"
I20260709 12:16:48.214972 23286 raft_consensus.cc:3055] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:48.214900 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd92f8c45fc8467d896f5a99d6248a83" candidate_uuid: "acc8af67993a40b4b831b0648627df4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6158309d5094456cb4548d7568b28ce6"
I20260709 12:16:48.215284 23286 raft_consensus.cc:740] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 653d221b042e4553b69ee069f7768959, State: Running, Role: LEADER
I20260709 12:16:48.215694 23359 raft_consensus.cc:3060] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:48.216145 23286 consensus_queue.cc:260] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:48.217114 23286 raft_consensus.cc:3060] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:48.221511 23359 raft_consensus.cc:2468] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acc8af67993a40b4b831b0648627df4a in term 3.
I20260709 12:16:48.221674 23286 raft_consensus.cc:2468] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acc8af67993a40b4b831b0648627df4a in term 3.
I20260709 12:16:48.222941 23398 leader_election.cc:304] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6158309d5094456cb4548d7568b28ce6, acc8af67993a40b4b831b0648627df4a; no voters: 
I20260709 12:16:48.223755 23578 raft_consensus.cc:2804] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:48.224304 23578 raft_consensus.cc:697] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 3 LEADER]: Becoming Leader. State: Replica: acc8af67993a40b4b831b0648627df4a, State: Running, Role: LEADER
I20260709 12:16:48.225224 23578 consensus_queue.cc:237] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:48.232818 23183 catalog_manager.cc:5697] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a reported cstate change: term changed from 2 to 3, leader changed from 653d221b042e4553b69ee069f7768959 (127.22.155.193) to acc8af67993a40b4b831b0648627df4a (127.22.155.195). New cstate: current_term: 3 leader_uuid: "acc8af67993a40b4b831b0648627df4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:48.570577 23286 raft_consensus.cc:1275] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [term 2 FOLLOWER]: Refusing update from remote peer acc8af67993a40b4b831b0648627df4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:48.572144 23578 consensus_queue.cc:1048] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:48.582473 23359 raft_consensus.cc:1275] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Refusing update from remote peer acc8af67993a40b4b831b0648627df4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:48.584494 23578 consensus_queue.cc:1048] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:48.732515 23359 raft_consensus.cc:1275] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6 [term 3 FOLLOWER]: Refusing update from remote peer acc8af67993a40b4b831b0648627df4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:48.734143 23578 consensus_queue.cc:1048] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:48.744311 23286 raft_consensus.cc:1275] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [term 3 FOLLOWER]: Refusing update from remote peer acc8af67993a40b4b831b0648627df4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:48.745956 23578 consensus_queue.cc:1048] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:48.853083 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:48.859580 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:48.860026 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:49.861155 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:49.867646 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:49.868207 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:50.869616 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:50.876497 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:50.877065 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:51.878175 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:51.883033 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:51.883459 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:52.884682 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:52.891445 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:52.892055 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:53.893064 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:53.897791 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:53.898212 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:54.899415 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:54.905241 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:54.905687 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:55.906821 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:55.911586 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:55.912019 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:56.912992 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:56.917701 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:56.918138 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:57.950785 23151 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:16:57.956156 23285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "118c992384fb4066acc1d04490d2239b"
dest_uuid: "653d221b042e4553b69ee069f7768959"
mode: GRACEFUL
new_leader_uuid: "6158309d5094456cb4548d7568b28ce6"
 from {username='slave'} at 127.0.0.1:36668
I20260709 12:16:57.956931 23285 raft_consensus.cc:606] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 [term 2 LEADER]: Received request to transfer leadership to TS 6158309d5094456cb4548d7568b28ce6
I20260709 12:16:57.962877 23285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d675dc4d2174178a63abad38736adfd"
dest_uuid: "653d221b042e4553b69ee069f7768959"
mode: GRACEFUL
new_leader_uuid: "6158309d5094456cb4548d7568b28ce6"
 from {username='slave'} at 127.0.0.1:36668
I20260709 12:16:57.963474 23285 raft_consensus.cc:606] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [term 1 LEADER]: Received request to transfer leadership to TS 6158309d5094456cb4548d7568b28ce6
I20260709 12:16:57.968884 23285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e85e09af0aa44ee09ccc4b71e1843fe9"
dest_uuid: "653d221b042e4553b69ee069f7768959"
mode: GRACEFUL
new_leader_uuid: "6158309d5094456cb4548d7568b28ce6"
 from {username='slave'} at 127.0.0.1:36668
I20260709 12:16:57.969408 23285 raft_consensus.cc:606] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [term 1 LEADER]: Received request to transfer leadership to TS 6158309d5094456cb4548d7568b28ce6
I20260709 12:16:57.975152 23435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd92f8c45fc8467d896f5a99d6248a83"
dest_uuid: "acc8af67993a40b4b831b0648627df4a"
mode: GRACEFUL
new_leader_uuid: "6158309d5094456cb4548d7568b28ce6"
 from {username='slave'} at 127.0.0.1:49908
I20260709 12:16:57.975634 23435 raft_consensus.cc:606] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 3 LEADER]: Received request to transfer leadership to TS 6158309d5094456cb4548d7568b28ce6
I20260709 12:16:57.980914 23435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57cac032df10494799e2fd4bd94aac17"
dest_uuid: "acc8af67993a40b4b831b0648627df4a"
mode: GRACEFUL
new_leader_uuid: "6158309d5094456cb4548d7568b28ce6"
 from {username='slave'} at 127.0.0.1:49908
I20260709 12:16:57.981434 23435 raft_consensus.cc:606] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [term 2 LEADER]: Received request to transfer leadership to TS 6158309d5094456cb4548d7568b28ce6
I20260709 12:16:58.022001 23606 raft_consensus.cc:993] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a: : Instructing follower 6158309d5094456cb4548d7568b28ce6 to start an election
I20260709 12:16:58.022600 23608 raft_consensus.cc:1081] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 3 LEADER]: Signalling peer 6158309d5094456cb4548d7568b28ce6 to start an election
I20260709 12:16:58.024245 23359 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd92f8c45fc8467d896f5a99d6248a83"
dest_uuid: "6158309d5094456cb4548d7568b28ce6"
 from {username='slave'} at 127.0.0.1:45452
I20260709 12:16:58.024786 23359 raft_consensus.cc:493] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:58.025136 23359 raft_consensus.cc:3060] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:58.029601 23359 raft_consensus.cc:515] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:58.031350 23359 leader_election.cc:290] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 4 election: Requested vote from peers 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:16:58.032651 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd92f8c45fc8467d896f5a99d6248a83" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "acc8af67993a40b4b831b0648627df4a"
I20260709 12:16:58.032470 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd92f8c45fc8467d896f5a99d6248a83" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "653d221b042e4553b69ee069f7768959"
I20260709 12:16:58.033365 23435 raft_consensus.cc:3055] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:58.033494 23285 raft_consensus.cc:3060] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:58.033653 23435 raft_consensus.cc:740] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: acc8af67993a40b4b831b0648627df4a, State: Running, Role: LEADER
I20260709 12:16:58.034482 23435 consensus_queue.cc:260] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:58.035454 23435 raft_consensus.cc:3060] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:58.039317 23285 raft_consensus.cc:2468] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6158309d5094456cb4548d7568b28ce6 in term 4.
I20260709 12:16:58.040130 23435 raft_consensus.cc:2468] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6158309d5094456cb4548d7568b28ce6 in term 4.
I20260709 12:16:58.040720 23324 leader_election.cc:304] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6158309d5094456cb4548d7568b28ce6, 653d221b042e4553b69ee069f7768959; no voters: 
I20260709 12:16:58.041764 23603 raft_consensus.cc:2804] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:58.042620 23603 raft_consensus.cc:697] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6 [term 4 LEADER]: Becoming Leader. State: Replica: 6158309d5094456cb4548d7568b28ce6, State: Running, Role: LEADER
I20260709 12:16:58.043546 23603 consensus_queue.cc:237] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:58.050647 23181 catalog_manager.cc:5697] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6 reported cstate change: term changed from 3 to 4, leader changed from acc8af67993a40b4b831b0648627df4a (127.22.155.195) to 6158309d5094456cb4548d7568b28ce6 (127.22.155.194). New cstate: current_term: 4 leader_uuid: "6158309d5094456cb4548d7568b28ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:58.079774 23608 raft_consensus.cc:993] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a: : Instructing follower 6158309d5094456cb4548d7568b28ce6 to start an election
I20260709 12:16:58.080363 23608 raft_consensus.cc:1081] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [term 2 LEADER]: Signalling peer 6158309d5094456cb4548d7568b28ce6 to start an election
I20260709 12:16:58.082194 23359 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57cac032df10494799e2fd4bd94aac17"
dest_uuid: "6158309d5094456cb4548d7568b28ce6"
 from {username='slave'} at 127.0.0.1:45452
I20260709 12:16:58.082719 23359 raft_consensus.cc:493] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:58.082983 23359 raft_consensus.cc:3060] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:58.087684 23359 raft_consensus.cc:515] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:58.089296 23359 leader_election.cc:290] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 3 election: Requested vote from peers 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:16:58.090296 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac032df10494799e2fd4bd94aac17" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "653d221b042e4553b69ee069f7768959"
I20260709 12:16:58.090348 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac032df10494799e2fd4bd94aac17" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "acc8af67993a40b4b831b0648627df4a"
I20260709 12:16:58.090953 23285 raft_consensus.cc:3060] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:58.091017 23435 raft_consensus.cc:3055] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:58.091424 23435 raft_consensus.cc:740] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: acc8af67993a40b4b831b0648627df4a, State: Running, Role: LEADER
I20260709 12:16:58.092110 23435 consensus_queue.cc:260] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:58.093003 23435 raft_consensus.cc:3060] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:58.096521 23285 raft_consensus.cc:2468] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6158309d5094456cb4548d7568b28ce6 in term 3.
I20260709 12:16:58.097869 23324 leader_election.cc:304] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6158309d5094456cb4548d7568b28ce6, 653d221b042e4553b69ee069f7768959; no voters: 
I20260709 12:16:58.098168 23435 raft_consensus.cc:2468] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6158309d5094456cb4548d7568b28ce6 in term 3.
I20260709 12:16:58.098729 23603 raft_consensus.cc:2804] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:58.099200 23603 raft_consensus.cc:697] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 3 LEADER]: Becoming Leader. State: Replica: 6158309d5094456cb4548d7568b28ce6, State: Running, Role: LEADER
I20260709 12:16:58.100018 23603 consensus_queue.cc:237] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:58.107730 23181 catalog_manager.cc:5697] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 reported cstate change: term changed from 2 to 3, leader changed from acc8af67993a40b4b831b0648627df4a (127.22.155.195) to 6158309d5094456cb4548d7568b28ce6 (127.22.155.194). New cstate: current_term: 3 leader_uuid: "6158309d5094456cb4548d7568b28ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:58.197289 23607 raft_consensus.cc:993] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959: : Instructing follower 6158309d5094456cb4548d7568b28ce6 to start an election
I20260709 12:16:58.197908 23617 raft_consensus.cc:1081] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [term 1 LEADER]: Signalling peer 6158309d5094456cb4548d7568b28ce6 to start an election
I20260709 12:16:58.199752 23359 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e85e09af0aa44ee09ccc4b71e1843fe9"
dest_uuid: "6158309d5094456cb4548d7568b28ce6"
 from {username='slave'} at 127.0.0.1:45450
I20260709 12:16:58.200400 23359 raft_consensus.cc:493] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:58.200737 23359 raft_consensus.cc:3060] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.203379 23607 raft_consensus.cc:993] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959: : Instructing follower 6158309d5094456cb4548d7568b28ce6 to start an election
I20260709 12:16:58.203948 23617 raft_consensus.cc:1081] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 [term 2 LEADER]: Signalling peer 6158309d5094456cb4548d7568b28ce6 to start an election
I20260709 12:16:58.205967 23361 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "118c992384fb4066acc1d04490d2239b"
dest_uuid: "6158309d5094456cb4548d7568b28ce6"
 from {username='slave'} at 127.0.0.1:45450
I20260709 12:16:58.206533 23361 raft_consensus.cc:493] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:58.206944 23361 raft_consensus.cc:3060] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:58.207669 23359 raft_consensus.cc:515] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:58.209882 23359 leader_election.cc:290] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:16:58.211167 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85e09af0aa44ee09ccc4b71e1843fe9" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "653d221b042e4553b69ee069f7768959"
I20260709 12:16:58.211910 23285 raft_consensus.cc:3055] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:58.212350 23285 raft_consensus.cc:740] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 653d221b042e4553b69ee069f7768959, State: Running, Role: LEADER
I20260709 12:16:58.213363 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85e09af0aa44ee09ccc4b71e1843fe9" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "acc8af67993a40b4b831b0648627df4a"
I20260709 12:16:58.213301 23285 consensus_queue.cc:260] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:58.214099 23434 raft_consensus.cc:3060] T e85e09af0aa44ee09ccc4b71e1843fe9 P acc8af67993a40b4b831b0648627df4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.214898 23285 raft_consensus.cc:3060] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.214789 23361 raft_consensus.cc:515] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } } peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } }
I20260709 12:16:58.217226 23361 leader_election.cc:290] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 3 election: Requested vote from peers acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153), 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731)
I20260709 12:16:58.218592 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "118c992384fb4066acc1d04490d2239b" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "653d221b042e4553b69ee069f7768959"
I20260709 12:16:58.218711 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "118c992384fb4066acc1d04490d2239b" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "acc8af67993a40b4b831b0648627df4a"
I20260709 12:16:58.219242 23286 raft_consensus.cc:3055] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:58.219401 23435 raft_consensus.cc:3060] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:58.219662 23286 raft_consensus.cc:740] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 653d221b042e4553b69ee069f7768959, State: Running, Role: LEADER
I20260709 12:16:58.220552 23286 consensus_queue.cc:260] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } } peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } }
I20260709 12:16:58.222236 23286 raft_consensus.cc:3060] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:58.222784 23434 raft_consensus.cc:2468] T e85e09af0aa44ee09ccc4b71e1843fe9 P acc8af67993a40b4b831b0648627df4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6158309d5094456cb4548d7568b28ce6 in term 2.
I20260709 12:16:58.224527 23327 leader_election.cc:304] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6158309d5094456cb4548d7568b28ce6, acc8af67993a40b4b831b0648627df4a; no voters: 
I20260709 12:16:58.225675 23603 raft_consensus.cc:2804] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:58.226235 23603 raft_consensus.cc:697] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6 [term 2 LEADER]: Becoming Leader. State: Replica: 6158309d5094456cb4548d7568b28ce6, State: Running, Role: LEADER
I20260709 12:16:58.226938 23435 raft_consensus.cc:2468] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6158309d5094456cb4548d7568b28ce6 in term 3.
I20260709 12:16:58.227268 23603 consensus_queue.cc:237] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:58.228361 23327 leader_election.cc:304] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6158309d5094456cb4548d7568b28ce6, acc8af67993a40b4b831b0648627df4a; no voters: 
I20260709 12:16:58.229010 23285 raft_consensus.cc:2468] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6158309d5094456cb4548d7568b28ce6 in term 2.
I20260709 12:16:58.229391 23609 raft_consensus.cc:2804] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:58.231259 23286 raft_consensus.cc:2468] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6158309d5094456cb4548d7568b28ce6 in term 3.
I20260709 12:16:58.231369 23609 raft_consensus.cc:697] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [term 3 LEADER]: Becoming Leader. State: Replica: 6158309d5094456cb4548d7568b28ce6, State: Running, Role: LEADER
I20260709 12:16:58.232910 23609 consensus_queue.cc:237] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } } peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } }
I20260709 12:16:58.236562 23181 catalog_manager.cc:5697] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6 reported cstate change: term changed from 1 to 2, leader changed from 653d221b042e4553b69ee069f7768959 (127.22.155.193) to 6158309d5094456cb4548d7568b28ce6 (127.22.155.194). New cstate: current_term: 2 leader_uuid: "6158309d5094456cb4548d7568b28ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:58.249380 23181 catalog_manager.cc:5697] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 reported cstate change: term changed from 2 to 3, leader changed from 653d221b042e4553b69ee069f7768959 (127.22.155.193) to 6158309d5094456cb4548d7568b28ce6 (127.22.155.194). New cstate: current_term: 3 leader_uuid: "6158309d5094456cb4548d7568b28ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.263908 23607 raft_consensus.cc:993] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959: : Instructing follower 6158309d5094456cb4548d7568b28ce6 to start an election
I20260709 12:16:58.264398 23607 raft_consensus.cc:1081] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [term 1 LEADER]: Signalling peer 6158309d5094456cb4548d7568b28ce6 to start an election
I20260709 12:16:58.266322 23361 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d675dc4d2174178a63abad38736adfd"
dest_uuid: "6158309d5094456cb4548d7568b28ce6"
 from {username='slave'} at 127.0.0.1:45450
I20260709 12:16:58.267100 23361 raft_consensus.cc:493] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:58.267452 23361 raft_consensus.cc:3060] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.273150 23361 raft_consensus.cc:515] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:58.275102 23361 leader_election.cc:290] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:16:58.275980 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d675dc4d2174178a63abad38736adfd" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "653d221b042e4553b69ee069f7768959"
I20260709 12:16:58.276392 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d675dc4d2174178a63abad38736adfd" candidate_uuid: "6158309d5094456cb4548d7568b28ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "acc8af67993a40b4b831b0648627df4a"
I20260709 12:16:58.276669 23286 raft_consensus.cc:3055] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:58.277026 23286 raft_consensus.cc:740] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 653d221b042e4553b69ee069f7768959, State: Running, Role: LEADER
I20260709 12:16:58.277056 23434 raft_consensus.cc:3060] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.277837 23286 consensus_queue.cc:260] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:58.278751 23286 raft_consensus.cc:3060] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.281829 23434 raft_consensus.cc:2468] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6158309d5094456cb4548d7568b28ce6 in term 2.
I20260709 12:16:58.283152 23327 leader_election.cc:304] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6158309d5094456cb4548d7568b28ce6, acc8af67993a40b4b831b0648627df4a; no voters: 
I20260709 12:16:58.283726 23286 raft_consensus.cc:2468] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6158309d5094456cb4548d7568b28ce6 in term 2.
I20260709 12:16:58.284080 23609 raft_consensus.cc:2804] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:58.284564 23609 raft_consensus.cc:697] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [term 2 LEADER]: Becoming Leader. State: Replica: 6158309d5094456cb4548d7568b28ce6, State: Running, Role: LEADER
I20260709 12:16:58.285504 23609 consensus_queue.cc:237] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:16:58.293102 23181 catalog_manager.cc:5697] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 reported cstate change: term changed from 1 to 2, leader changed from 653d221b042e4553b69ee069f7768959 (127.22.155.193) to 6158309d5094456cb4548d7568b28ce6 (127.22.155.194). New cstate: current_term: 2 leader_uuid: "6158309d5094456cb4548d7568b28ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:58.440682 23434 raft_consensus.cc:1275] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 4 FOLLOWER]: Refusing update from remote peer 6158309d5094456cb4548d7568b28ce6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:58.442261 23609 consensus_queue.cc:1048] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:58.453389 23286 raft_consensus.cc:1275] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [term 4 FOLLOWER]: Refusing update from remote peer 6158309d5094456cb4548d7568b28ce6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:58.454958 23603 consensus_queue.cc:1048] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:58.511485 23434 raft_consensus.cc:1275] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [term 3 FOLLOWER]: Refusing update from remote peer 6158309d5094456cb4548d7568b28ce6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:58.512806 23603 consensus_queue.cc:1048] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:58.522054 23286 raft_consensus.cc:1275] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [term 3 FOLLOWER]: Refusing update from remote peer 6158309d5094456cb4548d7568b28ce6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:58.523816 23603 consensus_queue.cc:1048] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:58.614490 23435 raft_consensus.cc:1275] T e85e09af0aa44ee09ccc4b71e1843fe9 P acc8af67993a40b4b831b0648627df4a [term 2 FOLLOWER]: Refusing update from remote peer 6158309d5094456cb4548d7568b28ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:58.615899 23609 consensus_queue.cc:1048] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.625077 23286 raft_consensus.cc:1275] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [term 2 FOLLOWER]: Refusing update from remote peer 6158309d5094456cb4548d7568b28ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:58.626835 23603 consensus_queue.cc:1048] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.732954 23435 raft_consensus.cc:1275] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a [term 2 FOLLOWER]: Refusing update from remote peer 6158309d5094456cb4548d7568b28ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:58.734318 23603 consensus_queue.cc:1048] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.745299 23286 raft_consensus.cc:1275] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [term 2 FOLLOWER]: Refusing update from remote peer 6158309d5094456cb4548d7568b28ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:58.747107 23603 consensus_queue.cc:1048] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.760532 23435 raft_consensus.cc:1275] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a [term 3 FOLLOWER]: Refusing update from remote peer 6158309d5094456cb4548d7568b28ce6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:58.762212 23603 consensus_queue.cc:1048] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:58.772886 23286 raft_consensus.cc:1275] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 [term 3 FOLLOWER]: Refusing update from remote peer 6158309d5094456cb4548d7568b28ce6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:58.774259 23632 consensus_queue.cc:1048] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:01.027905 23151 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:17:01.029050 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:01.036669 23361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d675dc4d2174178a63abad38736adfd"
dest_uuid: "6158309d5094456cb4548d7568b28ce6"
mode: GRACEFUL
new_leader_uuid: "653d221b042e4553b69ee069f7768959"
 from {username='slave'} at 127.0.0.1:45472
I20260709 12:17:01.037669 23361 raft_consensus.cc:606] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [term 2 LEADER]: Received request to transfer leadership to TS 653d221b042e4553b69ee069f7768959
I20260709 12:17:01.041153 23361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2cee52613ef54d57831a22f94dc04557"
dest_uuid: "6158309d5094456cb4548d7568b28ce6"
mode: GRACEFUL
new_leader_uuid: "acc8af67993a40b4b831b0648627df4a"
 from {username='slave'} at 127.0.0.1:45472
I20260709 12:17:01.041849 23361 raft_consensus.cc:606] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [term 2 LEADER]: Received request to transfer leadership to TS acc8af67993a40b4b831b0648627df4a
I20260709 12:17:01.045267 23361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57cac032df10494799e2fd4bd94aac17"
dest_uuid: "6158309d5094456cb4548d7568b28ce6"
mode: GRACEFUL
new_leader_uuid: "acc8af67993a40b4b831b0648627df4a"
 from {username='slave'} at 127.0.0.1:45472
I20260709 12:17:01.045737 23361 raft_consensus.cc:606] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 3 LEADER]: Received request to transfer leadership to TS acc8af67993a40b4b831b0648627df4a
I20260709 12:17:01.048234 23361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ea8a85ced6f47deae3785a1e3c6c57c"
dest_uuid: "6158309d5094456cb4548d7568b28ce6"
mode: GRACEFUL
new_leader_uuid: "653d221b042e4553b69ee069f7768959"
 from {username='slave'} at 127.0.0.1:45472
I20260709 12:17:01.048739 23361 raft_consensus.cc:606] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [term 1 LEADER]: Received request to transfer leadership to TS 653d221b042e4553b69ee069f7768959
I20260709 12:17:01.051198 23361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e85e09af0aa44ee09ccc4b71e1843fe9"
dest_uuid: "6158309d5094456cb4548d7568b28ce6"
mode: GRACEFUL
new_leader_uuid: "653d221b042e4553b69ee069f7768959"
 from {username='slave'} at 127.0.0.1:45472
I20260709 12:17:01.051646 23361 raft_consensus.cc:606] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6 [term 2 LEADER]: Received request to transfer leadership to TS 653d221b042e4553b69ee069f7768959
I20260709 12:17:01.052806 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:01.053332 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:01.092365 23636 raft_consensus.cc:993] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6: : Instructing follower acc8af67993a40b4b831b0648627df4a to start an election
I20260709 12:17:01.093062 23637 raft_consensus.cc:1081] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [term 2 LEADER]: Signalling peer acc8af67993a40b4b831b0648627df4a to start an election
I20260709 12:17:01.094936 23435 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2cee52613ef54d57831a22f94dc04557"
dest_uuid: "acc8af67993a40b4b831b0648627df4a"
 from {username='slave'} at 127.0.0.1:49900
I20260709 12:17:01.095476 23435 raft_consensus.cc:493] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:01.095818 23435 raft_consensus.cc:3060] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.101365 23435 raft_consensus.cc:515] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:17:01.103775 23435 leader_election.cc:290] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a [CANDIDATE]: Term 3 election: Requested vote from peers 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731), 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329)
I20260709 12:17:01.105093 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cee52613ef54d57831a22f94dc04557" candidate_uuid: "acc8af67993a40b4b831b0648627df4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6158309d5094456cb4548d7568b28ce6"
I20260709 12:17:01.104991 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cee52613ef54d57831a22f94dc04557" candidate_uuid: "acc8af67993a40b4b831b0648627df4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "653d221b042e4553b69ee069f7768959"
I20260709 12:17:01.106014 23286 raft_consensus.cc:3060] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.105983 23361 raft_consensus.cc:3055] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:01.106660 23361 raft_consensus.cc:740] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6158309d5094456cb4548d7568b28ce6, State: Running, Role: LEADER
I20260709 12:17:01.107527 23361 consensus_queue.cc:260] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:17:01.108762 23361 raft_consensus.cc:3060] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.111608 23286 raft_consensus.cc:2468] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acc8af67993a40b4b831b0648627df4a in term 3.
I20260709 12:17:01.113018 23398 leader_election.cc:304] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 653d221b042e4553b69ee069f7768959, acc8af67993a40b4b831b0648627df4a; no voters: 
I20260709 12:17:01.113880 23608 raft_consensus.cc:2804] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:01.115159 23608 raft_consensus.cc:697] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a [term 3 LEADER]: Becoming Leader. State: Replica: acc8af67993a40b4b831b0648627df4a, State: Running, Role: LEADER
I20260709 12:17:01.116276 23608 consensus_queue.cc:237] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:17:01.117271 23361 raft_consensus.cc:2468] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acc8af67993a40b4b831b0648627df4a in term 3.
I20260709 12:17:01.124475 23183 catalog_manager.cc:5697] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a reported cstate change: term changed from 2 to 3, leader changed from 6158309d5094456cb4548d7568b28ce6 (127.22.155.194) to acc8af67993a40b4b831b0648627df4a (127.22.155.195). New cstate: current_term: 3 leader_uuid: "acc8af67993a40b4b831b0648627df4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:01.262423 23636 raft_consensus.cc:993] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6: : Instructing follower acc8af67993a40b4b831b0648627df4a to start an election
I20260709 12:17:01.262995 23636 raft_consensus.cc:1081] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 3 LEADER]: Signalling peer acc8af67993a40b4b831b0648627df4a to start an election
I20260709 12:17:01.264783 23435 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57cac032df10494799e2fd4bd94aac17"
dest_uuid: "acc8af67993a40b4b831b0648627df4a"
 from {username='slave'} at 127.0.0.1:49900
I20260709 12:17:01.265311 23435 raft_consensus.cc:493] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:01.265648 23435 raft_consensus.cc:3060] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:01.270561 23435 raft_consensus.cc:515] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:17:01.272449 23435 leader_election.cc:290] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [CANDIDATE]: Term 4 election: Requested vote from peers 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731), 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329)
I20260709 12:17:01.273422 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac032df10494799e2fd4bd94aac17" candidate_uuid: "acc8af67993a40b4b831b0648627df4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "653d221b042e4553b69ee069f7768959"
I20260709 12:17:01.274065 23286 raft_consensus.cc:3060] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:01.273877 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57cac032df10494799e2fd4bd94aac17" candidate_uuid: "acc8af67993a40b4b831b0648627df4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6158309d5094456cb4548d7568b28ce6"
I20260709 12:17:01.274569 23361 raft_consensus.cc:3055] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:01.274904 23361 raft_consensus.cc:740] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6158309d5094456cb4548d7568b28ce6, State: Running, Role: LEADER
I20260709 12:17:01.275647 23361 consensus_queue.cc:260] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:17:01.276691 23361 raft_consensus.cc:3060] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:01.278558 23286 raft_consensus.cc:2468] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acc8af67993a40b4b831b0648627df4a in term 4.
I20260709 12:17:01.279594 23398 leader_election.cc:304] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 653d221b042e4553b69ee069f7768959, acc8af67993a40b4b831b0648627df4a; no voters: 
I20260709 12:17:01.280304 23608 raft_consensus.cc:2804] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:01.280786 23608 raft_consensus.cc:697] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [term 4 LEADER]: Becoming Leader. State: Replica: acc8af67993a40b4b831b0648627df4a, State: Running, Role: LEADER
I20260709 12:17:01.281497 23608 consensus_queue.cc:237] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:17:01.282588 23361 raft_consensus.cc:2468] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acc8af67993a40b4b831b0648627df4a in term 4.
I20260709 12:17:01.289371 23183 catalog_manager.cc:5697] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a reported cstate change: term changed from 3 to 4, leader changed from 6158309d5094456cb4548d7568b28ce6 (127.22.155.194) to acc8af67993a40b4b831b0648627df4a (127.22.155.195). New cstate: current_term: 4 leader_uuid: "acc8af67993a40b4b831b0648627df4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:01.329478 23637 raft_consensus.cc:993] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6: : Instructing follower 653d221b042e4553b69ee069f7768959 to start an election
I20260709 12:17:01.330142 23636 raft_consensus.cc:1081] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6 [term 2 LEADER]: Signalling peer 653d221b042e4553b69ee069f7768959 to start an election
I20260709 12:17:01.331884 23286 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e85e09af0aa44ee09ccc4b71e1843fe9"
dest_uuid: "653d221b042e4553b69ee069f7768959"
 from {username='slave'} at 127.0.0.1:36656
I20260709 12:17:01.332384 23286 raft_consensus.cc:493] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:01.332710 23286 raft_consensus.cc:3060] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.337016 23286 raft_consensus.cc:515] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:17:01.339083 23286 leader_election.cc:290] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 3 election: Requested vote from peers 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:17:01.340370 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85e09af0aa44ee09ccc4b71e1843fe9" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6158309d5094456cb4548d7568b28ce6"
I20260709 12:17:01.340493 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85e09af0aa44ee09ccc4b71e1843fe9" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "acc8af67993a40b4b831b0648627df4a"
I20260709 12:17:01.340977 23361 raft_consensus.cc:3055] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:01.341312 23435 raft_consensus.cc:3060] T e85e09af0aa44ee09ccc4b71e1843fe9 P acc8af67993a40b4b831b0648627df4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.341336 23361 raft_consensus.cc:740] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6158309d5094456cb4548d7568b28ce6, State: Running, Role: LEADER
I20260709 12:17:01.342319 23361 consensus_queue.cc:260] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:17:01.343380 23361 raft_consensus.cc:3060] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.347465 23435 raft_consensus.cc:2468] T e85e09af0aa44ee09ccc4b71e1843fe9 P acc8af67993a40b4b831b0648627df4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 653d221b042e4553b69ee069f7768959 in term 3.
I20260709 12:17:01.348944 23361 raft_consensus.cc:2468] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 653d221b042e4553b69ee069f7768959 in term 3.
I20260709 12:17:01.349107 23252 leader_election.cc:304] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 653d221b042e4553b69ee069f7768959, acc8af67993a40b4b831b0648627df4a; no voters: 
I20260709 12:17:01.351305 23646 raft_consensus.cc:2804] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:01.352752 23646 raft_consensus.cc:697] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [term 3 LEADER]: Becoming Leader. State: Replica: 653d221b042e4553b69ee069f7768959, State: Running, Role: LEADER
I20260709 12:17:01.353855 23646 consensus_queue.cc:237] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:17:01.355851 23637 raft_consensus.cc:993] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6: : Instructing follower 653d221b042e4553b69ee069f7768959 to start an election
I20260709 12:17:01.356366 23636 raft_consensus.cc:1081] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [term 2 LEADER]: Signalling peer 653d221b042e4553b69ee069f7768959 to start an election
I20260709 12:17:01.358358 23286 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d675dc4d2174178a63abad38736adfd"
dest_uuid: "653d221b042e4553b69ee069f7768959"
 from {username='slave'} at 127.0.0.1:36656
I20260709 12:17:01.358985 23286 raft_consensus.cc:493] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:01.359314 23286 raft_consensus.cc:3060] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.363014 23183 catalog_manager.cc:5697] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 reported cstate change: term changed from 2 to 3, leader changed from 6158309d5094456cb4548d7568b28ce6 (127.22.155.194) to 653d221b042e4553b69ee069f7768959 (127.22.155.193). New cstate: current_term: 3 leader_uuid: "653d221b042e4553b69ee069f7768959" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:01.365134 23286 raft_consensus.cc:515] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:17:01.367172 23286 leader_election.cc:290] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 3 election: Requested vote from peers 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:17:01.367789 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d675dc4d2174178a63abad38736adfd" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6158309d5094456cb4548d7568b28ce6"
I20260709 12:17:01.367820 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d675dc4d2174178a63abad38736adfd" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "acc8af67993a40b4b831b0648627df4a"
I20260709 12:17:01.368494 23361 raft_consensus.cc:3055] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:01.368706 23435 raft_consensus.cc:3060] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.369068 23361 raft_consensus.cc:740] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6158309d5094456cb4548d7568b28ce6, State: Running, Role: LEADER
I20260709 12:17:01.370132 23361 consensus_queue.cc:260] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:17:01.371996 23361 raft_consensus.cc:3060] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.375016 23435 raft_consensus.cc:2468] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 653d221b042e4553b69ee069f7768959 in term 3.
I20260709 12:17:01.376098 23252 leader_election.cc:304] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 653d221b042e4553b69ee069f7768959, acc8af67993a40b4b831b0648627df4a; no voters: 
I20260709 12:17:01.377007 23646 raft_consensus.cc:2804] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:01.377513 23646 raft_consensus.cc:697] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [term 3 LEADER]: Becoming Leader. State: Replica: 653d221b042e4553b69ee069f7768959, State: Running, Role: LEADER
I20260709 12:17:01.378530 23646 consensus_queue.cc:237] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:17:01.381148 23361 raft_consensus.cc:2468] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 653d221b042e4553b69ee069f7768959 in term 3.
I20260709 12:17:01.386253 23183 catalog_manager.cc:5697] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 reported cstate change: term changed from 2 to 3, leader changed from 6158309d5094456cb4548d7568b28ce6 (127.22.155.194) to 653d221b042e4553b69ee069f7768959 (127.22.155.193). New cstate: current_term: 3 leader_uuid: "653d221b042e4553b69ee069f7768959" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:01.439857 23636 raft_consensus.cc:993] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6: : Instructing follower 653d221b042e4553b69ee069f7768959 to start an election
I20260709 12:17:01.440419 23636 raft_consensus.cc:1081] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [term 1 LEADER]: Signalling peer 653d221b042e4553b69ee069f7768959 to start an election
I20260709 12:17:01.442204 23286 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ea8a85ced6f47deae3785a1e3c6c57c"
dest_uuid: "653d221b042e4553b69ee069f7768959"
 from {username='slave'} at 127.0.0.1:36656
I20260709 12:17:01.442720 23286 raft_consensus.cc:493] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:01.443059 23286 raft_consensus.cc:3060] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.448179 23286 raft_consensus.cc:515] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:17:01.449862 23286 leader_election.cc:290] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 2 election: Requested vote from peers 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329), acc8af67993a40b4b831b0648627df4a (127.22.155.195:37153)
I20260709 12:17:01.450989 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea8a85ced6f47deae3785a1e3c6c57c" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6158309d5094456cb4548d7568b28ce6"
I20260709 12:17:01.450995 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea8a85ced6f47deae3785a1e3c6c57c" candidate_uuid: "653d221b042e4553b69ee069f7768959" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "acc8af67993a40b4b831b0648627df4a"
I20260709 12:17:01.451843 23361 raft_consensus.cc:3055] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:01.451855 23435 raft_consensus.cc:3060] T 8ea8a85ced6f47deae3785a1e3c6c57c P acc8af67993a40b4b831b0648627df4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.452350 23361 raft_consensus.cc:740] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6158309d5094456cb4548d7568b28ce6, State: Running, Role: LEADER
I20260709 12:17:01.453292 23361 consensus_queue.cc:260] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:17:01.454274 23361 raft_consensus.cc:3060] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.457453 23435 raft_consensus.cc:2468] T 8ea8a85ced6f47deae3785a1e3c6c57c P acc8af67993a40b4b831b0648627df4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 653d221b042e4553b69ee069f7768959 in term 2.
I20260709 12:17:01.458643 23252 leader_election.cc:304] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 653d221b042e4553b69ee069f7768959, acc8af67993a40b4b831b0648627df4a; no voters: 
I20260709 12:17:01.459477 23646 raft_consensus.cc:2804] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:01.459652 23361 raft_consensus.cc:2468] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 653d221b042e4553b69ee069f7768959 in term 2.
I20260709 12:17:01.459954 23646 raft_consensus.cc:697] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959 [term 2 LEADER]: Becoming Leader. State: Replica: 653d221b042e4553b69ee069f7768959, State: Running, Role: LEADER
I20260709 12:17:01.461059 23646 consensus_queue.cc:237] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } }
I20260709 12:17:01.469826 23183 catalog_manager.cc:5697] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959 reported cstate change: term changed from 1 to 2, leader changed from 6158309d5094456cb4548d7568b28ce6 (127.22.155.194) to 653d221b042e4553b69ee069f7768959 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "653d221b042e4553b69ee069f7768959" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:01.557377 23361 raft_consensus.cc:1275] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [term 3 FOLLOWER]: Refusing update from remote peer acc8af67993a40b4b831b0648627df4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:01.558924 23608 consensus_queue.cc:1048] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:01.572989 23286 raft_consensus.cc:1275] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [term 3 FOLLOWER]: Refusing update from remote peer acc8af67993a40b4b831b0648627df4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:01.576782 23653 consensus_queue.cc:1048] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:01.701009 23361 raft_consensus.cc:1275] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 4 FOLLOWER]: Refusing update from remote peer acc8af67993a40b4b831b0648627df4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:01.702405 23653 consensus_queue.cc:1048] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:01.713629 23286 raft_consensus.cc:1275] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [term 4 FOLLOWER]: Refusing update from remote peer acc8af67993a40b4b831b0648627df4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:01.715466 23658 consensus_queue.cc:1048] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "653d221b042e4553b69ee069f7768959" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 45731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:01.924760 23361 raft_consensus.cc:1275] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6 [term 3 FOLLOWER]: Refusing update from remote peer 653d221b042e4553b69ee069f7768959: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:01.926223 23646 consensus_queue.cc:1048] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:01.936455 23435 raft_consensus.cc:1275] T e85e09af0aa44ee09ccc4b71e1843fe9 P acc8af67993a40b4b831b0648627df4a [term 3 FOLLOWER]: Refusing update from remote peer 653d221b042e4553b69ee069f7768959: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:01.938185 23646 consensus_queue.cc:1048] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:01.961577 23361 raft_consensus.cc:1275] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [term 3 FOLLOWER]: Refusing update from remote peer 653d221b042e4553b69ee069f7768959: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:01.963009 23647 consensus_queue.cc:1048] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:01.972568 23435 raft_consensus.cc:1275] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a [term 3 FOLLOWER]: Refusing update from remote peer 653d221b042e4553b69ee069f7768959: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:01.974442 23661 consensus_queue.cc:1048] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:01.999979 23435 raft_consensus.cc:1275] T 8ea8a85ced6f47deae3785a1e3c6c57c P acc8af67993a40b4b831b0648627df4a [term 2 FOLLOWER]: Refusing update from remote peer 653d221b042e4553b69ee069f7768959: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:02.001580 23646 consensus_queue.cc:1048] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acc8af67993a40b4b831b0648627df4a" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:02.011469 23361 raft_consensus.cc:1275] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Refusing update from remote peer 653d221b042e4553b69ee069f7768959: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:02.013166 23647 consensus_queue.cc:1048] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6158309d5094456cb4548d7568b28ce6" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:02.054700 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:02.059870 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:02.060262 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:03.061510 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:03.067451 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:03.067960 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:04.069149 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:04.074908 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:04.075397 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:05.076519 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:05.081569 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:05.082244 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:06.083755 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:06.091846 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:06.092394 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:07.093768 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:07.099634 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:07.100051 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:08.101136 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:08.107311 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:08.107685 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:09.108652 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:09.113968 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:09.114396 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:10.115482 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:10.121018 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:10.121512 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:11.157009 23151 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:17:11.157847 23151 tablet_server.cc:179] TabletServer@127.22.155.193:0 shutting down...
I20260709 12:17:11.192068 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:11.193120 23151 tablet_replica.cc:333] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959: stopping tablet replica
I20260709 12:17:11.193856 23151 raft_consensus.cc:2243] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:11.194437 23151 raft_consensus.cc:2272] T e7e39859435c4af59be53206dacf3cdb P 653d221b042e4553b69ee069f7768959 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:11.196856 23151 tablet_replica.cc:333] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959: stopping tablet replica
I20260709 12:17:11.197319 23151 raft_consensus.cc:2243] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:11.197700 23151 raft_consensus.cc:2272] T bd92f8c45fc8467d896f5a99d6248a83 P 653d221b042e4553b69ee069f7768959 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:11.199259 23151 tablet_replica.cc:333] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959: stopping tablet replica
I20260709 12:17:11.199743 23151 raft_consensus.cc:2243] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:11.200088 23151 raft_consensus.cc:2272] T 118c992384fb4066acc1d04490d2239b P 653d221b042e4553b69ee069f7768959 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:11.201877 23151 tablet_replica.cc:333] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959: stopping tablet replica
I20260709 12:17:11.202297 23151 raft_consensus.cc:2243] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:11.202669 23151 raft_consensus.cc:2272] T 2cee52613ef54d57831a22f94dc04557 P 653d221b042e4553b69ee069f7768959 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:11.204177 23151 tablet_replica.cc:333] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959: stopping tablet replica
I20260709 12:17:11.204600 23151 raft_consensus.cc:2243] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:11.205428 23151 raft_consensus.cc:2272] T 8ea8a85ced6f47deae3785a1e3c6c57c P 653d221b042e4553b69ee069f7768959 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:11.207207 23151 tablet_replica.cc:333] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 653d221b042e4553b69ee069f7768959: stopping tablet replica
I20260709 12:17:11.207691 23151 raft_consensus.cc:2243] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:11.208081 23151 raft_consensus.cc:2272] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 653d221b042e4553b69ee069f7768959 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:11.209712 23151 tablet_replica.cc:333] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959: stopping tablet replica
I20260709 12:17:11.210155 23151 raft_consensus.cc:2243] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:11.210883 23151 raft_consensus.cc:2272] T 0d675dc4d2174178a63abad38736adfd P 653d221b042e4553b69ee069f7768959 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:11.212698 23151 tablet_replica.cc:333] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959: stopping tablet replica
I20260709 12:17:11.213143 23151 raft_consensus.cc:2243] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:11.213599 23151 raft_consensus.cc:2272] T 57cac032df10494799e2fd4bd94aac17 P 653d221b042e4553b69ee069f7768959 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:11.215152 23151 tablet_replica.cc:333] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959: stopping tablet replica
I20260709 12:17:11.215591 23151 raft_consensus.cc:2243] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:11.216419 23151 raft_consensus.cc:2272] T e85e09af0aa44ee09ccc4b71e1843fe9 P 653d221b042e4553b69ee069f7768959 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:11.316723 23324 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.155.193:45731: connect: Connection refused (error 111)
I20260709 12:17:11.318538 23151 tablet_server.cc:196] TabletServer@127.22.155.193:0 shutdown complete.
W20260709 12:17:11.321313 23324 consensus_peers.cc:597] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6 -> Peer 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731): Couldn't send request to peer 653d221b042e4553b69ee069f7768959. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:45731: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:11.341547 23151 tablet_server.cc:179] TabletServer@127.22.155.194:0 shutting down...
I20260709 12:17:11.377137 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:11.378015 23151 tablet_replica.cc:333] T e7e39859435c4af59be53206dacf3cdb P 6158309d5094456cb4548d7568b28ce6: stopping tablet replica
I20260709 12:17:11.379149 23151 raft_consensus.cc:2243] T e7e39859435c4af59be53206dacf3cdb P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:11.379900 23151 raft_consensus.cc:2272] T e7e39859435c4af59be53206dacf3cdb P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:11.382274 23151 tablet_replica.cc:333] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6: stopping tablet replica
I20260709 12:17:11.382861 23151 raft_consensus.cc:2243] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:11.383378 23151 raft_consensus.cc:2272] T 2cee52613ef54d57831a22f94dc04557 P 6158309d5094456cb4548d7568b28ce6 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:11.383937 23398 consensus_peers.cc:597] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a -> Peer 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731): Couldn't send request to peer 653d221b042e4553b69ee069f7768959. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:45731: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:11.385499 23151 tablet_replica.cc:333] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6: stopping tablet replica
I20260709 12:17:11.386003 23151 raft_consensus.cc:2243] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:11.386395 23151 raft_consensus.cc:2272] T 8ea8a85ced6f47deae3785a1e3c6c57c P 6158309d5094456cb4548d7568b28ce6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:11.388170 23151 tablet_replica.cc:333] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6: stopping tablet replica
I20260709 12:17:11.388716 23151 raft_consensus.cc:2243] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:11.389084 23151 raft_consensus.cc:2272] T 0d675dc4d2174178a63abad38736adfd P 6158309d5094456cb4548d7568b28ce6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:11.391134 23151 tablet_replica.cc:333] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6: stopping tablet replica
I20260709 12:17:11.391674 23151 raft_consensus.cc:2243] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:11.392593 23151 raft_consensus.cc:2272] T 118c992384fb4066acc1d04490d2239b P 6158309d5094456cb4548d7568b28ce6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:11.394665 23151 tablet_replica.cc:333] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6: stopping tablet replica
I20260709 12:17:11.395169 23151 raft_consensus.cc:2243] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:17:11.395406 23398 consensus_peers.cc:597] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a -> Peer 653d221b042e4553b69ee069f7768959 (127.22.155.193:45731): Couldn't send request to peer 653d221b042e4553b69ee069f7768959. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:45731: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:11.395640 23151 raft_consensus.cc:2272] T e85e09af0aa44ee09ccc4b71e1843fe9 P 6158309d5094456cb4548d7568b28ce6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:11.397471 23151 tablet_replica.cc:333] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6: stopping tablet replica
I20260709 12:17:11.398017 23151 raft_consensus.cc:2243] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:17:11.398865 23151 raft_consensus.cc:2272] T bd92f8c45fc8467d896f5a99d6248a83 P 6158309d5094456cb4548d7568b28ce6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:11.400694 23151 tablet_replica.cc:333] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6: stopping tablet replica
I20260709 12:17:11.401175 23151 raft_consensus.cc:2243] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:11.401978 23151 raft_consensus.cc:2272] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P 6158309d5094456cb4548d7568b28ce6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:11.403746 23151 tablet_replica.cc:333] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6: stopping tablet replica
I20260709 12:17:11.404208 23151 raft_consensus.cc:2243] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:11.404719 23151 raft_consensus.cc:2272] T 57cac032df10494799e2fd4bd94aac17 P 6158309d5094456cb4548d7568b28ce6 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:11.409032 23398 consensus_peers.cc:597] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a -> Peer 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329): Couldn't send request to peer 6158309d5094456cb4548d7568b28ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:11.434870 23151 tablet_server.cc:196] TabletServer@127.22.155.194:0 shutdown complete.
I20260709 12:17:11.458773 23151 tablet_server.cc:179] TabletServer@127.22.155.195:0 shutting down...
W20260709 12:17:11.467341 23398 consensus_peers.cc:597] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a -> Peer 6158309d5094456cb4548d7568b28ce6 (127.22.155.194:34329): Couldn't send request to peer 6158309d5094456cb4548d7568b28ce6. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:34329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:11.498989 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:11.499924 23151 tablet_replica.cc:333] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a: stopping tablet replica
I20260709 12:17:11.500613 23151 raft_consensus.cc:2243] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:11.501685 23151 raft_consensus.cc:2272] T e7e39859435c4af59be53206dacf3cdb P acc8af67993a40b4b831b0648627df4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:11.503677 23151 tablet_replica.cc:333] T 8ea8a85ced6f47deae3785a1e3c6c57c P acc8af67993a40b4b831b0648627df4a: stopping tablet replica
I20260709 12:17:11.504206 23151 raft_consensus.cc:2243] T 8ea8a85ced6f47deae3785a1e3c6c57c P acc8af67993a40b4b831b0648627df4a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:11.504742 23151 raft_consensus.cc:2272] T 8ea8a85ced6f47deae3785a1e3c6c57c P acc8af67993a40b4b831b0648627df4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:11.506527 23151 tablet_replica.cc:333] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a: stopping tablet replica
I20260709 12:17:11.507052 23151 raft_consensus.cc:2243] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:11.507853 23151 raft_consensus.cc:2272] T 2cee52613ef54d57831a22f94dc04557 P acc8af67993a40b4b831b0648627df4a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:11.509606 23151 tablet_replica.cc:333] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a: stopping tablet replica
I20260709 12:17:11.510100 23151 raft_consensus.cc:2243] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:17:11.510835 23151 raft_consensus.cc:2272] T 57cac032df10494799e2fd4bd94aac17 P acc8af67993a40b4b831b0648627df4a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:11.512486 23151 tablet_replica.cc:333] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P acc8af67993a40b4b831b0648627df4a: stopping tablet replica
I20260709 12:17:11.513083 23151 raft_consensus.cc:2243] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P acc8af67993a40b4b831b0648627df4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:11.513499 23151 raft_consensus.cc:2272] T 0ab8f653ff9e44e9a34ef9bee94e4a05 P acc8af67993a40b4b831b0648627df4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:11.515161 23151 tablet_replica.cc:333] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a: stopping tablet replica
I20260709 12:17:11.515658 23151 raft_consensus.cc:2243] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:11.516078 23151 raft_consensus.cc:2272] T bd92f8c45fc8467d896f5a99d6248a83 P acc8af67993a40b4b831b0648627df4a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:11.517808 23151 tablet_replica.cc:333] T e85e09af0aa44ee09ccc4b71e1843fe9 P acc8af67993a40b4b831b0648627df4a: stopping tablet replica
I20260709 12:17:11.518271 23151 raft_consensus.cc:2243] T e85e09af0aa44ee09ccc4b71e1843fe9 P acc8af67993a40b4b831b0648627df4a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:11.518712 23151 raft_consensus.cc:2272] T e85e09af0aa44ee09ccc4b71e1843fe9 P acc8af67993a40b4b831b0648627df4a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:11.520424 23151 tablet_replica.cc:333] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a: stopping tablet replica
I20260709 12:17:11.520951 23151 raft_consensus.cc:2243] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:11.521378 23151 raft_consensus.cc:2272] T 0d675dc4d2174178a63abad38736adfd P acc8af67993a40b4b831b0648627df4a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:11.523087 23151 tablet_replica.cc:333] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a: stopping tablet replica
I20260709 12:17:11.523561 23151 raft_consensus.cc:2243] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:11.523993 23151 raft_consensus.cc:2272] T 118c992384fb4066acc1d04490d2239b P acc8af67993a40b4b831b0648627df4a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:11.554651 23151 tablet_server.cc:196] TabletServer@127.22.155.195:0 shutdown complete.
I20260709 12:17:11.575798 23151 master.cc:562] Master@127.22.155.254:43651 shutting down...
I20260709 12:17:11.718546 23151 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 813e6e6d2359416ea3078f44d505a5f6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:11.719256 23151 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 813e6e6d2359416ea3078f44d505a5f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:11.719606 23151 tablet_replica.cc:333] T 00000000000000000000000000000000 P 813e6e6d2359416ea3078f44d505a5f6: stopping tablet replica
I20260709 12:17:11.740957 23151 master.cc:584] Master@127.22.155.254:43651 shutdown complete.
6158309d5094456cb4548d7568b28ce6  4
653d221b042e4553b69ee069f7768959  4
acc8af67993a40b4b831b0648627df4a  1
6158309d5094456cb4548d7568b28ce6  3
653d221b042e4553b69ee069f7768959  3
acc8af67993a40b4b831b0648627df4a  3
6158309d5094456cb4548d7568b28ce6  8
653d221b042e4553b69ee069f7768959  0
acc8af67993a40b4b831b0648627df4a  1
6158309d5094456cb4548d7568b28ce6  3
653d221b042e4553b69ee069f7768959  3
acc8af67993a40b4b831b0648627df4a  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (31349 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:17:11.790126 23151 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.155.254:36387
I20260709 12:17:11.791416 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:11.798224 23677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:11.798206 23678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:11.800315 23680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:11.800848 23151 server_base.cc:1061] running on GCE node
I20260709 12:17:11.802007 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:11.802235 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:11.802443 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599431802424 us; error 0 us; skew 500 ppm
I20260709 12:17:11.803030 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:11.805687 23151 webserver.cc:533] Webserver started at http://127.22.155.254:37677/ using document root <none> and password file <none>
I20260709 12:17:11.806217 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:11.806463 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:11.806756 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:11.807961 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599400258298-23151-0/minicluster-data/master-0-root/instance:
uuid: "684b39eaad3249a59c92fb05d0d2576b"
format_stamp: "Formatted at 2026-07-09 12:17:11 on dist-test-slave-p7fg"
I20260709 12:17:11.812758 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 12:17:11.816501 23685 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:11.817472 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:17:11.817866 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599400258298-23151-0/minicluster-data/master-0-root
uuid: "684b39eaad3249a59c92fb05d0d2576b"
format_stamp: "Formatted at 2026-07-09 12:17:11 on dist-test-slave-p7fg"
I20260709 12:17:11.818205 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599400258298-23151-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599400258298-23151-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599400258298-23151-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:11.847796 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:11.849211 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:11.893428 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.254:36387
I20260709 12:17:11.893560 23736 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.254:36387 every 8 connection(s)
I20260709 12:17:11.897781 23737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.908552 23737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 684b39eaad3249a59c92fb05d0d2576b: Bootstrap starting.
I20260709 12:17:11.913967 23737 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 684b39eaad3249a59c92fb05d0d2576b: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:11.918888 23737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 684b39eaad3249a59c92fb05d0d2576b: No bootstrap required, opened a new log
I20260709 12:17:11.921446 23737 raft_consensus.cc:359] T 00000000000000000000000000000000 P 684b39eaad3249a59c92fb05d0d2576b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "684b39eaad3249a59c92fb05d0d2576b" member_type: VOTER }
I20260709 12:17:11.921902 23737 raft_consensus.cc:385] T 00000000000000000000000000000000 P 684b39eaad3249a59c92fb05d0d2576b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:11.922101 23737 raft_consensus.cc:740] T 00000000000000000000000000000000 P 684b39eaad3249a59c92fb05d0d2576b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 684b39eaad3249a59c92fb05d0d2576b, State: Initialized, Role: FOLLOWER
I20260709 12:17:11.922715 23737 consensus_queue.cc:260] T 00000000000000000000000000000000 P 684b39eaad3249a59c92fb05d0d2576b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "684b39eaad3249a59c92fb05d0d2576b" member_type: VOTER }
I20260709 12:17:11.923163 23737 raft_consensus.cc:399] T 00000000000000000000000000000000 P 684b39eaad3249a59c92fb05d0d2576b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:17:11.923391 23737 raft_consensus.cc:493] T 00000000000000000000000000000000 P 684b39eaad3249a59c92fb05d0d2576b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:17:11.923615 23737 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 684b39eaad3249a59c92fb05d0d2576b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:11.928742 23737 raft_consensus.cc:515] T 00000000000000000000000000000000 P 684b39eaad3249a59c92fb05d0d2576b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "684b39eaad3249a59c92fb05d0d2576b" member_type: VOTER }
I20260709 12:17:11.929246 23737 leader_election.cc:304] T 00000000000000000000000000000000 P 684b39eaad3249a59c92fb05d0d2576b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 684b39eaad3249a59c92fb05d0d2576b; no voters: 
I20260709 12:17:11.930573 23737 leader_election.cc:290] T 00000000000000000000000000000000 P 684b39eaad3249a59c92fb05d0d2576b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:17:11.931106 23740 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 684b39eaad3249a59c92fb05d0d2576b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:11.932695 23740 raft_consensus.cc:697] T 00000000000000000000000000000000 P 684b39eaad3249a59c92fb05d0d2576b [term 1 LEADER]: Becoming Leader. State: Replica: 684b39eaad3249a59c92fb05d0d2576b, State: Running, Role: LEADER
I20260709 12:17:11.933525 23740 consensus_queue.cc:237] T 00000000000000000000000000000000 P 684b39eaad3249a59c92fb05d0d2576b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "684b39eaad3249a59c92fb05d0d2576b" member_type: VOTER }
I20260709 12:17:11.934001 23737 sys_catalog.cc:565] T 00000000000000000000000000000000 P 684b39eaad3249a59c92fb05d0d2576b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:17:11.939719 23741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 684b39eaad3249a59c92fb05d0d2576b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "684b39eaad3249a59c92fb05d0d2576b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "684b39eaad3249a59c92fb05d0d2576b" member_type: VOTER } }
I20260709 12:17:11.940676 23741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 684b39eaad3249a59c92fb05d0d2576b [sys.catalog]: This master's current role is: LEADER
I20260709 12:17:11.940418 23742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 684b39eaad3249a59c92fb05d0d2576b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 684b39eaad3249a59c92fb05d0d2576b. Latest consensus state: current_term: 1 leader_uuid: "684b39eaad3249a59c92fb05d0d2576b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "684b39eaad3249a59c92fb05d0d2576b" member_type: VOTER } }
I20260709 12:17:11.941349 23742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 684b39eaad3249a59c92fb05d0d2576b [sys.catalog]: This master's current role is: LEADER
I20260709 12:17:11.943007 23749 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:17:11.948107 23749 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:17:11.950820 23151 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:17:11.957896 23749 catalog_manager.cc:1383] Generated new cluster ID: c87baec99c9047e4839a5153601c28a2
I20260709 12:17:11.958272 23749 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:17:11.976276 23749 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:17:11.977662 23749 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:17:11.989955 23749 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 684b39eaad3249a59c92fb05d0d2576b: Generated new TSK 0
I20260709 12:17:11.990602 23749 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:17:12.017731 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:12.024142 23758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:12.026019 23759 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:12.027403 23761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:12.027731 23151 server_base.cc:1061] running on GCE node
I20260709 12:17:12.028807 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:12.029002 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:12.029130 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599432029118 us; error 0 us; skew 500 ppm
I20260709 12:17:12.029618 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:12.032090 23151 webserver.cc:533] Webserver started at http://127.22.155.193:34323/ using document root <none> and password file <none>
I20260709 12:17:12.032572 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:12.032832 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:12.033082 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:12.034165 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599400258298-23151-0/minicluster-data/ts-0-root/instance:
uuid: "cdf181ff3be844e8b834e63e4b7869b7"
format_stamp: "Formatted at 2026-07-09 12:17:12 on dist-test-slave-p7fg"
I20260709 12:17:12.039099 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:17:12.042814 23766 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:12.043702 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:17:12.044147 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599400258298-23151-0/minicluster-data/ts-0-root
uuid: "cdf181ff3be844e8b834e63e4b7869b7"
format_stamp: "Formatted at 2026-07-09 12:17:12 on dist-test-slave-p7fg"
I20260709 12:17:12.044517 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599400258298-23151-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599400258298-23151-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599400258298-23151-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:12.069191 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:12.070780 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:12.072758 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:12.075433 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:12.075711 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:12.076006 23151 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:12.076226 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:12.126987 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.193:42899
I20260709 12:17:12.127069 23828 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.193:42899 every 8 connection(s)
I20260709 12:17:12.132676 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:12.141251 23833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:12.142841 23834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:12.146255 23836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:12.147713 23151 server_base.cc:1061] running on GCE node
I20260709 12:17:12.148118 23829 heartbeater.cc:344] Connected to a master server at 127.22.155.254:36387
I20260709 12:17:12.148481 23829 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:12.149180 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:17:12.149269 23829 heartbeater.cc:507] Master 127.22.155.254:36387 requested a full tablet report, sending...
W20260709 12:17:12.149479 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:12.149753 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599432149728 us; error 0 us; skew 500 ppm
I20260709 12:17:12.150619 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:12.151722 23702 ts_manager.cc:194] Registered new tserver with Master: cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899)
I20260709 12:17:12.153697 23702 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56196
I20260709 12:17:12.154111 23151 webserver.cc:533] Webserver started at http://127.22.155.194:39079/ using document root <none> and password file <none>
I20260709 12:17:12.154877 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:12.155208 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:12.155547 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:12.157006 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599400258298-23151-0/minicluster-data/ts-1-root/instance:
uuid: "4d358937860e459f9e166a492245ea21"
format_stamp: "Formatted at 2026-07-09 12:17:12 on dist-test-slave-p7fg"
I20260709 12:17:12.162163 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:17:12.165947 23841 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:12.166919 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:17:12.167196 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599400258298-23151-0/minicluster-data/ts-1-root
uuid: "4d358937860e459f9e166a492245ea21"
format_stamp: "Formatted at 2026-07-09 12:17:12 on dist-test-slave-p7fg"
I20260709 12:17:12.167511 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599400258298-23151-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599400258298-23151-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599400258298-23151-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:12.178905 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:12.180154 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:12.181717 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:12.184018 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:12.184195 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:12.184500 23151 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:12.184732 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
I20260709 12:17:12.227602 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.194:41429
I20260709 12:17:12.227735 23903 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.194:41429 every 8 connection(s)
I20260709 12:17:12.232379 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:12.239346 23907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:12.241995 23908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:12.245147 23910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:12.245551 23151 server_base.cc:1061] running on GCE node
I20260709 12:17:12.246896 23904 heartbeater.cc:344] Connected to a master server at 127.22.155.254:36387
I20260709 12:17:12.247011 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:12.247370 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:12.247465 23904 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:12.247601 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599432247576 us; error 0 us; skew 500 ppm
I20260709 12:17:12.248463 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:12.248463 23904 heartbeater.cc:507] Master 127.22.155.254:36387 requested a full tablet report, sending...
I20260709 12:17:12.251281 23702 ts_manager.cc:194] Registered new tserver with Master: 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429)
I20260709 12:17:12.251880 23151 webserver.cc:533] Webserver started at http://127.22.155.195:37713/ using document root <none> and password file <none>
I20260709 12:17:12.252501 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:12.252758 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:12.253052 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:12.253000 23702 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56208
I20260709 12:17:12.254918 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599400258298-23151-0/minicluster-data/ts-2-root/instance:
uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
format_stamp: "Formatted at 2026-07-09 12:17:12 on dist-test-slave-p7fg"
I20260709 12:17:12.259804 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:17:12.263523 23915 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:12.264577 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:17:12.264936 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599400258298-23151-0/minicluster-data/ts-2-root
uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
format_stamp: "Formatted at 2026-07-09 12:17:12 on dist-test-slave-p7fg"
I20260709 12:17:12.265203 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599400258298-23151-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599400258298-23151-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599400258298-23151-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:12.289310 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:12.290495 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:12.291960 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:12.294553 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:12.294814 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:12.295167 23151 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:12.295336 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:12.339600 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.195:41371
I20260709 12:17:12.339824 23977 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.195:41371 every 8 connection(s)
I20260709 12:17:12.355608 23978 heartbeater.cc:344] Connected to a master server at 127.22.155.254:36387
I20260709 12:17:12.356084 23978 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:12.356973 23978 heartbeater.cc:507] Master 127.22.155.254:36387 requested a full tablet report, sending...
I20260709 12:17:12.359138 23702 ts_manager.cc:194] Registered new tserver with Master: 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:12.360183 23151 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017238393s
I20260709 12:17:12.360769 23702 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56222
I20260709 12:17:12.388724 23702 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56228:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:17:12.391677 23702 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:17:12.470151 23943 tablet_service.cc:1511] Processing CreateTablet for tablet 8d39e331a2424292bc6f2c8bd10500d8 (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:17:12.470816 23942 tablet_service.cc:1511] Processing CreateTablet for tablet 6b9b9a00169a4e9baa1cc18be0940f54 (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:17:12.471531 23943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d39e331a2424292bc6f2c8bd10500d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.472489 23942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9b9a00169a4e9baa1cc18be0940f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.477327 23869 tablet_service.cc:1511] Processing CreateTablet for tablet 8d39e331a2424292bc6f2c8bd10500d8 (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:17:12.478005 23868 tablet_service.cc:1511] Processing CreateTablet for tablet 6b9b9a00169a4e9baa1cc18be0940f54 (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:17:12.478964 23869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d39e331a2424292bc6f2c8bd10500d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.479646 23868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9b9a00169a4e9baa1cc18be0940f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.485917 23794 tablet_service.cc:1511] Processing CreateTablet for tablet 8d39e331a2424292bc6f2c8bd10500d8 (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:17:12.486006 23941 tablet_service.cc:1511] Processing CreateTablet for tablet cc3223e00e774a718ab27e3a4f998bd4 (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:17:12.487362 23794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d39e331a2424292bc6f2c8bd10500d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.487618 23941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc3223e00e774a718ab27e3a4f998bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.489887 23793 tablet_service.cc:1511] Processing CreateTablet for tablet 6b9b9a00169a4e9baa1cc18be0940f54 (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:17:12.491284 23793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9b9a00169a4e9baa1cc18be0940f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.493366 23792 tablet_service.cc:1511] Processing CreateTablet for tablet cc3223e00e774a718ab27e3a4f998bd4 (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:17:12.494740 23792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc3223e00e774a718ab27e3a4f998bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.499264 23867 tablet_service.cc:1511] Processing CreateTablet for tablet cc3223e00e774a718ab27e3a4f998bd4 (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:17:12.500780 23867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc3223e00e774a718ab27e3a4f998bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.504077 23791 tablet_service.cc:1511] Processing CreateTablet for tablet 9921ab8d07eb4dc9b603c5a95302e70f (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:17:12.505720 23791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9921ab8d07eb4dc9b603c5a95302e70f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.505272 23866 tablet_service.cc:1511] Processing CreateTablet for tablet 9921ab8d07eb4dc9b603c5a95302e70f (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:17:12.508997 23866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9921ab8d07eb4dc9b603c5a95302e70f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.510442 23940 tablet_service.cc:1511] Processing CreateTablet for tablet 9921ab8d07eb4dc9b603c5a95302e70f (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:17:12.511921 23940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9921ab8d07eb4dc9b603c5a95302e70f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.525475 23790 tablet_service.cc:1511] Processing CreateTablet for tablet 09f952f11a13489098c690696373b9b7 (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:17:12.527452 23790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09f952f11a13489098c690696373b9b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.547376 23868 tablet_service.cc:1511] Processing CreateTablet for tablet 09f952f11a13489098c690696373b9b7 (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:17:12.548731 23868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09f952f11a13489098c690696373b9b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.569314 23941 tablet_service.cc:1511] Processing CreateTablet for tablet 09f952f11a13489098c690696373b9b7 (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:17:12.570830 23941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09f952f11a13489098c690696373b9b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.572259 23794 tablet_service.cc:1511] Processing CreateTablet for tablet fa351a9bbfba435186b9cb98204fbb64 (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:17:12.573714 23794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa351a9bbfba435186b9cb98204fbb64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.574940 23869 tablet_service.cc:1511] Processing CreateTablet for tablet fa351a9bbfba435186b9cb98204fbb64 (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:17:12.576339 23869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa351a9bbfba435186b9cb98204fbb64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.575146 23993 tablet_bootstrap.cc:492] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21: Bootstrap starting.
I20260709 12:17:12.575186 23994 tablet_bootstrap.cc:492] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73: Bootstrap starting.
I20260709 12:17:12.586983 23943 tablet_service.cc:1511] Processing CreateTablet for tablet fa351a9bbfba435186b9cb98204fbb64 (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:17:12.587910 23994 tablet_bootstrap.cc:654] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.588848 23943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa351a9bbfba435186b9cb98204fbb64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.590613 23866 tablet_service.cc:1511] Processing CreateTablet for tablet 512dbe65edfe4c3d996d129d188325c0 (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:17:12.591946 23866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 512dbe65edfe4c3d996d129d188325c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.594234 23792 tablet_service.cc:1511] Processing CreateTablet for tablet 512dbe65edfe4c3d996d129d188325c0 (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:17:12.596082 23792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 512dbe65edfe4c3d996d129d188325c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.603277 23940 tablet_service.cc:1511] Processing CreateTablet for tablet 512dbe65edfe4c3d996d129d188325c0 (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:17:12.605077 23940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 512dbe65edfe4c3d996d129d188325c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.610142 23867 tablet_service.cc:1511] Processing CreateTablet for tablet cb47341c94564f6d828ff2feabe4ec0f (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:17:12.611589 23867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb47341c94564f6d828ff2feabe4ec0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.619900 23993 tablet_bootstrap.cc:654] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.621866 23995 tablet_bootstrap.cc:492] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7: Bootstrap starting.
I20260709 12:17:12.622946 23790 tablet_service.cc:1511] Processing CreateTablet for tablet cb47341c94564f6d828ff2feabe4ec0f (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:17:12.624331 23790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb47341c94564f6d828ff2feabe4ec0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.636509 23942 tablet_service.cc:1511] Processing CreateTablet for tablet cb47341c94564f6d828ff2feabe4ec0f (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:17:12.637481 23994 tablet_bootstrap.cc:492] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73: No bootstrap required, opened a new log
I20260709 12:17:12.637895 23942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb47341c94564f6d828ff2feabe4ec0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.638054 23994 ts_tablet_manager.cc:1403] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73: Time spent bootstrapping tablet: real 0.063s	user 0.008s	sys 0.005s
I20260709 12:17:12.643548 23994 raft_consensus.cc:359] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:12.644325 23994 raft_consensus.cc:385] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.644650 23994 raft_consensus.cc:740] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77d535b4d74e4f59b15c3fa20dbdbf73, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.645439 23994 consensus_queue.cc:260] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:12.655684 23794 tablet_service.cc:1511] Processing CreateTablet for tablet 8076306a710440779e266942ec39c883 (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:17:12.657196 23794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8076306a710440779e266942ec39c883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.657073 23868 tablet_service.cc:1511] Processing CreateTablet for tablet 8076306a710440779e266942ec39c883 (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:17:12.658556 23868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8076306a710440779e266942ec39c883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.661346 23978 heartbeater.cc:499] Master 127.22.155.254:36387 was elected leader, sending a full tablet report...
I20260709 12:17:12.668136 23994 ts_tablet_manager.cc:1434] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73: Time spent starting tablet: real 0.030s	user 0.011s	sys 0.008s
I20260709 12:17:12.668438 23995 tablet_bootstrap.cc:654] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.669307 23994 tablet_bootstrap.cc:492] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73: Bootstrap starting.
I20260709 12:17:12.669346 23792 tablet_service.cc:1511] Processing CreateTablet for tablet 78d98d7b027f40cdac191caf3e580679 (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:17:12.670873 23792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78d98d7b027f40cdac191caf3e580679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.681768 23942 tablet_service.cc:1511] Processing CreateTablet for tablet 8076306a710440779e266942ec39c883 (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:17:12.685426 23994 tablet_bootstrap.cc:654] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.687654 23993 tablet_bootstrap.cc:492] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21: No bootstrap required, opened a new log
I20260709 12:17:12.688198 23993 ts_tablet_manager.cc:1403] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21: Time spent bootstrapping tablet: real 0.113s	user 0.014s	sys 0.000s
I20260709 12:17:12.688272 23942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8076306a710440779e266942ec39c883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.692528 23993 raft_consensus.cc:359] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } }
I20260709 12:17:12.695427 23993 raft_consensus.cc:385] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.695757 23993 raft_consensus.cc:740] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d358937860e459f9e166a492245ea21, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.696548 23993 consensus_queue.cc:260] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } }
I20260709 12:17:12.700610 23995 tablet_bootstrap.cc:492] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7: No bootstrap required, opened a new log
I20260709 12:17:12.701180 23869 tablet_service.cc:1511] Processing CreateTablet for tablet 78d98d7b027f40cdac191caf3e580679 (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:17:12.698310 23943 tablet_service.cc:1511] Processing CreateTablet for tablet 78d98d7b027f40cdac191caf3e580679 (DEFAULT_TABLE table=test-workload [id=f3be19f8de6648efb82cb14b1330ef5c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:17:12.701218 23995 ts_tablet_manager.cc:1403] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7: Time spent bootstrapping tablet: real 0.080s	user 0.009s	sys 0.004s
I20260709 12:17:12.703518 23943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78d98d7b027f40cdac191caf3e580679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.706445 23995 raft_consensus.cc:359] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:12.707310 23995 raft_consensus.cc:385] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.707661 23995 raft_consensus.cc:740] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.702535 23869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78d98d7b027f40cdac191caf3e580679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:12.708338 23904 heartbeater.cc:499] Master 127.22.155.254:36387 was elected leader, sending a full tablet report...
I20260709 12:17:12.709554 23993 ts_tablet_manager.cc:1434] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 12:17:12.710631 23993 tablet_bootstrap.cc:492] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21: Bootstrap starting.
I20260709 12:17:12.713702 23994 tablet_bootstrap.cc:492] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73: No bootstrap required, opened a new log
I20260709 12:17:12.714298 23994 ts_tablet_manager.cc:1403] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.011s
I20260709 12:17:12.717687 23993 tablet_bootstrap.cc:654] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.717567 23994 raft_consensus.cc:359] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:12.718637 23994 raft_consensus.cc:385] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.719020 23994 raft_consensus.cc:740] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77d535b4d74e4f59b15c3fa20dbdbf73, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.719867 23994 consensus_queue.cc:260] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:12.720165 23995 consensus_queue.cc:260] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:12.722460 23994 ts_tablet_manager.cc:1434] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:17:12.723524 23994 tablet_bootstrap.cc:492] T 8d39e331a2424292bc6f2c8bd10500d8 P 77d535b4d74e4f59b15c3fa20dbdbf73: Bootstrap starting.
I20260709 12:17:12.729569 23997 raft_consensus.cc:493] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.729892 23994 tablet_bootstrap.cc:654] T 8d39e331a2424292bc6f2c8bd10500d8 P 77d535b4d74e4f59b15c3fa20dbdbf73: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.730345 23997 raft_consensus.cc:515] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:12.758792 23997 leader_election.cc:290] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429)
I20260709 12:17:12.758926 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc3223e00e774a718ab27e3a4f998bd4" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7" is_pre_election: true
W20260709 12:17:12.761441 23919 leader_election.cc:343] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:12.778584 23994 tablet_bootstrap.cc:492] T 8d39e331a2424292bc6f2c8bd10500d8 P 77d535b4d74e4f59b15c3fa20dbdbf73: No bootstrap required, opened a new log
I20260709 12:17:12.779196 23994 ts_tablet_manager.cc:1403] T 8d39e331a2424292bc6f2c8bd10500d8 P 77d535b4d74e4f59b15c3fa20dbdbf73: Time spent bootstrapping tablet: real 0.056s	user 0.021s	sys 0.033s
I20260709 12:17:12.781338 23879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc3223e00e774a718ab27e3a4f998bd4" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d358937860e459f9e166a492245ea21" is_pre_election: true
I20260709 12:17:12.781766 23994 raft_consensus.cc:359] T 8d39e331a2424292bc6f2c8bd10500d8 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } }
I20260709 12:17:12.782526 23994 raft_consensus.cc:385] T 8d39e331a2424292bc6f2c8bd10500d8 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.782835 23994 raft_consensus.cc:740] T 8d39e331a2424292bc6f2c8bd10500d8 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77d535b4d74e4f59b15c3fa20dbdbf73, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.783723 23994 consensus_queue.cc:260] T 8d39e331a2424292bc6f2c8bd10500d8 P 77d535b4d74e4f59b15c3fa20dbdbf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } }
W20260709 12:17:12.783947 23917 leader_election.cc:343] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:12.784855 23829 heartbeater.cc:499] Master 127.22.155.254:36387 was elected leader, sending a full tablet report...
I20260709 12:17:12.784724 23917 leader_election.cc:304] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77d535b4d74e4f59b15c3fa20dbdbf73; no voters: 4d358937860e459f9e166a492245ea21, cdf181ff3be844e8b834e63e4b7869b7
I20260709 12:17:12.784138 23995 ts_tablet_manager.cc:1434] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7: Time spent starting tablet: real 0.081s	user 0.011s	sys 0.000s
I20260709 12:17:12.788543 23995 tablet_bootstrap.cc:492] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7: Bootstrap starting.
I20260709 12:17:12.789996 23994 ts_tablet_manager.cc:1434] T 8d39e331a2424292bc6f2c8bd10500d8 P 77d535b4d74e4f59b15c3fa20dbdbf73: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:17:12.790256 23993 tablet_bootstrap.cc:492] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21: No bootstrap required, opened a new log
I20260709 12:17:12.790830 23993 ts_tablet_manager.cc:1403] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21: Time spent bootstrapping tablet: real 0.080s	user 0.021s	sys 0.052s
I20260709 12:17:12.794045 23993 raft_consensus.cc:359] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:12.794832 23993 raft_consensus.cc:385] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.795142 23993 raft_consensus.cc:740] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d358937860e459f9e166a492245ea21, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.795578 23995 tablet_bootstrap.cc:654] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.795905 23994 tablet_bootstrap.cc:492] T 9921ab8d07eb4dc9b603c5a95302e70f P 77d535b4d74e4f59b15c3fa20dbdbf73: Bootstrap starting.
I20260709 12:17:12.796478 23997 raft_consensus.cc:2749] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:12.795921 23993 consensus_queue.cc:260] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:12.802851 23994 tablet_bootstrap.cc:654] T 9921ab8d07eb4dc9b603c5a95302e70f P 77d535b4d74e4f59b15c3fa20dbdbf73: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.810046 23993 ts_tablet_manager.cc:1434] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.003s
I20260709 12:17:12.811514 23993 tablet_bootstrap.cc:492] T 6b9b9a00169a4e9baa1cc18be0940f54 P 4d358937860e459f9e166a492245ea21: Bootstrap starting.
I20260709 12:17:12.813752 24001 raft_consensus.cc:493] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.814520 24001 raft_consensus.cc:515] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } }
I20260709 12:17:12.822449 24001 leader_election.cc:290] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
W20260709 12:17:12.847432 23917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:41429, user_credentials={real_user=slave}} blocked reactor thread for 63728.7us
I20260709 12:17:12.852599 23993 tablet_bootstrap.cc:654] T 6b9b9a00169a4e9baa1cc18be0940f54 P 4d358937860e459f9e166a492245ea21: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.877310 23995 tablet_bootstrap.cc:492] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7: No bootstrap required, opened a new log
I20260709 12:17:12.877939 23995 ts_tablet_manager.cc:1403] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7: Time spent bootstrapping tablet: real 0.090s	user 0.038s	sys 0.049s
I20260709 12:17:12.880221 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d39e331a2424292bc6f2c8bd10500d8" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7" is_pre_election: true
I20260709 12:17:12.881625 23995 raft_consensus.cc:359] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:12.882468 23995 raft_consensus.cc:385] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:17:12.882541 23845 leader_election.cc:343] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:12.882920 23995 raft_consensus.cc:740] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.883872 23995 consensus_queue.cc:260] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:12.884559 23953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d39e331a2424292bc6f2c8bd10500d8" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" is_pre_election: true
I20260709 12:17:12.885232 23953 raft_consensus.cc:2468] T 8d39e331a2424292bc6f2c8bd10500d8 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d358937860e459f9e166a492245ea21 in term 0.
I20260709 12:17:12.886034 23994 tablet_bootstrap.cc:492] T 9921ab8d07eb4dc9b603c5a95302e70f P 77d535b4d74e4f59b15c3fa20dbdbf73: No bootstrap required, opened a new log
I20260709 12:17:12.886124 23995 ts_tablet_manager.cc:1434] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:17:12.886689 23994 ts_tablet_manager.cc:1403] T 9921ab8d07eb4dc9b603c5a95302e70f P 77d535b4d74e4f59b15c3fa20dbdbf73: Time spent bootstrapping tablet: real 0.091s	user 0.047s	sys 0.031s
I20260709 12:17:12.886745 23842 leader_election.cc:304] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d358937860e459f9e166a492245ea21, 77d535b4d74e4f59b15c3fa20dbdbf73; no voters: cdf181ff3be844e8b834e63e4b7869b7
I20260709 12:17:12.887207 23995 tablet_bootstrap.cc:492] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7: Bootstrap starting.
I20260709 12:17:12.888145 24001 raft_consensus.cc:2804] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:12.888532 24001 raft_consensus.cc:493] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.888906 24001 raft_consensus.cc:3060] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:12.889856 23994 raft_consensus.cc:359] T 9921ab8d07eb4dc9b603c5a95302e70f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:12.890616 23994 raft_consensus.cc:385] T 9921ab8d07eb4dc9b603c5a95302e70f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.890892 23994 raft_consensus.cc:740] T 9921ab8d07eb4dc9b603c5a95302e70f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77d535b4d74e4f59b15c3fa20dbdbf73, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.891798 23994 consensus_queue.cc:260] T 9921ab8d07eb4dc9b603c5a95302e70f P 77d535b4d74e4f59b15c3fa20dbdbf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:12.894357 23995 tablet_bootstrap.cc:654] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.897403 23994 ts_tablet_manager.cc:1434] T 9921ab8d07eb4dc9b603c5a95302e70f P 77d535b4d74e4f59b15c3fa20dbdbf73: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:17:12.897771 23993 tablet_bootstrap.cc:492] T 6b9b9a00169a4e9baa1cc18be0940f54 P 4d358937860e459f9e166a492245ea21: No bootstrap required, opened a new log
I20260709 12:17:12.898399 23993 ts_tablet_manager.cc:1403] T 6b9b9a00169a4e9baa1cc18be0940f54 P 4d358937860e459f9e166a492245ea21: Time spent bootstrapping tablet: real 0.087s	user 0.029s	sys 0.011s
I20260709 12:17:12.898550 23994 tablet_bootstrap.cc:492] T 512dbe65edfe4c3d996d129d188325c0 P 77d535b4d74e4f59b15c3fa20dbdbf73: Bootstrap starting.
I20260709 12:17:12.901944 23993 raft_consensus.cc:359] T 6b9b9a00169a4e9baa1cc18be0940f54 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:12.897245 24001 raft_consensus.cc:515] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } }
I20260709 12:17:12.905416 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d39e331a2424292bc6f2c8bd10500d8" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
I20260709 12:17:12.905970 23994 tablet_bootstrap.cc:654] T 512dbe65edfe4c3d996d129d188325c0 P 77d535b4d74e4f59b15c3fa20dbdbf73: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:12.907079 23845 leader_election.cc:343] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:12.909252 24001 leader_election.cc:290] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 election: Requested vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:12.909547 23953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d39e331a2424292bc6f2c8bd10500d8" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
I20260709 12:17:12.909780 23993 raft_consensus.cc:385] T 6b9b9a00169a4e9baa1cc18be0940f54 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.910324 23953 raft_consensus.cc:3060] T 8d39e331a2424292bc6f2c8bd10500d8 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:12.910465 23993 raft_consensus.cc:740] T 6b9b9a00169a4e9baa1cc18be0940f54 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d358937860e459f9e166a492245ea21, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.912156 23993 consensus_queue.cc:260] T 6b9b9a00169a4e9baa1cc18be0940f54 P 4d358937860e459f9e166a492245ea21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:12.915778 23993 ts_tablet_manager.cc:1434] T 6b9b9a00169a4e9baa1cc18be0940f54 P 4d358937860e459f9e166a492245ea21: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.004s
I20260709 12:17:12.916488 23995 tablet_bootstrap.cc:492] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7: No bootstrap required, opened a new log
I20260709 12:17:12.917098 23995 ts_tablet_manager.cc:1403] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.008s
I20260709 12:17:12.917397 23993 tablet_bootstrap.cc:492] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21: Bootstrap starting.
I20260709 12:17:12.920392 23995 raft_consensus.cc:359] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } }
I20260709 12:17:12.921228 23995 raft_consensus.cc:385] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.921574 23995 raft_consensus.cc:740] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.922499 23995 consensus_queue.cc:260] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } }
I20260709 12:17:12.924940 23995 ts_tablet_manager.cc:1434] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.007s
I20260709 12:17:12.926126 23995 tablet_bootstrap.cc:492] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7: Bootstrap starting.
I20260709 12:17:12.927613 23993 tablet_bootstrap.cc:654] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.935568 23995 tablet_bootstrap.cc:654] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.935887 23994 tablet_bootstrap.cc:492] T 512dbe65edfe4c3d996d129d188325c0 P 77d535b4d74e4f59b15c3fa20dbdbf73: No bootstrap required, opened a new log
I20260709 12:17:12.937157 23994 ts_tablet_manager.cc:1403] T 512dbe65edfe4c3d996d129d188325c0 P 77d535b4d74e4f59b15c3fa20dbdbf73: Time spent bootstrapping tablet: real 0.039s	user 0.030s	sys 0.006s
I20260709 12:17:12.937304 23993 tablet_bootstrap.cc:492] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21: No bootstrap required, opened a new log
I20260709 12:17:12.937922 23993 ts_tablet_manager.cc:1403] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 12:17:12.941401 23994 raft_consensus.cc:359] T 512dbe65edfe4c3d996d129d188325c0 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:12.943007 23994 raft_consensus.cc:385] T 512dbe65edfe4c3d996d129d188325c0 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.943300 23994 raft_consensus.cc:740] T 512dbe65edfe4c3d996d129d188325c0 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77d535b4d74e4f59b15c3fa20dbdbf73, State: Initialized, Role: FOLLOWER
W20260709 12:17:12.945672 23750 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:12.944147 23994 consensus_queue.cc:260] T 512dbe65edfe4c3d996d129d188325c0 P 77d535b4d74e4f59b15c3fa20dbdbf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:12.947381 23953 raft_consensus.cc:2468] T 8d39e331a2424292bc6f2c8bd10500d8 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d358937860e459f9e166a492245ea21 in term 1.
I20260709 12:17:12.949152 23842 leader_election.cc:304] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d358937860e459f9e166a492245ea21, 77d535b4d74e4f59b15c3fa20dbdbf73; no voters: cdf181ff3be844e8b834e63e4b7869b7
I20260709 12:17:12.949570 23994 ts_tablet_manager.cc:1434] T 512dbe65edfe4c3d996d129d188325c0 P 77d535b4d74e4f59b15c3fa20dbdbf73: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:17:12.950721 23994 tablet_bootstrap.cc:492] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73: Bootstrap starting.
I20260709 12:17:12.950789 24001 raft_consensus.cc:2804] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:12.957124 23993 raft_consensus.cc:359] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:12.958256 23994 tablet_bootstrap.cc:654] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.958299 23993 raft_consensus.cc:385] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.960286 23993 raft_consensus.cc:740] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d358937860e459f9e166a492245ea21, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.963138 24006 raft_consensus.cc:493] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.963832 24006 raft_consensus.cc:515] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:12.968098 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b9a00169a4e9baa1cc18be0940f54" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7" is_pre_election: true
I20260709 12:17:12.970227 24001 raft_consensus.cc:697] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [term 1 LEADER]: Becoming Leader. State: Replica: 4d358937860e459f9e166a492245ea21, State: Running, Role: LEADER
I20260709 12:17:12.972231 24006 leader_election.cc:290] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429)
I20260709 12:17:12.973284 24001 consensus_queue.cc:237] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } }
I20260709 12:17:12.973981 23879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b9a00169a4e9baa1cc18be0940f54" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d358937860e459f9e166a492245ea21" is_pre_election: true
I20260709 12:17:12.974136 23993 consensus_queue.cc:260] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:12.974699 23879 raft_consensus.cc:2468] T 6b9b9a00169a4e9baa1cc18be0940f54 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77d535b4d74e4f59b15c3fa20dbdbf73 in term 0.
W20260709 12:17:12.973989 23919 leader_election.cc:343] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:12.976527 23917 leader_election.cc:304] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d358937860e459f9e166a492245ea21, 77d535b4d74e4f59b15c3fa20dbdbf73; no voters: cdf181ff3be844e8b834e63e4b7869b7
I20260709 12:17:12.977267 23993 ts_tablet_manager.cc:1434] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 12:17:12.977816 24006 raft_consensus.cc:2804] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:12.978192 24006 raft_consensus.cc:493] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.978571 24006 raft_consensus.cc:3060] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:12.978305 23993 tablet_bootstrap.cc:492] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21: Bootstrap starting.
I20260709 12:17:12.981381 23994 tablet_bootstrap.cc:492] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73: No bootstrap required, opened a new log
I20260709 12:17:12.981925 23994 ts_tablet_manager.cc:1403] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.015s
I20260709 12:17:12.984921 23994 raft_consensus.cc:359] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:12.985663 23994 raft_consensus.cc:385] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.985965 23994 raft_consensus.cc:740] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77d535b4d74e4f59b15c3fa20dbdbf73, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.986438 23993 tablet_bootstrap.cc:654] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.987473 23702 catalog_manager.cc:5697] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d358937860e459f9e166a492245ea21 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "4d358937860e459f9e166a492245ea21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:12.988796 24006 raft_consensus.cc:515] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:12.988984 23994 consensus_queue.cc:260] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:12.991997 23995 tablet_bootstrap.cc:492] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7: No bootstrap required, opened a new log
I20260709 12:17:12.992534 23995 ts_tablet_manager.cc:1403] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.022s
I20260709 12:17:12.992332 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b9a00169a4e9baa1cc18be0940f54" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
W20260709 12:17:12.993919 23919 leader_election.cc:343] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:12.996470 23994 ts_tablet_manager.cc:1434] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:17:12.996059 23995 raft_consensus.cc:359] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:12.997115 23995 raft_consensus.cc:385] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.997548 23994 tablet_bootstrap.cc:492] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73: Bootstrap starting.
I20260709 12:17:12.997506 23995 raft_consensus.cc:740] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.000267 23879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b9a00169a4e9baa1cc18be0940f54" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d358937860e459f9e166a492245ea21"
I20260709 12:17:13.000882 23879 raft_consensus.cc:3060] T 6b9b9a00169a4e9baa1cc18be0940f54 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.001407 23993 tablet_bootstrap.cc:492] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21: No bootstrap required, opened a new log
I20260709 12:17:13.001937 23993 ts_tablet_manager.cc:1403] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.003s
I20260709 12:17:13.005215 23993 raft_consensus.cc:359] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.006001 23993 raft_consensus.cc:385] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.006289 23993 raft_consensus.cc:740] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d358937860e459f9e166a492245ea21, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.007342 23993 consensus_queue.cc:260] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.007872 24001 raft_consensus.cc:493] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.008818 24001 raft_consensus.cc:515] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.009565 24006 leader_election.cc:290] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 1 election: Requested vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429)
I20260709 12:17:13.009093 23879 raft_consensus.cc:2468] T 6b9b9a00169a4e9baa1cc18be0940f54 P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77d535b4d74e4f59b15c3fa20dbdbf73 in term 1.
I20260709 12:17:13.010084 23993 ts_tablet_manager.cc:1434] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:17:13.011008 24002 raft_consensus.cc:493] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.011170 23917 leader_election.cc:304] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d358937860e459f9e166a492245ea21, 77d535b4d74e4f59b15c3fa20dbdbf73; no voters: cdf181ff3be844e8b834e63e4b7869b7
I20260709 12:17:13.011931 23995 consensus_queue.cc:260] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.011813 24002 raft_consensus.cc:515] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.012549 24006 raft_consensus.cc:2804] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:13.014673 23994 tablet_bootstrap.cc:654] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.014824 24001 leader_election.cc:290] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:13.014945 24002 leader_election.cc:290] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:13.011157 23993 tablet_bootstrap.cc:492] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21: Bootstrap starting.
I20260709 12:17:13.015784 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9921ab8d07eb4dc9b603c5a95302e70f" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7" is_pre_election: true
I20260709 12:17:13.016422 23804 raft_consensus.cc:2468] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d358937860e459f9e166a492245ea21 in term 0.
I20260709 12:17:13.017470 23995 ts_tablet_manager.cc:1434] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:17:13.018517 23995 tablet_bootstrap.cc:492] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7: Bootstrap starting.
I20260709 12:17:13.020164 23953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9921ab8d07eb4dc9b603c5a95302e70f" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" is_pre_election: true
I20260709 12:17:13.020864 23953 raft_consensus.cc:2468] T 9921ab8d07eb4dc9b603c5a95302e70f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d358937860e459f9e166a492245ea21 in term 0.
I20260709 12:17:13.022801 23842 leader_election.cc:304] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d358937860e459f9e166a492245ea21, 77d535b4d74e4f59b15c3fa20dbdbf73; no voters: 
I20260709 12:17:13.023737 24001 raft_consensus.cc:2804] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:13.024160 24001 raft_consensus.cc:493] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.024498 24001 raft_consensus.cc:3060] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.031986 24006 raft_consensus.cc:697] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 LEADER]: Becoming Leader. State: Replica: 77d535b4d74e4f59b15c3fa20dbdbf73, State: Running, Role: LEADER
I20260709 12:17:13.035424 23993 tablet_bootstrap.cc:654] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.037420 24006 consensus_queue.cc:237] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.039644 23995 tablet_bootstrap.cc:654] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.044778 23994 tablet_bootstrap.cc:492] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73: No bootstrap required, opened a new log
I20260709 12:17:13.050580 23997 raft_consensus.cc:493] T 512dbe65edfe4c3d996d129d188325c0 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.051340 23997 raft_consensus.cc:515] T 512dbe65edfe4c3d996d129d188325c0 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.054250 23997 leader_election.cc:290] T 512dbe65edfe4c3d996d129d188325c0 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429)
I20260709 12:17:13.055856 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512dbe65edfe4c3d996d129d188325c0" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7" is_pre_election: true
I20260709 12:17:13.057727 23879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512dbe65edfe4c3d996d129d188325c0" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d358937860e459f9e166a492245ea21" is_pre_election: true
I20260709 12:17:13.058451 23994 ts_tablet_manager.cc:1403] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.011s
W20260709 12:17:13.059271 23919 leader_election.cc:343] T 512dbe65edfe4c3d996d129d188325c0 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:13.060420 23917 leader_election.cc:343] T 512dbe65edfe4c3d996d129d188325c0 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:13.060880 23917 leader_election.cc:304] T 512dbe65edfe4c3d996d129d188325c0 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77d535b4d74e4f59b15c3fa20dbdbf73; no voters: 4d358937860e459f9e166a492245ea21, cdf181ff3be844e8b834e63e4b7869b7
I20260709 12:17:13.062376 23997 raft_consensus.cc:2749] T 512dbe65edfe4c3d996d129d188325c0 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:13.062597 23994 raft_consensus.cc:359] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.063746 23994 raft_consensus.cc:385] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.064143 23994 raft_consensus.cc:740] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77d535b4d74e4f59b15c3fa20dbdbf73, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.065018 24001 raft_consensus.cc:515] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.067904 24001 leader_election.cc:290] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 election: Requested vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:13.068662 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9921ab8d07eb4dc9b603c5a95302e70f" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
I20260709 12:17:13.069298 23804 raft_consensus.cc:3060] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.073213 23994 consensus_queue.cc:260] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.076404 23994 ts_tablet_manager.cc:1434] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73: Time spent starting tablet: real 0.017s	user 0.000s	sys 0.007s
I20260709 12:17:13.078655 23953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9921ab8d07eb4dc9b603c5a95302e70f" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
I20260709 12:17:13.079492 23953 raft_consensus.cc:3060] T 9921ab8d07eb4dc9b603c5a95302e70f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.077721 23994 tablet_bootstrap.cc:492] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73: Bootstrap starting.
I20260709 12:17:13.088109 23952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9921ab8d07eb4dc9b603c5a95302e70f" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" is_pre_election: true
I20260709 12:17:13.092372 23879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9921ab8d07eb4dc9b603c5a95302e70f" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d358937860e459f9e166a492245ea21" is_pre_election: true
I20260709 12:17:13.093541 23879 raft_consensus.cc:2393] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cdf181ff3be844e8b834e63e4b7869b7 in current term 1: Already voted for candidate 4d358937860e459f9e166a492245ea21 in this term.
I20260709 12:17:13.095046 23768 leader_election.cc:304] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cdf181ff3be844e8b834e63e4b7869b7; no voters: 4d358937860e459f9e166a492245ea21, 77d535b4d74e4f59b15c3fa20dbdbf73
I20260709 12:17:13.099155 23953 raft_consensus.cc:2468] T 9921ab8d07eb4dc9b603c5a95302e70f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d358937860e459f9e166a492245ea21 in term 1.
I20260709 12:17:13.099655 23700 catalog_manager.cc:5697] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:13.100574 23842 leader_election.cc:304] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d358937860e459f9e166a492245ea21, 77d535b4d74e4f59b15c3fa20dbdbf73; no voters: 
I20260709 12:17:13.101511 24001 raft_consensus.cc:2804] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:13.102015 24001 raft_consensus.cc:697] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [term 1 LEADER]: Becoming Leader. State: Replica: 4d358937860e459f9e166a492245ea21, State: Running, Role: LEADER
I20260709 12:17:13.102836 24001 consensus_queue.cc:237] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.112207 23995 tablet_bootstrap.cc:492] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7: No bootstrap required, opened a new log
I20260709 12:17:13.112797 23995 ts_tablet_manager.cc:1403] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7: Time spent bootstrapping tablet: real 0.094s	user 0.015s	sys 0.021s
I20260709 12:17:13.115964 23995 raft_consensus.cc:359] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.116758 23995 raft_consensus.cc:385] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.117080 23995 raft_consensus.cc:740] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.118036 23995 consensus_queue.cc:260] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.120114 23993 tablet_bootstrap.cc:492] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21: No bootstrap required, opened a new log
I20260709 12:17:13.120779 23993 ts_tablet_manager.cc:1403] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21: Time spent bootstrapping tablet: real 0.110s	user 0.021s	sys 0.009s
I20260709 12:17:13.120839 23994 tablet_bootstrap.cc:654] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.118845 23804 raft_consensus.cc:2468] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d358937860e459f9e166a492245ea21 in term 1.
I20260709 12:17:13.125144 24002 raft_consensus.cc:2749] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:13.131701 23702 catalog_manager.cc:5697] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d358937860e459f9e166a492245ea21 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "4d358937860e459f9e166a492245ea21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:13.124161 23993 raft_consensus.cc:359] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.136152 23993 raft_consensus.cc:385] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.136493 23993 raft_consensus.cc:740] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d358937860e459f9e166a492245ea21, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.137360 23993 consensus_queue.cc:260] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.139679 23993 ts_tablet_manager.cc:1434] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:17:13.141808 23993 tablet_bootstrap.cc:492] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21: Bootstrap starting.
I20260709 12:17:13.146817 23995 ts_tablet_manager.cc:1434] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.018s
I20260709 12:17:13.148068 23995 tablet_bootstrap.cc:492] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7: Bootstrap starting.
I20260709 12:17:13.151288 23993 tablet_bootstrap.cc:654] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.152155 23994 tablet_bootstrap.cc:492] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73: No bootstrap required, opened a new log
I20260709 12:17:13.155006 23995 tablet_bootstrap.cc:654] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.155694 23994 ts_tablet_manager.cc:1403] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.022s
I20260709 12:17:13.158512 23993 tablet_bootstrap.cc:492] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21: No bootstrap required, opened a new log
I20260709 12:17:13.159013 23993 ts_tablet_manager.cc:1403] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.001s
I20260709 12:17:13.158942 23994 raft_consensus.cc:359] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.160145 23994 raft_consensus.cc:385] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.160537 23994 raft_consensus.cc:740] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77d535b4d74e4f59b15c3fa20dbdbf73, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.161834 23993 raft_consensus.cc:359] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.161589 23994 consensus_queue.cc:260] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.162447 23993 raft_consensus.cc:385] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.162768 23993 raft_consensus.cc:740] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d358937860e459f9e166a492245ea21, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.163550 23993 consensus_queue.cc:260] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.164832 23994 ts_tablet_manager.cc:1434] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:17:13.165935 23994 tablet_bootstrap.cc:492] T 8076306a710440779e266942ec39c883 P 77d535b4d74e4f59b15c3fa20dbdbf73: Bootstrap starting.
I20260709 12:17:13.167698 23995 tablet_bootstrap.cc:492] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7: No bootstrap required, opened a new log
I20260709 12:17:13.168088 23993 ts_tablet_manager.cc:1434] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:17:13.168211 23995 ts_tablet_manager.cc:1403] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 12:17:13.169430 23993 tablet_bootstrap.cc:492] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21: Bootstrap starting.
I20260709 12:17:13.171671 23995 raft_consensus.cc:359] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.172362 23994 tablet_bootstrap.cc:654] T 8076306a710440779e266942ec39c883 P 77d535b4d74e4f59b15c3fa20dbdbf73: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.172504 23995 raft_consensus.cc:385] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.172886 23995 raft_consensus.cc:740] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.173878 23995 consensus_queue.cc:260] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.176795 23993 tablet_bootstrap.cc:654] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.181345 23995 ts_tablet_manager.cc:1434] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
I20260709 12:17:13.182888 23995 tablet_bootstrap.cc:492] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7: Bootstrap starting.
I20260709 12:17:13.185477 24030 raft_consensus.cc:493] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.186196 24030 raft_consensus.cc:515] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } }
I20260709 12:17:13.190544 23953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d39e331a2424292bc6f2c8bd10500d8" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" is_pre_election: true
I20260709 12:17:13.191411 23953 raft_consensus.cc:2393] T 8d39e331a2424292bc6f2c8bd10500d8 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cdf181ff3be844e8b834e63e4b7869b7 in current term 1: Already voted for candidate 4d358937860e459f9e166a492245ea21 in this term.
I20260709 12:17:13.191886 23879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d39e331a2424292bc6f2c8bd10500d8" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d358937860e459f9e166a492245ea21" is_pre_election: true
I20260709 12:17:13.193885 23768 leader_election.cc:304] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cdf181ff3be844e8b834e63e4b7869b7; no voters: 4d358937860e459f9e166a492245ea21, 77d535b4d74e4f59b15c3fa20dbdbf73
I20260709 12:17:13.195158 24002 raft_consensus.cc:3060] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.200788 24030 leader_election.cc:290] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371), 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429)
I20260709 12:17:13.202085 24001 raft_consensus.cc:493] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.202644 24001 raft_consensus.cc:515] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.204936 24006 raft_consensus.cc:493] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.205686 24001 leader_election.cc:290] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:13.205430 24006 raft_consensus.cc:515] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.207253 23953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc3223e00e774a718ab27e3a4f998bd4" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" is_pre_election: true
I20260709 12:17:13.208019 24006 leader_election.cc:290] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429)
I20260709 12:17:13.207954 23953 raft_consensus.cc:2468] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d358937860e459f9e166a492245ea21 in term 0.
I20260709 12:17:13.211722 23842 leader_election.cc:304] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d358937860e459f9e166a492245ea21, 77d535b4d74e4f59b15c3fa20dbdbf73; no voters: 
I20260709 12:17:13.213084 24001 raft_consensus.cc:2804] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:13.213622 24001 raft_consensus.cc:493] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.214123 24001 raft_consensus.cc:3060] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.214356 23993 tablet_bootstrap.cc:492] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21: No bootstrap required, opened a new log
I20260709 12:17:13.214998 23993 ts_tablet_manager.cc:1403] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.033s
I20260709 12:17:13.214949 23803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc3223e00e774a718ab27e3a4f998bd4" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7" is_pre_election: true
I20260709 12:17:13.215809 23803 raft_consensus.cc:2468] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d358937860e459f9e166a492245ea21 in term 0.
I20260709 12:17:13.213117 23879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f952f11a13489098c690696373b9b7" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d358937860e459f9e166a492245ea21" is_pre_election: true
I20260709 12:17:13.217303 23879 raft_consensus.cc:2468] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77d535b4d74e4f59b15c3fa20dbdbf73 in term 0.
I20260709 12:17:13.214301 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f952f11a13489098c690696373b9b7" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7" is_pre_election: true
I20260709 12:17:13.218317 23804 raft_consensus.cc:2468] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77d535b4d74e4f59b15c3fa20dbdbf73 in term 0.
I20260709 12:17:13.218084 23993 raft_consensus.cc:359] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.218804 23993 raft_consensus.cc:385] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.219071 23993 raft_consensus.cc:740] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d358937860e459f9e166a492245ea21, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.219797 23919 leader_election.cc:304] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77d535b4d74e4f59b15c3fa20dbdbf73, cdf181ff3be844e8b834e63e4b7869b7; no voters: 
I20260709 12:17:13.219952 23993 consensus_queue.cc:260] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.221837 24002 raft_consensus.cc:2749] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:13.222453 23993 ts_tablet_manager.cc:1434] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:17:13.227682 23993 tablet_bootstrap.cc:492] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21: Bootstrap starting.
I20260709 12:17:13.231281 24001 raft_consensus.cc:515] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.232402 23995 tablet_bootstrap.cc:654] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.222405 24006 raft_consensus.cc:2804] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:13.232919 23993 tablet_bootstrap.cc:654] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.234117 24006 raft_consensus.cc:493] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.234617 24006 raft_consensus.cc:3060] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.234581 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc3223e00e774a718ab27e3a4f998bd4" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
I20260709 12:17:13.235533 23804 raft_consensus.cc:3060] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.238124 23953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc3223e00e774a718ab27e3a4f998bd4" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
I20260709 12:17:13.238818 23953 raft_consensus.cc:3060] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.240288 23994 tablet_bootstrap.cc:492] T 8076306a710440779e266942ec39c883 P 77d535b4d74e4f59b15c3fa20dbdbf73: No bootstrap required, opened a new log
I20260709 12:17:13.240870 23994 ts_tablet_manager.cc:1403] T 8076306a710440779e266942ec39c883 P 77d535b4d74e4f59b15c3fa20dbdbf73: Time spent bootstrapping tablet: real 0.075s	user 0.040s	sys 0.014s
I20260709 12:17:13.243795 23994 raft_consensus.cc:359] T 8076306a710440779e266942ec39c883 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.244489 23994 raft_consensus.cc:385] T 8076306a710440779e266942ec39c883 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.244870 23994 raft_consensus.cc:740] T 8076306a710440779e266942ec39c883 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77d535b4d74e4f59b15c3fa20dbdbf73, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.245615 23994 consensus_queue.cc:260] T 8076306a710440779e266942ec39c883 P 77d535b4d74e4f59b15c3fa20dbdbf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.247808 23994 ts_tablet_manager.cc:1434] T 8076306a710440779e266942ec39c883 P 77d535b4d74e4f59b15c3fa20dbdbf73: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:17:13.249014 23994 tablet_bootstrap.cc:492] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73: Bootstrap starting.
I20260709 12:17:13.250865 24006 raft_consensus.cc:515] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.253608 23953 raft_consensus.cc:2468] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d358937860e459f9e166a492245ea21 in term 1.
I20260709 12:17:13.254994 23842 leader_election.cc:304] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d358937860e459f9e166a492245ea21, 77d535b4d74e4f59b15c3fa20dbdbf73; no voters: 
I20260709 12:17:13.255259 23994 tablet_bootstrap.cc:654] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.255992 24016 raft_consensus.cc:2804] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:13.258342 23803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f952f11a13489098c690696373b9b7" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
I20260709 12:17:13.259193 23803 raft_consensus.cc:3060] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.256047 24001 leader_election.cc:290] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 election: Requested vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:13.269829 23879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f952f11a13489098c690696373b9b7" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d358937860e459f9e166a492245ea21"
I20260709 12:17:13.270704 23879 raft_consensus.cc:3060] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.271042 23803 raft_consensus.cc:2468] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77d535b4d74e4f59b15c3fa20dbdbf73 in term 1.
I20260709 12:17:13.272778 23919 leader_election.cc:304] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77d535b4d74e4f59b15c3fa20dbdbf73, cdf181ff3be844e8b834e63e4b7869b7; no voters: 
I20260709 12:17:13.274034 23997 raft_consensus.cc:2804] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:13.281519 23879 raft_consensus.cc:2468] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77d535b4d74e4f59b15c3fa20dbdbf73 in term 1.
I20260709 12:17:13.281809 23804 raft_consensus.cc:2468] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d358937860e459f9e166a492245ea21 in term 1.
I20260709 12:17:13.268210 24006 leader_election.cc:290] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 1 election: Requested vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429)
I20260709 12:17:13.287235 23993 tablet_bootstrap.cc:492] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21: No bootstrap required, opened a new log
I20260709 12:17:13.287706 23995 tablet_bootstrap.cc:492] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7: No bootstrap required, opened a new log
I20260709 12:17:13.287804 23993 ts_tablet_manager.cc:1403] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21: Time spent bootstrapping tablet: real 0.060s	user 0.004s	sys 0.025s
I20260709 12:17:13.288759 23995 ts_tablet_manager.cc:1403] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7: Time spent bootstrapping tablet: real 0.106s	user 0.020s	sys 0.015s
I20260709 12:17:13.289865 23997 raft_consensus.cc:697] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 LEADER]: Becoming Leader. State: Replica: 77d535b4d74e4f59b15c3fa20dbdbf73, State: Running, Role: LEADER
I20260709 12:17:13.290838 23997 consensus_queue.cc:237] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.291347 23993 raft_consensus.cc:359] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.292029 23993 raft_consensus.cc:385] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.292321 23993 raft_consensus.cc:740] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d358937860e459f9e166a492245ea21, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.293113 23993 consensus_queue.cc:260] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.293082 23995 raft_consensus.cc:359] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.294437 23995 raft_consensus.cc:385] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.294766 24016 raft_consensus.cc:697] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 1 LEADER]: Becoming Leader. State: Replica: 4d358937860e459f9e166a492245ea21, State: Running, Role: LEADER
I20260709 12:17:13.294783 23995 raft_consensus.cc:740] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.295694 23993 ts_tablet_manager.cc:1434] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:17:13.295918 24016 consensus_queue.cc:237] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.295970 23995 consensus_queue.cc:260] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.296900 23993 tablet_bootstrap.cc:492] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21: Bootstrap starting.
I20260709 12:17:13.301875 23994 tablet_bootstrap.cc:492] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73: No bootstrap required, opened a new log
I20260709 12:17:13.302426 23994 ts_tablet_manager.cc:1403] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.014s
I20260709 12:17:13.305593 23993 tablet_bootstrap.cc:654] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.305431 23994 raft_consensus.cc:359] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.306252 23994 raft_consensus.cc:385] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.306594 23994 raft_consensus.cc:740] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77d535b4d74e4f59b15c3fa20dbdbf73, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.307024 23995 ts_tablet_manager.cc:1434] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.004s
I20260709 12:17:13.309266 23994 consensus_queue.cc:260] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.313506 23994 ts_tablet_manager.cc:1434] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:17:13.317659 23995 tablet_bootstrap.cc:492] T 8076306a710440779e266942ec39c883 P cdf181ff3be844e8b834e63e4b7869b7: Bootstrap starting.
I20260709 12:17:13.320003 23993 tablet_bootstrap.cc:492] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21: No bootstrap required, opened a new log
I20260709 12:17:13.320819 23993 ts_tablet_manager.cc:1403] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.004s
I20260709 12:17:13.323907 23993 raft_consensus.cc:359] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.324717 23993 raft_consensus.cc:385] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.325053 23993 raft_consensus.cc:740] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d358937860e459f9e166a492245ea21, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.325798 23993 consensus_queue.cc:260] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.328377 23993 ts_tablet_manager.cc:1434] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:17:13.327529 23701 catalog_manager.cc:5697] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:13.333328 23995 tablet_bootstrap.cc:654] T 8076306a710440779e266942ec39c883 P cdf181ff3be844e8b834e63e4b7869b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.335822 24016 raft_consensus.cc:493] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.335749 23700 catalog_manager.cc:5697] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d358937860e459f9e166a492245ea21 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "4d358937860e459f9e166a492245ea21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:13.336422 24016 raft_consensus.cc:515] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.339021 24016 leader_election.cc:290] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:13.340538 23995 tablet_bootstrap.cc:492] T 8076306a710440779e266942ec39c883 P cdf181ff3be844e8b834e63e4b7869b7: No bootstrap required, opened a new log
I20260709 12:17:13.340765 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb47341c94564f6d828ff2feabe4ec0f" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7" is_pre_election: true
I20260709 12:17:13.341133 23995 ts_tablet_manager.cc:1403] T 8076306a710440779e266942ec39c883 P cdf181ff3be844e8b834e63e4b7869b7: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.005s
W20260709 12:17:13.342433 23845 leader_election.cc:343] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:13.344444 23953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb47341c94564f6d828ff2feabe4ec0f" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" is_pre_election: true
I20260709 12:17:13.345194 23953 raft_consensus.cc:2468] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d358937860e459f9e166a492245ea21 in term 0.
I20260709 12:17:13.344205 23995 raft_consensus.cc:359] T 8076306a710440779e266942ec39c883 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.345890 23995 raft_consensus.cc:385] T 8076306a710440779e266942ec39c883 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.346246 23995 raft_consensus.cc:740] T 8076306a710440779e266942ec39c883 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.346980 23995 consensus_queue.cc:260] T 8076306a710440779e266942ec39c883 P cdf181ff3be844e8b834e63e4b7869b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.348600 23842 leader_election.cc:304] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d358937860e459f9e166a492245ea21, 77d535b4d74e4f59b15c3fa20dbdbf73; no voters: cdf181ff3be844e8b834e63e4b7869b7
I20260709 12:17:13.349174 23995 ts_tablet_manager.cc:1434] T 8076306a710440779e266942ec39c883 P cdf181ff3be844e8b834e63e4b7869b7: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:17:13.349517 24016 raft_consensus.cc:2804] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:13.349994 24016 raft_consensus.cc:493] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.350252 23995 tablet_bootstrap.cc:492] T 78d98d7b027f40cdac191caf3e580679 P cdf181ff3be844e8b834e63e4b7869b7: Bootstrap starting.
I20260709 12:17:13.350410 24016 raft_consensus.cc:3060] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:13.354394 23979 tablet.cc:2406] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:17:13.356961 23995 tablet_bootstrap.cc:654] T 78d98d7b027f40cdac191caf3e580679 P cdf181ff3be844e8b834e63e4b7869b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.358811 24016 raft_consensus.cc:515] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.361974 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb47341c94564f6d828ff2feabe4ec0f" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
W20260709 12:17:13.363547 23845 leader_election.cc:343] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:13.364715 24016 leader_election.cc:290] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 election: Requested vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:13.366149 23953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb47341c94564f6d828ff2feabe4ec0f" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
I20260709 12:17:13.366851 23953 raft_consensus.cc:3060] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.367898 23995 tablet_bootstrap.cc:492] T 78d98d7b027f40cdac191caf3e580679 P cdf181ff3be844e8b834e63e4b7869b7: No bootstrap required, opened a new log
I20260709 12:17:13.368414 23995 ts_tablet_manager.cc:1403] T 78d98d7b027f40cdac191caf3e580679 P cdf181ff3be844e8b834e63e4b7869b7: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.009s
I20260709 12:17:13.371670 23995 raft_consensus.cc:359] T 78d98d7b027f40cdac191caf3e580679 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.372457 23995 raft_consensus.cc:385] T 78d98d7b027f40cdac191caf3e580679 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.372786 23995 raft_consensus.cc:740] T 78d98d7b027f40cdac191caf3e580679 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.373529 23995 consensus_queue.cc:260] T 78d98d7b027f40cdac191caf3e580679 P cdf181ff3be844e8b834e63e4b7869b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.374676 23953 raft_consensus.cc:2468] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d358937860e459f9e166a492245ea21 in term 1.
I20260709 12:17:13.375876 23995 ts_tablet_manager.cc:1434] T 78d98d7b027f40cdac191caf3e580679 P cdf181ff3be844e8b834e63e4b7869b7: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 12:17:13.376484 23842 leader_election.cc:304] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d358937860e459f9e166a492245ea21, 77d535b4d74e4f59b15c3fa20dbdbf73; no voters: cdf181ff3be844e8b834e63e4b7869b7
I20260709 12:17:13.376966 23995 tablet_bootstrap.cc:492] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7: Bootstrap starting.
I20260709 12:17:13.377439 24016 raft_consensus.cc:2804] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:13.378051 24016 raft_consensus.cc:697] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [term 1 LEADER]: Becoming Leader. State: Replica: 4d358937860e459f9e166a492245ea21, State: Running, Role: LEADER
I20260709 12:17:13.379010 24016 consensus_queue.cc:237] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.379745 24038 raft_consensus.cc:493] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.380297 24038 raft_consensus.cc:515] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.384480 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8076306a710440779e266942ec39c883" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7" is_pre_election: true
I20260709 12:17:13.385197 23804 raft_consensus.cc:2468] T 8076306a710440779e266942ec39c883 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d358937860e459f9e166a492245ea21 in term 0.
I20260709 12:17:13.386986 24038 leader_election.cc:290] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:13.387656 23845 leader_election.cc:304] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d358937860e459f9e166a492245ea21, cdf181ff3be844e8b834e63e4b7869b7; no voters: 
I20260709 12:17:13.389928 23995 tablet_bootstrap.cc:654] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.388378 23997 raft_consensus.cc:493] T 8076306a710440779e266942ec39c883 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.390978 23997 raft_consensus.cc:515] T 8076306a710440779e266942ec39c883 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.393791 23997 leader_election.cc:290] T 8076306a710440779e266942ec39c883 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429)
I20260709 12:17:13.394821 24016 raft_consensus.cc:2804] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:13.395280 24016 raft_consensus.cc:493] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.389227 23952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8076306a710440779e266942ec39c883" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" is_pre_election: true
I20260709 12:17:13.395630 24016 raft_consensus.cc:3060] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.396018 23952 raft_consensus.cc:2468] T 8076306a710440779e266942ec39c883 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d358937860e459f9e166a492245ea21 in term 0.
I20260709 12:17:13.396021 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8076306a710440779e266942ec39c883" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7" is_pre_election: true
I20260709 12:17:13.397570 23804 raft_consensus.cc:2468] T 8076306a710440779e266942ec39c883 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77d535b4d74e4f59b15c3fa20dbdbf73 in term 0.
I20260709 12:17:13.398401 23700 catalog_manager.cc:5697] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d358937860e459f9e166a492245ea21 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "4d358937860e459f9e166a492245ea21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:13.399466 23919 leader_election.cc:304] T 8076306a710440779e266942ec39c883 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77d535b4d74e4f59b15c3fa20dbdbf73, cdf181ff3be844e8b834e63e4b7869b7; no voters: 
I20260709 12:17:13.402361 23879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8076306a710440779e266942ec39c883" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d358937860e459f9e166a492245ea21" is_pre_election: true
I20260709 12:17:13.403656 24016 raft_consensus.cc:515] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.403779 24001 consensus_queue.cc:1048] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:13.405294 23879 raft_consensus.cc:2393] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77d535b4d74e4f59b15c3fa20dbdbf73 in current term 1: Already voted for candidate 4d358937860e459f9e166a492245ea21 in this term.
I20260709 12:17:13.406600 23997 raft_consensus.cc:2804] T 8076306a710440779e266942ec39c883 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:13.407024 23997 raft_consensus.cc:493] T 8076306a710440779e266942ec39c883 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.407233 24016 leader_election.cc:290] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 election: Requested vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:13.407414 23997 raft_consensus.cc:3060] T 8076306a710440779e266942ec39c883 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.412039 23995 tablet_bootstrap.cc:492] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7: No bootstrap required, opened a new log
I20260709 12:17:13.412025 23953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8076306a710440779e266942ec39c883" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
I20260709 12:17:13.412809 23995 ts_tablet_manager.cc:1403] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.017s
I20260709 12:17:13.412230 24038 consensus_queue.cc:1048] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:13.415686 23995 raft_consensus.cc:359] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.419209 23995 raft_consensus.cc:385] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.415201 23997 raft_consensus.cc:515] T 8076306a710440779e266942ec39c883 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.415246 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8076306a710440779e266942ec39c883" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
I20260709 12:17:13.419795 23995 raft_consensus.cc:740] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.420905 23953 raft_consensus.cc:2393] T 8076306a710440779e266942ec39c883 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d358937860e459f9e166a492245ea21 in current term 1: Already voted for candidate 77d535b4d74e4f59b15c3fa20dbdbf73 in this term.
I20260709 12:17:13.422731 24002 raft_consensus.cc:493] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.422957 23997 leader_election.cc:290] T 8076306a710440779e266942ec39c883 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 1 election: Requested vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429)
I20260709 12:17:13.423298 24002 raft_consensus.cc:515] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.423763 23995 consensus_queue.cc:260] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.425616 24002 leader_election.cc:290] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:13.425997 23995 ts_tablet_manager.cc:1434] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:17:13.426373 23997 raft_consensus.cc:493] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.426860 23997 raft_consensus.cc:515] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.427371 24038 raft_consensus.cc:493] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.427935 24038 raft_consensus.cc:515] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.428993 23997 leader_election.cc:290] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429)
I20260709 12:17:13.429828 23879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa351a9bbfba435186b9cb98204fbb64" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d358937860e459f9e166a492245ea21" is_pre_election: true
I20260709 12:17:13.430230 24038 leader_election.cc:290] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:13.430466 23879 raft_consensus.cc:2468] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdf181ff3be844e8b834e63e4b7869b7 in term 0.
I20260709 12:17:13.431774 23953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa351a9bbfba435186b9cb98204fbb64" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" is_pre_election: true
I20260709 12:17:13.420902 23804 raft_consensus.cc:3060] T 8076306a710440779e266942ec39c883 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.431900 23768 leader_election.cc:304] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d358937860e459f9e166a492245ea21, cdf181ff3be844e8b834e63e4b7869b7; no voters: 
I20260709 12:17:13.432428 23953 raft_consensus.cc:2468] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdf181ff3be844e8b834e63e4b7869b7 in term 0.
I20260709 12:17:13.433099 24030 raft_consensus.cc:2804] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:13.433524 24030 raft_consensus.cc:493] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.433605 23803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8076306a710440779e266942ec39c883" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
I20260709 12:17:13.433969 24030 raft_consensus.cc:3060] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.434237 23802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa351a9bbfba435186b9cb98204fbb64" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7" is_pre_election: true
I20260709 12:17:13.438438 23803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d98d7b027f40cdac191caf3e580679" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7" is_pre_election: true
I20260709 12:17:13.438948 23878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa351a9bbfba435186b9cb98204fbb64" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d358937860e459f9e166a492245ea21" is_pre_election: true
I20260709 12:17:13.439217 23803 raft_consensus.cc:2468] T 78d98d7b027f40cdac191caf3e580679 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d358937860e459f9e166a492245ea21 in term 0.
I20260709 12:17:13.439635 23878 raft_consensus.cc:2468] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77d535b4d74e4f59b15c3fa20dbdbf73 in term 0.
I20260709 12:17:13.441555 23917 leader_election.cc:304] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d358937860e459f9e166a492245ea21, 77d535b4d74e4f59b15c3fa20dbdbf73; no voters: 
I20260709 12:17:13.442322 23997 raft_consensus.cc:2804] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:13.442778 23997 raft_consensus.cc:493] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.442926 23845 leader_election.cc:304] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d358937860e459f9e166a492245ea21, cdf181ff3be844e8b834e63e4b7869b7; no voters: 
I20260709 12:17:13.443224 23997 raft_consensus.cc:3060] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.444037 24030 raft_consensus.cc:515] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.445384 24001 raft_consensus.cc:2804] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:13.445588 23802 raft_consensus.cc:2393] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77d535b4d74e4f59b15c3fa20dbdbf73 in current term 1: Already voted for candidate cdf181ff3be844e8b834e63e4b7869b7 in this term.
I20260709 12:17:13.445779 24001 raft_consensus.cc:493] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.446209 24001 raft_consensus.cc:3060] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.442560 23953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d98d7b027f40cdac191caf3e580679" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" is_pre_election: true
I20260709 12:17:13.447731 23953 raft_consensus.cc:2468] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d358937860e459f9e166a492245ea21 in term 0.
I20260709 12:17:13.449491 23953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa351a9bbfba435186b9cb98204fbb64" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
I20260709 12:17:13.449649 23879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8076306a710440779e266942ec39c883" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d358937860e459f9e166a492245ea21"
I20260709 12:17:13.454185 23878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa351a9bbfba435186b9cb98204fbb64" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d358937860e459f9e166a492245ea21"
I20260709 12:17:13.454402 23997 raft_consensus.cc:515] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.454838 23878 raft_consensus.cc:3060] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.456650 24001 raft_consensus.cc:515] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.459632 23803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d98d7b027f40cdac191caf3e580679" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
I20260709 12:17:13.460244 23803 raft_consensus.cc:3060] T 78d98d7b027f40cdac191caf3e580679 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.460300 23951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d98d7b027f40cdac191caf3e580679" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
I20260709 12:17:13.461190 23951 raft_consensus.cc:3060] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.461468 23879 raft_consensus.cc:2393] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 77d535b4d74e4f59b15c3fa20dbdbf73 in current term 1: Already voted for candidate 4d358937860e459f9e166a492245ea21 in this term.
I20260709 12:17:13.462811 24030 leader_election.cc:290] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 1 election: Requested vote from peers 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:13.464516 23917 leader_election.cc:304] T 8076306a710440779e266942ec39c883 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77d535b4d74e4f59b15c3fa20dbdbf73; no voters: 4d358937860e459f9e166a492245ea21, cdf181ff3be844e8b834e63e4b7869b7
I20260709 12:17:13.465335 24001 leader_election.cc:290] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 election: Requested vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:13.466382 24040 raft_consensus.cc:2749] T 8076306a710440779e266942ec39c883 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:13.467514 23878 raft_consensus.cc:2468] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdf181ff3be844e8b834e63e4b7869b7 in term 1.
I20260709 12:17:13.468924 23768 leader_election.cc:304] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d358937860e459f9e166a492245ea21, cdf181ff3be844e8b834e63e4b7869b7; no voters: 
I20260709 12:17:13.469990 23953 raft_consensus.cc:2393] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cdf181ff3be844e8b834e63e4b7869b7 in current term 1: Already voted for candidate 77d535b4d74e4f59b15c3fa20dbdbf73 in this term.
I20260709 12:17:13.469877 23951 raft_consensus.cc:2468] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d358937860e459f9e166a492245ea21 in term 1.
I20260709 12:17:13.467921 23804 raft_consensus.cc:2468] T 8076306a710440779e266942ec39c883 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d358937860e459f9e166a492245ea21 in term 1.
I20260709 12:17:13.473779 24030 raft_consensus.cc:2804] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:13.469842 23997 leader_election.cc:290] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 1 election: Requested vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429)
I20260709 12:17:13.477169 24030 raft_consensus.cc:697] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 LEADER]: Becoming Leader. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Running, Role: LEADER
I20260709 12:17:13.476999 23801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa351a9bbfba435186b9cb98204fbb64" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
I20260709 12:17:13.479032 23800 raft_consensus.cc:3060] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.481491 23878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa351a9bbfba435186b9cb98204fbb64" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d358937860e459f9e166a492245ea21"
I20260709 12:17:13.481750 23845 leader_election.cc:304] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d358937860e459f9e166a492245ea21, cdf181ff3be844e8b834e63e4b7869b7; no voters: 77d535b4d74e4f59b15c3fa20dbdbf73
I20260709 12:17:13.482291 23878 raft_consensus.cc:2393] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 77d535b4d74e4f59b15c3fa20dbdbf73 in current term 1: Already voted for candidate cdf181ff3be844e8b834e63e4b7869b7 in this term.
I20260709 12:17:13.482877 24038 raft_consensus.cc:2804] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:13.483345 24038 raft_consensus.cc:697] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21 [term 1 LEADER]: Becoming Leader. State: Replica: 4d358937860e459f9e166a492245ea21, State: Running, Role: LEADER
I20260709 12:17:13.485008 23842 leader_election.cc:304] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d358937860e459f9e166a492245ea21, 77d535b4d74e4f59b15c3fa20dbdbf73; no voters: 
I20260709 12:17:13.485019 24030 consensus_queue.cc:237] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.486630 24016 raft_consensus.cc:2804] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:13.487154 24016 raft_consensus.cc:697] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [term 1 LEADER]: Becoming Leader. State: Replica: 4d358937860e459f9e166a492245ea21, State: Running, Role: LEADER
I20260709 12:17:13.484192 24038 consensus_queue.cc:237] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.488811 24016 consensus_queue.cc:237] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.504948 24040 consensus_queue.cc:1048] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:13.505219 23803 raft_consensus.cc:2468] T 78d98d7b027f40cdac191caf3e580679 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d358937860e459f9e166a492245ea21 in term 1.
I20260709 12:17:13.512923 23919 leader_election.cc:304] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77d535b4d74e4f59b15c3fa20dbdbf73; no voters: 4d358937860e459f9e166a492245ea21, cdf181ff3be844e8b834e63e4b7869b7
I20260709 12:17:13.518280 23700 catalog_manager.cc:5697] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "cdf181ff3be844e8b834e63e4b7869b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:13.520303 24040 raft_consensus.cc:2749] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:13.530040 23701 catalog_manager.cc:5697] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d358937860e459f9e166a492245ea21 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "4d358937860e459f9e166a492245ea21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:13.531919 24006 consensus_queue.cc:1048] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:13.531950 23701 catalog_manager.cc:5697] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d358937860e459f9e166a492245ea21 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "4d358937860e459f9e166a492245ea21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:13.541627 24030 raft_consensus.cc:493] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.542182 24030 raft_consensus.cc:515] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.545796 24030 leader_election.cc:290] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:13.546155 23953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512dbe65edfe4c3d996d129d188325c0" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" is_pre_election: true
I20260709 12:17:13.546805 23953 raft_consensus.cc:2468] T 512dbe65edfe4c3d996d129d188325c0 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdf181ff3be844e8b834e63e4b7869b7 in term 0.
I20260709 12:17:13.547441 23878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512dbe65edfe4c3d996d129d188325c0" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d358937860e459f9e166a492245ea21" is_pre_election: true
I20260709 12:17:13.547801 24038 consensus_queue.cc:1048] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:13.548290 23878 raft_consensus.cc:2468] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdf181ff3be844e8b834e63e4b7869b7 in term 0.
I20260709 12:17:13.548806 23767 leader_election.cc:304] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77d535b4d74e4f59b15c3fa20dbdbf73, cdf181ff3be844e8b834e63e4b7869b7; no voters: 
I20260709 12:17:13.549764 24030 raft_consensus.cc:2804] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:13.552109 24030 raft_consensus.cc:493] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.552459 24030 raft_consensus.cc:3060] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.558751 24030 raft_consensus.cc:515] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.561470 24030 leader_election.cc:290] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 1 election: Requested vote from peers 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:13.562201 23878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512dbe65edfe4c3d996d129d188325c0" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d358937860e459f9e166a492245ea21"
I20260709 12:17:13.562803 23878 raft_consensus.cc:3060] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.563747 23952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512dbe65edfe4c3d996d129d188325c0" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
I20260709 12:17:13.564438 23952 raft_consensus.cc:3060] T 512dbe65edfe4c3d996d129d188325c0 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.570788 23878 raft_consensus.cc:2468] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdf181ff3be844e8b834e63e4b7869b7 in term 1.
I20260709 12:17:13.572073 23952 raft_consensus.cc:2468] T 512dbe65edfe4c3d996d129d188325c0 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdf181ff3be844e8b834e63e4b7869b7 in term 1.
I20260709 12:17:13.572104 23768 leader_election.cc:304] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d358937860e459f9e166a492245ea21, cdf181ff3be844e8b834e63e4b7869b7; no voters: 
I20260709 12:17:13.573271 24030 raft_consensus.cc:2804] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:13.573762 24030 raft_consensus.cc:697] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 LEADER]: Becoming Leader. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Running, Role: LEADER
I20260709 12:17:13.574668 24030 consensus_queue.cc:237] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.575114 24016 consensus_queue.cc:1048] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:13.587666 23699 catalog_manager.cc:5697] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "cdf181ff3be844e8b834e63e4b7869b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:13.611666 24030 raft_consensus.cc:493] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.612159 24030 raft_consensus.cc:515] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.613870 24030 leader_election.cc:290] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:13.614979 23878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb47341c94564f6d828ff2feabe4ec0f" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d358937860e459f9e166a492245ea21" is_pre_election: true
I20260709 12:17:13.615137 23952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb47341c94564f6d828ff2feabe4ec0f" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" is_pre_election: true
I20260709 12:17:13.615942 23952 raft_consensus.cc:2393] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cdf181ff3be844e8b834e63e4b7869b7 in current term 1: Already voted for candidate 4d358937860e459f9e166a492245ea21 in this term.
I20260709 12:17:13.616993 23767 leader_election.cc:304] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cdf181ff3be844e8b834e63e4b7869b7; no voters: 4d358937860e459f9e166a492245ea21, 77d535b4d74e4f59b15c3fa20dbdbf73
I20260709 12:17:13.617702 24030 raft_consensus.cc:3060] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.622694 24030 raft_consensus.cc:2749] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:13.741652 24006 consensus_queue.cc:1048] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:13.753029 23997 consensus_queue.cc:1048] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:13.847271 23878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d39e331a2424292bc6f2c8bd10500d8"
dest_uuid: "4d358937860e459f9e166a492245ea21"
mode: GRACEFUL
new_leader_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
 from {username='slave'} at 127.0.0.1:58984
I20260709 12:17:13.847904 23878 raft_consensus.cc:606] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [term 1 LEADER]: Received request to transfer leadership to TS cdf181ff3be844e8b834e63e4b7869b7
I20260709 12:17:13.862695 23952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b9b9a00169a4e9baa1cc18be0940f54"
dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
mode: GRACEFUL
new_leader_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
 from {username='slave'} at 127.0.0.1:34866
I20260709 12:17:13.863359 23952 raft_consensus.cc:606] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 LEADER]: Received request to transfer leadership to TS cdf181ff3be844e8b834e63e4b7869b7
I20260709 12:17:13.870085 23878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc3223e00e774a718ab27e3a4f998bd4"
dest_uuid: "4d358937860e459f9e166a492245ea21"
mode: GRACEFUL
new_leader_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
 from {username='slave'} at 127.0.0.1:58984
I20260709 12:17:13.870172 24016 consensus_queue.cc:1048] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:13.870813 23878 raft_consensus.cc:606] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 1 LEADER]: Received request to transfer leadership to TS cdf181ff3be844e8b834e63e4b7869b7
I20260709 12:17:13.878867 23878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9921ab8d07eb4dc9b603c5a95302e70f"
dest_uuid: "4d358937860e459f9e166a492245ea21"
mode: GRACEFUL
new_leader_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
 from {username='slave'} at 127.0.0.1:58984
I20260709 12:17:13.879540 23878 raft_consensus.cc:606] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [term 1 LEADER]: Received request to transfer leadership to TS cdf181ff3be844e8b834e63e4b7869b7
I20260709 12:17:13.883328 24038 consensus_queue.cc:1048] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:13.889213 23952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09f952f11a13489098c690696373b9b7"
dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
mode: GRACEFUL
new_leader_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
 from {username='slave'} at 127.0.0.1:34866
I20260709 12:17:13.889915 23952 raft_consensus.cc:606] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 LEADER]: Received request to transfer leadership to TS cdf181ff3be844e8b834e63e4b7869b7
I20260709 12:17:13.892453 24038 raft_consensus.cc:993] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21: : Instructing follower cdf181ff3be844e8b834e63e4b7869b7 to start an election
I20260709 12:17:13.892930 24016 raft_consensus.cc:1081] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 1 LEADER]: Signalling peer cdf181ff3be844e8b834e63e4b7869b7 to start an election
I20260709 12:17:13.894780 23803 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc3223e00e774a718ab27e3a4f998bd4"
dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
 from {username='slave'} at 127.0.0.1:51752
I20260709 12:17:13.895464 23803 raft_consensus.cc:493] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:13.895828 23803 raft_consensus.cc:3060] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:13.898991 24038 raft_consensus.cc:993] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21: : Instructing follower cdf181ff3be844e8b834e63e4b7869b7 to start an election
I20260709 12:17:13.899577 24001 raft_consensus.cc:1081] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [term 1 LEADER]: Signalling peer cdf181ff3be844e8b834e63e4b7869b7 to start an election
I20260709 12:17:13.901496 23801 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d39e331a2424292bc6f2c8bd10500d8"
dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
 from {username='slave'} at 127.0.0.1:51752
I20260709 12:17:13.902088 23801 raft_consensus.cc:493] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:13.902635 23801 raft_consensus.cc:3060] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:13.902683 23803 raft_consensus.cc:515] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.906925 23803 leader_election.cc:290] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 2 election: Requested vote from peers 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:13.906764 23878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc3223e00e774a718ab27e3a4f998bd4" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d358937860e459f9e166a492245ea21"
I20260709 12:17:13.907675 23878 raft_consensus.cc:3055] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:13.908012 23878 raft_consensus.cc:740] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d358937860e459f9e166a492245ea21, State: Running, Role: LEADER
I20260709 12:17:13.908862 23878 consensus_queue.cc:260] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.909653 23952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc3223e00e774a718ab27e3a4f998bd4" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
I20260709 12:17:13.910238 23878 raft_consensus.cc:3060] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:13.910355 23952 raft_consensus.cc:3060] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:13.915354 23803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa351a9bbfba435186b9cb98204fbb64"
dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
mode: GRACEFUL
new_leader_uuid: "4d358937860e459f9e166a492245ea21"
 from {username='slave'} at 127.0.0.1:51760
I20260709 12:17:13.916051 23803 raft_consensus.cc:606] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 LEADER]: Received request to transfer leadership to TS 4d358937860e459f9e166a492245ea21
I20260709 12:17:13.916277 23801 raft_consensus.cc:515] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } }
I20260709 12:17:13.918527 23952 raft_consensus.cc:2468] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdf181ff3be844e8b834e63e4b7869b7 in term 2.
I20260709 12:17:13.919096 23878 raft_consensus.cc:2468] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdf181ff3be844e8b834e63e4b7869b7 in term 2.
I20260709 12:17:13.920233 23768 leader_election.cc:304] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d358937860e459f9e166a492245ea21, cdf181ff3be844e8b834e63e4b7869b7; no voters: 
I20260709 12:17:13.920841 23801 leader_election.cc:290] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 2 election: Requested vote from peers 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371), 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429)
I20260709 12:17:13.921202 24030 raft_consensus.cc:2804] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:13.921718 24030 raft_consensus.cc:697] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 LEADER]: Becoming Leader. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Running, Role: LEADER
I20260709 12:17:13.922538 24030 consensus_queue.cc:237] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:13.923236 23953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d39e331a2424292bc6f2c8bd10500d8" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
I20260709 12:17:13.923844 23953 raft_consensus.cc:3060] T 8d39e331a2424292bc6f2c8bd10500d8 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:13.924881 23997 raft_consensus.cc:993] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73: : Instructing follower cdf181ff3be844e8b834e63e4b7869b7 to start an election
I20260709 12:17:13.924685 24002 consensus_queue.cc:1048] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:13.925292 23997 raft_consensus.cc:1081] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 LEADER]: Signalling peer cdf181ff3be844e8b834e63e4b7869b7 to start an election
I20260709 12:17:13.925930 23878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d39e331a2424292bc6f2c8bd10500d8" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d358937860e459f9e166a492245ea21"
I20260709 12:17:13.926710 23878 raft_consensus.cc:3055] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:13.927052 23878 raft_consensus.cc:740] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d358937860e459f9e166a492245ea21, State: Running, Role: LEADER
I20260709 12:17:13.928140 23878 consensus_queue.cc:260] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } }
I20260709 12:17:13.929687 23878 raft_consensus.cc:3060] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:13.933665 23801 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "512dbe65edfe4c3d996d129d188325c0"
dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
mode: GRACEFUL
new_leader_uuid: "4d358937860e459f9e166a492245ea21"
 from {username='slave'} at 127.0.0.1:51760
I20260709 12:17:13.934291 23801 raft_consensus.cc:606] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 LEADER]: Received request to transfer leadership to TS 4d358937860e459f9e166a492245ea21
I20260709 12:17:13.936074 24001 consensus_queue.cc:1048] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:13.941159 23699 catalog_manager.cc:5697] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 reported cstate change: term changed from 1 to 2, leader changed from 4d358937860e459f9e166a492245ea21 (127.22.155.194) to cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "cdf181ff3be844e8b834e63e4b7869b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:13.943559 23878 raft_consensus.cc:2468] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdf181ff3be844e8b834e63e4b7869b7 in term 2.
I20260709 12:17:13.945861 23768 leader_election.cc:304] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d358937860e459f9e166a492245ea21, cdf181ff3be844e8b834e63e4b7869b7; no voters: 
I20260709 12:17:13.949237 23803 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b9b9a00169a4e9baa1cc18be0940f54"
dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
 from {username='slave'} at 127.0.0.1:51736
I20260709 12:17:13.949436 24038 consensus_queue.cc:1048] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:13.949877 23803 raft_consensus.cc:493] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:13.950311 23803 raft_consensus.cc:3060] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:13.954794 24001 consensus_queue.cc:1048] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:13.958900 23879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78d98d7b027f40cdac191caf3e580679"
dest_uuid: "4d358937860e459f9e166a492245ea21"
mode: GRACEFUL
new_leader_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
 from {username='slave'} at 127.0.0.1:58984
I20260709 12:17:13.959627 23879 raft_consensus.cc:606] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [term 1 LEADER]: Received request to transfer leadership to TS 77d535b4d74e4f59b15c3fa20dbdbf73
I20260709 12:17:13.960116 24001 consensus_queue.cc:1048] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:13.963119 24030 raft_consensus.cc:2804] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:13.963843 24030 raft_consensus.cc:697] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 LEADER]: Becoming Leader. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Running, Role: LEADER
I20260709 12:17:13.963323 24001 consensus_queue.cc:1048] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:17:13.967175 24030 consensus_queue.cc:237] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } }
I20260709 12:17:13.979408 24038 consensus_queue.cc:1048] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:13.980188 23953 raft_consensus.cc:2468] T 8d39e331a2424292bc6f2c8bd10500d8 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdf181ff3be844e8b834e63e4b7869b7 in term 2.
I20260709 12:17:13.981067 23950 raft_consensus.cc:1240] T 8d39e331a2424292bc6f2c8bd10500d8 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Rejecting Update request from peer 4d358937860e459f9e166a492245ea21 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:13.994351 23699 catalog_manager.cc:5697] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7 reported cstate change: term changed from 1 to 2, leader changed from 4d358937860e459f9e166a492245ea21 (127.22.155.194) to cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "cdf181ff3be844e8b834e63e4b7869b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:13.998615 23803 raft_consensus.cc:515] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:14.009279 23879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b9a00169a4e9baa1cc18be0940f54" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d358937860e459f9e166a492245ea21"
I20260709 12:17:14.009542 23951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b9a00169a4e9baa1cc18be0940f54" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
I20260709 12:17:14.009981 23879 raft_consensus.cc:3060] T 6b9b9a00169a4e9baa1cc18be0940f54 P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:14.010210 23951 raft_consensus.cc:3055] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:14.010586 23951 raft_consensus.cc:740] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77d535b4d74e4f59b15c3fa20dbdbf73, State: Running, Role: LEADER
I20260709 12:17:14.011374 23951 consensus_queue.cc:260] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:14.012476 23951 raft_consensus.cc:3060] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:14.018672 23803 leader_election.cc:290] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 2 election: Requested vote from peers 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:14.023600 23951 raft_consensus.cc:2468] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdf181ff3be844e8b834e63e4b7869b7 in term 2.
I20260709 12:17:14.027297 24001 raft_consensus.cc:993] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21: : Instructing follower 77d535b4d74e4f59b15c3fa20dbdbf73 to start an election
I20260709 12:17:14.038595 23767 leader_election.cc:304] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77d535b4d74e4f59b15c3fa20dbdbf73, cdf181ff3be844e8b834e63e4b7869b7; no voters: 
I20260709 12:17:14.029191 24001 raft_consensus.cc:1081] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [term 1 LEADER]: Signalling peer 77d535b4d74e4f59b15c3fa20dbdbf73 to start an election
I20260709 12:17:14.051708 23951 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78d98d7b027f40cdac191caf3e580679"
dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
 from {username='slave'} at 127.0.0.1:34852
I20260709 12:17:14.052595 23951 raft_consensus.cc:493] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:14.053148 23951 raft_consensus.cc:3060] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:14.058913 24002 raft_consensus.cc:2804] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:14.059501 24002 raft_consensus.cc:697] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 LEADER]: Becoming Leader. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Running, Role: LEADER
I20260709 12:17:14.060491 24002 consensus_queue.cc:237] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:14.062485 24030 consensus_queue.cc:1048] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:14.044991 23879 raft_consensus.cc:2468] T 6b9b9a00169a4e9baa1cc18be0940f54 P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdf181ff3be844e8b834e63e4b7869b7 in term 2.
I20260709 12:17:14.077837 23951 raft_consensus.cc:515] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:14.079095 23952 raft_consensus.cc:1240] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Rejecting Update request from peer 4d358937860e459f9e166a492245ea21 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:14.084694 24077 consensus_queue.cc:1059] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:14.086390 24077 raft_consensus.cc:3055] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:14.086772 24077 raft_consensus.cc:740] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d358937860e459f9e166a492245ea21, State: Running, Role: LEADER
I20260709 12:17:14.089694 24077 consensus_queue.cc:260] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:14.090474 24030 consensus_queue.cc:1048] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:14.091308 24077 raft_consensus.cc:3060] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:14.113940 23803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d98d7b027f40cdac191caf3e580679" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
I20260709 12:17:14.114825 23877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d98d7b027f40cdac191caf3e580679" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d358937860e459f9e166a492245ea21"
I20260709 12:17:14.115954 23951 leader_election.cc:290] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 2 election: Requested vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429)
I20260709 12:17:14.114863 23803 raft_consensus.cc:3060] T 78d98d7b027f40cdac191caf3e580679 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:14.130508 23803 raft_consensus.cc:2468] T 78d98d7b027f40cdac191caf3e580679 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77d535b4d74e4f59b15c3fa20dbdbf73 in term 2.
I20260709 12:17:14.132447 23919 leader_election.cc:304] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77d535b4d74e4f59b15c3fa20dbdbf73, cdf181ff3be844e8b834e63e4b7869b7; no voters: 
I20260709 12:17:14.133751 24006 raft_consensus.cc:2804] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:14.134582 24006 raft_consensus.cc:697] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 LEADER]: Becoming Leader. State: Replica: 77d535b4d74e4f59b15c3fa20dbdbf73, State: Running, Role: LEADER
I20260709 12:17:14.135737 24006 consensus_queue.cc:237] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
W20260709 12:17:14.136126 23845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:42899, user_credentials={real_user=slave}} blocked reactor thread for 132082us
I20260709 12:17:14.140925 23699 catalog_manager.cc:5697] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 reported cstate change: term changed from 1 to 2, leader changed from 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195) to cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "cdf181ff3be844e8b834e63e4b7869b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:14.145995 23803 raft_consensus.cc:1240] T 78d98d7b027f40cdac191caf3e580679 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Rejecting Update request from peer 4d358937860e459f9e166a492245ea21 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:14.149091 23877 raft_consensus.cc:2468] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77d535b4d74e4f59b15c3fa20dbdbf73 in term 2.
I20260709 12:17:14.148595 23702 catalog_manager.cc:5697] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73 reported cstate change: term changed from 1 to 2, leader changed from 4d358937860e459f9e166a492245ea21 (127.22.155.194) to 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195). New cstate: current_term: 2 leader_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:14.161397 24081 raft_consensus.cc:993] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7: : Instructing follower 4d358937860e459f9e166a492245ea21 to start an election
I20260709 12:17:14.161895 24081 raft_consensus.cc:1081] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 LEADER]: Signalling peer 4d358937860e459f9e166a492245ea21 to start an election
I20260709 12:17:14.163740 23878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa351a9bbfba435186b9cb98204fbb64"
dest_uuid: "4d358937860e459f9e166a492245ea21"
 from {username='slave'} at 127.0.0.1:58976
I20260709 12:17:14.164186 23878 raft_consensus.cc:493] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:14.164533 23878 raft_consensus.cc:3060] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:14.171062 24030 raft_consensus.cc:993] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7: : Instructing follower 4d358937860e459f9e166a492245ea21 to start an election
I20260709 12:17:14.171536 24030 raft_consensus.cc:1081] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 LEADER]: Signalling peer 4d358937860e459f9e166a492245ea21 to start an election
I20260709 12:17:14.173748 23878 raft_consensus.cc:515] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:14.176180 23878 leader_election.cc:290] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 2 election: Requested vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:14.177306 23951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa351a9bbfba435186b9cb98204fbb64" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
I20260709 12:17:14.177996 23951 raft_consensus.cc:3060] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:14.178491 24002 consensus_queue.cc:1048] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:14.180749 23877 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "512dbe65edfe4c3d996d129d188325c0"
dest_uuid: "4d358937860e459f9e166a492245ea21"
 from {username='slave'} at 127.0.0.1:58976
I20260709 12:17:14.181324 23877 raft_consensus.cc:493] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:14.181701 23877 raft_consensus.cc:3060] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:14.183887 23803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa351a9bbfba435186b9cb98204fbb64" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
I20260709 12:17:14.184754 23803 raft_consensus.cc:3055] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:14.185148 23803 raft_consensus.cc:740] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Running, Role: LEADER
I20260709 12:17:14.186183 23803 consensus_queue.cc:260] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:14.187971 23803 raft_consensus.cc:3060] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:14.188607 23877 raft_consensus.cc:515] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:14.191833 24079 raft_consensus.cc:993] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21: : Instructing follower cdf181ff3be844e8b834e63e4b7869b7 to start an election
I20260709 12:17:14.191933 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512dbe65edfe4c3d996d129d188325c0" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
I20260709 12:17:14.195502 23951 raft_consensus.cc:2468] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d358937860e459f9e166a492245ea21 in term 2.
I20260709 12:17:14.195711 23804 raft_consensus.cc:3055] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:14.195783 24079 raft_consensus.cc:1081] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [term 1 LEADER]: Signalling peer cdf181ff3be844e8b834e63e4b7869b7 to start an election
I20260709 12:17:14.196954 23842 leader_election.cc:304] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d358937860e459f9e166a492245ea21, 77d535b4d74e4f59b15c3fa20dbdbf73; no voters: 
I20260709 12:17:14.194113 23952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512dbe65edfe4c3d996d129d188325c0" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
I20260709 12:17:14.198738 23800 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9921ab8d07eb4dc9b603c5a95302e70f"
dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
 from {username='slave'} at 127.0.0.1:51752
I20260709 12:17:14.199337 23800 raft_consensus.cc:493] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:14.196105 23804 raft_consensus.cc:740] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Running, Role: LEADER
I20260709 12:17:14.199730 23800 raft_consensus.cc:3060] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:14.200408 23804 consensus_queue.cc:260] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:14.201583 23804 raft_consensus.cc:3060] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:14.203590 23803 raft_consensus.cc:2468] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d358937860e459f9e166a492245ea21 in term 2.
I20260709 12:17:14.208012 23800 raft_consensus.cc:515] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:14.208613 23804 raft_consensus.cc:2468] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d358937860e459f9e166a492245ea21 in term 2.
I20260709 12:17:14.210027 23845 leader_election.cc:304] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d358937860e459f9e166a492245ea21, cdf181ff3be844e8b834e63e4b7869b7; no voters: 77d535b4d74e4f59b15c3fa20dbdbf73
I20260709 12:17:14.210911 24016 raft_consensus.cc:2804] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:14.211458 24016 raft_consensus.cc:697] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 [term 2 LEADER]: Becoming Leader. State: Replica: 4d358937860e459f9e166a492245ea21, State: Running, Role: LEADER
I20260709 12:17:14.212141 23878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9921ab8d07eb4dc9b603c5a95302e70f" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d358937860e459f9e166a492245ea21"
I20260709 12:17:14.212316 24016 consensus_queue.cc:237] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:14.194538 23877 leader_election.cc:290] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 2 election: Requested vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:14.213037 23878 raft_consensus.cc:3055] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:14.213506 23878 raft_consensus.cc:740] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d358937860e459f9e166a492245ea21, State: Running, Role: LEADER
I20260709 12:17:14.214591 23878 consensus_queue.cc:260] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:14.215829 23878 raft_consensus.cc:3060] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:14.208892 24079 raft_consensus.cc:2804] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:14.217788 24079 raft_consensus.cc:697] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [term 2 LEADER]: Becoming Leader. State: Replica: 4d358937860e459f9e166a492245ea21, State: Running, Role: LEADER
I20260709 12:17:14.218636 24079 consensus_queue.cc:237] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:14.222899 23953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9921ab8d07eb4dc9b603c5a95302e70f" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
I20260709 12:17:14.222824 23701 catalog_manager.cc:5697] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 reported cstate change: term changed from 1 to 2, leader changed from cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193) to 4d358937860e459f9e166a492245ea21 (127.22.155.194). New cstate: current_term: 2 leader_uuid: "4d358937860e459f9e166a492245ea21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:14.224071 23953 raft_consensus.cc:3060] T 9921ab8d07eb4dc9b603c5a95302e70f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:14.225239 23878 raft_consensus.cc:2468] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdf181ff3be844e8b834e63e4b7869b7 in term 2.
I20260709 12:17:14.223508 23800 leader_election.cc:290] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 2 election: Requested vote from peers 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:14.226794 23768 leader_election.cc:304] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d358937860e459f9e166a492245ea21, cdf181ff3be844e8b834e63e4b7869b7; no voters: 
I20260709 12:17:14.227643 24081 raft_consensus.cc:2804] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:14.228164 24081 raft_consensus.cc:697] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7 [term 2 LEADER]: Becoming Leader. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Running, Role: LEADER
I20260709 12:17:14.228986 24081 consensus_queue.cc:237] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:14.231909 23953 raft_consensus.cc:2468] T 9921ab8d07eb4dc9b603c5a95302e70f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdf181ff3be844e8b834e63e4b7869b7 in term 2.
I20260709 12:17:14.236797 23701 catalog_manager.cc:5697] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7 reported cstate change: term changed from 1 to 2, leader changed from 4d358937860e459f9e166a492245ea21 (127.22.155.194) to cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "cdf181ff3be844e8b834e63e4b7869b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:14.240033 23699 catalog_manager.cc:5697] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 reported cstate change: term changed from 1 to 2, leader changed from cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193) to 4d358937860e459f9e166a492245ea21 (127.22.155.194). New cstate: current_term: 2 leader_uuid: "4d358937860e459f9e166a492245ea21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:14.359129 24040 raft_consensus.cc:993] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73: : Instructing follower cdf181ff3be844e8b834e63e4b7869b7 to start an election
I20260709 12:17:14.359624 24006 raft_consensus.cc:1081] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 LEADER]: Signalling peer cdf181ff3be844e8b834e63e4b7869b7 to start an election
I20260709 12:17:14.359550 23953 raft_consensus.cc:1275] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Refusing update from remote peer cdf181ff3be844e8b834e63e4b7869b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:14.361364 24081 consensus_queue.cc:1048] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:14.361649 23800 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09f952f11a13489098c690696373b9b7"
dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
 from {username='slave'} at 127.0.0.1:51736
I20260709 12:17:14.362373 23800 raft_consensus.cc:493] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:14.362771 23800 raft_consensus.cc:3060] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:14.369328 23800 raft_consensus.cc:515] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:14.370592 23878 raft_consensus.cc:1275] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Refusing update from remote peer cdf181ff3be844e8b834e63e4b7869b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:14.372921 23878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f952f11a13489098c690696373b9b7" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d358937860e459f9e166a492245ea21"
I20260709 12:17:14.372800 24080 consensus_queue.cc:1048] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:14.373500 23878 raft_consensus.cc:3060] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:14.386129 23878 raft_consensus.cc:2468] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdf181ff3be844e8b834e63e4b7869b7 in term 2.
I20260709 12:17:14.387162 23768 leader_election.cc:304] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d358937860e459f9e166a492245ea21, cdf181ff3be844e8b834e63e4b7869b7; no voters: 
I20260709 12:17:14.387966 24080 raft_consensus.cc:2804] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:14.388249 23800 leader_election.cc:290] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 2 election: Requested vote from peers 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:14.388568 24080 raft_consensus.cc:697] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 LEADER]: Becoming Leader. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Running, Role: LEADER
I20260709 12:17:14.389500 24080 consensus_queue.cc:237] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:14.390432 23953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f952f11a13489098c690696373b9b7" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
I20260709 12:17:14.391026 23953 raft_consensus.cc:3055] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:14.391340 23953 raft_consensus.cc:740] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77d535b4d74e4f59b15c3fa20dbdbf73, State: Running, Role: LEADER
I20260709 12:17:14.392203 23953 consensus_queue.cc:260] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:14.393599 23953 raft_consensus.cc:3060] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:14.397090 23699 catalog_manager.cc:5697] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 reported cstate change: term changed from 1 to 2, leader changed from 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195) to cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "cdf181ff3be844e8b834e63e4b7869b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:14.399284 23953 raft_consensus.cc:2468] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdf181ff3be844e8b834e63e4b7869b7 in term 2.
I20260709 12:17:14.462379 23953 raft_consensus.cc:1275] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Refusing update from remote peer cdf181ff3be844e8b834e63e4b7869b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:14.463810 24080 consensus_queue.cc:1048] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:14.469260 23952 raft_consensus.cc:1275] T 8d39e331a2424292bc6f2c8bd10500d8 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Refusing update from remote peer cdf181ff3be844e8b834e63e4b7869b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:14.470815 24081 consensus_queue.cc:1048] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:14.473666 23878 raft_consensus.cc:1275] T 6b9b9a00169a4e9baa1cc18be0940f54 P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Refusing update from remote peer cdf181ff3be844e8b834e63e4b7869b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:14.475208 24030 consensus_queue.cc:1048] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:14.485466 23878 raft_consensus.cc:1275] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Refusing update from remote peer cdf181ff3be844e8b834e63e4b7869b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:14.486681 24081 consensus_queue.cc:1048] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:14.605523 23952 raft_consensus.cc:3060] T 512dbe65edfe4c3d996d129d188325c0 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:14.610723 23952 raft_consensus.cc:1275] T 512dbe65edfe4c3d996d129d188325c0 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Refusing update from remote peer 4d358937860e459f9e166a492245ea21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:14.612573 24016 consensus_queue.cc:1048] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:14.615660 23800 raft_consensus.cc:1275] T 78d98d7b027f40cdac191caf3e580679 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Refusing update from remote peer 77d535b4d74e4f59b15c3fa20dbdbf73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:14.617092 24040 consensus_queue.cc:1048] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:14.622035 23804 raft_consensus.cc:1275] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Refusing update from remote peer 4d358937860e459f9e166a492245ea21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:14.624187 24077 consensus_queue.cc:1048] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:14.632654 23878 raft_consensus.cc:1275] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Refusing update from remote peer 77d535b4d74e4f59b15c3fa20dbdbf73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:14.635238 23804 raft_consensus.cc:1275] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Refusing update from remote peer 4d358937860e459f9e166a492245ea21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:14.636757 24077 consensus_queue.cc:1048] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:14.638197 24006 consensus_queue.cc:1048] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:14.648015 23952 raft_consensus.cc:1275] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Refusing update from remote peer 4d358937860e459f9e166a492245ea21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:14.650380 24077 consensus_queue.cc:1048] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:14.794131 23878 raft_consensus.cc:1275] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Refusing update from remote peer cdf181ff3be844e8b834e63e4b7869b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:14.795701 24081 consensus_queue.cc:1048] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:14.805348 23952 raft_consensus.cc:1275] T 9921ab8d07eb4dc9b603c5a95302e70f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Refusing update from remote peer cdf181ff3be844e8b834e63e4b7869b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:14.806902 24002 consensus_queue.cc:1048] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:14.844444 23952 raft_consensus.cc:1275] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Refusing update from remote peer cdf181ff3be844e8b834e63e4b7869b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:14.845882 24002 consensus_queue.cc:1048] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:14.854969 23878 raft_consensus.cc:1275] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Refusing update from remote peer cdf181ff3be844e8b834e63e4b7869b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:14.856824 24002 consensus_queue.cc:1048] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:16.995239 23151 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:17:16.995862 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:17.019291 23800 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b9b9a00169a4e9baa1cc18be0940f54"
dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
mode: GRACEFUL
new_leader_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
 from {username='slave'} at 127.0.0.1:51764
I20260709 12:17:17.019773 23800 raft_consensus.cc:606] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 LEADER]: Received request to transfer leadership to TS 77d535b4d74e4f59b15c3fa20dbdbf73
I20260709 12:17:17.022423 23800 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc3223e00e774a718ab27e3a4f998bd4"
dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
mode: GRACEFUL
new_leader_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
 from {username='slave'} at 127.0.0.1:51764
I20260709 12:17:17.022938 23800 raft_consensus.cc:606] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 LEADER]: Received request to transfer leadership to TS 77d535b4d74e4f59b15c3fa20dbdbf73
I20260709 12:17:17.024093 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:17:17.024561 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:17.052446 24081 raft_consensus.cc:993] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7: : Instructing follower 77d535b4d74e4f59b15c3fa20dbdbf73 to start an election
I20260709 12:17:17.053004 24095 raft_consensus.cc:1081] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 LEADER]: Signalling peer 77d535b4d74e4f59b15c3fa20dbdbf73 to start an election
I20260709 12:17:17.054476 23953 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b9b9a00169a4e9baa1cc18be0940f54"
dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
 from {username='slave'} at 127.0.0.1:34860
I20260709 12:17:17.055004 23953 raft_consensus.cc:493] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:17.055310 23953 raft_consensus.cc:3060] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:17.060520 23953 raft_consensus.cc:515] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:17.062479 23953 leader_election.cc:290] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 3 election: Requested vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429)
I20260709 12:17:17.063474 23800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b9a00169a4e9baa1cc18be0940f54" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
I20260709 12:17:17.063784 23878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b9a00169a4e9baa1cc18be0940f54" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d358937860e459f9e166a492245ea21"
I20260709 12:17:17.064138 23800 raft_consensus.cc:3055] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:17.064450 23878 raft_consensus.cc:3060] T 6b9b9a00169a4e9baa1cc18be0940f54 P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:17.064572 23800 raft_consensus.cc:740] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Running, Role: LEADER
I20260709 12:17:17.065598 23800 consensus_queue.cc:260] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:17.066694 23800 raft_consensus.cc:3060] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:17.070569 23878 raft_consensus.cc:2468] T 6b9b9a00169a4e9baa1cc18be0940f54 P 4d358937860e459f9e166a492245ea21 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77d535b4d74e4f59b15c3fa20dbdbf73 in term 3.
I20260709 12:17:17.071762 23917 leader_election.cc:304] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d358937860e459f9e166a492245ea21, 77d535b4d74e4f59b15c3fa20dbdbf73; no voters: 
I20260709 12:17:17.072086 23800 raft_consensus.cc:2468] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77d535b4d74e4f59b15c3fa20dbdbf73 in term 3.
I20260709 12:17:17.072520 24092 raft_consensus.cc:2804] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:17.073797 24092 raft_consensus.cc:697] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 LEADER]: Becoming Leader. State: Replica: 77d535b4d74e4f59b15c3fa20dbdbf73, State: Running, Role: LEADER
I20260709 12:17:17.074594 24092 consensus_queue.cc:237] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:17.082222 23701 catalog_manager.cc:5697] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 reported cstate change: term changed from 2 to 3, leader changed from cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193) to 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195). New cstate: current_term: 3 leader_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:17.086906 24081 raft_consensus.cc:993] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7: : Instructing follower 77d535b4d74e4f59b15c3fa20dbdbf73 to start an election
I20260709 12:17:17.087469 24095 raft_consensus.cc:1081] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 LEADER]: Signalling peer 77d535b4d74e4f59b15c3fa20dbdbf73 to start an election
I20260709 12:17:17.089308 23953 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc3223e00e774a718ab27e3a4f998bd4"
dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
 from {username='slave'} at 127.0.0.1:34860
I20260709 12:17:17.089913 23953 raft_consensus.cc:493] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:17.090227 23953 raft_consensus.cc:3060] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:17.096338 23953 raft_consensus.cc:515] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:17.098028 23953 leader_election.cc:290] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 3 election: Requested vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429)
I20260709 12:17:17.099051 23800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc3223e00e774a718ab27e3a4f998bd4" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
I20260709 12:17:17.099306 23878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc3223e00e774a718ab27e3a4f998bd4" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d358937860e459f9e166a492245ea21"
I20260709 12:17:17.099606 23800 raft_consensus.cc:3055] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:17.099975 23878 raft_consensus.cc:3060] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:17.099980 23800 raft_consensus.cc:740] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Running, Role: LEADER
I20260709 12:17:17.101109 23800 consensus_queue.cc:260] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:17.102367 23800 raft_consensus.cc:3060] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:17.106751 23878 raft_consensus.cc:2468] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77d535b4d74e4f59b15c3fa20dbdbf73 in term 3.
I20260709 12:17:17.107772 23917 leader_election.cc:304] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d358937860e459f9e166a492245ea21, 77d535b4d74e4f59b15c3fa20dbdbf73; no voters: 
I20260709 12:17:17.108525 24092 raft_consensus.cc:2804] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:17.108701 23800 raft_consensus.cc:2468] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77d535b4d74e4f59b15c3fa20dbdbf73 in term 3.
I20260709 12:17:17.109095 24092 raft_consensus.cc:697] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 LEADER]: Becoming Leader. State: Replica: 77d535b4d74e4f59b15c3fa20dbdbf73, State: Running, Role: LEADER
I20260709 12:17:17.110031 24092 consensus_queue.cc:237] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:17.118393 23701 catalog_manager.cc:5697] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 reported cstate change: term changed from 2 to 3, leader changed from cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193) to 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195). New cstate: current_term: 3 leader_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:17.549968 23878 raft_consensus.cc:1275] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 3 FOLLOWER]: Refusing update from remote peer 77d535b4d74e4f59b15c3fa20dbdbf73: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:17.550122 23800 raft_consensus.cc:1275] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [term 3 FOLLOWER]: Refusing update from remote peer 77d535b4d74e4f59b15c3fa20dbdbf73: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:17.551291 24096 consensus_queue.cc:1048] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:17.551458 24092 consensus_queue.cc:1048] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:17.573472 23804 raft_consensus.cc:1275] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 3 FOLLOWER]: Refusing update from remote peer 77d535b4d74e4f59b15c3fa20dbdbf73: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:17.575933 23878 raft_consensus.cc:1275] T 6b9b9a00169a4e9baa1cc18be0940f54 P 4d358937860e459f9e166a492245ea21 [term 3 FOLLOWER]: Refusing update from remote peer 77d535b4d74e4f59b15c3fa20dbdbf73: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:17.576311 24092 consensus_queue.cc:1048] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:17.583140 24092 consensus_queue.cc:1048] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:18.025552 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:18.030922 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:18.031363 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:19.032459 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:19.038872 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:19.039341 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:20.040491 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:20.046479 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:20.047145 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:21.048518 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:21.054840 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:21.055361 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:22.056490 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:22.061751 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:22.062238 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:23.063380 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:23.070060 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:23.070581 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:24.071568 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:24.077790 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:24.078258 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:25.079375 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:25.085011 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:25.085533 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:26.086540 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:26.092201 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:26.092752 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:27.126999 23151 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:17:27.135488 23952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b9b9a00169a4e9baa1cc18be0940f54"
dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
mode: GRACEFUL
new_leader_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
 from {username='slave'} at 127.0.0.1:34866
I20260709 12:17:27.136255 23952 raft_consensus.cc:606] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 LEADER]: Received request to transfer leadership to TS cdf181ff3be844e8b834e63e4b7869b7
I20260709 12:17:27.142015 23952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc3223e00e774a718ab27e3a4f998bd4"
dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
mode: GRACEFUL
new_leader_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
 from {username='slave'} at 127.0.0.1:34866
I20260709 12:17:27.142547 23952 raft_consensus.cc:606] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 LEADER]: Received request to transfer leadership to TS cdf181ff3be844e8b834e63e4b7869b7
I20260709 12:17:27.154327 23877 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa351a9bbfba435186b9cb98204fbb64"
dest_uuid: "4d358937860e459f9e166a492245ea21"
mode: GRACEFUL
new_leader_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
 from {username='slave'} at 127.0.0.1:58984
I20260709 12:17:27.155016 23877 raft_consensus.cc:606] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [term 2 LEADER]: Received request to transfer leadership to TS cdf181ff3be844e8b834e63e4b7869b7
I20260709 12:17:27.160562 23877 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "512dbe65edfe4c3d996d129d188325c0"
dest_uuid: "4d358937860e459f9e166a492245ea21"
mode: GRACEFUL
new_leader_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
 from {username='slave'} at 127.0.0.1:58984
I20260709 12:17:27.161142 23877 raft_consensus.cc:606] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 [term 2 LEADER]: Received request to transfer leadership to TS cdf181ff3be844e8b834e63e4b7869b7
I20260709 12:17:27.166074 23877 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb47341c94564f6d828ff2feabe4ec0f"
dest_uuid: "4d358937860e459f9e166a492245ea21"
mode: GRACEFUL
new_leader_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
 from {username='slave'} at 127.0.0.1:58984
I20260709 12:17:27.166682 23877 raft_consensus.cc:606] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [term 1 LEADER]: Received request to transfer leadership to TS cdf181ff3be844e8b834e63e4b7869b7
I20260709 12:17:27.214905 24122 raft_consensus.cc:993] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73: : Instructing follower cdf181ff3be844e8b834e63e4b7869b7 to start an election
I20260709 12:17:27.215481 24126 raft_consensus.cc:1081] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 LEADER]: Signalling peer cdf181ff3be844e8b834e63e4b7869b7 to start an election
I20260709 12:17:27.217139 23804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc3223e00e774a718ab27e3a4f998bd4"
dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
 from {username='slave'} at 127.0.0.1:51736
I20260709 12:17:27.217646 23804 raft_consensus.cc:493] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:27.217963 23804 raft_consensus.cc:3060] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:27.224913 23804 raft_consensus.cc:515] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:27.226723 23804 leader_election.cc:290] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 4 election: Requested vote from peers 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:27.227784 23877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc3223e00e774a718ab27e3a4f998bd4" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4d358937860e459f9e166a492245ea21"
I20260709 12:17:27.227910 23952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc3223e00e774a718ab27e3a4f998bd4" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
I20260709 12:17:27.228744 23952 raft_consensus.cc:3055] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:27.229071 23952 raft_consensus.cc:740] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 77d535b4d74e4f59b15c3fa20dbdbf73, State: Running, Role: LEADER
I20260709 12:17:27.229358 23877 raft_consensus.cc:3060] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:27.230149 23952 consensus_queue.cc:260] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:27.231639 23952 raft_consensus.cc:3060] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:27.235966 23877 raft_consensus.cc:2468] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdf181ff3be844e8b834e63e4b7869b7 in term 4.
I20260709 12:17:27.237385 23768 leader_election.cc:304] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d358937860e459f9e166a492245ea21, cdf181ff3be844e8b834e63e4b7869b7; no voters: 
I20260709 12:17:27.237442 23952 raft_consensus.cc:2468] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdf181ff3be844e8b834e63e4b7869b7 in term 4.
I20260709 12:17:27.238325 24125 raft_consensus.cc:2804] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:27.239513 24125 raft_consensus.cc:697] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 4 LEADER]: Becoming Leader. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Running, Role: LEADER
I20260709 12:17:27.240680 24125 consensus_queue.cc:237] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:27.249711 23701 catalog_manager.cc:5697] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 reported cstate change: term changed from 3 to 4, leader changed from 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195) to cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193). New cstate: current_term: 4 leader_uuid: "cdf181ff3be844e8b834e63e4b7869b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:27.352313 24122 raft_consensus.cc:993] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73: : Instructing follower cdf181ff3be844e8b834e63e4b7869b7 to start an election
I20260709 12:17:27.352882 24126 raft_consensus.cc:1081] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 LEADER]: Signalling peer cdf181ff3be844e8b834e63e4b7869b7 to start an election
I20260709 12:17:27.354530 23804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b9b9a00169a4e9baa1cc18be0940f54"
dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
 from {username='slave'} at 127.0.0.1:51736
I20260709 12:17:27.355072 23804 raft_consensus.cc:493] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:27.355496 23804 raft_consensus.cc:3060] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:27.360803 23804 raft_consensus.cc:515] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:27.362565 23804 leader_election.cc:290] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 4 election: Requested vote from peers 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:27.363662 23877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b9a00169a4e9baa1cc18be0940f54" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4d358937860e459f9e166a492245ea21"
I20260709 12:17:27.363857 23952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9b9a00169a4e9baa1cc18be0940f54" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
I20260709 12:17:27.364374 23877 raft_consensus.cc:3060] T 6b9b9a00169a4e9baa1cc18be0940f54 P 4d358937860e459f9e166a492245ea21 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:27.364462 23952 raft_consensus.cc:3055] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:27.364884 23952 raft_consensus.cc:740] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 77d535b4d74e4f59b15c3fa20dbdbf73, State: Running, Role: LEADER
I20260709 12:17:27.365792 23952 consensus_queue.cc:260] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:27.367110 23952 raft_consensus.cc:3060] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:27.372264 23877 raft_consensus.cc:2468] T 6b9b9a00169a4e9baa1cc18be0940f54 P 4d358937860e459f9e166a492245ea21 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdf181ff3be844e8b834e63e4b7869b7 in term 4.
I20260709 12:17:27.373651 23768 leader_election.cc:304] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d358937860e459f9e166a492245ea21, cdf181ff3be844e8b834e63e4b7869b7; no voters: 
I20260709 12:17:27.374321 23952 raft_consensus.cc:2468] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdf181ff3be844e8b834e63e4b7869b7 in term 4.
I20260709 12:17:27.374423 24125 raft_consensus.cc:2804] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:27.374980 24125 raft_consensus.cc:697] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [term 4 LEADER]: Becoming Leader. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Running, Role: LEADER
I20260709 12:17:27.375945 24125 consensus_queue.cc:237] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:27.383507 23701 catalog_manager.cc:5697] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 reported cstate change: term changed from 3 to 4, leader changed from 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195) to cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193). New cstate: current_term: 4 leader_uuid: "cdf181ff3be844e8b834e63e4b7869b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:27.400520 24135 raft_consensus.cc:993] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21: : Instructing follower cdf181ff3be844e8b834e63e4b7869b7 to start an election
I20260709 12:17:27.401152 24135 raft_consensus.cc:1081] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [term 1 LEADER]: Signalling peer cdf181ff3be844e8b834e63e4b7869b7 to start an election
I20260709 12:17:27.402753 23804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb47341c94564f6d828ff2feabe4ec0f"
dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
 from {username='slave'} at 127.0.0.1:51752
I20260709 12:17:27.403280 23804 raft_consensus.cc:493] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:27.403590 23804 raft_consensus.cc:3060] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.407924 23804 raft_consensus.cc:515] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:27.409531 23804 leader_election.cc:290] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 2 election: Requested vote from peers 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:27.410358 23877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb47341c94564f6d828ff2feabe4ec0f" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d358937860e459f9e166a492245ea21"
I20260709 12:17:27.410961 23877 raft_consensus.cc:3055] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:27.410821 23952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb47341c94564f6d828ff2feabe4ec0f" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
I20260709 12:17:27.411295 23877 raft_consensus.cc:740] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d358937860e459f9e166a492245ea21, State: Running, Role: LEADER
I20260709 12:17:27.411455 23952 raft_consensus.cc:3060] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.412169 23877 consensus_queue.cc:260] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:27.413452 23877 raft_consensus.cc:3060] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.418310 23952 raft_consensus.cc:2468] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdf181ff3be844e8b834e63e4b7869b7 in term 2.
I20260709 12:17:27.419631 23877 raft_consensus.cc:2468] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdf181ff3be844e8b834e63e4b7869b7 in term 2.
I20260709 12:17:27.419780 23767 leader_election.cc:304] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77d535b4d74e4f59b15c3fa20dbdbf73, cdf181ff3be844e8b834e63e4b7869b7; no voters: 
I20260709 12:17:27.420855 24125 raft_consensus.cc:2804] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:27.421334 24125 raft_consensus.cc:697] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [term 2 LEADER]: Becoming Leader. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Running, Role: LEADER
I20260709 12:17:27.422160 24125 consensus_queue.cc:237] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:27.430120 23701 catalog_manager.cc:5697] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 reported cstate change: term changed from 1 to 2, leader changed from 4d358937860e459f9e166a492245ea21 (127.22.155.194) to cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "cdf181ff3be844e8b834e63e4b7869b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:27.440800 24136 raft_consensus.cc:993] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21: : Instructing follower cdf181ff3be844e8b834e63e4b7869b7 to start an election
I20260709 12:17:27.441259 24135 raft_consensus.cc:1081] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [term 2 LEADER]: Signalling peer cdf181ff3be844e8b834e63e4b7869b7 to start an election
I20260709 12:17:27.442667 23804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa351a9bbfba435186b9cb98204fbb64"
dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
 from {username='slave'} at 127.0.0.1:51752
I20260709 12:17:27.443192 23804 raft_consensus.cc:493] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:27.443511 23804 raft_consensus.cc:3060] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:27.448256 23804 raft_consensus.cc:515] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:27.450309 23804 leader_election.cc:290] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 3 election: Requested vote from peers 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:27.450620 23877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa351a9bbfba435186b9cb98204fbb64" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d358937860e459f9e166a492245ea21"
I20260709 12:17:27.450955 23952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa351a9bbfba435186b9cb98204fbb64" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
I20260709 12:17:27.451157 23877 raft_consensus.cc:3055] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:27.451617 23952 raft_consensus.cc:3060] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:27.451869 23877 raft_consensus.cc:740] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4d358937860e459f9e166a492245ea21, State: Running, Role: LEADER
I20260709 12:17:27.452625 23877 consensus_queue.cc:260] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:27.453613 23877 raft_consensus.cc:3060] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:27.457729 23952 raft_consensus.cc:2468] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdf181ff3be844e8b834e63e4b7869b7 in term 3.
I20260709 12:17:27.457894 23877 raft_consensus.cc:2468] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdf181ff3be844e8b834e63e4b7869b7 in term 3.
I20260709 12:17:27.458498 23953 raft_consensus.cc:1240] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 FOLLOWER]: Rejecting Update request from peer 4d358937860e459f9e166a492245ea21 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:27.459013 23767 leader_election.cc:304] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77d535b4d74e4f59b15c3fa20dbdbf73, cdf181ff3be844e8b834e63e4b7869b7; no voters: 
I20260709 12:17:27.459939 24125 raft_consensus.cc:2804] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:27.460427 24125 raft_consensus.cc:697] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 3 LEADER]: Becoming Leader. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Running, Role: LEADER
I20260709 12:17:27.461311 24125 consensus_queue.cc:237] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:27.468847 23701 catalog_manager.cc:5697] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 reported cstate change: term changed from 2 to 3, leader changed from 4d358937860e459f9e166a492245ea21 (127.22.155.194) to cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193). New cstate: current_term: 3 leader_uuid: "cdf181ff3be844e8b834e63e4b7869b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:27.505226 24136 raft_consensus.cc:993] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21: : Instructing follower cdf181ff3be844e8b834e63e4b7869b7 to start an election
I20260709 12:17:27.505800 24135 raft_consensus.cc:1081] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 [term 2 LEADER]: Signalling peer cdf181ff3be844e8b834e63e4b7869b7 to start an election
I20260709 12:17:27.507478 23804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "512dbe65edfe4c3d996d129d188325c0"
dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
 from {username='slave'} at 127.0.0.1:51752
I20260709 12:17:27.507956 23804 raft_consensus.cc:493] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:27.508235 23804 raft_consensus.cc:3060] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:27.512243 23804 raft_consensus.cc:515] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:27.513622 23804 leader_election.cc:290] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 3 election: Requested vote from peers 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:27.514505 23877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512dbe65edfe4c3d996d129d188325c0" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d358937860e459f9e166a492245ea21"
I20260709 12:17:27.514794 23953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512dbe65edfe4c3d996d129d188325c0" candidate_uuid: "cdf181ff3be844e8b834e63e4b7869b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
I20260709 12:17:27.515012 23877 raft_consensus.cc:3055] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:27.515411 23953 raft_consensus.cc:3060] T 512dbe65edfe4c3d996d129d188325c0 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:27.515424 23877 raft_consensus.cc:740] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4d358937860e459f9e166a492245ea21, State: Running, Role: LEADER
I20260709 12:17:27.516391 23877 consensus_queue.cc:260] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:27.517318 23877 raft_consensus.cc:3060] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:27.520891 23953 raft_consensus.cc:2468] T 512dbe65edfe4c3d996d129d188325c0 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdf181ff3be844e8b834e63e4b7869b7 in term 3.
I20260709 12:17:27.521934 23877 raft_consensus.cc:2468] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdf181ff3be844e8b834e63e4b7869b7 in term 3.
I20260709 12:17:27.521946 23767 leader_election.cc:304] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77d535b4d74e4f59b15c3fa20dbdbf73, cdf181ff3be844e8b834e63e4b7869b7; no voters: 
I20260709 12:17:27.522936 24125 raft_consensus.cc:2804] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:27.523420 24125 raft_consensus.cc:697] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [term 3 LEADER]: Becoming Leader. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Running, Role: LEADER
I20260709 12:17:27.524199 24125 consensus_queue.cc:237] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:27.531586 23701 catalog_manager.cc:5697] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 reported cstate change: term changed from 2 to 3, leader changed from 4d358937860e459f9e166a492245ea21 (127.22.155.194) to cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193). New cstate: current_term: 3 leader_uuid: "cdf181ff3be844e8b834e63e4b7869b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:27.745047 23877 raft_consensus.cc:1275] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 4 FOLLOWER]: Refusing update from remote peer cdf181ff3be844e8b834e63e4b7869b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:27.745081 23953 raft_consensus.cc:1275] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 4 FOLLOWER]: Refusing update from remote peer cdf181ff3be844e8b834e63e4b7869b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:27.746937 24127 consensus_queue.cc:1048] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:27.747781 24125 consensus_queue.cc:1048] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:27.791683 23877 raft_consensus.cc:1275] T 6b9b9a00169a4e9baa1cc18be0940f54 P 4d358937860e459f9e166a492245ea21 [term 4 FOLLOWER]: Refusing update from remote peer cdf181ff3be844e8b834e63e4b7869b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:27.793015 24146 consensus_queue.cc:1048] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:27.802335 23953 raft_consensus.cc:1275] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 4 FOLLOWER]: Refusing update from remote peer cdf181ff3be844e8b834e63e4b7869b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:27.803992 24142 consensus_queue.cc:1048] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:27.823203 23877 raft_consensus.cc:1275] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Refusing update from remote peer cdf181ff3be844e8b834e63e4b7869b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:27.824393 24127 consensus_queue.cc:1048] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:27.835356 23953 raft_consensus.cc:1275] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Refusing update from remote peer cdf181ff3be844e8b834e63e4b7869b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:27.836894 24127 consensus_queue.cc:1048] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:27.942915 23877 raft_consensus.cc:1275] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 [term 3 FOLLOWER]: Refusing update from remote peer cdf181ff3be844e8b834e63e4b7869b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:27.944175 24127 consensus_queue.cc:1048] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:27.954259 23953 raft_consensus.cc:1275] T 512dbe65edfe4c3d996d129d188325c0 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 FOLLOWER]: Refusing update from remote peer cdf181ff3be844e8b834e63e4b7869b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:27.956701 23878 raft_consensus.cc:1275] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [term 3 FOLLOWER]: Refusing update from remote peer cdf181ff3be844e8b834e63e4b7869b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:27.958320 24125 consensus_queue.cc:1048] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:27.958753 24146 consensus_queue.cc:1048] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:27.973313 23953 raft_consensus.cc:1275] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 FOLLOWER]: Refusing update from remote peer cdf181ff3be844e8b834e63e4b7869b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:27.976169 24127 consensus_queue.cc:1048] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:30.220623 23151 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:17:30.221692 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:30.232851 23804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09f952f11a13489098c690696373b9b7"
dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
mode: GRACEFUL
new_leader_uuid: "4d358937860e459f9e166a492245ea21"
 from {username='slave'} at 127.0.0.1:51764
I20260709 12:17:30.233636 23804 raft_consensus.cc:606] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 LEADER]: Received request to transfer leadership to TS 4d358937860e459f9e166a492245ea21
I20260709 12:17:30.237324 23804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb47341c94564f6d828ff2feabe4ec0f"
dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
mode: GRACEFUL
new_leader_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
 from {username='slave'} at 127.0.0.1:51764
I20260709 12:17:30.238009 23804 raft_consensus.cc:606] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [term 2 LEADER]: Received request to transfer leadership to TS 77d535b4d74e4f59b15c3fa20dbdbf73
I20260709 12:17:30.240937 23804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc3223e00e774a718ab27e3a4f998bd4"
dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
mode: GRACEFUL
new_leader_uuid: "4d358937860e459f9e166a492245ea21"
 from {username='slave'} at 127.0.0.1:51764
I20260709 12:17:30.241564 23804 raft_consensus.cc:606] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 4 LEADER]: Received request to transfer leadership to TS 4d358937860e459f9e166a492245ea21
I20260709 12:17:30.244287 23804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa351a9bbfba435186b9cb98204fbb64"
dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
mode: GRACEFUL
new_leader_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
 from {username='slave'} at 127.0.0.1:51764
I20260709 12:17:30.244853 23804 raft_consensus.cc:606] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 3 LEADER]: Received request to transfer leadership to TS 77d535b4d74e4f59b15c3fa20dbdbf73
I20260709 12:17:30.245867 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:17:30.246484 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:30.263371 24125 raft_consensus.cc:993] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7: : Instructing follower 77d535b4d74e4f59b15c3fa20dbdbf73 to start an election
I20260709 12:17:30.263931 24125 raft_consensus.cc:1081] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [term 2 LEADER]: Signalling peer 77d535b4d74e4f59b15c3fa20dbdbf73 to start an election
I20260709 12:17:30.265616 23952 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb47341c94564f6d828ff2feabe4ec0f"
dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
 from {username='slave'} at 127.0.0.1:34860
I20260709 12:17:30.266104 23952 raft_consensus.cc:493] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:30.266422 23952 raft_consensus.cc:3060] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:30.272193 23952 raft_consensus.cc:515] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:30.274367 23952 leader_election.cc:290] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 3 election: Requested vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429)
I20260709 12:17:30.275476 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb47341c94564f6d828ff2feabe4ec0f" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
I20260709 12:17:30.275478 23877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb47341c94564f6d828ff2feabe4ec0f" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d358937860e459f9e166a492245ea21"
I20260709 12:17:30.276219 23804 raft_consensus.cc:3055] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:30.276224 23877 raft_consensus.cc:3060] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:30.276724 23804 raft_consensus.cc:740] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Running, Role: LEADER
I20260709 12:17:30.277465 23804 consensus_queue.cc:260] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:30.278394 23804 raft_consensus.cc:3060] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:30.281116 23877 raft_consensus.cc:2468] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77d535b4d74e4f59b15c3fa20dbdbf73 in term 3.
I20260709 12:17:30.282294 23917 leader_election.cc:304] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d358937860e459f9e166a492245ea21, 77d535b4d74e4f59b15c3fa20dbdbf73; no voters: 
I20260709 12:17:30.283167 24122 raft_consensus.cc:2804] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:30.283629 23804 raft_consensus.cc:2468] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77d535b4d74e4f59b15c3fa20dbdbf73 in term 3.
I20260709 12:17:30.284327 24122 raft_consensus.cc:697] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 LEADER]: Becoming Leader. State: Replica: 77d535b4d74e4f59b15c3fa20dbdbf73, State: Running, Role: LEADER
I20260709 12:17:30.285218 24122 consensus_queue.cc:237] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:30.292052 23699 catalog_manager.cc:5697] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73 reported cstate change: term changed from 2 to 3, leader changed from cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193) to 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195). New cstate: current_term: 3 leader_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:30.446686 24127 raft_consensus.cc:993] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7: : Instructing follower 4d358937860e459f9e166a492245ea21 to start an election
I20260709 12:17:30.447225 24125 raft_consensus.cc:1081] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 4 LEADER]: Signalling peer 4d358937860e459f9e166a492245ea21 to start an election
I20260709 12:17:30.448891 23877 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc3223e00e774a718ab27e3a4f998bd4"
dest_uuid: "4d358937860e459f9e166a492245ea21"
 from {username='slave'} at 127.0.0.1:58976
I20260709 12:17:30.449396 23877 raft_consensus.cc:493] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:30.449750 23877 raft_consensus.cc:3060] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:30.454478 23877 raft_consensus.cc:515] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:30.456822 23877 leader_election.cc:290] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 5 election: Requested vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:30.457899 23952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc3223e00e774a718ab27e3a4f998bd4" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
I20260709 12:17:30.457924 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc3223e00e774a718ab27e3a4f998bd4" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
I20260709 12:17:30.458413 23952 raft_consensus.cc:3060] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:30.458627 23804 raft_consensus.cc:3055] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:30.458957 23804 raft_consensus.cc:740] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Running, Role: LEADER
I20260709 12:17:30.459652 23804 consensus_queue.cc:260] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:30.460681 23804 raft_consensus.cc:3060] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:30.463963 23952 raft_consensus.cc:2468] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d358937860e459f9e166a492245ea21 in term 5.
I20260709 12:17:30.465313 23842 leader_election.cc:304] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d358937860e459f9e166a492245ea21, 77d535b4d74e4f59b15c3fa20dbdbf73; no voters: 
I20260709 12:17:30.466082 24162 raft_consensus.cc:2804] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:30.466451 23804 raft_consensus.cc:2468] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d358937860e459f9e166a492245ea21 in term 5.
I20260709 12:17:30.467597 24162 raft_consensus.cc:697] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 5 LEADER]: Becoming Leader. State: Replica: 4d358937860e459f9e166a492245ea21, State: Running, Role: LEADER
I20260709 12:17:30.468477 24162 consensus_queue.cc:237] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:30.475288 23699 catalog_manager.cc:5697] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 reported cstate change: term changed from 4 to 5, leader changed from cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193) to 4d358937860e459f9e166a492245ea21 (127.22.155.194). New cstate: current_term: 5 leader_uuid: "4d358937860e459f9e166a492245ea21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:30.692320 24127 raft_consensus.cc:993] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7: : Instructing follower 4d358937860e459f9e166a492245ea21 to start an election
I20260709 12:17:30.693156 24125 raft_consensus.cc:1081] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 LEADER]: Signalling peer 4d358937860e459f9e166a492245ea21 to start an election
I20260709 12:17:30.695029 23877 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09f952f11a13489098c690696373b9b7"
dest_uuid: "4d358937860e459f9e166a492245ea21"
 from {username='slave'} at 127.0.0.1:58976
I20260709 12:17:30.695648 23877 raft_consensus.cc:493] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:30.695940 23877 raft_consensus.cc:3060] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:30.703373 23877 raft_consensus.cc:515] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:30.705331 23877 leader_election.cc:290] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 3 election: Requested vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195:41371)
I20260709 12:17:30.707288 23952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f952f11a13489098c690696373b9b7" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
I20260709 12:17:30.707161 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f952f11a13489098c690696373b9b7" candidate_uuid: "4d358937860e459f9e166a492245ea21" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
I20260709 12:17:30.707960 23804 raft_consensus.cc:3055] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:30.707969 23952 raft_consensus.cc:3060] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:30.708398 23804 raft_consensus.cc:740] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Running, Role: LEADER
I20260709 12:17:30.709664 23804 consensus_queue.cc:260] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:30.711153 23804 raft_consensus.cc:3060] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:30.714731 23952 raft_consensus.cc:2468] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d358937860e459f9e166a492245ea21 in term 3.
I20260709 12:17:30.716071 23842 leader_election.cc:304] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d358937860e459f9e166a492245ea21, 77d535b4d74e4f59b15c3fa20dbdbf73; no voters: 
I20260709 12:17:30.716711 23804 raft_consensus.cc:2468] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d358937860e459f9e166a492245ea21 in term 3.
I20260709 12:17:30.717294 24162 raft_consensus.cc:2804] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:30.717871 24162 raft_consensus.cc:697] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21 [term 3 LEADER]: Becoming Leader. State: Replica: 4d358937860e459f9e166a492245ea21, State: Running, Role: LEADER
I20260709 12:17:30.719192 24162 consensus_queue.cc:237] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:30.721747 23877 raft_consensus.cc:1275] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [term 3 FOLLOWER]: Refusing update from remote peer 77d535b4d74e4f59b15c3fa20dbdbf73: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:30.723347 24122 consensus_queue.cc:1048] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:30.731755 23699 catalog_manager.cc:5697] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21 reported cstate change: term changed from 2 to 3, leader changed from cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193) to 4d358937860e459f9e166a492245ea21 (127.22.155.194). New cstate: current_term: 3 leader_uuid: "4d358937860e459f9e166a492245ea21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:30.737587 23804 raft_consensus.cc:1275] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [term 3 FOLLOWER]: Refusing update from remote peer 77d535b4d74e4f59b15c3fa20dbdbf73: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:30.742990 24122 consensus_queue.cc:1048] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:30.823873 24127 raft_consensus.cc:993] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7: : Instructing follower 77d535b4d74e4f59b15c3fa20dbdbf73 to start an election
I20260709 12:17:30.824609 24125 raft_consensus.cc:1081] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 3 LEADER]: Signalling peer 77d535b4d74e4f59b15c3fa20dbdbf73 to start an election
I20260709 12:17:30.826411 23952 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa351a9bbfba435186b9cb98204fbb64"
dest_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73"
 from {username='slave'} at 127.0.0.1:34860
I20260709 12:17:30.826949 23952 raft_consensus.cc:493] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:30.827275 23952 raft_consensus.cc:3060] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:30.831645 23952 raft_consensus.cc:515] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:30.833209 23952 leader_election.cc:290] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 4 election: Requested vote from peers cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899), 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429)
I20260709 12:17:30.834340 23877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa351a9bbfba435186b9cb98204fbb64" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4d358937860e459f9e166a492245ea21"
I20260709 12:17:30.834340 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa351a9bbfba435186b9cb98204fbb64" candidate_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cdf181ff3be844e8b834e63e4b7869b7"
I20260709 12:17:30.835042 23877 raft_consensus.cc:3060] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:30.835047 23804 raft_consensus.cc:3055] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:30.835572 23804 raft_consensus.cc:740] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cdf181ff3be844e8b834e63e4b7869b7, State: Running, Role: LEADER
I20260709 12:17:30.836519 23804 consensus_queue.cc:260] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:30.837772 23804 raft_consensus.cc:3060] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:30.841948 23877 raft_consensus.cc:2468] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77d535b4d74e4f59b15c3fa20dbdbf73 in term 4.
I20260709 12:17:30.843457 23917 leader_election.cc:304] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d358937860e459f9e166a492245ea21, 77d535b4d74e4f59b15c3fa20dbdbf73; no voters: 
I20260709 12:17:30.844563 24156 raft_consensus.cc:2804] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:30.845192 24156 raft_consensus.cc:697] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 4 LEADER]: Becoming Leader. State: Replica: 77d535b4d74e4f59b15c3fa20dbdbf73, State: Running, Role: LEADER
I20260709 12:17:30.846760 24156 consensus_queue.cc:237] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } }
I20260709 12:17:30.845273 23804 raft_consensus.cc:2468] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77d535b4d74e4f59b15c3fa20dbdbf73 in term 4.
I20260709 12:17:30.854836 23699 catalog_manager.cc:5697] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 reported cstate change: term changed from 3 to 4, leader changed from cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193) to 77d535b4d74e4f59b15c3fa20dbdbf73 (127.22.155.195). New cstate: current_term: 4 leader_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:30.885697 23952 raft_consensus.cc:1275] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 5 FOLLOWER]: Refusing update from remote peer 4d358937860e459f9e166a492245ea21: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:17:30.887097 24162 consensus_queue.cc:1048] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:30.899410 23804 raft_consensus.cc:1275] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 5 FOLLOWER]: Refusing update from remote peer 4d358937860e459f9e166a492245ea21: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:17:30.901059 24163 consensus_queue.cc:1048] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:31.131664 23953 raft_consensus.cc:1275] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 FOLLOWER]: Refusing update from remote peer 4d358937860e459f9e166a492245ea21: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:31.133114 24163 consensus_queue.cc:1048] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77d535b4d74e4f59b15c3fa20dbdbf73" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:31.143880 23804 raft_consensus.cc:1275] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 [term 3 FOLLOWER]: Refusing update from remote peer 4d358937860e459f9e166a492245ea21: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:31.145777 24163 consensus_queue.cc:1048] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:31.247815 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:31.253747 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:31.254258 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:31.448012 23877 raft_consensus.cc:1275] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [term 4 FOLLOWER]: Refusing update from remote peer 77d535b4d74e4f59b15c3fa20dbdbf73: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:31.449816 24156 consensus_queue.cc:1048] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d358937860e459f9e166a492245ea21" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:31.457329 23804 raft_consensus.cc:1275] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 4 FOLLOWER]: Refusing update from remote peer 77d535b4d74e4f59b15c3fa20dbdbf73: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:31.459208 24156 consensus_queue.cc:1048] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdf181ff3be844e8b834e63e4b7869b7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:32.255400 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:32.261137 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:32.261615 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:33.262639 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:33.270030 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:33.270490 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:34.271508 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:34.277443 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:34.277951 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:35.279068 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:35.285162 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:35.285686 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:36.286823 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:36.292594 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:36.293164 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:37.294261 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:37.299924 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:37.300467 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:38.301699 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:38.306928 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:38.307421 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:39.308513 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:39.314239 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:39.314760 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:40.351027 23151 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:17:40.351672 23151 tablet_server.cc:179] TabletServer@127.22.155.193:0 shutting down...
W20260709 12:17:40.374748 23845 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
W20260709 12:17:40.380980 23845 consensus_peers.cc:597] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21 -> Peer cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899): Couldn't send request to peer cdf181ff3be844e8b834e63e4b7869b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:40.391866 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:40.392838 23151 tablet_replica.cc:333] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7: stopping tablet replica
W20260709 12:17:40.393433 23845 consensus_peers.cc:597] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21 -> Peer cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899): Couldn't send request to peer cdf181ff3be844e8b834e63e4b7869b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:40.393540 23151 raft_consensus.cc:2243] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:40.394408 23151 raft_consensus.cc:2272] T cb47341c94564f6d828ff2feabe4ec0f P cdf181ff3be844e8b834e63e4b7869b7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.396867 23151 tablet_replica.cc:333] T 78d98d7b027f40cdac191caf3e580679 P cdf181ff3be844e8b834e63e4b7869b7: stopping tablet replica
I20260709 12:17:40.397644 23151 raft_consensus.cc:2243] T 78d98d7b027f40cdac191caf3e580679 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:40.398181 23151 raft_consensus.cc:2272] T 78d98d7b027f40cdac191caf3e580679 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.400274 23151 tablet_replica.cc:333] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7: stopping tablet replica
I20260709 12:17:40.400890 23151 raft_consensus.cc:2243] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:40.401254 23151 raft_consensus.cc:2272] T fa351a9bbfba435186b9cb98204fbb64 P cdf181ff3be844e8b834e63e4b7869b7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.402899 23151 tablet_replica.cc:333] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7: stopping tablet replica
I20260709 12:17:40.403357 23151 raft_consensus.cc:2243] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:40.404114 23151 raft_consensus.cc:2272] T 512dbe65edfe4c3d996d129d188325c0 P cdf181ff3be844e8b834e63e4b7869b7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.405867 23151 tablet_replica.cc:333] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7: stopping tablet replica
I20260709 12:17:40.406338 23151 raft_consensus.cc:2243] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:40.406690 23151 raft_consensus.cc:2272] T cc3223e00e774a718ab27e3a4f998bd4 P cdf181ff3be844e8b834e63e4b7869b7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.408351 23151 tablet_replica.cc:333] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7: stopping tablet replica
I20260709 12:17:40.408885 23151 raft_consensus.cc:2243] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:17:40.409637 23151 raft_consensus.cc:2272] T 6b9b9a00169a4e9baa1cc18be0940f54 P cdf181ff3be844e8b834e63e4b7869b7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.411307 23151 tablet_replica.cc:333] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7: stopping tablet replica
I20260709 12:17:40.411747 23151 raft_consensus.cc:2243] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:40.412107 23151 raft_consensus.cc:2272] T 09f952f11a13489098c690696373b9b7 P cdf181ff3be844e8b834e63e4b7869b7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.413817 23151 tablet_replica.cc:333] T 8076306a710440779e266942ec39c883 P cdf181ff3be844e8b834e63e4b7869b7: stopping tablet replica
I20260709 12:17:40.414314 23151 raft_consensus.cc:2243] T 8076306a710440779e266942ec39c883 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:40.414712 23151 raft_consensus.cc:2272] T 8076306a710440779e266942ec39c883 P cdf181ff3be844e8b834e63e4b7869b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.416499 23151 tablet_replica.cc:333] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7: stopping tablet replica
I20260709 12:17:40.417028 23151 raft_consensus.cc:2243] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:40.417804 23151 raft_consensus.cc:2272] T 8d39e331a2424292bc6f2c8bd10500d8 P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.419462 23151 tablet_replica.cc:333] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7: stopping tablet replica
I20260709 12:17:40.419935 23151 raft_consensus.cc:2243] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:40.420763 23151 raft_consensus.cc:2272] T 9921ab8d07eb4dc9b603c5a95302e70f P cdf181ff3be844e8b834e63e4b7869b7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:40.443718 23919 consensus_peers.cc:597] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73 -> Peer cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899): Couldn't send request to peer cdf181ff3be844e8b834e63e4b7869b7. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:42899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:40.454975 23151 tablet_server.cc:196] TabletServer@127.22.155.193:0 shutdown complete.
W20260709 12:17:40.475127 23919 consensus_peers.cc:597] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73 -> Peer cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899): Couldn't send request to peer cdf181ff3be844e8b834e63e4b7869b7. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:42899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:40.480278 23151 tablet_server.cc:179] TabletServer@127.22.155.194:0 shutting down...
W20260709 12:17:40.494194 23917 consensus_peers.cc:597] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73 -> Peer 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429): Couldn't send request to peer 4d358937860e459f9e166a492245ea21. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:40.514134 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:40.515122 23151 tablet_replica.cc:333] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21: stopping tablet replica
I20260709 12:17:40.516155 23151 raft_consensus.cc:2243] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:17:40.516140 23919 consensus_peers.cc:597] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 -> Peer cdf181ff3be844e8b834e63e4b7869b7 (127.22.155.193:42899): Couldn't send request to peer cdf181ff3be844e8b834e63e4b7869b7. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:42899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:40.517107 23151 raft_consensus.cc:2272] T 78d98d7b027f40cdac191caf3e580679 P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.519163 23151 tablet_replica.cc:333] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21: stopping tablet replica
I20260709 12:17:40.519809 23151 raft_consensus.cc:2243] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:40.520223 23151 raft_consensus.cc:2272] T 512dbe65edfe4c3d996d129d188325c0 P 4d358937860e459f9e166a492245ea21 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.522104 23151 tablet_replica.cc:333] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21: stopping tablet replica
I20260709 12:17:40.522653 23151 raft_consensus.cc:2243] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:40.523093 23151 raft_consensus.cc:2272] T cb47341c94564f6d828ff2feabe4ec0f P 4d358937860e459f9e166a492245ea21 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.524989 23151 tablet_replica.cc:333] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21: stopping tablet replica
I20260709 12:17:40.525461 23151 raft_consensus.cc:2243] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:40.525832 23151 raft_consensus.cc:2272] T fa351a9bbfba435186b9cb98204fbb64 P 4d358937860e459f9e166a492245ea21 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.527801 23151 tablet_replica.cc:333] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21: stopping tablet replica
I20260709 12:17:40.528556 23151 raft_consensus.cc:2243] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:40.529386 23151 raft_consensus.cc:2272] T 09f952f11a13489098c690696373b9b7 P 4d358937860e459f9e166a492245ea21 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.531066 23151 tablet_replica.cc:333] T 6b9b9a00169a4e9baa1cc18be0940f54 P 4d358937860e459f9e166a492245ea21: stopping tablet replica
I20260709 12:17:40.531602 23151 raft_consensus.cc:2243] T 6b9b9a00169a4e9baa1cc18be0940f54 P 4d358937860e459f9e166a492245ea21 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:40.532070 23151 raft_consensus.cc:2272] T 6b9b9a00169a4e9baa1cc18be0940f54 P 4d358937860e459f9e166a492245ea21 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.533864 23151 tablet_replica.cc:333] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21: stopping tablet replica
I20260709 12:17:40.534385 23151 raft_consensus.cc:2243] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:17:40.535109 23151 raft_consensus.cc:2272] T cc3223e00e774a718ab27e3a4f998bd4 P 4d358937860e459f9e166a492245ea21 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.536885 23151 tablet_replica.cc:333] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21: stopping tablet replica
I20260709 12:17:40.537374 23151 raft_consensus.cc:2243] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:40.538144 23151 raft_consensus.cc:2272] T 8076306a710440779e266942ec39c883 P 4d358937860e459f9e166a492245ea21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.540184 23151 tablet_replica.cc:333] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21: stopping tablet replica
I20260709 12:17:40.540725 23151 raft_consensus.cc:2243] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:40.541139 23151 raft_consensus.cc:2272] T 9921ab8d07eb4dc9b603c5a95302e70f P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.542680 23151 tablet_replica.cc:333] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21: stopping tablet replica
I20260709 12:17:40.543102 23151 raft_consensus.cc:2243] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:40.543514 23151 raft_consensus.cc:2272] T 8d39e331a2424292bc6f2c8bd10500d8 P 4d358937860e459f9e166a492245ea21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.572928 23151 tablet_server.cc:196] TabletServer@127.22.155.194:0 shutdown complete.
I20260709 12:17:40.594799 23151 tablet_server.cc:179] TabletServer@127.22.155.195:0 shutting down...
W20260709 12:17:40.602723 23917 consensus_peers.cc:597] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 -> Peer 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429): Couldn't send request to peer 4d358937860e459f9e166a492245ea21. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:41429: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:40.612967 23917 consensus_peers.cc:597] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73 -> Peer 4d358937860e459f9e166a492245ea21 (127.22.155.194:41429): Couldn't send request to peer 4d358937860e459f9e166a492245ea21. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:41429: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:40.632249 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:40.633019 23151 tablet_replica.cc:333] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73: stopping tablet replica
I20260709 12:17:40.633795 23151 raft_consensus.cc:2243] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:40.634635 23151 raft_consensus.cc:2272] T 78d98d7b027f40cdac191caf3e580679 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.636751 23151 tablet_replica.cc:333] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73: stopping tablet replica
I20260709 12:17:40.637288 23151 raft_consensus.cc:2243] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:40.638000 23151 raft_consensus.cc:2272] T cb47341c94564f6d828ff2feabe4ec0f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.639688 23151 tablet_replica.cc:333] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73: stopping tablet replica
I20260709 12:17:40.640211 23151 raft_consensus.cc:2243] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:17:40.641018 23151 raft_consensus.cc:2272] T fa351a9bbfba435186b9cb98204fbb64 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.642647 23151 tablet_replica.cc:333] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73: stopping tablet replica
I20260709 12:17:40.643168 23151 raft_consensus.cc:2243] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:40.643587 23151 raft_consensus.cc:2272] T 09f952f11a13489098c690696373b9b7 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.645421 23151 tablet_replica.cc:333] T 8076306a710440779e266942ec39c883 P 77d535b4d74e4f59b15c3fa20dbdbf73: stopping tablet replica
I20260709 12:17:40.645921 23151 raft_consensus.cc:2243] T 8076306a710440779e266942ec39c883 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:40.646333 23151 raft_consensus.cc:2272] T 8076306a710440779e266942ec39c883 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.648085 23151 tablet_replica.cc:333] T 9921ab8d07eb4dc9b603c5a95302e70f P 77d535b4d74e4f59b15c3fa20dbdbf73: stopping tablet replica
I20260709 12:17:40.648602 23151 raft_consensus.cc:2243] T 9921ab8d07eb4dc9b603c5a95302e70f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:40.649103 23151 raft_consensus.cc:2272] T 9921ab8d07eb4dc9b603c5a95302e70f P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.650776 23151 tablet_replica.cc:333] T 8d39e331a2424292bc6f2c8bd10500d8 P 77d535b4d74e4f59b15c3fa20dbdbf73: stopping tablet replica
I20260709 12:17:40.651261 23151 raft_consensus.cc:2243] T 8d39e331a2424292bc6f2c8bd10500d8 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:40.651649 23151 raft_consensus.cc:2272] T 8d39e331a2424292bc6f2c8bd10500d8 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.653353 23151 tablet_replica.cc:333] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73: stopping tablet replica
I20260709 12:17:40.653848 23151 raft_consensus.cc:2243] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:40.654280 23151 raft_consensus.cc:2272] T 6b9b9a00169a4e9baa1cc18be0940f54 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.655982 23151 tablet_replica.cc:333] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73: stopping tablet replica
I20260709 12:17:40.656471 23151 raft_consensus.cc:2243] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:40.656957 23151 raft_consensus.cc:2272] T cc3223e00e774a718ab27e3a4f998bd4 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.658483 23151 tablet_replica.cc:333] T 512dbe65edfe4c3d996d129d188325c0 P 77d535b4d74e4f59b15c3fa20dbdbf73: stopping tablet replica
I20260709 12:17:40.658926 23151 raft_consensus.cc:2243] T 512dbe65edfe4c3d996d129d188325c0 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:40.659348 23151 raft_consensus.cc:2272] T 512dbe65edfe4c3d996d129d188325c0 P 77d535b4d74e4f59b15c3fa20dbdbf73 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.702311 23151 tablet_server.cc:196] TabletServer@127.22.155.195:0 shutdown complete.
I20260709 12:17:40.729449 23151 master.cc:562] Master@127.22.155.254:36387 shutting down...
I20260709 12:17:40.757777 23151 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 684b39eaad3249a59c92fb05d0d2576b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:40.758754 23151 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 684b39eaad3249a59c92fb05d0d2576b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:40.759145 23151 tablet_replica.cc:333] T 00000000000000000000000000000000 P 684b39eaad3249a59c92fb05d0d2576b: stopping tablet replica
I20260709 12:17:40.781031 23151 master.cc:584] Master@127.22.155.254:36387 shutdown complete.
4d358937860e459f9e166a492245ea21  4
77d535b4d74e4f59b15c3fa20dbdbf73  1
cdf181ff3be844e8b834e63e4b7869b7  5
4d358937860e459f9e166a492245ea21  4
77d535b4d74e4f59b15c3fa20dbdbf73  3
cdf181ff3be844e8b834e63e4b7869b7  3
4d358937860e459f9e166a492245ea21  1
77d535b4d74e4f59b15c3fa20dbdbf73  1
cdf181ff3be844e8b834e63e4b7869b7  8
4d358937860e459f9e166a492245ea21  3
77d535b4d74e4f59b15c3fa20dbdbf73  3
cdf181ff3be844e8b834e63e4b7869b7  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (29041 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:17:40.831404 23151 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.155.254:34311
I20260709 12:17:40.833081 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:40.840251 24199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:40.840341 24198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:40.841399 24201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:40.842777 23151 server_base.cc:1061] running on GCE node
I20260709 12:17:40.843919 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:40.844137 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:40.844309 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599460844290 us; error 0 us; skew 500 ppm
I20260709 12:17:40.844959 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:40.847729 23151 webserver.cc:533] Webserver started at http://127.22.155.254:43173/ using document root <none> and password file <none>
I20260709 12:17:40.848268 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:40.848480 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:40.848822 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:40.850241 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/master-0-root/instance:
uuid: "68b836feee894afe8d95b23bdf764928"
format_stamp: "Formatted at 2026-07-09 12:17:40 on dist-test-slave-p7fg"
I20260709 12:17:40.855439 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.003s
I20260709 12:17:40.859511 24206 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:40.860349 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 12:17:40.860704 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/master-0-root
uuid: "68b836feee894afe8d95b23bdf764928"
format_stamp: "Formatted at 2026-07-09 12:17:40 on dist-test-slave-p7fg"
I20260709 12:17:40.860996 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:40.879523 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:40.881017 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:40.926963 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.254:34311
I20260709 12:17:40.927093 24257 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.254:34311 every 8 connection(s)
I20260709 12:17:40.931728 24258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:40.942271 24258 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928: Bootstrap starting.
I20260709 12:17:40.947319 24258 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:40.952196 24258 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928: No bootstrap required, opened a new log
I20260709 12:17:40.954525 24258 raft_consensus.cc:359] T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68b836feee894afe8d95b23bdf764928" member_type: VOTER }
I20260709 12:17:40.955036 24258 raft_consensus.cc:385] T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:40.955291 24258 raft_consensus.cc:740] T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68b836feee894afe8d95b23bdf764928, State: Initialized, Role: FOLLOWER
I20260709 12:17:40.955963 24258 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68b836feee894afe8d95b23bdf764928" member_type: VOTER }
I20260709 12:17:40.956465 24258 raft_consensus.cc:399] T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:17:40.956696 24258 raft_consensus.cc:493] T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:17:40.957038 24258 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:40.961229 24258 raft_consensus.cc:515] T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68b836feee894afe8d95b23bdf764928" member_type: VOTER }
I20260709 12:17:40.961849 24258 leader_election.cc:304] T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68b836feee894afe8d95b23bdf764928; no voters: 
I20260709 12:17:40.963498 24258 leader_election.cc:290] T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:17:40.963903 24261 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:40.965446 24261 raft_consensus.cc:697] T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928 [term 1 LEADER]: Becoming Leader. State: Replica: 68b836feee894afe8d95b23bdf764928, State: Running, Role: LEADER
I20260709 12:17:40.966300 24261 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68b836feee894afe8d95b23bdf764928" member_type: VOTER }
I20260709 12:17:40.967072 24258 sys_catalog.cc:565] T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:17:40.974124 24263 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68b836feee894afe8d95b23bdf764928. Latest consensus state: current_term: 1 leader_uuid: "68b836feee894afe8d95b23bdf764928" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68b836feee894afe8d95b23bdf764928" member_type: VOTER } }
I20260709 12:17:40.974785 24263 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928 [sys.catalog]: This master's current role is: LEADER
I20260709 12:17:40.976027 24262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "68b836feee894afe8d95b23bdf764928" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68b836feee894afe8d95b23bdf764928" member_type: VOTER } }
I20260709 12:17:40.977278 24262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928 [sys.catalog]: This master's current role is: LEADER
I20260709 12:17:40.978863 24270 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:17:40.986860 24270 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:17:40.987975 23151 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:17:40.996814 24270 catalog_manager.cc:1383] Generated new cluster ID: cb10d0b7f8884c9c86ba46f32a75ebc4
I20260709 12:17:40.997090 24270 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:17:41.021541 24270 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:17:41.022933 24270 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:17:41.037468 24270 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928: Generated new TSK 0
I20260709 12:17:41.038136 24270 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:17:41.054767 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:41.062057 24279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:41.063135 24280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:41.064926 24282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:41.065238 23151 server_base.cc:1061] running on GCE node
I20260709 12:17:41.066366 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:41.066565 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:41.066701 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599461066689 us; error 0 us; skew 500 ppm
I20260709 12:17:41.067212 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:41.070073 23151 webserver.cc:533] Webserver started at http://127.22.155.193:41671/ using document root <none> and password file <none>
I20260709 12:17:41.070580 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:41.070761 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:41.070988 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:41.072281 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-0-root/instance:
uuid: "c711faa13ead43ebbea0192cb74a4756"
format_stamp: "Formatted at 2026-07-09 12:17:41 on dist-test-slave-p7fg"
I20260709 12:17:41.077353 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 12:17:41.080907 24287 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:41.081765 23151 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:17:41.082091 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-0-root
uuid: "c711faa13ead43ebbea0192cb74a4756"
format_stamp: "Formatted at 2026-07-09 12:17:41 on dist-test-slave-p7fg"
I20260709 12:17:41.082428 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:41.096782 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:41.098184 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:41.099804 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:41.102473 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:41.102715 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:41.102974 23151 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:41.103165 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:41.151751 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.193:36951
I20260709 12:17:41.151873 24349 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.193:36951 every 8 connection(s)
I20260709 12:17:41.157260 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:41.166590 24354 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:41.169023 24355 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:41.173012 24350 heartbeater.cc:344] Connected to a master server at 127.22.155.254:34311
I20260709 12:17:41.173648 24350 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:41.175078 24350 heartbeater.cc:507] Master 127.22.155.254:34311 requested a full tablet report, sending...
I20260709 12:17:41.179445 23151 server_base.cc:1061] running on GCE node
W20260709 12:17:41.179982 24358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:41.178668 24223 ts_manager.cc:194] Registered new tserver with Master: c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:17:41.181149 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:41.181367 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:41.181507 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599461181495 us; error 0 us; skew 500 ppm
I20260709 12:17:41.182008 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:41.182667 24223 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54244
I20260709 12:17:41.184916 23151 webserver.cc:533] Webserver started at http://127.22.155.194:36161/ using document root <none> and password file <none>
I20260709 12:17:41.185497 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:41.185726 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:41.186005 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:41.187319 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-1-root/instance:
uuid: "c855242ec9d34a5397741ef20db9de8a"
format_stamp: "Formatted at 2026-07-09 12:17:41 on dist-test-slave-p7fg"
I20260709 12:17:41.192055 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:17:41.195799 24362 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:41.196791 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:17:41.197124 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-1-root
uuid: "c855242ec9d34a5397741ef20db9de8a"
format_stamp: "Formatted at 2026-07-09 12:17:41 on dist-test-slave-p7fg"
I20260709 12:17:41.197432 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:41.224349 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:41.225692 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:41.227240 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:41.229640 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:41.229872 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:41.230119 23151 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:41.230289 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:41.274215 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.194:35893
I20260709 12:17:41.274394 24424 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.194:35893 every 8 connection(s)
I20260709 12:17:41.279240 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:41.287576 24428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:41.294353 24429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:41.297263 24431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:41.297369 23151 server_base.cc:1061] running on GCE node
I20260709 12:17:41.298688 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:41.298923 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:41.299166 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599461299146 us; error 0 us; skew 500 ppm
I20260709 12:17:41.299811 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:41.301007 24425 heartbeater.cc:344] Connected to a master server at 127.22.155.254:34311
I20260709 12:17:41.301435 24425 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:41.302548 24425 heartbeater.cc:507] Master 127.22.155.254:34311 requested a full tablet report, sending...
I20260709 12:17:41.302695 23151 webserver.cc:533] Webserver started at http://127.22.155.195:42059/ using document root <none> and password file <none>
I20260709 12:17:41.303334 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:41.303579 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:41.303897 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:41.305069 24223 ts_manager.cc:194] Registered new tserver with Master: c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:41.305171 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-2-root/instance:
uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
format_stamp: "Formatted at 2026-07-09 12:17:41 on dist-test-slave-p7fg"
I20260709 12:17:41.306641 24223 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54252
I20260709 12:17:41.310034 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:17:41.313637 24436 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:41.314546 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:17:41.314916 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-2-root
uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
format_stamp: "Formatted at 2026-07-09 12:17:41 on dist-test-slave-p7fg"
I20260709 12:17:41.315248 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:41.335546 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:41.337059 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:41.338704 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:41.341262 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:41.341519 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:41.341791 23151 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:41.341992 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:41.389966 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.195:44453
I20260709 12:17:41.390125 24498 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.195:44453 every 8 connection(s)
I20260709 12:17:41.405534 24499 heartbeater.cc:344] Connected to a master server at 127.22.155.254:34311
I20260709 12:17:41.406123 24499 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:41.407147 24499 heartbeater.cc:507] Master 127.22.155.254:34311 requested a full tablet report, sending...
I20260709 12:17:41.409818 24223 ts_manager.cc:194] Registered new tserver with Master: 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:41.410020 23151 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016471595s
I20260709 12:17:41.412031 24223 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54254
I20260709 12:17:41.443318 24223 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54258:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:17:41.449699 24223 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:17:41.679572 24387 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff0373496af48a585a7d6ceab63908f (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:17:41.680843 24389 tablet_service.cc:1511] Processing CreateTablet for tablet 1541b2ab674f43ca8c6b46df9171c32d (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:17:41.681908 24386 tablet_service.cc:1511] Processing CreateTablet for tablet 125e800842274e17a2c01df7bb749005 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:17:41.682986 24388 tablet_service.cc:1511] Processing CreateTablet for tablet 63debf83121c430e9dffcd1c5035cf3a (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:17:41.684113 24385 tablet_service.cc:1511] Processing CreateTablet for tablet 1ba811822a8a4266a950b36a73a9fce7 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:17:41.686184 24384 tablet_service.cc:1511] Processing CreateTablet for tablet 97dd30b21cc14958a91b2da522e4bbe9 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:17:41.689525 24459 tablet_service.cc:1511] Processing CreateTablet for tablet 1ba811822a8a4266a950b36a73a9fce7 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:17:41.689690 24463 tablet_service.cc:1511] Processing CreateTablet for tablet 1541b2ab674f43ca8c6b46df9171c32d (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:17:41.689939 24461 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff0373496af48a585a7d6ceab63908f (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:17:41.691102 24459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ba811822a8a4266a950b36a73a9fce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.691808 24456 tablet_service.cc:1511] Processing CreateTablet for tablet 9f31ae8f765347f0b4ac12809516729c (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:17:41.691970 24460 tablet_service.cc:1511] Processing CreateTablet for tablet 125e800842274e17a2c01df7bb749005 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:17:41.693943 24458 tablet_service.cc:1511] Processing CreateTablet for tablet 97dd30b21cc14958a91b2da522e4bbe9 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:17:41.694309 24457 tablet_service.cc:1511] Processing CreateTablet for tablet d9034e708c454259aebd10b80eeab667 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:17:41.694406 24455 tablet_service.cc:1511] Processing CreateTablet for tablet 3f669315af0d426da28d57b462979ebd (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:17:41.695685 24461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff0373496af48a585a7d6ceab63908f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.697685 24462 tablet_service.cc:1511] Processing CreateTablet for tablet 63debf83121c430e9dffcd1c5035cf3a (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:17:41.700747 24464 tablet_service.cc:1511] Processing CreateTablet for tablet 3a802b4f6ba54f358ebd8a2a74f2a9c6 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:17:41.679572 24390 tablet_service.cc:1511] Processing CreateTablet for tablet 3a802b4f6ba54f358ebd8a2a74f2a9c6 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:17:41.705013 24455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f669315af0d426da28d57b462979ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.706131 24312 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff0373496af48a585a7d6ceab63908f (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:17:41.707645 24312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff0373496af48a585a7d6ceab63908f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.707898 24314 tablet_service.cc:1511] Processing CreateTablet for tablet 1541b2ab674f43ca8c6b46df9171c32d (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:17:41.709425 24314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1541b2ab674f43ca8c6b46df9171c32d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.709476 24460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 125e800842274e17a2c01df7bb749005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.709856 24311 tablet_service.cc:1511] Processing CreateTablet for tablet 125e800842274e17a2c01df7bb749005 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:17:41.711213 24311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 125e800842274e17a2c01df7bb749005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.712878 24313 tablet_service.cc:1511] Processing CreateTablet for tablet 63debf83121c430e9dffcd1c5035cf3a (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:17:41.714229 24313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63debf83121c430e9dffcd1c5035cf3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.715647 24309 tablet_service.cc:1511] Processing CreateTablet for tablet 97dd30b21cc14958a91b2da522e4bbe9 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:17:41.716998 24309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97dd30b21cc14958a91b2da522e4bbe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.716888 24315 tablet_service.cc:1511] Processing CreateTablet for tablet 3a802b4f6ba54f358ebd8a2a74f2a9c6 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:17:41.713828 24310 tablet_service.cc:1511] Processing CreateTablet for tablet 1ba811822a8a4266a950b36a73a9fce7 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:17:41.719343 24383 tablet_service.cc:1511] Processing CreateTablet for tablet d9034e708c454259aebd10b80eeab667 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:17:41.722164 24458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97dd30b21cc14958a91b2da522e4bbe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.722404 24382 tablet_service.cc:1511] Processing CreateTablet for tablet 9f31ae8f765347f0b4ac12809516729c (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:17:41.725368 24463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1541b2ab674f43ca8c6b46df9171c32d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.720217 24315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a802b4f6ba54f358ebd8a2a74f2a9c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.730233 24306 tablet_service.cc:1511] Processing CreateTablet for tablet 3f669315af0d426da28d57b462979ebd (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:17:41.733696 24387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff0373496af48a585a7d6ceab63908f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.741149 24382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f31ae8f765347f0b4ac12809516729c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.744086 24386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 125e800842274e17a2c01df7bb749005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.745740 24390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a802b4f6ba54f358ebd8a2a74f2a9c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.749972 24385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ba811822a8a4266a950b36a73a9fce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.750995 24384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97dd30b21cc14958a91b2da522e4bbe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.751794 24389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1541b2ab674f43ca8c6b46df9171c32d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.758157 24388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63debf83121c430e9dffcd1c5035cf3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.763826 24383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9034e708c454259aebd10b80eeab667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.763221 24381 tablet_service.cc:1511] Processing CreateTablet for tablet 3f669315af0d426da28d57b462979ebd (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:17:41.765026 24310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ba811822a8a4266a950b36a73a9fce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.765249 24462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63debf83121c430e9dffcd1c5035cf3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.765722 24381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f669315af0d426da28d57b462979ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.768064 24457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9034e708c454259aebd10b80eeab667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.767838 24308 tablet_service.cc:1511] Processing CreateTablet for tablet d9034e708c454259aebd10b80eeab667 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:17:41.769325 24307 tablet_service.cc:1511] Processing CreateTablet for tablet 9f31ae8f765347f0b4ac12809516729c (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:17:41.777863 24464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a802b4f6ba54f358ebd8a2a74f2a9c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.782348 24456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f31ae8f765347f0b4ac12809516729c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.784986 24306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f669315af0d426da28d57b462979ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.788841 24308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9034e708c454259aebd10b80eeab667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.794255 24307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f31ae8f765347f0b4ac12809516729c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.823598 24307 tablet_service.cc:1511] Processing CreateTablet for tablet f3d18ca89df84c1ba95edb6284f7a8fb (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:17:41.828569 24307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d18ca89df84c1ba95edb6284f7a8fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.867129 24311 tablet_service.cc:1511] Processing CreateTablet for tablet 400165817fe74ada9a4793982993a5e3 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:17:41.895617 24455 tablet_service.cc:1511] Processing CreateTablet for tablet f3d18ca89df84c1ba95edb6284f7a8fb (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:17:41.900698 24514 tablet_bootstrap.cc:492] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:41.904577 24311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400165817fe74ada9a4793982993a5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.910331 24515 tablet_bootstrap.cc:492] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:41.917618 24462 tablet_service.cc:1511] Processing CreateTablet for tablet 400165817fe74ada9a4793982993a5e3 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:17:41.918949 24462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400165817fe74ada9a4793982993a5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.921438 24313 tablet_service.cc:1511] Processing CreateTablet for tablet 9edb2262948747f3b2674ddb57a2da5c (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:17:41.923235 24313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9edb2262948747f3b2674ddb57a2da5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.928831 24388 tablet_service.cc:1511] Processing CreateTablet for tablet f3d18ca89df84c1ba95edb6284f7a8fb (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:17:41.944154 24308 tablet_service.cc:1511] Processing CreateTablet for tablet 7cd3bd910f7f47f9acdd1792db910842 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:17:41.932104 24382 tablet_service.cc:1511] Processing CreateTablet for tablet 400165817fe74ada9a4793982993a5e3 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:17:41.946628 24386 tablet_service.cc:1511] Processing CreateTablet for tablet 9edb2262948747f3b2674ddb57a2da5c (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:17:41.948276 24310 tablet_service.cc:1511] Processing CreateTablet for tablet 82c31a779e7949a590cf168eef01e405 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:17:41.951114 24515 tablet_bootstrap.cc:654] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:41.952970 24455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d18ca89df84c1ba95edb6284f7a8fb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:17:41.979864 24271 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:41.957976 24389 tablet_service.cc:1511] Processing CreateTablet for tablet 7cd3bd910f7f47f9acdd1792db910842 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:17:41.971130 24459 tablet_service.cc:1511] Processing CreateTablet for tablet 46c46f855639421fb6d7eab9b01f55a0 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:17:41.981626 24456 tablet_service.cc:1511] Processing CreateTablet for tablet 4fb70b6bc9ed40a793fb93839c889578 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:17:41.982164 24459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c46f855639421fb6d7eab9b01f55a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.983052 24382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400165817fe74ada9a4793982993a5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.984089 24387 tablet_service.cc:1511] Processing CreateTablet for tablet 4fb70b6bc9ed40a793fb93839c889578 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:17:41.985944 24464 tablet_service.cc:1511] Processing CreateTablet for tablet 48b5441f03704ebb94ffdbb55b9f33c6 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:17:41.987056 24387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fb70b6bc9ed40a793fb93839c889578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.990111 24308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cd3bd910f7f47f9acdd1792db910842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.990582 24312 tablet_service.cc:1511] Processing CreateTablet for tablet 4fb70b6bc9ed40a793fb93839c889578 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:17:41.991880 24312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fb70b6bc9ed40a793fb93839c889578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.993211 24388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d18ca89df84c1ba95edb6284f7a8fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.991920 24307 tablet_service.cc:1511] Processing CreateTablet for tablet 1246d2a6c02a457f97a768233aa6cf6d (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:17:41.994796 24307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1246d2a6c02a457f97a768233aa6cf6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.997726 24516 tablet_bootstrap.cc:492] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:41.999840 24310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82c31a779e7949a590cf168eef01e405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.980041 24460 tablet_service.cc:1511] Processing CreateTablet for tablet 82c31a779e7949a590cf168eef01e405 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:17:42.000871 24461 tablet_service.cc:1511] Processing CreateTablet for tablet 9edb2262948747f3b2674ddb57a2da5c (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:17:42.001652 24460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82c31a779e7949a590cf168eef01e405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.001480 24462 tablet_service.cc:1511] Processing CreateTablet for tablet 1246d2a6c02a457f97a768233aa6cf6d (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:17:41.981705 24390 tablet_service.cc:1511] Processing CreateTablet for tablet 82c31a779e7949a590cf168eef01e405 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:17:42.005455 24390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82c31a779e7949a590cf168eef01e405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.005859 24384 tablet_service.cc:1511] Processing CreateTablet for tablet 46c46f855639421fb6d7eab9b01f55a0 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:17:42.007295 24384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c46f855639421fb6d7eab9b01f55a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.011345 24306 tablet_service.cc:1511] Processing CreateTablet for tablet 46c46f855639421fb6d7eab9b01f55a0 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:17:41.971387 24463 tablet_service.cc:1511] Processing CreateTablet for tablet 7cd3bd910f7f47f9acdd1792db910842 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:17:42.013772 24462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1246d2a6c02a457f97a768233aa6cf6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.018944 24386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9edb2262948747f3b2674ddb57a2da5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.021987 24314 tablet_service.cc:1511] Processing CreateTablet for tablet 48b5441f03704ebb94ffdbb55b9f33c6 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:17:42.015340 24306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c46f855639421fb6d7eab9b01f55a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.025024 24389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cd3bd910f7f47f9acdd1792db910842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.030112 24381 tablet_service.cc:1511] Processing CreateTablet for tablet 1246d2a6c02a457f97a768233aa6cf6d (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:17:42.031641 24381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1246d2a6c02a457f97a768233aa6cf6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.033155 24385 tablet_service.cc:1511] Processing CreateTablet for tablet 9e8cc498654c4fde9917eeb605fdc906 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:17:42.041002 24456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fb70b6bc9ed40a793fb93839c889578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.041776 24385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e8cc498654c4fde9917eeb605fdc906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.041813 24458 tablet_service.cc:1511] Processing CreateTablet for tablet 9e8cc498654c4fde9917eeb605fdc906 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:17:42.043367 24458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e8cc498654c4fde9917eeb605fdc906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.043658 24309 tablet_service.cc:1511] Processing CreateTablet for tablet 8fcc66a9731446a989f79106ac6fa5ea (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:17:42.034358 24515 tablet_bootstrap.cc:492] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:42.045128 24515 ts_tablet_manager.cc:1403] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.135s	user 0.010s	sys 0.005s
I20260709 12:17:42.049053 24463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cd3bd910f7f47f9acdd1792db910842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.052970 24461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9edb2262948747f3b2674ddb57a2da5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.057703 24383 tablet_service.cc:1511] Processing CreateTablet for tablet 48b5441f03704ebb94ffdbb55b9f33c6 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:17:42.059188 24383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48b5441f03704ebb94ffdbb55b9f33c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.060910 24464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48b5441f03704ebb94ffdbb55b9f33c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.063639 24313 tablet_service.cc:1511] Processing CreateTablet for tablet 7fd01a911fd14f38a5e1ca5b30c7da18 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:17:42.036079 24315 tablet_service.cc:1511] Processing CreateTablet for tablet 9e8cc498654c4fde9917eeb605fdc906 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:17:42.037024 24314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48b5441f03704ebb94ffdbb55b9f33c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.065514 24315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e8cc498654c4fde9917eeb605fdc906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.065971 24310 tablet_service.cc:1511] Processing CreateTablet for tablet 67fce41b64ab4350b88ec02abbcd9c82 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:17:42.069247 24310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67fce41b64ab4350b88ec02abbcd9c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.074405 24311 tablet_service.cc:1511] Processing CreateTablet for tablet 111838cb1ad347d59c8b479393f9d486 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:17:42.075877 24311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 111838cb1ad347d59c8b479393f9d486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.073927 24456 tablet_service.cc:1511] Processing CreateTablet for tablet 8fcc66a9731446a989f79106ac6fa5ea (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:17:42.078910 24455 tablet_service.cc:1511] Processing CreateTablet for tablet 7fd01a911fd14f38a5e1ca5b30c7da18 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:17:42.080090 24456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fcc66a9731446a989f79106ac6fa5ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.082930 24516 tablet_bootstrap.cc:654] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:42.089025 24309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fcc66a9731446a989f79106ac6fa5ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.048489 24515 raft_consensus.cc:359] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:42.093371 24515 raft_consensus.cc:385] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:42.093717 24515 raft_consensus.cc:740] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:42.094213 24313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fd01a911fd14f38a5e1ca5b30c7da18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.097985 24312 tablet_service.cc:1511] Processing CreateTablet for tablet 48340fd716644ed18711f9addc546f4b (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:17:42.099860 24312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48340fd716644ed18711f9addc546f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.094647 24515 consensus_queue.cc:260] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:42.095579 24514 tablet_bootstrap.cc:654] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:42.097863 24382 tablet_service.cc:1511] Processing CreateTablet for tablet 8fcc66a9731446a989f79106ac6fa5ea (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:17:42.106086 24382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fcc66a9731446a989f79106ac6fa5ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.110477 24460 tablet_service.cc:1511] Processing CreateTablet for tablet 111838cb1ad347d59c8b479393f9d486 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:17:42.124861 24455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fd01a911fd14f38a5e1ca5b30c7da18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.133504 24457 tablet_service.cc:1511] Processing CreateTablet for tablet 67fce41b64ab4350b88ec02abbcd9c82 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:17:42.155040 24516 tablet_bootstrap.cc:492] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:42.155608 24516 ts_tablet_manager.cc:1403] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.158s	user 0.013s	sys 0.000s
I20260709 12:17:42.157493 24387 tablet_service.cc:1511] Processing CreateTablet for tablet 7fd01a911fd14f38a5e1ca5b30c7da18 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:17:42.158990 24387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fd01a911fd14f38a5e1ca5b30c7da18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.163748 24516 raft_consensus.cc:359] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:42.186301 24350 heartbeater.cc:499] Master 127.22.155.254:34311 was elected leader, sending a full tablet report...
I20260709 12:17:42.140113 24306 tablet_service.cc:1511] Processing CreateTablet for tablet 9950f2ff950845e1837dbf993fb23cb0 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:17:42.175808 24516 raft_consensus.cc:385] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:42.203094 24460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 111838cb1ad347d59c8b479393f9d486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.215384 24389 tablet_service.cc:1511] Processing CreateTablet for tablet 67fce41b64ab4350b88ec02abbcd9c82 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:17:42.217628 24389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67fce41b64ab4350b88ec02abbcd9c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.223356 24499 heartbeater.cc:499] Master 127.22.155.254:34311 was elected leader, sending a full tablet report...
I20260709 12:17:42.224895 24457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67fce41b64ab4350b88ec02abbcd9c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.224459 24307 tablet_service.cc:1511] Processing CreateTablet for tablet 51965da6bcc444d5b20f7348cba2c649 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:17:42.233067 24515 ts_tablet_manager.cc:1434] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.188s	user 0.049s	sys 0.020s
I20260709 12:17:42.207290 24516 raft_consensus.cc:740] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:42.251298 24384 tablet_service.cc:1511] Processing CreateTablet for tablet 48340fd716644ed18711f9addc546f4b (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:17:42.258945 24384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48340fd716644ed18711f9addc546f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.261255 24306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9950f2ff950845e1837dbf993fb23cb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.267468 24307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51965da6bcc444d5b20f7348cba2c649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.270610 24516 consensus_queue.cc:260] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:42.277485 24514 tablet_bootstrap.cc:492] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:42.277609 24314 tablet_service.cc:1511] Processing CreateTablet for tablet 95c2470f38204e5ba4ee545bb2de933c (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:17:42.278055 24514 ts_tablet_manager.cc:1403] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.378s	user 0.013s	sys 0.013s
I20260709 12:17:42.279059 24314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95c2470f38204e5ba4ee545bb2de933c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.283056 24515 tablet_bootstrap.cc:492] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:42.286118 24386 tablet_service.cc:1511] Processing CreateTablet for tablet 111838cb1ad347d59c8b479393f9d486 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:17:42.287350 24463 tablet_service.cc:1511] Processing CreateTablet for tablet 48340fd716644ed18711f9addc546f4b (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:17:42.292879 24463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48340fd716644ed18711f9addc546f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.293100 24456 tablet_service.cc:1511] Processing CreateTablet for tablet 9950f2ff950845e1837dbf993fb23cb0 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:17:42.294909 24456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9950f2ff950845e1837dbf993fb23cb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.309857 24425 heartbeater.cc:499] Master 127.22.155.254:34311 was elected leader, sending a full tablet report...
I20260709 12:17:42.314575 24386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 111838cb1ad347d59c8b479393f9d486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.315840 24381 tablet_service.cc:1511] Processing CreateTablet for tablet 9950f2ff950845e1837dbf993fb23cb0 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:17:42.317536 24381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9950f2ff950845e1837dbf993fb23cb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.321558 24382 tablet_service.cc:1511] Processing CreateTablet for tablet 51965da6bcc444d5b20f7348cba2c649 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:17:42.323225 24382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51965da6bcc444d5b20f7348cba2c649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.332074 24460 tablet_service.cc:1511] Processing CreateTablet for tablet 51965da6bcc444d5b20f7348cba2c649 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:17:42.333885 24460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51965da6bcc444d5b20f7348cba2c649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.358086 24516 ts_tablet_manager.cc:1434] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.202s	user 0.010s	sys 0.004s
W20260709 12:17:42.361387 24209 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 75916.6us
I20260709 12:17:42.363476 24514 raft_consensus.cc:359] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:42.364495 24514 raft_consensus.cc:385] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:42.364883 24514 raft_consensus.cc:740] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:42.365849 24514 consensus_queue.cc:260] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:42.376368 24459 tablet_service.cc:1511] Processing CreateTablet for tablet 95c2470f38204e5ba4ee545bb2de933c (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:17:42.401652 24459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95c2470f38204e5ba4ee545bb2de933c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.402283 24311 tablet_service.cc:1511] Processing CreateTablet for tablet 218e3bf7807b42d09ac3db0dad69fcf9 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:17:42.403905 24311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 218e3bf7807b42d09ac3db0dad69fcf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.406528 24313 tablet_service.cc:1511] Processing CreateTablet for tablet 40ccde13a66c45c8bd6d8780ee632ea8 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:17:42.407958 24313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40ccde13a66c45c8bd6d8780ee632ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.410852 24309 tablet_service.cc:1511] Processing CreateTablet for tablet f8dc8357b0c947d9a0f16daa0f4210aa (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:17:42.412180 24309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8dc8357b0c947d9a0f16daa0f4210aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.417753 24519 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.418331 24519 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:42.418814 24310 tablet_service.cc:1511] Processing CreateTablet for tablet 7910ea4d480e41fda4aa4fd10f0fef8f (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:17:42.383778 24308 tablet_service.cc:1511] Processing CreateTablet for tablet 101287bb58d2418bad8554ed0a096407 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:17:42.420606 24308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 101287bb58d2418bad8554ed0a096407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.422066 24514 ts_tablet_manager.cc:1434] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.143s	user 0.009s	sys 0.007s
I20260709 12:17:42.384087 24458 tablet_service.cc:1511] Processing CreateTablet for tablet 218e3bf7807b42d09ac3db0dad69fcf9 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:17:42.371433 24516 tablet_bootstrap.cc:492] T 63debf83121c430e9dffcd1c5035cf3a P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:42.425546 24458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 218e3bf7807b42d09ac3db0dad69fcf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.430234 24519 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:42.387112 24461 tablet_service.cc:1511] Processing CreateTablet for tablet 40ccde13a66c45c8bd6d8780ee632ea8 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:17:42.438735 24515 tablet_bootstrap.cc:654] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:42.391187 24464 tablet_service.cc:1511] Processing CreateTablet for tablet f8dc8357b0c947d9a0f16daa0f4210aa (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:17:42.430205 24315 tablet_service.cc:1511] Processing CreateTablet for tablet cabffff9a20f4f0091c52fc21d5abcde (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:17:42.441707 24315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cabffff9a20f4f0091c52fc21d5abcde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.436762 24461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40ccde13a66c45c8bd6d8780ee632ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.447919 24464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8dc8357b0c947d9a0f16daa0f4210aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.449405 24310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7910ea4d480e41fda4aa4fd10f0fef8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.455617 24516 tablet_bootstrap.cc:654] T 63debf83121c430e9dffcd1c5035cf3a P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:42.463624 24383 tablet_service.cc:1511] Processing CreateTablet for tablet 218e3bf7807b42d09ac3db0dad69fcf9 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:17:42.424387 24384 tablet_service.cc:1511] Processing CreateTablet for tablet 101287bb58d2418bad8554ed0a096407 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:17:42.418905 24388 tablet_service.cc:1511] Processing CreateTablet for tablet 95c2470f38204e5ba4ee545bb2de933c (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:17:42.381474 24462 tablet_service.cc:1511] Processing CreateTablet for tablet 101287bb58d2418bad8554ed0a096407 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:17:42.477689 24462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 101287bb58d2418bad8554ed0a096407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.424657 24514 tablet_bootstrap.cc:492] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
W20260709 12:17:42.485562 24209 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 56675.1us
W20260709 12:17:42.488071 24208 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 47828.7us
I20260709 12:17:42.490793 24457 tablet_service.cc:1511] Processing CreateTablet for tablet 7910ea4d480e41fda4aa4fd10f0fef8f (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:17:42.492365 24457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7910ea4d480e41fda4aa4fd10f0fef8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.493201 24383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 218e3bf7807b42d09ac3db0dad69fcf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.497328 24384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 101287bb58d2418bad8554ed0a096407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.501178 24312 tablet_service.cc:1511] Processing CreateTablet for tablet c7855d741eff4cb394101baa2af0f082 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:17:42.501704 24389 tablet_service.cc:1511] Processing CreateTablet for tablet 40ccde13a66c45c8bd6d8780ee632ea8 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:17:42.502596 24312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7855d741eff4cb394101baa2af0f082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.503018 24389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40ccde13a66c45c8bd6d8780ee632ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.480526 24455 tablet_service.cc:1511] Processing CreateTablet for tablet cabffff9a20f4f0091c52fc21d5abcde (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:17:42.504957 24390 tablet_service.cc:1511] Processing CreateTablet for tablet f8dc8357b0c947d9a0f16daa0f4210aa (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:17:42.506333 24390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8dc8357b0c947d9a0f16daa0f4210aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.506215 24387 tablet_service.cc:1511] Processing CreateTablet for tablet 7910ea4d480e41fda4aa4fd10f0fef8f (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:17:42.507457 24387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7910ea4d480e41fda4aa4fd10f0fef8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.507148 24307 tablet_service.cc:1511] Processing CreateTablet for tablet 3ae398278b05401c9dbc83b30a800655 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:17:42.516948 24455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cabffff9a20f4f0091c52fc21d5abcde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.528908 24381 tablet_service.cc:1511] Processing CreateTablet for tablet cabffff9a20f4f0091c52fc21d5abcde (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:17:42.563951 24514 tablet_bootstrap.cc:654] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:42.564347 24307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae398278b05401c9dbc83b30a800655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.566979 24516 tablet_bootstrap.cc:492] T 63debf83121c430e9dffcd1c5035cf3a P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:42.567557 24516 ts_tablet_manager.cc:1403] T 63debf83121c430e9dffcd1c5035cf3a P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.197s	user 0.015s	sys 0.004s
I20260709 12:17:42.567584 24382 tablet_service.cc:1511] Processing CreateTablet for tablet c7855d741eff4cb394101baa2af0f082 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:17:42.570860 24463 tablet_service.cc:1511] Processing CreateTablet for tablet c7855d741eff4cb394101baa2af0f082 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:17:42.570925 24516 raft_consensus.cc:359] T 63debf83121c430e9dffcd1c5035cf3a P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:42.577209 24516 raft_consensus.cc:385] T 63debf83121c430e9dffcd1c5035cf3a P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:42.572355 24463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7855d741eff4cb394101baa2af0f082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.606396 24516 raft_consensus.cc:740] T 63debf83121c430e9dffcd1c5035cf3a P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:42.632530 24516 consensus_queue.cc:260] T 63debf83121c430e9dffcd1c5035cf3a P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:42.634127 24514 tablet_bootstrap.cc:492] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:42.634687 24514 ts_tablet_manager.cc:1403] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.210s	user 0.008s	sys 0.003s
I20260709 12:17:42.635025 24516 ts_tablet_manager.cc:1434] T 63debf83121c430e9dffcd1c5035cf3a P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.000s
I20260709 12:17:42.603850 24313 tablet_service.cc:1511] Processing CreateTablet for tablet 5de6cc497bc845dda523b96c519faf83 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:17:42.636391 24313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5de6cc497bc845dda523b96c519faf83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.637710 24458 tablet_service.cc:1511] Processing CreateTablet for tablet 3ae398278b05401c9dbc83b30a800655 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:17:42.584649 24388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95c2470f38204e5ba4ee545bb2de933c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.650439 24382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7855d741eff4cb394101baa2af0f082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.611713 24308 tablet_service.cc:1511] Processing CreateTablet for tablet 18eaf20aac4141229219a10fc4ed0a23 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:17:42.653680 24522 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.654435 24458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae398278b05401c9dbc83b30a800655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.654250 24522 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:42.657114 24308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18eaf20aac4141229219a10fc4ed0a23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.663087 24522 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:42.668098 24390 tablet_service.cc:1511] Processing CreateTablet for tablet 5de6cc497bc845dda523b96c519faf83 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:17:42.669695 24390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5de6cc497bc845dda523b96c519faf83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.670185 24462 tablet_service.cc:1511] Processing CreateTablet for tablet 18eaf20aac4141229219a10fc4ed0a23 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:17:42.671921 24462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18eaf20aac4141229219a10fc4ed0a23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.676600 24309 tablet_service.cc:1511] Processing CreateTablet for tablet 626f1d05390b4454b317c19d513384be (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:17:42.677955 24309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 626f1d05390b4454b317c19d513384be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.617296 24386 tablet_service.cc:1511] Processing CreateTablet for tablet daeed7cb347a434082488f5c5807424b (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:17:42.619719 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:42.621711 24461 tablet_service.cc:1511] Processing CreateTablet for tablet daeed7cb347a434082488f5c5807424b (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:17:42.681311 24461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daeed7cb347a434082488f5c5807424b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.682224 24386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daeed7cb347a434082488f5c5807424b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.581007 24515 tablet_bootstrap.cc:492] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:42.685015 24515 ts_tablet_manager.cc:1403] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.402s	user 0.015s	sys 0.006s
I20260709 12:17:42.687695 24390 tablet_service.cc:1511] Processing CreateTablet for tablet 18eaf20aac4141229219a10fc4ed0a23 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:17:42.687997 24515 raft_consensus.cc:359] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:42.638337 24456 tablet_service.cc:1511] Processing CreateTablet for tablet 5de6cc497bc845dda523b96c519faf83 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:17:42.639948 24516 tablet_bootstrap.cc:492] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:42.688933 24515 raft_consensus.cc:385] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:42.609699 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:42.693426 24400 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:42.692791 24515 raft_consensus.cc:740] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:42.694784 24515 consensus_queue.cc:260] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:42.689553 24456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5de6cc497bc845dda523b96c519faf83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.666079 24514 raft_consensus.cc:359] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:42.699534 24514 raft_consensus.cc:385] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:42.699863 24514 raft_consensus.cc:740] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:42.689983 24390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18eaf20aac4141229219a10fc4ed0a23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.704716 24515 ts_tablet_manager.cc:1434] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 12:17:42.705963 24515 tablet_bootstrap.cc:492] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:42.695181 24438 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:42.590240 24385 tablet_service.cc:1511] Processing CreateTablet for tablet 3ae398278b05401c9dbc83b30a800655 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:17:42.592285 24306 tablet_service.cc:1511] Processing CreateTablet for tablet daeed7cb347a434082488f5c5807424b (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:17:42.713999 24385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae398278b05401c9dbc83b30a800655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.714756 24306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daeed7cb347a434082488f5c5807424b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.717422 24519 raft_consensus.cc:2804] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:42.717792 24519 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.718102 24519 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:42.720217 24381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cabffff9a20f4f0091c52fc21d5abcde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.723592 24315 tablet_service.cc:1511] Processing CreateTablet for tablet ac37baecf20841f7b0a74e07f89c2a09 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:17:42.725143 24315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac37baecf20841f7b0a74e07f89c2a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.706007 24514 consensus_queue.cc:260] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:42.732882 24514 ts_tablet_manager.cc:1434] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.098s	user 0.011s	sys 0.000s
I20260709 12:17:42.733947 24514 tablet_bootstrap.cc:492] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:42.695960 24516 tablet_bootstrap.cc:654] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:42.738919 24521 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.739621 24521 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:42.750330 24384 tablet_service.cc:1511] Processing CreateTablet for tablet ac37baecf20841f7b0a74e07f89c2a09 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:17:42.752246 24384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac37baecf20841f7b0a74e07f89c2a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.736371 24519 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:42.776238 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:42.776965 24400 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:42.777406 24521 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:42.778604 24387 tablet_service.cc:1511] Processing CreateTablet for tablet 626f1d05390b4454b317c19d513384be (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:17:42.780169 24387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 626f1d05390b4454b317c19d513384be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.781586 24515 tablet_bootstrap.cc:654] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:42.784215 24519 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:42.796223 24460 tablet_service.cc:1511] Processing CreateTablet for tablet ac37baecf20841f7b0a74e07f89c2a09 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:17:42.807857 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:42.809719 24312 tablet_service.cc:1511] Processing CreateTablet for tablet 22a61f2b7e79419c82712f4b54b899ed (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:17:42.811049 24312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a61f2b7e79419c82712f4b54b899ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.798447 24460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac37baecf20841f7b0a74e07f89c2a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.801086 24519 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.818449 24456 tablet_service.cc:1511] Processing CreateTablet for tablet dfa0a0cd756141c094288d3c05139379 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:17:42.818994 24519 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:42.835678 24456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfa0a0cd756141c094288d3c05139379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.818470 24400 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:42.841153 24464 tablet_service.cc:1511] Processing CreateTablet for tablet 626f1d05390b4454b317c19d513384be (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:17:42.842701 24464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 626f1d05390b4454b317c19d513384be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.843072 24313 tablet_service.cc:1511] Processing CreateTablet for tablet dfa0a0cd756141c094288d3c05139379 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:17:42.844377 24313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfa0a0cd756141c094288d3c05139379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.852865 24519 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:42.855154 24461 tablet_service.cc:1511] Processing CreateTablet for tablet 22a61f2b7e79419c82712f4b54b899ed (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:17:42.860967 24461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a61f2b7e79419c82712f4b54b899ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.855970 24514 tablet_bootstrap.cc:654] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:42.901410 24440 leader_election.cc:343] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:42.901922 24310 tablet_service.cc:1511] Processing CreateTablet for tablet 27d97e40dd274a2ea3734c2982741e3c (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:17:42.902266 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:17:42.902391 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 67111.5us
I20260709 12:17:42.902885 24400 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
W20260709 12:17:42.903430 24440 leader_election.cc:343] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:42.904130 24438 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:42.904603 24459 tablet_service.cc:1511] Processing CreateTablet for tablet 03c8932a13b744d7a945b0a7655f5a47 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:17:42.905468 24519 raft_consensus.cc:2804] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:42.905917 24459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c8932a13b744d7a945b0a7655f5a47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.906041 24519 raft_consensus.cc:697] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:17:42.906929 24519 consensus_queue.cc:237] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:42.913633 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:42.925133 24289 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:42.928822 24522 raft_consensus.cc:2804] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:42.934967 24522 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.935331 24522 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:42.949178 24463 tablet_service.cc:1511] Processing CreateTablet for tablet 27d97e40dd274a2ea3734c2982741e3c (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:17:42.950569 24463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27d97e40dd274a2ea3734c2982741e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.952749 24522 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:42.897557 24308 tablet_service.cc:1511] Processing CreateTablet for tablet 03c8932a13b744d7a945b0a7655f5a47 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:17:42.957633 24310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27d97e40dd274a2ea3734c2982741e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.963157 24308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c8932a13b744d7a945b0a7655f5a47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.928238 24515 tablet_bootstrap.cc:492] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:42.969178 24309 tablet_service.cc:1511] Processing CreateTablet for tablet 419283bfbe814a8dbebaa6962ce15ee0 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:17:42.970609 24309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 419283bfbe814a8dbebaa6962ce15ee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.976941 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:42.979218 24381 tablet_service.cc:1511] Processing CreateTablet for tablet 22a61f2b7e79419c82712f4b54b899ed (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:17:42.980159 24462 tablet_service.cc:1511] Processing CreateTablet for tablet fdc8b7c33c2b4e9da87a15ea80d2f342 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:17:42.980536 24381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a61f2b7e79419c82712f4b54b899ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.982470 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:42.982355 24390 tablet_service.cc:1511] Processing CreateTablet for tablet 27d97e40dd274a2ea3734c2982741e3c (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:17:42.983069 24400 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:42.983687 24390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27d97e40dd274a2ea3734c2982741e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.985387 24522 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:42.985595 24388 tablet_service.cc:1511] Processing CreateTablet for tablet fdc8b7c33c2b4e9da87a15ea80d2f342 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:17:42.987067 24388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdc8b7c33c2b4e9da87a15ea80d2f342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.989871 24386 tablet_service.cc:1511] Processing CreateTablet for tablet dfa0a0cd756141c094288d3c05139379 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:17:42.990497 24516 tablet_bootstrap.cc:492] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:42.991285 24386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfa0a0cd756141c094288d3c05139379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.991375 24306 tablet_service.cc:1511] Processing CreateTablet for tablet fdc8b7c33c2b4e9da87a15ea80d2f342 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:17:42.991317 24516 ts_tablet_manager.cc:1403] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.352s	user 0.012s	sys 0.008s
I20260709 12:17:42.992853 24306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdc8b7c33c2b4e9da87a15ea80d2f342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.993661 24384 tablet_service.cc:1511] Processing CreateTablet for tablet 03c8932a13b744d7a945b0a7655f5a47 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:17:42.994907 24384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c8932a13b744d7a945b0a7655f5a47. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:17:42.965250 24440 leader_election.cc:343] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:42.995582 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 61045.9us
I20260709 12:17:42.997509 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:42.998687 24515 ts_tablet_manager.cc:1403] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.270s	user 0.014s	sys 0.005s
W20260709 12:17:43.001134 24271 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:43.005357 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:17:43.007162 24290 leader_election.cc:343] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:43.008203 24290 leader_election.cc:343] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:42.999356 24522 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:43.019696 24438 leader_election.cc:343] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:43.020193 24438 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:43.021274 24535 raft_consensus.cc:2749] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:43.015256 24462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdc8b7c33c2b4e9da87a15ea80d2f342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.038460 24461 tablet_service.cc:1511] Processing CreateTablet for tablet 419283bfbe814a8dbebaa6962ce15ee0 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:17:43.039880 24515 raft_consensus.cc:359] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.028985 24522 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.043569 24522 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:43.044737 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:43.047303 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:17:43.048903 24290 leader_election.cc:343] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:43.008392 24516 raft_consensus.cc:359] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.054175 24223 catalog_manager.cc:5697] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:43.057511 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:43.058362 24325 raft_consensus.cc:2393] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 1: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:17:43.055960 24516 raft_consensus.cc:385] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.058941 24516 raft_consensus.cc:740] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.059028 24312 tablet_service.cc:1511] Processing CreateTablet for tablet 72fa7cd50b4c4a12af95a9accb7dd947 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:17:43.061646 24312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72fa7cd50b4c4a12af95a9accb7dd947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.062227 24461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 419283bfbe814a8dbebaa6962ce15ee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.017578 24400 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:17:43.052989 24515 raft_consensus.cc:385] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.088781 24515 raft_consensus.cc:740] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.089726 24515 consensus_queue.cc:260] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.072052 24388 tablet_service.cc:1511] Processing CreateTablet for tablet 419283bfbe814a8dbebaa6962ce15ee0 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:17:43.072904 24315 tablet_service.cc:1511] Processing CreateTablet for tablet 8616bc73679e486399b789377c5cd1ba (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:17:43.065327 24460 tablet_service.cc:1511] Processing CreateTablet for tablet 72fa7cd50b4c4a12af95a9accb7dd947 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:17:43.081318 24458 tablet_service.cc:1511] Processing CreateTablet for tablet 8616bc73679e486399b789377c5cd1ba (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:17:43.084167 24311 tablet_service.cc:1511] Processing CreateTablet for tablet 74a60f1722e64f329fe72226d0dbb7c4 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:17:43.091817 24315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8616bc73679e486399b789377c5cd1ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.092718 24311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a60f1722e64f329fe72226d0dbb7c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.091818 24458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8616bc73679e486399b789377c5cd1ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.084936 24455 tablet_service.cc:1511] Processing CreateTablet for tablet 74a60f1722e64f329fe72226d0dbb7c4 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:17:43.096591 24455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a60f1722e64f329fe72226d0dbb7c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.097476 24516 consensus_queue.cc:260] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.087754 24313 tablet_service.cc:1511] Processing CreateTablet for tablet 36992a1e3818480c9a2705bd569f099a (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:17:43.091578 24388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 419283bfbe814a8dbebaa6962ce15ee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.099334 24399 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
I20260709 12:17:43.100030 24460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72fa7cd50b4c4a12af95a9accb7dd947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.105528 24289 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:17:43.111186 24514 tablet_bootstrap.cc:492] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:43.115109 24385 tablet_service.cc:1511] Processing CreateTablet for tablet 72fa7cd50b4c4a12af95a9accb7dd947 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:17:43.125105 24313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36992a1e3818480c9a2705bd569f099a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.125031 24522 raft_consensus.cc:2804] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:43.126693 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:43.127948 24307 tablet_service.cc:1511] Processing CreateTablet for tablet c06ca9ec70d4444d88577d9e07b62edc (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:17:43.129329 24307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c06ca9ec70d4444d88577d9e07b62edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.132295 24289 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:17:43.138587 24385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72fa7cd50b4c4a12af95a9accb7dd947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.138864 24382 tablet_service.cc:1511] Processing CreateTablet for tablet 74a60f1722e64f329fe72226d0dbb7c4 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 12:17:43.139590 24365 leader_election.cc:343] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:43.139864 24389 tablet_service.cc:1511] Processing CreateTablet for tablet 36992a1e3818480c9a2705bd569f099a (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:17:43.140158 24365 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:43.141687 24382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a60f1722e64f329fe72226d0dbb7c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.142292 24389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36992a1e3818480c9a2705bd569f099a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.143086 24521 raft_consensus.cc:2749] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:43.132791 24514 ts_tablet_manager.cc:1403] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.399s	user 0.043s	sys 0.005s
I20260709 12:17:43.145323 24456 tablet_service.cc:1511] Processing CreateTablet for tablet 36992a1e3818480c9a2705bd569f099a (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:17:43.146637 24456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36992a1e3818480c9a2705bd569f099a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.141901 24383 tablet_service.cc:1511] Processing CreateTablet for tablet c06ca9ec70d4444d88577d9e07b62edc (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:17:43.149413 24383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c06ca9ec70d4444d88577d9e07b62edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.149868 24516 ts_tablet_manager.cc:1434] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.157s	user 0.005s	sys 0.003s
I20260709 12:17:43.156037 24515 ts_tablet_manager.cc:1434] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.157s	user 0.007s	sys 0.001s
I20260709 12:17:43.157267 24515 tablet_bootstrap.cc:492] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:43.158855 24516 tablet_bootstrap.cc:492] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:43.180601 24459 tablet_service.cc:1511] Processing CreateTablet for tablet c06ca9ec70d4444d88577d9e07b62edc (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:17:43.184732 24459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c06ca9ec70d4444d88577d9e07b62edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.194746 24306 tablet_service.cc:1511] Processing CreateTablet for tablet 83efb40b1c6f4c9385b9e7c153e902bc (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:17:43.196173 24306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83efb40b1c6f4c9385b9e7c153e902bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.196980 24381 tablet_service.cc:1511] Processing CreateTablet for tablet 83efb40b1c6f4c9385b9e7c153e902bc (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:17:43.148488 24514 raft_consensus.cc:359] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.198421 24463 tablet_service.cc:1511] Processing CreateTablet for tablet 83efb40b1c6f4c9385b9e7c153e902bc (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:17:43.199998 24514 raft_consensus.cc:385] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.200448 24514 raft_consensus.cc:740] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.201107 24463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83efb40b1c6f4c9385b9e7c153e902bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.203111 24387 tablet_service.cc:1511] Processing CreateTablet for tablet 8616bc73679e486399b789377c5cd1ba (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:17:43.204262 24381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83efb40b1c6f4c9385b9e7c153e902bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.211002 24516 tablet_bootstrap.cc:654] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.211428 24514 consensus_queue.cc:260] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.212718 24308 tablet_service.cc:1511] Processing CreateTablet for tablet 5a08303c706b4fcda5778a1f60dc1915 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260709 12:17:43.212989 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 80783.2us
I20260709 12:17:43.218230 24386 tablet_service.cc:1511] Processing CreateTablet for tablet 5a08303c706b4fcda5778a1f60dc1915 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:17:43.230512 24543 raft_consensus.cc:2804] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:43.230913 24543 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.231341 24543 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.240996 24522 raft_consensus.cc:697] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:17:43.246685 24542 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.246869 24522 consensus_queue.cc:237] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.247201 24542 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.240785 24387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8616bc73679e486399b789377c5cd1ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.254232 24310 tablet_service.cc:1511] Processing CreateTablet for tablet 9ae0187acc6343ef874010bc79580048 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:17:43.255131 24384 tablet_service.cc:1511] Processing CreateTablet for tablet 9ae0187acc6343ef874010bc79580048 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:17:43.255988 24462 tablet_service.cc:1511] Processing CreateTablet for tablet 9ae0187acc6343ef874010bc79580048 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:17:43.256759 24458 tablet_service.cc:1511] Processing CreateTablet for tablet 5a08303c706b4fcda5778a1f60dc1915 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:17:43.267891 24308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a08303c706b4fcda5778a1f60dc1915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.275098 24310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ae0187acc6343ef874010bc79580048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.275245 24306 tablet_service.cc:1511] Processing CreateTablet for tablet 01bd4c6351f24e35abba86aef1ce23be (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:17:43.277442 24306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01bd4c6351f24e35abba86aef1ce23be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.275684 24384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ae0187acc6343ef874010bc79580048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.282053 24461 tablet_service.cc:1511] Processing CreateTablet for tablet 01bd4c6351f24e35abba86aef1ce23be (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:17:43.283257 24515 tablet_bootstrap.cc:654] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.284341 24386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a08303c706b4fcda5778a1f60dc1915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.291463 24514 ts_tablet_manager.cc:1434] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.146s	user 0.014s	sys 0.022s
I20260709 12:17:43.291872 24315 tablet_service.cc:1511] Processing CreateTablet for tablet 34412a32b83e40b7918bf8492b7af28f (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:17:43.292999 24514 tablet_bootstrap.cc:492] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:43.293291 24315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34412a32b83e40b7918bf8492b7af28f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.296504 24458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a08303c706b4fcda5778a1f60dc1915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.299894 24311 tablet_service.cc:1511] Processing CreateTablet for tablet 66cf199780b748b28ae5a775abb95cbe (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:17:43.307847 24311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66cf199780b748b28ae5a775abb95cbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.307492 24464 tablet_service.cc:1511] Processing CreateTablet for tablet 66cf199780b748b28ae5a775abb95cbe (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:17:43.308768 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:43.309597 24399 raft_consensus.cc:2393] T 63debf83121c430e9dffcd1c5035cf3a P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 1: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:17:43.307492 24314 tablet_service.cc:1511] Processing CreateTablet for tablet 36cbfd088b3e4737a74b878b802210f1 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:17:43.312778 24542 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:43.313815 24314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36cbfd088b3e4737a74b878b802210f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.321822 24462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ae0187acc6343ef874010bc79580048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.325337 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:43.325459 24457 tablet_service.cc:1511] Processing CreateTablet for tablet 36cbfd088b3e4737a74b878b802210f1 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:17:43.342861 24456 tablet_service.cc:1511] Processing CreateTablet for tablet 34412a32b83e40b7918bf8492b7af28f (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:17:43.345785 24464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66cf199780b748b28ae5a775abb95cbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.347071 24383 tablet_service.cc:1511] Processing CreateTablet for tablet 01bd4c6351f24e35abba86aef1ce23be (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:17:43.327229 24290 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:43.349277 24383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01bd4c6351f24e35abba86aef1ce23be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.356767 24457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36cbfd088b3e4737a74b878b802210f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.367025 24461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01bd4c6351f24e35abba86aef1ce23be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.367913 24456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34412a32b83e40b7918bf8492b7af28f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.393631 24545 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.395743 24516 tablet_bootstrap.cc:492] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:43.396330 24516 ts_tablet_manager.cc:1403] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.239s	user 0.014s	sys 0.009s
I20260709 12:17:43.399379 24543 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.389334 24221 catalog_manager.cc:5697] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 0 to 1, leader changed from <none> to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:43.402516 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:43.403110 24399 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.408931 24390 tablet_service.cc:1511] Processing CreateTablet for tablet 34412a32b83e40b7918bf8492b7af28f (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:17:43.410282 24390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34412a32b83e40b7918bf8492b7af28f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.410328 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:17:43.412984 24351 tablet.cc:2406] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260709 12:17:43.413321 24290 leader_election.cc:343] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:43.419715 24514 tablet_bootstrap.cc:654] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.422137 24385 tablet_service.cc:1511] Processing CreateTablet for tablet 66cf199780b748b28ae5a775abb95cbe (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:17:43.422675 24382 tablet_service.cc:1511] Processing CreateTablet for tablet 36cbfd088b3e4737a74b878b802210f1 (DEFAULT_TABLE table=test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:17:43.423602 24385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66cf199780b748b28ae5a775abb95cbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.426760 24382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36cbfd088b3e4737a74b878b802210f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:43.426229 24543 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:43.461071 24519 consensus_queue.cc:1048] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:43.471215 24515 tablet_bootstrap.cc:492] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:43.471764 24515 ts_tablet_manager.cc:1403] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.315s	user 0.019s	sys 0.008s
I20260709 12:17:43.473084 24516 raft_consensus.cc:359] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.473879 24516 raft_consensus.cc:385] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.474186 24516 raft_consensus.cc:740] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.475099 24516 consensus_queue.cc:260] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.476797 24515 raft_consensus.cc:359] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.477468 24516 ts_tablet_manager.cc:1434] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.002s
I20260709 12:17:43.477708 24515 raft_consensus.cc:385] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.478268 24515 raft_consensus.cc:740] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.481537 24515 consensus_queue.cc:260] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.483292 24545 raft_consensus.cc:2749] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:43.485351 24515 ts_tablet_manager.cc:1434] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:17:43.439429 24399 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:17:43.492337 24515 tablet_bootstrap.cc:492] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:43.491027 24519 consensus_queue.cc:1048] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:43.496579 24289 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:17:43.509454 24516 tablet_bootstrap.cc:492] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:43.506466 24545 raft_consensus.cc:2804] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:43.514544 24514 tablet_bootstrap.cc:492] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:43.516884 24514 ts_tablet_manager.cc:1403] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.224s	user 0.013s	sys 0.003s
I20260709 12:17:43.519414 24514 raft_consensus.cc:359] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.520167 24514 raft_consensus.cc:385] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.520462 24514 raft_consensus.cc:740] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.516390 24545 raft_consensus.cc:697] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:17:43.525081 24545 consensus_queue.cc:237] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.521422 24514 consensus_queue.cc:260] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.553735 24535 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.554313 24535 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.558625 24514 ts_tablet_manager.cc:1434] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 12:17:43.559885 24514 tablet_bootstrap.cc:492] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:43.561746 24535 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:43.563576 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:43.564340 24515 tablet_bootstrap.cc:654] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.563802 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:17:43.565851 24440 leader_election.cc:343] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:43.568145 24438 leader_election.cc:343] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:43.569262 24516 tablet_bootstrap.cc:654] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.568809 24438 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:43.574563 24535 raft_consensus.cc:2749] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:43.579126 24516 tablet_bootstrap.cc:492] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:43.579677 24516 ts_tablet_manager.cc:1403] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.000s
I20260709 12:17:43.580471 24514 tablet_bootstrap.cc:654] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.582252 24223 catalog_manager.cc:5697] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 0 to 1, leader changed from <none> to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:43.582767 24516 raft_consensus.cc:359] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:17:43.583730 24516 raft_consensus.cc:385] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.585767 24545 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.586105 24515 tablet_bootstrap.cc:492] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:43.586649 24515 ts_tablet_manager.cc:1403] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.095s	user 0.006s	sys 0.007s
I20260709 12:17:43.586412 24545 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.586939 24514 tablet_bootstrap.cc:492] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:43.588999 24514 ts_tablet_manager.cc:1403] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.003s
I20260709 12:17:43.589350 24545 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:43.589529 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:43.584128 24516 raft_consensus.cc:740] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
W20260709 12:17:43.591058 24289 leader_election.cc:343] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:43.592826 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:43.592901 24516 consensus_queue.cc:260] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:17:43.593933 24514 raft_consensus.cc:359] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.594722 24514 raft_consensus.cc:385] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.595014 24514 raft_consensus.cc:740] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.595841 24516 ts_tablet_manager.cc:1434] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.001s
I20260709 12:17:43.595851 24514 consensus_queue.cc:260] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:17:43.597692 24290 leader_election.cc:343] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:43.598177 24290 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:43.598803 24514 ts_tablet_manager.cc:1434] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.005s
I20260709 12:17:43.599289 24545 raft_consensus.cc:2749] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:43.599802 24514 tablet_bootstrap.cc:492] T 1541b2ab674f43ca8c6b46df9171c32d P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:43.602787 24515 raft_consensus.cc:359] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.604456 24516 tablet_bootstrap.cc:492] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:43.606561 24514 tablet_bootstrap.cc:654] T 1541b2ab674f43ca8c6b46df9171c32d P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.607808 24515 raft_consensus.cc:385] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.608278 24515 raft_consensus.cc:740] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.609290 24515 consensus_queue.cc:260] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.611562 24516 tablet_bootstrap.cc:654] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.618275 24514 tablet_bootstrap.cc:492] T 1541b2ab674f43ca8c6b46df9171c32d P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:43.618723 24514 ts_tablet_manager.cc:1403] T 1541b2ab674f43ca8c6b46df9171c32d P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.009s
I20260709 12:17:43.621366 24515 ts_tablet_manager.cc:1434] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.034s	user 0.002s	sys 0.006s
I20260709 12:17:43.621327 24514 raft_consensus.cc:359] T 1541b2ab674f43ca8c6b46df9171c32d P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.622202 24514 raft_consensus.cc:385] T 1541b2ab674f43ca8c6b46df9171c32d P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.622519 24514 raft_consensus.cc:740] T 1541b2ab674f43ca8c6b46df9171c32d P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.622678 24515 tablet_bootstrap.cc:492] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:43.623349 24514 consensus_queue.cc:260] T 1541b2ab674f43ca8c6b46df9171c32d P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.623859 24516 tablet_bootstrap.cc:492] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:43.624487 24516 ts_tablet_manager.cc:1403] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.008s
I20260709 12:17:43.628158 24514 ts_tablet_manager.cc:1434] T 1541b2ab674f43ca8c6b46df9171c32d P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:17:43.627911 24516 raft_consensus.cc:359] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.628908 24516 raft_consensus.cc:385] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.629312 24514 tablet_bootstrap.cc:492] T 0ff0373496af48a585a7d6ceab63908f P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:43.629323 24516 raft_consensus.cc:740] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.630786 24516 consensus_queue.cc:260] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.633214 24515 tablet_bootstrap.cc:654] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.633327 24516 ts_tablet_manager.cc:1434] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:17:43.635994 24514 tablet_bootstrap.cc:654] T 0ff0373496af48a585a7d6ceab63908f P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.636492 24516 tablet_bootstrap.cc:492] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:43.646486 24516 tablet_bootstrap.cc:654] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.647557 24515 tablet_bootstrap.cc:492] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:43.648128 24515 ts_tablet_manager.cc:1403] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.009s
I20260709 12:17:43.652040 24515 raft_consensus.cc:359] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.653059 24515 raft_consensus.cc:385] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.653435 24515 raft_consensus.cc:740] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.658418 24516 tablet_bootstrap.cc:492] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:43.658980 24516 ts_tablet_manager.cc:1403] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.003s
I20260709 12:17:43.654600 24515 consensus_queue.cc:260] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.662156 24516 raft_consensus.cc:359] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.663128 24516 raft_consensus.cc:385] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.663437 24516 raft_consensus.cc:740] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.664455 24514 tablet_bootstrap.cc:492] T 0ff0373496af48a585a7d6ceab63908f P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:43.664340 24516 consensus_queue.cc:260] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.665447 24514 ts_tablet_manager.cc:1403] T 0ff0373496af48a585a7d6ceab63908f P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.013s
I20260709 12:17:43.669601 24514 raft_consensus.cc:359] T 0ff0373496af48a585a7d6ceab63908f P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.670442 24514 raft_consensus.cc:385] T 0ff0373496af48a585a7d6ceab63908f P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.670795 24514 raft_consensus.cc:740] T 0ff0373496af48a585a7d6ceab63908f P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.671146 24516 ts_tablet_manager.cc:1434] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:17:43.671626 24514 consensus_queue.cc:260] T 0ff0373496af48a585a7d6ceab63908f P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.672274 24516 tablet_bootstrap.cc:492] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:43.673555 24514 ts_tablet_manager.cc:1434] T 0ff0373496af48a585a7d6ceab63908f P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:17:43.677922 24514 tablet_bootstrap.cc:492] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:43.678308 24515 ts_tablet_manager.cc:1434] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.001s
I20260709 12:17:43.679854 24516 tablet_bootstrap.cc:654] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.684849 24514 tablet_bootstrap.cc:654] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.688691 24515 tablet_bootstrap.cc:492] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:43.690287 24516 tablet_bootstrap.cc:492] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:43.690824 24516 ts_tablet_manager.cc:1403] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 12:17:43.693627 24516 raft_consensus.cc:359] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.694321 24516 raft_consensus.cc:385] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.694591 24516 raft_consensus.cc:740] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.694832 24514 tablet_bootstrap.cc:492] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:43.695308 24514 ts_tablet_manager.cc:1403] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.004s
I20260709 12:17:43.695291 24516 consensus_queue.cc:260] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.696518 24515 tablet_bootstrap.cc:654] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.697528 24516 ts_tablet_manager.cc:1434] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:17:43.698099 24514 raft_consensus.cc:359] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.698797 24514 raft_consensus.cc:385] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.699069 24514 raft_consensus.cc:740] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.699901 24514 consensus_queue.cc:260] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.700966 24516 tablet_bootstrap.cc:492] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:43.702039 24514 ts_tablet_manager.cc:1434] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:17:43.703274 24514 tablet_bootstrap.cc:492] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:43.707487 24516 tablet_bootstrap.cc:654] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.709033 24514 tablet_bootstrap.cc:654] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.709801 24515 tablet_bootstrap.cc:492] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:43.710374 24515 ts_tablet_manager.cc:1403] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.000s
I20260709 12:17:43.713423 24515 raft_consensus.cc:359] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.714180 24515 raft_consensus.cc:385] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.714533 24515 raft_consensus.cc:740] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.715278 24515 consensus_queue.cc:260] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.720925 24516 tablet_bootstrap.cc:492] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:43.721220 24515 ts_tablet_manager.cc:1434] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:17:43.721623 24516 ts_tablet_manager.cc:1403] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 12:17:43.722538 24515 tablet_bootstrap.cc:492] T 9f31ae8f765347f0b4ac12809516729c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:43.725548 24516 raft_consensus.cc:359] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.726506 24516 raft_consensus.cc:385] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.726852 24516 raft_consensus.cc:740] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.727501 24516 consensus_queue.cc:260] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.729501 24515 tablet_bootstrap.cc:654] T 9f31ae8f765347f0b4ac12809516729c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.730839 24516 ts_tablet_manager.cc:1434] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:17:43.732422 24516 tablet_bootstrap.cc:492] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:43.733810 24514 tablet_bootstrap.cc:492] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:43.734282 24514 ts_tablet_manager.cc:1403] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.031s	user 0.024s	sys 0.000s
I20260709 12:17:43.737178 24514 raft_consensus.cc:359] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.737840 24514 raft_consensus.cc:385] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.738121 24514 raft_consensus.cc:740] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.738377 24516 tablet_bootstrap.cc:654] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.738859 24514 consensus_queue.cc:260] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.741039 24514 ts_tablet_manager.cc:1434] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:17:43.741888 24474 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.742290 24514 tablet_bootstrap.cc:492] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:43.749663 24514 tablet_bootstrap.cc:654] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.750213 24516 tablet_bootstrap.cc:492] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:43.750741 24516 ts_tablet_manager.cc:1403] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.008s
I20260709 12:17:43.751307 24543 consensus_queue.cc:1048] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:43.752591 24515 tablet_bootstrap.cc:492] T 9f31ae8f765347f0b4ac12809516729c P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:43.753146 24515 ts_tablet_manager.cc:1403] T 9f31ae8f765347f0b4ac12809516729c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.002s
I20260709 12:17:43.753919 24516 raft_consensus.cc:359] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.755110 24516 raft_consensus.cc:385] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.755476 24516 raft_consensus.cc:740] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.756107 24515 raft_consensus.cc:359] T 9f31ae8f765347f0b4ac12809516729c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.756907 24515 raft_consensus.cc:385] T 9f31ae8f765347f0b4ac12809516729c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.756448 24516 consensus_queue.cc:260] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.757426 24515 raft_consensus.cc:740] T 9f31ae8f765347f0b4ac12809516729c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.758205 24515 consensus_queue.cc:260] T 9f31ae8f765347f0b4ac12809516729c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.760221 24515 ts_tablet_manager.cc:1434] T 9f31ae8f765347f0b4ac12809516729c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:17:43.761158 24515 tablet_bootstrap.cc:492] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:43.764559 24516 ts_tablet_manager.cc:1434] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:17:43.765826 24516 tablet_bootstrap.cc:492] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:43.767722 24515 tablet_bootstrap.cc:654] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.778254 24516 tablet_bootstrap.cc:654] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.779247 24514 tablet_bootstrap.cc:492] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:43.779752 24514 ts_tablet_manager.cc:1403] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.038s	user 0.027s	sys 0.006s
I20260709 12:17:43.781172 24535 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.781684 24535 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.783893 24535 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:43.785200 24545 consensus_queue.cc:1048] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:43.785461 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:43.785502 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:17:43.787314 24440 leader_election.cc:343] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:43.787498 24400 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:43.790124 24438 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:43.790655 24515 tablet_bootstrap.cc:492] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:43.791322 24515 ts_tablet_manager.cc:1403] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.010s
I20260709 12:17:43.791358 24535 raft_consensus.cc:2804] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:43.783744 24514 raft_consensus.cc:359] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:17:43.792002 24535 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.792405 24514 raft_consensus.cc:385] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.793081 24514 raft_consensus.cc:740] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.793243 24521 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.793773 24521 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:17:43.793906 24514 consensus_queue.cc:260] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:17:43.795895 24516 tablet_bootstrap.cc:492] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:43.796365 24516 ts_tablet_manager.cc:1403] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.003s
I20260709 12:17:43.792498 24535 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.797370 24515 raft_consensus.cc:359] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:17:43.797835 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:43.798049 24515 raft_consensus.cc:385] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.798460 24515 raft_consensus.cc:740] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.798583 24324 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 0.
I20260709 12:17:43.799288 24515 consensus_queue.cc:260] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:17:43.800648 24514 ts_tablet_manager.cc:1434] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 12:17:43.800364 24366 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:43.801645 24514 tablet_bootstrap.cc:492] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:43.802007 24515 ts_tablet_manager.cc:1434] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:17:43.802884 24515 tablet_bootstrap.cc:492] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:43.795888 24521 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:17:43.805383 24521 raft_consensus.cc:2804] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:43.805725 24521 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.806046 24521 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.807171 24535 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.808275 24514 tablet_bootstrap.cc:654] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.808499 24515 tablet_bootstrap.cc:654] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.799072 24516 raft_consensus.cc:359] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.809327 24516 raft_consensus.cc:385] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.809636 24516 raft_consensus.cc:740] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.810428 24516 consensus_queue.cc:260] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.812964 24516 ts_tablet_manager.cc:1434] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:17:43.814167 24516 tablet_bootstrap.cc:492] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:43.814873 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:43.825570 24516 tablet_bootstrap.cc:654] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.818447 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:43.818758 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:43.826323 24400 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:43.827593 24440 leader_election.cc:343] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:43.830973 24515 tablet_bootstrap.cc:492] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:43.831875 24515 ts_tablet_manager.cc:1403] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.007s
I20260709 12:17:43.825408 24474 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 0.
I20260709 12:17:43.838124 24515 raft_consensus.cc:359] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.839108 24515 raft_consensus.cc:385] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.839465 24515 raft_consensus.cc:740] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.840553 24515 consensus_queue.cc:260] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.836442 24400 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:43.843779 24438 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:43.845139 24515 ts_tablet_manager.cc:1434] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 12:17:43.845741 24519 raft_consensus.cc:2804] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:43.846601 24515 tablet_bootstrap.cc:492] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:43.817507 24535 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:43.853361 24521 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:17:43.850865 24519 raft_consensus.cc:697] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:17:43.856091 24519 consensus_queue.cc:237] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.856511 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:43.857082 24474 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:43.861506 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 61368.5us
I20260709 12:17:43.862780 24521 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:17:43.864190 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:43.865497 24324 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.868854 24521 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.869726 24521 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.872877 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:43.873531 24325 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 0.
I20260709 12:17:43.873821 24324 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
I20260709 12:17:43.876139 24366 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:43.877187 24474 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
I20260709 12:17:43.878439 24579 raft_consensus.cc:2804] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:43.878856 24579 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.880249 24579 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.878950 24365 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:43.878854 24521 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:43.885689 24515 tablet_bootstrap.cc:654] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.887197 24521 raft_consensus.cc:2804] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:43.887389 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:43.888841 24582 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.889508 24582 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.890434 24474 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 0.
I20260709 12:17:43.892391 24582 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:43.893370 24514 tablet_bootstrap.cc:492] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:43.893887 24514 ts_tablet_manager.cc:1403] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.039s
I20260709 12:17:43.894810 24223 catalog_manager.cc:5697] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:43.899083 24516 tablet_bootstrap.cc:492] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:43.899590 24516 ts_tablet_manager.cc:1403] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.086s	user 0.020s	sys 0.001s
I20260709 12:17:43.895362 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:43.901384 24473 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 0.
I20260709 12:17:43.902293 24514 raft_consensus.cc:359] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.902736 24516 raft_consensus.cc:359] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.903141 24514 raft_consensus.cc:385] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.902747 24579 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.903757 24514 raft_consensus.cc:740] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.903898 24365 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:43.904865 24582 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:43.905260 24582 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.905643 24582 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.904958 24514 consensus_queue.cc:260] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.906364 24516 raft_consensus.cc:385] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.906692 24516 raft_consensus.cc:740] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.907368 24516 consensus_queue.cc:260] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.903201 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:43.910316 24324 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 0.
I20260709 12:17:43.911955 24516 ts_tablet_manager.cc:1434] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:17:43.912457 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:43.912969 24516 tablet_bootstrap.cc:492] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:43.913028 24325 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.917210 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:43.934811 24473 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.936556 24514 ts_tablet_manager.cc:1434] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.004s
I20260709 12:17:43.931494 24582 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.937569 24515 tablet_bootstrap.cc:492] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:43.938051 24515 ts_tablet_manager.cc:1403] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.092s	user 0.027s	sys 0.007s
I20260709 12:17:43.940897 24515 raft_consensus.cc:359] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.941553 24515 raft_consensus.cc:385] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.918273 24579 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:43.942584 24515 raft_consensus.cc:740] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.942670 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:43.943312 24324 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.943446 24515 consensus_queue.cc:260] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.945137 24473 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
I20260709 12:17:43.936467 24325 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
I20260709 12:17:43.946502 24365 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:43.947396 24579 raft_consensus.cc:2804] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:43.947867 24579 raft_consensus.cc:697] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:17:43.948247 24515 ts_tablet_manager.cc:1434] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:17:43.949188 24515 tablet_bootstrap.cc:492] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:43.948770 24579 consensus_queue.cc:237] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.945353 24514 tablet_bootstrap.cc:492] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:43.952211 24324 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
I20260709 12:17:43.953431 24366 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:43.955282 24515 tablet_bootstrap.cc:654] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.961100 24589 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:43.961351 24514 tablet_bootstrap.cc:654] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.963163 24582 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:43.963752 24589 raft_consensus.cc:697] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:17:43.964679 24515 tablet_bootstrap.cc:492] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:43.964466 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:43.965215 24473 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.965492 24589 consensus_queue.cc:237] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.967319 24521 raft_consensus.cc:697] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:17:43.966073 24516 tablet_bootstrap.cc:654] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.965215 24515 ts_tablet_manager.cc:1403] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 12:17:43.968562 24521 consensus_queue.cc:237] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:17:43.971895 24515 raft_consensus.cc:359] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.972679 24515 raft_consensus.cc:385] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.972834 24473 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
I20260709 12:17:43.973006 24515 raft_consensus.cc:740] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.973865 24515 consensus_queue.cc:260] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.975800 24515 ts_tablet_manager.cc:1434] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:17:43.976715 24515 tablet_bootstrap.cc:492] T d9034e708c454259aebd10b80eeab667 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:43.976761 24514 tablet_bootstrap.cc:492] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:43.977434 24514 ts_tablet_manager.cc:1403] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.003s
I20260709 12:17:43.981127 24514 raft_consensus.cc:359] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.981869 24514 raft_consensus.cc:385] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.982151 24514 raft_consensus.cc:740] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.983768 24515 tablet_bootstrap.cc:654] T d9034e708c454259aebd10b80eeab667 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.984308 24535 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.984838 24535 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.986433 24516 tablet_bootstrap.cc:492] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:43.986968 24516 ts_tablet_manager.cc:1403] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.074s	user 0.007s	sys 0.009s
I20260709 12:17:43.987025 24535 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:43.988901 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:17:43.990350 24440 leader_election.cc:343] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:43.992179 24516 raft_consensus.cc:359] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.995016 24516 raft_consensus.cc:385] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.993345 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:43.999055 24514 consensus_queue.cc:260] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:43.999786 24516 raft_consensus.cc:740] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:44.000173 24399 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:44.000560 24516 consensus_queue.cc:260] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.003228 24516 ts_tablet_manager.cc:1434] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:17:44.004266 24516 tablet_bootstrap.cc:492] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
W20260709 12:17:44.004678 24271 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:44.005846 24438 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:44.007380 24535 raft_consensus.cc:2804] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:44.007891 24535 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.008474 24535 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:44.010658 24514 ts_tablet_manager.cc:1434] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.004s
I20260709 12:17:44.010804 24516 tablet_bootstrap.cc:654] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:44.014665 24521 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.015585 24515 tablet_bootstrap.cc:492] T d9034e708c454259aebd10b80eeab667 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:44.016263 24515 ts_tablet_manager.cc:1403] T d9034e708c454259aebd10b80eeab667 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.028s
I20260709 12:17:44.015772 24521 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.018322 24223 catalog_manager.cc:5697] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 0 to 1, leader changed from <none> to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:44.018939 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:44.022841 24324 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 0.
I20260709 12:17:44.023913 24473 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:44.024240 24366 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:44.019093 24515 raft_consensus.cc:359] T d9034e708c454259aebd10b80eeab667 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.025080 24514 tablet_bootstrap.cc:492] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:44.019858 24521 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:44.021158 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:44.021993 24535 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.026386 24519 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:44.026674 24365 leader_election.cc:343] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:44.026893 24519 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.027262 24535 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:44.025219 24589 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:44.025271 24515 raft_consensus.cc:385] T d9034e708c454259aebd10b80eeab667 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:44.027793 24589 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.027920 24515 raft_consensus.cc:740] T d9034e708c454259aebd10b80eeab667 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:44.028357 24589 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:44.029016 24519 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:44.028934 24515 consensus_queue.cc:260] T d9034e708c454259aebd10b80eeab667 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.029673 24542 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.030136 24542 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.031167 24515 ts_tablet_manager.cc:1434] T d9034e708c454259aebd10b80eeab667 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:17:44.032133 24515 tablet_bootstrap.cc:492] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:44.032282 24542 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:44.033015 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:44.037948 24399 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:44.038744 24515 tablet_bootstrap.cc:654] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:44.039778 24589 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.034972 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:44.041157 24398 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
I20260709 12:17:44.043144 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:44.035516 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:44.044171 24323 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:44.036381 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:44.045133 24400 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:44.036506 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:44.037223 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:44.047185 24325 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:44.035665 24545 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.048898 24545 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:17:44.049278 24440 leader_election.cc:343] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:44.050356 24440 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:44.051085 24545 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:44.052059 24519 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:44.052785 24519 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.053277 24514 tablet_bootstrap.cc:654] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:44.052882 24542 consensus_queue.cc:1048] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:44.053463 24519 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:44.043093 24289 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:44.058357 24535 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.058823 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:44.059207 24545 raft_consensus.cc:2804] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:44.058957 24535 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.059577 24545 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.059638 24473 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
I20260709 12:17:44.060020 24545 raft_consensus.cc:3060] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:44.061244 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:44.061920 24400 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
I20260709 12:17:44.064297 24290 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:44.066425 24542 raft_consensus.cc:2804] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:44.066784 24542 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.067117 24542 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:44.067034 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:44.044456 24474 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
I20260709 12:17:44.067598 24535 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:44.071627 24543 consensus_queue.cc:1048] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:44.087380 24545 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.094645 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:44.088007 24589 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:44.097616 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:44.098569 24397 raft_consensus.cc:3060] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:44.098891 24545 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:44.099193 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:44.086956 24323 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
I20260709 12:17:44.100412 24474 raft_consensus.cc:3060] T d9034e708c454259aebd10b80eeab667 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:44.107213 24366 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:44.108278 24589 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:44.108801 24589 raft_consensus.cc:697] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:17:44.109661 24589 consensus_queue.cc:237] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.110353 24519 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.111804 24474 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:17:44.112475 24519 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:44.112380 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:44.113889 24290 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:44.103014 24542 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:17:44.115020 24365 leader_election.cc:343] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:44.116829 24545 raft_consensus.cc:2804] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:44.117684 24545 raft_consensus.cc:697] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:17:44.111879 24438 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:44.118954 24545 consensus_queue.cc:237] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.120211 24399 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:44.120792 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:44.122464 24542 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:44.135001 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:44.136039 24396 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:44.135838 24438 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:44.126583 24400 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:44.143147 24583 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.143989 24583 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.138500 24535 raft_consensus.cc:2804] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:44.178941 24583 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:44.186789 24514 tablet_bootstrap.cc:492] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:44.187307 24514 ts_tablet_manager.cc:1403] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.163s	user 0.006s	sys 0.010s
I20260709 12:17:44.149647 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:44.160933 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:44.210013 24589 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.218559 24589 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.176892 24542 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.204368 24473 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:44.445010 24515 tablet_bootstrap.cc:492] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:44.445793 24515 ts_tablet_manager.cc:1403] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.414s	user 0.026s	sys 0.037s
I20260709 12:17:44.247359 24589 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:44.369022 24583 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.446933 24583 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.235684 24323 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:44.449978 24516 tablet_bootstrap.cc:492] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:44.287002 24542 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.452262 24516 ts_tablet_manager.cc:1403] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.447s	user 0.021s	sys 0.017s
I20260709 12:17:44.445029 24514 raft_consensus.cc:359] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.459095 24514 raft_consensus.cc:385] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:44.459534 24514 raft_consensus.cc:740] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:44.460541 24514 consensus_queue.cc:260] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.291227 24543 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.221184 24535 raft_consensus.cc:697] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:17:44.291007 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:44.249042 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:44.309725 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:44.234871 24519 raft_consensus.cc:2749] T 9f31ae8f765347f0b4ac12809516729c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:44.290565 24397 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:17:44.475595 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:44.475919 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:44.479890 24322 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:44.480170 24399 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:44.480610 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:44.481285 24440 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:44.485217 24583 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:44.482129 24474 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 0.
I20260709 12:17:44.471208 24543 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.513341 24438 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:44.536331 24515 raft_consensus.cc:359] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.537519 24515 raft_consensus.cc:385] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:44.537938 24515 raft_consensus.cc:740] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:44.538933 24515 consensus_queue.cc:260] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:17:44.525650 24599 log.cc:927] Time spent T 9f31ae8f765347f0b4ac12809516729c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.070s	user 0.001s	sys 0.001s
I20260709 12:17:44.540505 24516 raft_consensus.cc:359] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.543882 24516 raft_consensus.cc:385] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:44.544485 24516 raft_consensus.cc:740] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:44.547290 24516 consensus_queue.cc:260] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.535647 24365 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:44.560180 24521 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:44.560360 24583 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:44.560735 24521 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.561134 24583 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.520356 24535 consensus_queue.cc:237] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.561254 24521 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:44.566622 24516 ts_tablet_manager.cc:1434] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.111s	user 0.009s	sys 0.000s
I20260709 12:17:44.568100 24516 tablet_bootstrap.cc:492] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:44.561795 24583 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:44.563160 24438 leader_election.cc:343] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:44.570099 24607 raft_consensus.cc:2804] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:44.569785 24542 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:44.583616 24514 ts_tablet_manager.cc:1434] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.396s	user 0.026s	sys 0.045s
W20260709 12:17:44.581652 24366 leader_election.cc:343] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:44.599210 24515 ts_tablet_manager.cc:1434] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.153s	user 0.010s	sys 0.019s
I20260709 12:17:44.601014 24515 tablet_bootstrap.cc:492] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
W20260709 12:17:44.596378 24601 log.cc:927] Time spent T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:17:44.594640 24607 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:44.592362 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 64047.4us
I20260709 12:17:44.594627 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:44.609746 24612 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:44.599716 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 118523us
W20260709 12:17:44.600942 24602 log.cc:927] Time spent T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:17:44.610332 24612 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.624034 24323 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
W20260709 12:17:44.630748 24600 log.cc:927] Time spent T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260709 12:17:44.624853 24289 leader_election.cc:343] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:44.629936 24396 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:44.627529 24400 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:17:44.638126 24323 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:44.638504 24289 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:44.640622 24608 raft_consensus.cc:2804] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:44.640784 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:44.641188 24608 raft_consensus.cc:697] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:17:44.642184 24440 leader_election.cc:343] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:44.642153 24608 consensus_queue.cc:237] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.638772 24514 tablet_bootstrap.cc:492] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:44.609124 24607 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:44.656296 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:44.657218 24398 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 1: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:17:44.643306 24440 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:44.660032 24535 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:44.660746 24535 raft_consensus.cc:697] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:17:44.661019 24473 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:17:44.661980 24535 consensus_queue.cc:237] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.674376 24515 tablet_bootstrap.cc:654] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:44.687882 24521 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.692386 24589 consensus_queue.cc:1048] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:44.672950 24543 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:44.704160 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:44.704972 24322 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:44.708992 24519 consensus_queue.cc:1048] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:44.710294 24221 catalog_manager.cc:5697] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 0 to 1, leader changed from <none> to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:44.718078 24616 consensus_queue.cc:1048] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:17:44.725193 24516 tablet_bootstrap.cc:654] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:44.729601 24440 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:44.726061 24612 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:44.730947 24612 raft_consensus.cc:2804] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:44.731308 24612 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.731662 24612 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:44.716081 24543 consensus_queue.cc:1048] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:17:44.719266 24583 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:17:44.741470 24365 consensus_peers.cc:597] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a -> Peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Couldn't send request to peer 99b8650fa8324ac2ac5f75eee9b1a1e3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.764250 24514 tablet_bootstrap.cc:654] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:44.769953 24589 consensus_queue.cc:1048] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:17:44.780927 24519 consensus_queue.cc:1048] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:44.789561 24589 consensus_queue.cc:1048] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:44.784281 24521 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:44.786943 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:44.797727 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:44.811295 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:44.797127 24611 consensus_queue.cc:1048] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.086s
I20260709 12:17:44.813355 24521 consensus_queue.cc:1048] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:17:44.816834 24616 consensus_queue.cc:1048] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:44.819275 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:44.823307 24473 raft_consensus.cc:2393] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 1: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
W20260709 12:17:44.815382 24366 leader_election.cc:343] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:44.824354 24583 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:44.826601 24612 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.854159 24607 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:17:44.843338 24438 leader_election.cc:343] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:44.850227 24290 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:44.861637 24521 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.869407 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:44.870368 24474 raft_consensus.cc:2393] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 1: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:17:44.868357 24612 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:44.863219 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:44.864288 24606 consensus_queue.cc:1048] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:17:44.897883 24515 tablet_bootstrap.cc:492] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:44.901275 24515 ts_tablet_manager.cc:1403] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.301s	user 0.012s	sys 0.013s
I20260709 12:17:44.904654 24515 raft_consensus.cc:359] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.873704 24608 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:44.880673 24323 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:44.907336 24515 raft_consensus.cc:385] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:44.908272 24516 tablet_bootstrap.cc:492] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:44.908540 24515 raft_consensus.cc:740] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:44.908869 24516 ts_tablet_manager.cc:1403] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.341s	user 0.020s	sys 0.012s
I20260709 12:17:44.909312 24515 consensus_queue.cc:260] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.874351 24521 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.915225 24514 tablet_bootstrap.cc:492] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:44.916975 24514 ts_tablet_manager.cc:1403] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.278s	user 0.022s	sys 0.005s
I20260709 12:17:44.924746 24515 ts_tablet_manager.cc:1434] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
W20260709 12:17:44.922816 24440 leader_election.cc:343] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:44.923591 24290 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:44.885668 24365 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:44.927506 24515 tablet_bootstrap.cc:492] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:44.936604 24607 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:44.950407 24616 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:44.950510 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:17:44.951435 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 76903.8us
I20260709 12:17:44.953073 24521 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:44.953999 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:44.954231 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:44.943852 24606 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:44.955008 24396 raft_consensus.cc:2393] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 1: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:17:44.973382 24514 raft_consensus.cc:359] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.974169 24514 raft_consensus.cc:385] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:44.974495 24514 raft_consensus.cc:740] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:44.976621 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:44.977627 24471 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 0.
I20260709 12:17:44.985472 24514 consensus_queue.cc:260] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:44.987679 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:44.988787 24514 ts_tablet_manager.cc:1434] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.072s	user 0.003s	sys 0.005s
I20260709 12:17:44.990598 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:44.993001 24514 tablet_bootstrap.cc:492] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:44.992848 24365 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:44.994055 24616 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:44.994459 24616 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.994818 24616 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:45.013367 24616 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.017660 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:45.018292 24472 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:45.020813 24616 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:17:44.995815 24438 leader_election.cc:343] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:45.046424 24516 raft_consensus.cc:359] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.047194 24516 raft_consensus.cc:385] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:45.047466 24516 raft_consensus.cc:740] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
W20260709 12:17:45.038268 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 48268.9us
W20260709 12:17:45.070755 24366 leader_election.cc:343] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:45.073218 24516 consensus_queue.cc:260] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.075407 24516 ts_tablet_manager.cc:1434] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.166s	user 0.009s	sys 0.013s
W20260709 12:17:45.061195 24271 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:45.079084 24516 tablet_bootstrap.cc:492] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:45.083036 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:45.086625 24323 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:45.087051 24438 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:17:45.089386 24366 leader_election.cc:343] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:45.090093 24519 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:17:45.089605 24438 leader_election.cc:343] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:45.093391 24472 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
I20260709 12:17:45.093552 24440 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:45.094734 24519 raft_consensus.cc:2804] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:45.095235 24519 raft_consensus.cc:697] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:17:45.097338 24515 tablet_bootstrap.cc:654] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:45.100334 24365 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:45.100965 24606 raft_consensus.cc:2749] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:45.103003 24625 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:45.103256 24514 tablet_bootstrap.cc:654] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:45.103776 24625 raft_consensus.cc:697] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:17:45.105140 24607 consensus_queue.cc:1048] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:45.105461 24625 consensus_queue.cc:237] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.096151 24519 consensus_queue.cc:237] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:17:45.140092 24440 consensus_peers.cc:597] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:45.021401 24222 catalog_manager.cc:5697] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 0 to 1, leader changed from <none> to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:45.171633 24640 log.cc:927] Time spent T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:17:45.176734 24607 consensus_queue.cc:1048] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:17:45.181236 24641 log.cc:927] Time spent T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:17:45.183442 24222 catalog_manager.cc:5697] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 0 to 1, leader changed from <none> to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:45.186970 24516 tablet_bootstrap.cc:654] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:45.217190 24545 consensus_queue.cc:1048] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:45.227604 24543 consensus_queue.cc:1048] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:45.268028 24607 consensus_queue.cc:1048] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:45.291782 24516 tablet_bootstrap.cc:492] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:45.291910 24515 tablet_bootstrap.cc:492] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:45.292482 24515 ts_tablet_manager.cc:1403] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.366s	user 0.045s	sys 0.039s
I20260709 12:17:45.292482 24516 ts_tablet_manager.cc:1403] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.216s	user 0.010s	sys 0.021s
I20260709 12:17:45.298391 24516 raft_consensus.cc:359] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.299057 24516 raft_consensus.cc:385] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:45.299301 24516 raft_consensus.cc:740] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:45.299903 24516 consensus_queue.cc:260] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.301944 24516 ts_tablet_manager.cc:1434] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:17:45.302908 24516 tablet_bootstrap.cc:492] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:45.303051 24320 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:45.303490 24515 raft_consensus.cc:359] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.304188 24515 raft_consensus.cc:385] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:45.304438 24515 raft_consensus.cc:740] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:45.305163 24515 consensus_queue.cc:260] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.307837 24515 ts_tablet_manager.cc:1434] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:17:45.319947 24516 tablet_bootstrap.cc:654] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:45.320173 24440 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:45.321478 24583 raft_consensus.cc:2804] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:45.322161 24583 raft_consensus.cc:697] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:17:45.323385 24583 consensus_queue.cc:237] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.349360 24515 tablet_bootstrap.cc:492] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:45.349445 24543 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.353880 24543 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.357965 24543 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:45.359709 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:45.360916 24473 raft_consensus.cc:2393] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 1: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:17:45.363988 24515 tablet_bootstrap.cc:654] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:45.376791 24223 catalog_manager.cc:5697] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 0 to 1, leader changed from <none> to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:45.379513 24223 catalog_manager.cc:5697] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 0 to 1, leader changed from <none> to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:17:45.398864 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:45.400038 24398 raft_consensus.cc:2393] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 1: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:17:45.405472 24516 tablet_bootstrap.cc:492] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:45.406073 24516 ts_tablet_manager.cc:1403] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.103s	user 0.014s	sys 0.006s
I20260709 12:17:45.408499 24514 tablet_bootstrap.cc:492] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:45.458796 24514 ts_tablet_manager.cc:1403] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.466s	user 0.081s	sys 0.085s
I20260709 12:17:45.457616 24222 catalog_manager.cc:5697] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:45.465417 24516 raft_consensus.cc:359] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.465198 24222 catalog_manager.cc:5697] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:45.466481 24516 raft_consensus.cc:385] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:45.466894 24516 raft_consensus.cc:740] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:45.470649 24516 consensus_queue.cc:260] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.441512 24607 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.422360 24289 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:45.477072 24545 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:45.480547 24625 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.481148 24625 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:17:45.482431 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 63779.6us
I20260709 12:17:45.483345 24625 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:45.485195 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:45.486332 24516 ts_tablet_manager.cc:1434] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.080s	user 0.009s	sys 0.005s
W20260709 12:17:45.487716 24366 leader_election.cc:343] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:45.489305 24516 tablet_bootstrap.cc:492] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:45.474308 24607 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.467880 24222 catalog_manager.cc:5697] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:45.497303 24514 raft_consensus.cc:359] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.498220 24514 raft_consensus.cc:385] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:45.498674 24514 raft_consensus.cc:740] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:45.499415 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:45.499436 24514 consensus_queue.cc:260] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.500505 24474 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 0.
I20260709 12:17:45.504808 24515 tablet_bootstrap.cc:492] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:45.505438 24515 ts_tablet_manager.cc:1403] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.156s	user 0.033s	sys 0.025s
I20260709 12:17:45.506513 24516 tablet_bootstrap.cc:654] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:45.503027 24365 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:45.511569 24589 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:45.511977 24589 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:45.512367 24589 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:45.511247 24515 raft_consensus.cc:359] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.514019 24515 raft_consensus.cc:385] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:45.514341 24515 raft_consensus.cc:740] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:45.517223 24545 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:45.521261 24607 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:45.522158 24589 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.524224 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:45.524948 24514 ts_tablet_manager.cc:1434] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.001s
W20260709 12:17:45.525835 24440 leader_election.cc:343] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:45.524174 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:45.526404 24514 tablet_bootstrap.cc:492] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:45.526968 24396 raft_consensus.cc:2393] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 1: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:17:45.528193 24515 consensus_queue.cc:260] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.528609 24625 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.528859 24438 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:45.530090 24535 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:45.529726 24625 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.533512 24625 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:45.533723 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:45.537247 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:17:45.538901 24366 leader_election.cc:343] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:45.530558 24515 ts_tablet_manager.cc:1434] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:17:45.543444 24515 tablet_bootstrap.cc:492] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
W20260709 12:17:45.543871 24365 leader_election.cc:343] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:45.532819 24221 catalog_manager.cc:5697] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 0 to 1, leader changed from <none> to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:45.544378 24365 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:45.545524 24625 raft_consensus.cc:2749] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:45.547407 24535 raft_consensus.cc:2749] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:45.549017 24589 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:45.549973 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:45.550187 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:17:45.551730 24366 leader_election.cc:343] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:45.562492 24474 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
I20260709 12:17:45.563659 24365 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:45.564596 24625 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:45.565193 24625 raft_consensus.cc:697] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:17:45.565485 24616 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.566689 24625 consensus_queue.cc:237] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.565915 24616 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.570586 24514 tablet_bootstrap.cc:654] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:45.571085 24515 tablet_bootstrap.cc:654] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:45.571759 24616 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:45.576473 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:45.579929 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:45.588099 24516 tablet_bootstrap.cc:492] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:45.588615 24516 ts_tablet_manager.cc:1403] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.101s	user 0.009s	sys 0.024s
W20260709 12:17:45.583173 24366 leader_election.cc:343] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:45.589172 24365 leader_election.cc:343] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:45.591694 24516 raft_consensus.cc:359] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.592422 24516 raft_consensus.cc:385] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:45.592954 24516 raft_consensus.cc:740] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:45.593695 24516 consensus_queue.cc:260] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.591415 24365 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:45.598830 24616 raft_consensus.cc:2749] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:45.599993 24516 ts_tablet_manager.cc:1434] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 12:17:45.601126 24516 tablet_bootstrap.cc:492] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
W20260709 12:17:45.607846 24438 consensus_peers.cc:597] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:45.616204 24223 catalog_manager.cc:5697] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:45.617192 24514 tablet_bootstrap.cc:492] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:45.617909 24514 ts_tablet_manager.cc:1403] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.092s	user 0.014s	sys 0.001s
I20260709 12:17:45.618054 24516 tablet_bootstrap.cc:654] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:45.622454 24515 tablet_bootstrap.cc:492] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:45.622941 24515 ts_tablet_manager.cc:1403] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.080s	user 0.015s	sys 0.001s
I20260709 12:17:45.625530 24515 raft_consensus.cc:359] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.626011 24515 raft_consensus.cc:385] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:45.626171 24515 raft_consensus.cc:740] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:45.626748 24515 consensus_queue.cc:260] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.628733 24515 ts_tablet_manager.cc:1434] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:17:45.630414 24515 tablet_bootstrap.cc:492] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:45.629928 24514 raft_consensus.cc:359] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.631642 24514 raft_consensus.cc:385] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:45.632212 24514 raft_consensus.cc:740] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:45.633103 24514 consensus_queue.cc:260] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.636732 24514 ts_tablet_manager.cc:1434] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:17:45.637732 24514 tablet_bootstrap.cc:492] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:45.639153 24515 tablet_bootstrap.cc:654] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:45.642226 24222 catalog_manager.cc:5697] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 0 to 1, leader changed from <none> to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:45.653774 24516 tablet_bootstrap.cc:492] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:45.654536 24516 ts_tablet_manager.cc:1403] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.008s
I20260709 12:17:45.665140 24516 raft_consensus.cc:359] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.666019 24516 raft_consensus.cc:385] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:45.666322 24516 raft_consensus.cc:740] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:45.667321 24516 consensus_queue.cc:260] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:17:45.669389 24366 consensus_peers.cc:597] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:45.671794 24515 tablet_bootstrap.cc:492] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:45.672338 24515 ts_tablet_manager.cc:1403] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.004s
I20260709 12:17:45.676887 24515 raft_consensus.cc:359] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.677964 24515 raft_consensus.cc:385] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:45.678485 24515 raft_consensus.cc:740] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:45.679497 24516 ts_tablet_manager.cc:1434] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:17:45.679243 24515 consensus_queue.cc:260] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.680099 24514 tablet_bootstrap.cc:654] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:45.680744 24516 tablet_bootstrap.cc:492] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:45.690121 24515 ts_tablet_manager.cc:1434] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 12:17:45.690210 24516 tablet_bootstrap.cc:654] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:45.691339 24515 tablet_bootstrap.cc:492] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:45.698794 24515 tablet_bootstrap.cc:654] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:45.700286 24516 tablet_bootstrap.cc:492] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:45.702088 24516 ts_tablet_manager.cc:1403] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.000s
I20260709 12:17:45.705596 24514 tablet_bootstrap.cc:492] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:45.706190 24514 ts_tablet_manager.cc:1403] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.069s	user 0.003s	sys 0.021s
I20260709 12:17:45.709046 24625 consensus_queue.cc:1048] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:45.709640 24514 raft_consensus.cc:359] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.710427 24514 raft_consensus.cc:385] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:45.712517 24515 tablet_bootstrap.cc:492] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:45.710702 24514 raft_consensus.cc:740] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:45.713083 24515 ts_tablet_manager.cc:1403] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.006s
I20260709 12:17:45.713351 24514 consensus_queue.cc:260] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.715893 24514 ts_tablet_manager.cc:1434] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:17:45.712136 24516 raft_consensus.cc:359] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.716233 24516 raft_consensus.cc:385] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:45.716499 24516 raft_consensus.cc:740] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:45.717140 24516 consensus_queue.cc:260] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.718329 24515 raft_consensus.cc:359] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.719013 24515 raft_consensus.cc:385] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:45.719317 24515 raft_consensus.cc:740] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:45.720039 24515 consensus_queue.cc:260] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.722837 24515 ts_tablet_manager.cc:1434] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 12:17:45.723711 24515 tablet_bootstrap.cc:492] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:45.733040 24515 tablet_bootstrap.cc:654] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:45.735510 24323 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:45.746380 24589 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.747129 24589 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.724820 24514 tablet_bootstrap.cc:492] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:45.723938 24516 ts_tablet_manager.cc:1434] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:17:45.752781 24516 tablet_bootstrap.cc:492] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:45.755864 24535 consensus_queue.cc:1048] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:45.765512 24516 tablet_bootstrap.cc:654] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:45.766144 24589 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:45.766896 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:45.767799 24321 raft_consensus.cc:2393] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 1: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:17:45.767812 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:45.770818 24365 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:45.784665 24589 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:45.797456 24535 consensus_queue.cc:1048] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:45.806162 24589 raft_consensus.cc:2749] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:45.812909 24514 tablet_bootstrap.cc:654] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:45.816037 24516 tablet_bootstrap.cc:492] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:45.816687 24516 ts_tablet_manager.cc:1403] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.000s
I20260709 12:17:45.829661 24607 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.830276 24607 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.833624 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:17:45.835218 24440 leader_election.cc:343] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:45.836476 24607 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:45.838415 24625 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.838965 24625 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.842684 24516 raft_consensus.cc:359] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.843456 24516 raft_consensus.cc:385] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:45.843746 24516 raft_consensus.cc:740] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:45.845064 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:17:45.846647 24438 leader_election.cc:343] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:45.847163 24438 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:45.848877 24625 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:45.849836 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:45.850414 24535 consensus_queue.cc:1048] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:45.851863 24535 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:17:45.852056 24366 leader_election.cc:343] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:45.844452 24516 consensus_queue.cc:260] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.857177 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:45.874264 24516 ts_tablet_manager.cc:1434] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 12:17:45.875823 24516 tablet_bootstrap.cc:492] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:45.825863 24589 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.882530 24543 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.909165 24607 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.912197 24607 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:17:45.907469 24365 leader_election.cc:343] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:45.913640 24365 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:45.914462 24607 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:45.914470 24625 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:45.916810 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:45.894685 24589 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.905840 24543 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.917243 24535 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.919986 24535 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.920846 24515 tablet_bootstrap.cc:492] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:45.921825 24515 ts_tablet_manager.cc:1403] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.198s	user 0.039s	sys 0.068s
I20260709 12:17:45.921870 24589 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:45.922117 24535 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:45.923522 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:45.924201 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:45.929796 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:45.924216 24400 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
W20260709 12:17:45.931756 24365 leader_election.cc:343] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:45.933193 24321 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:45.934211 24515 raft_consensus.cc:359] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.935784 24515 raft_consensus.cc:385] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:45.936029 24515 raft_consensus.cc:740] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:45.936715 24515 consensus_queue.cc:260] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:45.938047 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:45.941231 24515 ts_tablet_manager.cc:1434] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:17:45.942260 24515 tablet_bootstrap.cc:492] T 48b5441f03704ebb94ffdbb55b9f33c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:45.935438 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:17:45.938005 24440 leader_election.cc:343] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:45.939920 24438 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:45.947988 24583 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:45.948390 24583 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:45.948741 24583 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:45.954842 24543 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:17:45.956043 24366 leader_election.cc:343] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:45.956514 24366 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:45.957862 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:45.958339 24589 raft_consensus.cc:2749] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:17:45.952894 24438 leader_election.cc:343] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:45.961863 24438 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:45.963148 24607 raft_consensus.cc:2749] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:45.976410 24514 tablet_bootstrap.cc:492] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:45.977092 24514 ts_tablet_manager.cc:1403] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.252s	user 0.037s	sys 0.028s
I20260709 12:17:45.978384 24516 tablet_bootstrap.cc:654] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:45.978497 24515 tablet_bootstrap.cc:654] T 48b5441f03704ebb94ffdbb55b9f33c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:45.989596 24612 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.960937 24398 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
I20260709 12:17:45.993660 24514 raft_consensus.cc:359] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.000370 24514 raft_consensus.cc:385] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:46.002169 24514 raft_consensus.cc:740] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:46.002987 24514 consensus_queue.cc:260] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.008978 24583 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.010879 24514 ts_tablet_manager.cc:1434] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.033s	user 0.011s	sys 0.000s
I20260709 12:17:46.012899 24514 tablet_bootstrap.cc:492] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:46.020318 24543 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.021811 24543 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.023159 24289 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:46.024221 24657 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:46.024648 24657 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:46.024981 24657 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:46.000236 24612 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.032306 24470 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:46.033396 24657 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.036521 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:46.037312 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:46.039613 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:46.029861 24583 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:46.030857 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:46.029433 24543 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:46.037410 24397 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:46.047505 24637 consensus_queue.cc:1048] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:46.048679 24612 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:46.051973 24535 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.051194 24657 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:46.075186 24516 tablet_bootstrap.cc:492] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:46.075801 24516 ts_tablet_manager.cc:1403] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.200s	user 0.021s	sys 0.014s
I20260709 12:17:46.079141 24515 tablet_bootstrap.cc:492] T 48b5441f03704ebb94ffdbb55b9f33c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:46.079634 24515 ts_tablet_manager.cc:1403] T 48b5441f03704ebb94ffdbb55b9f33c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.138s	user 0.017s	sys 0.002s
W20260709 12:17:46.052753 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 89696.5us
I20260709 12:17:46.052990 24400 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
I20260709 12:17:46.083521 24515 raft_consensus.cc:359] T 48b5441f03704ebb94ffdbb55b9f33c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.090862 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:46.081349 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:46.092378 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:46.093899 24515 raft_consensus.cc:385] T 48b5441f03704ebb94ffdbb55b9f33c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:46.094398 24471 raft_consensus.cc:2393] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 1: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:17:46.094368 24515 raft_consensus.cc:740] T 48b5441f03704ebb94ffdbb55b9f33c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:46.091560 24516 raft_consensus.cc:359] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.095927 24516 raft_consensus.cc:385] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:46.095647 24515 consensus_queue.cc:260] T 48b5441f03704ebb94ffdbb55b9f33c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.096212 24516 raft_consensus.cc:740] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:46.097991 24289 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:46.099004 24473 raft_consensus.cc:2393] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 1: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:17:46.084992 24397 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:17:46.076426 24535 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.099561 24657 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:46.100183 24472 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
I20260709 12:17:46.100518 24289 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:46.101855 24543 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:46.102531 24543 raft_consensus.cc:697] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:17:46.103281 24535 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:46.101100 24657 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:46.104017 24657 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:46.104592 24515 ts_tablet_manager.cc:1434] T 48b5441f03704ebb94ffdbb55b9f33c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:17:46.106519 24515 tablet_bootstrap.cc:492] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:46.106778 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:46.108186 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:46.108882 24397 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:46.109510 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:46.110150 24438 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:46.112178 24583 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:46.112600 24583 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:46.112993 24583 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:46.114522 24440 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:46.115389 24676 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:17:46.119577 24366 consensus_peers.cc:597] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:46.103569 24543 consensus_queue.cc:237] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.119774 24657 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.121055 24583 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.121840 24657 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:46.112895 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:46.098623 24516 consensus_queue.cc:260] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.107805 24514 tablet_bootstrap.cc:654] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:46.123131 24323 raft_consensus.cc:2393] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 1: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:17:46.124346 24516 ts_tablet_manager.cc:1434] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.001s
I20260709 12:17:46.127719 24516 tablet_bootstrap.cc:492] T 82c31a779e7949a590cf168eef01e405 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:46.131790 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:46.132193 24440 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:46.132614 24397 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:46.133085 24535 raft_consensus.cc:2749] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:46.135746 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:46.136538 24323 raft_consensus.cc:2393] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 1: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:17:46.138746 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:17:46.104017 24271 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:46.131033 24583 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:46.150485 24222 catalog_manager.cc:5697] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 0 to 1, leader changed from <none> to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:46.162436 24440 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:46.161612 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:46.171373 24583 raft_consensus.cc:2749] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:46.174499 24474 raft_consensus.cc:2393] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 1: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:17:46.168789 24397 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:17:46.179068 24289 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:46.179914 24543 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:46.180473 24543 raft_consensus.cc:697] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:17:46.186367 24543 consensus_queue.cc:237] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.187072 24514 tablet_bootstrap.cc:492] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:46.187690 24514 ts_tablet_manager.cc:1403] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.175s	user 0.018s	sys 0.009s
I20260709 12:17:46.197242 24516 tablet_bootstrap.cc:654] T 82c31a779e7949a590cf168eef01e405 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:46.199258 24515 tablet_bootstrap.cc:654] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:46.211014 24514 raft_consensus.cc:359] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.212195 24514 raft_consensus.cc:385] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:46.212652 24514 raft_consensus.cc:740] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:46.213615 24514 consensus_queue.cc:260] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.216434 24514 ts_tablet_manager.cc:1434] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.002s
I20260709 12:17:46.217608 24515 tablet_bootstrap.cc:492] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:46.220695 24515 ts_tablet_manager.cc:1403] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.114s	user 0.014s	sys 0.006s
I20260709 12:17:46.221235 24514 tablet_bootstrap.cc:492] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:46.221838 24516 tablet_bootstrap.cc:492] T 82c31a779e7949a590cf168eef01e405 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:46.222368 24516 ts_tablet_manager.cc:1403] T 82c31a779e7949a590cf168eef01e405 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.095s	user 0.020s	sys 0.000s
I20260709 12:17:46.223652 24515 raft_consensus.cc:359] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.224466 24515 raft_consensus.cc:385] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:46.224809 24515 raft_consensus.cc:740] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:46.225287 24516 raft_consensus.cc:359] T 82c31a779e7949a590cf168eef01e405 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.225589 24515 consensus_queue.cc:260] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.226305 24516 raft_consensus.cc:385] T 82c31a779e7949a590cf168eef01e405 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:46.226670 24516 raft_consensus.cc:740] T 82c31a779e7949a590cf168eef01e405 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:46.227514 24516 consensus_queue.cc:260] T 82c31a779e7949a590cf168eef01e405 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.228448 24515 ts_tablet_manager.cc:1434] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:17:46.229789 24515 tablet_bootstrap.cc:492] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:46.230108 24516 ts_tablet_manager.cc:1434] T 82c31a779e7949a590cf168eef01e405 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:17:46.230614 24637 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.231101 24637 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.233374 24637 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:46.234030 24543 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.234578 24543 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.236065 24515 tablet_bootstrap.cc:654] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:46.236472 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:46.236857 24543 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:46.237242 24474 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 0.
I20260709 12:17:46.238747 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:46.239430 24323 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 0.
I20260709 12:17:46.240201 24516 tablet_bootstrap.cc:492] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:46.242560 24365 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:46.244766 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:46.245457 24400 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
I20260709 12:17:46.246912 24516 tablet_bootstrap.cc:654] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:46.254561 24514 tablet_bootstrap.cc:654] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:46.257359 24289 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:46.258190 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:46.258487 24625 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:46.259136 24625 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:46.258360 24543 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:46.259016 24474 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
I20260709 12:17:46.260178 24543 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:46.260785 24543 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:46.264454 24515 tablet_bootstrap.cc:492] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:46.259750 24625 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:46.265101 24515 ts_tablet_manager.cc:1403] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.013s
I20260709 12:17:46.267234 24514 tablet_bootstrap.cc:492] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:46.269155 24514 ts_tablet_manager.cc:1403] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.005s
I20260709 12:17:46.277014 24515 raft_consensus.cc:359] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.277808 24515 raft_consensus.cc:385] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:46.278116 24515 raft_consensus.cc:740] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:46.278839 24515 consensus_queue.cc:260] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.281075 24515 ts_tablet_manager.cc:1434] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.003s
I20260709 12:17:46.281363 24543 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.282160 24515 tablet_bootstrap.cc:492] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:46.285560 24221 catalog_manager.cc:5697] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 0 to 1, leader changed from <none> to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:46.288720 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:46.297503 24543 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:46.300069 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:46.303174 24474 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:46.308414 24515 tablet_bootstrap.cc:654] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:46.313761 24516 tablet_bootstrap.cc:492] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:46.314450 24516 ts_tablet_manager.cc:1403] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.074s	user 0.031s	sys 0.016s
I20260709 12:17:46.321309 24516 raft_consensus.cc:359] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.322115 24516 raft_consensus.cc:385] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:46.322464 24516 raft_consensus.cc:740] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:46.323305 24516 consensus_queue.cc:260] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.324427 24474 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:17:46.325757 24516 ts_tablet_manager.cc:1434] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:17:46.326841 24516 tablet_bootstrap.cc:492] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:46.326642 24290 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:46.328059 24543 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:46.328714 24543 raft_consensus.cc:697] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:17:46.330291 24543 consensus_queue.cc:237] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.368036 24515 tablet_bootstrap.cc:492] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:46.368799 24515 ts_tablet_manager.cc:1403] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.087s	user 0.028s	sys 0.023s
I20260709 12:17:46.372406 24515 raft_consensus.cc:359] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.373193 24515 raft_consensus.cc:385] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:46.373471 24515 raft_consensus.cc:740] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:46.377974 24514 raft_consensus.cc:359] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.378656 24515 consensus_queue.cc:260] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.379926 24514 raft_consensus.cc:385] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:46.380290 24514 raft_consensus.cc:740] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:46.374131 24637 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.382357 24515 ts_tablet_manager.cc:1434] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:17:46.388437 24515 tablet_bootstrap.cc:492] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:46.388212 24637 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.365995 24625 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.380965 24514 consensus_queue.cc:260] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.381697 24516 tablet_bootstrap.cc:654] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:46.394784 24400 raft_consensus.cc:2393] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 1: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:17:46.398339 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:46.399199 24474 raft_consensus.cc:2393] T 48b5441f03704ebb94ffdbb55b9f33c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 1: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:17:46.403369 24514 ts_tablet_manager.cc:1434] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.134s	user 0.010s	sys 0.000s
I20260709 12:17:46.402890 24616 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.404497 24514 tablet_bootstrap.cc:492] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:46.404224 24616 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.406365 24616 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:46.407713 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:46.407868 24607 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.400561 24535 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.409521 24607 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.409768 24535 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.411722 24607 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:46.399782 24625 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:46.411722 24535 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:46.413472 24470 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 0.
I20260709 12:17:46.413834 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:46.402269 24637 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:17:46.415999 24440 leader_election.cc:343] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:46.419212 24515 tablet_bootstrap.cc:654] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:46.420147 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:46.420948 24397 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:46.421263 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:46.421931 24516 tablet_bootstrap.cc:492] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:46.422214 24438 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:46.422648 24516 ts_tablet_manager.cc:1403] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.096s	user 0.016s	sys 0.008s
I20260709 12:17:46.423456 24535 raft_consensus.cc:2804] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:46.423844 24535 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:46.424197 24535 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:46.426015 24514 tablet_bootstrap.cc:654] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:46.425694 24516 raft_consensus.cc:359] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.427131 24516 raft_consensus.cc:385] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:46.427431 24516 raft_consensus.cc:740] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:46.428122 24516 consensus_queue.cc:260] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.430290 24516 ts_tablet_manager.cc:1434] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:17:46.431187 24516 tablet_bootstrap.cc:492] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:46.430783 24535 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.434566 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:46.436075 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:46.436743 24397 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:46.436985 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:17:46.438287 24440 leader_election.cc:343] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:46.439320 24440 leader_election.cc:343] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:46.439725 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:46.421998 24396 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:46.442865 24515 tablet_bootstrap.cc:492] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:46.443476 24515 ts_tablet_manager.cc:1403] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.009s
I20260709 12:17:46.445175 24516 tablet_bootstrap.cc:654] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:46.446380 24515 raft_consensus.cc:359] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.447093 24515 raft_consensus.cc:385] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:46.447525 24515 raft_consensus.cc:740] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:46.454692 24535 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:46.676425 24697 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.677188 24697 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.683243 24697 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:46.694816 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:46.695022 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:46.697991 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:46.718585 24606 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.719130 24606 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.721428 24606 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:46.754220 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:46.757407 24625 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.758116 24625 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.761895 24625 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:46.764501 24625 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.765038 24625 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.767042 24625 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:46.773931 24397 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:46.780524 24535 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.781216 24535 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.782974 24535 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:46.784155 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:46.784885 24473 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
I20260709 12:17:46.789002 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:46.789348 24290 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:46.790659 24543 raft_consensus.cc:2804] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:46.791016 24543 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:46.791340 24543 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:46.794425 24516 tablet_bootstrap.cc:492] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:46.794957 24516 ts_tablet_manager.cc:1403] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.364s	user 0.013s	sys 0.001s
I20260709 12:17:46.798509 24516 raft_consensus.cc:359] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.799638 24516 raft_consensus.cc:385] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:46.800552 24516 raft_consensus.cc:740] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:46.801563 24516 consensus_queue.cc:260] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.804322 24516 ts_tablet_manager.cc:1434] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:17:46.805588 24516 tablet_bootstrap.cc:492] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
W20260709 12:17:46.807534 24440 leader_election.cc:343] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:46.809204 24657 consensus_queue.cc:1048] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:46.809544 24606 consensus_queue.cc:1048] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:46.800443 24543 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.810122 24221 catalog_manager.cc:5697] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 0 to 1, leader changed from <none> to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:46.812112 24543 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:46.813227 24516 tablet_bootstrap.cc:654] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:46.819289 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:46.820147 24393 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:46.821709 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:46.822665 24468 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:46.824831 24514 tablet_bootstrap.cc:492] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:46.825520 24514 ts_tablet_manager.cc:1403] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.421s	user 0.013s	sys 0.008s
I20260709 12:17:46.835848 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:46.838498 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:46.845796 24290 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:46.847226 24543 raft_consensus.cc:2749] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:17:46.855098 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 407217us
I20260709 12:17:46.871814 24468 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:17:46.881551 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:46.882326 24470 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 0.
I20260709 12:17:46.881610 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:46.884727 24365 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:46.885926 24637 raft_consensus.cc:2804] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:46.886420 24637 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:46.886847 24637 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:46.889762 24365 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:46.893692 24657 consensus_queue.cc:1048] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:46.894140 24606 consensus_queue.cc:1048] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:46.900698 24625 raft_consensus.cc:2804] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:46.901182 24625 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:46.901508 24625 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:46.909641 24514 raft_consensus.cc:359] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.910758 24514 raft_consensus.cc:385] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:46.911103 24514 raft_consensus.cc:740] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:46.912029 24514 consensus_queue.cc:260] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.931842 24290 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:46.932914 24657 raft_consensus.cc:2804] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:46.933460 24657 raft_consensus.cc:697] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:17:46.934486 24366 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:46.934362 24657 consensus_queue.cc:237] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.935540 24616 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:46.936411 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:17:46.937889 24366 leader_election.cc:343] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:46.939301 24321 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:46.932210 24606 consensus_queue.cc:1048] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:17:46.450212 24438 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
W20260709 12:17:46.925190 24365 leader_election.cc:343] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:46.942894 24514 ts_tablet_manager.cc:1434] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.117s	user 0.010s	sys 0.000s
I20260709 12:17:46.958885 24514 tablet_bootstrap.cc:492] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:46.970485 24625 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.964267 24366 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:46.974562 24589 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:46.962388 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:46.448320 24515 consensus_queue.cc:260] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.989660 24699 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.990286 24699 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:46.991070 24515 ts_tablet_manager.cc:1434] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.547s	user 0.012s	sys 0.000s
W20260709 12:17:46.991456 24515 ts_tablet_manager.cc:1467] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Tablet startup took 547ms
I20260709 12:17:46.964530 24701 raft_consensus.cc:2804] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:46.972512 24625 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:47.014743 24698 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.015566 24698 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.018406 24393 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:17:47.026665 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:46.995718 24701 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:47.037592 24701 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:47.030648 24289 leader_election.cc:343] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:46.978803 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 520561us
W20260709 12:17:46.991770 24515 ts_tablet_manager.cc:1469] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Trace:
0709 12:17:42.092466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:42.386170 (+293704us) service_pool.cc:224] Handling call
0709 12:17:42.435510 (+ 49340us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:17:42.435797 (+   287us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:17:42.572113 (+136316us) tablet_metadata.cc:665] Metadata flushed
0709 12:17:42.608926 (+ 36813us) tablet_replica.cc:206] Creating consensus instance
0709 12:17:42.609391 (+   465us) inbound_call.cc:177] Queueing success response
0709 12:17:46.387951 (+3778560us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:17:46.443857 (+ 55906us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:17:46.444471 (+   614us) tablet_replica.cc:261] Starting instrumentation
0709 12:17:46.445070 (+   599us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":2088,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"tablet-open.queue_time_us":3778626}
I20260709 12:17:47.042516 24515 tablet_bootstrap.cc:492] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:46.987845 24637 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.029491 24698 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:47.062744 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:47.063684 24393 raft_consensus.cc:2393] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 1: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
W20260709 12:17:47.053577 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 78226.7us
W20260709 12:17:47.064749 24366 leader_election.cc:343] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:47.065042 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:47.065948 24469 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
I20260709 12:17:47.068506 24699 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:47.068526 24607 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.069629 24607 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.081266 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:47.082686 24712 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.083261 24712 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.084589 24290 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:47.064109 24438 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:47.081622 24607 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:47.072724 24366 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:47.091701 24516 tablet_bootstrap.cc:492] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:47.181403 24514 tablet_bootstrap.cc:654] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:47.185427 24516 ts_tablet_manager.cc:1403] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.380s	user 0.078s	sys 0.180s
I20260709 12:17:47.175144 24515 tablet_bootstrap.cc:654] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:47.085219 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:47.106570 24606 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:47.191362 24625 raft_consensus.cc:2749] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:47.197191 24607 raft_consensus.cc:2804] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:47.197062 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:17:47.115712 24440 leader_election.cc:343] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:47.201323 24712 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:47.197126 24701 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.204013 24323 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:47.201711 24472 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:47.201087 24606 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:47.217377 24701 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:17:47.213426 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 97807us
W20260709 12:17:47.201854 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 137870us
I20260709 12:17:47.219374 24438 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:47.220989 24440 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:47.222317 24535 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:47.222720 24535 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:47.223096 24535 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:47.208006 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 143383us
I20260709 12:17:47.231485 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:47.226327 24709 consensus_queue.cc:1048] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:17:47.207726 24637 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:47.223095 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:17:47.243088 24366 leader_election.cc:343] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:47.225246 24606 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:47.209952 24607 raft_consensus.cc:697] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:17:47.258780 24607 consensus_queue.cc:237] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.266166 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:47.267616 24470 raft_consensus.cc:2393] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 1: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
W20260709 12:17:47.250051 24713 log.cc:927] Time spent T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 12:17:47.249910 24440 leader_election.cc:343] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:47.270653 24271 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:47.290588 24514 tablet_bootstrap.cc:492] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:47.291186 24514 ts_tablet_manager.cc:1403] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.345s	user 0.023s	sys 0.007s
I20260709 12:17:47.291530 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:47.300213 24391 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:47.300621 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:47.303421 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:47.304189 24393 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:47.305274 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:47.306100 24395 raft_consensus.cc:2393] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 1: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:17:47.303794 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:47.307060 24319 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
I20260709 12:17:47.310568 24472 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
W20260709 12:17:47.310895 24366 leader_election.cc:343] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:47.311381 24583 raft_consensus.cc:2749] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:47.311447 24366 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:47.313429 24625 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:47.313572 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:47.317147 24365 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:47.328238 24712 raft_consensus.cc:2804] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:47.328994 24712 raft_consensus.cc:697] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:17:47.330190 24712 consensus_queue.cc:237] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.322878 24438 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:47.336520 24583 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:47.341979 24515 tablet_bootstrap.cc:492] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:47.342581 24515 ts_tablet_manager.cc:1403] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.300s	user 0.010s	sys 0.043s
I20260709 12:17:47.344702 24514 raft_consensus.cc:359] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.345664 24514 raft_consensus.cc:385] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:47.345656 24516 raft_consensus.cc:359] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.346752 24516 raft_consensus.cc:385] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:47.347041 24516 raft_consensus.cc:740] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:47.346292 24514 raft_consensus.cc:740] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:47.348687 24514 consensus_queue.cc:260] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.352566 24514 ts_tablet_manager.cc:1434] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 12:17:47.353745 24514 tablet_bootstrap.cc:492] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:47.354620 24606 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.358299 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:17:47.361001 24438 leader_election.cc:343] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:47.361595 24438 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:47.362516 24583 raft_consensus.cc:2749] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:47.363128 24698 consensus_queue.cc:1048] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:47.364851 24221 catalog_manager.cc:5697] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:47.366575 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:47.364953 24606 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:47.369053 24657 consensus_queue.cc:1048] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:17:47.362540 24516 consensus_queue.cc:260] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.370430 24472 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:47.375921 24395 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:47.379796 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 68945.1us
I20260709 12:17:47.377998 24535 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.397107 24469 raft_consensus.cc:2393] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 2: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:17:47.396332 24535 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:47.407286 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:47.408042 24323 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:47.411248 24515 raft_consensus.cc:359] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.412065 24515 raft_consensus.cc:385] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:47.412339 24515 raft_consensus.cc:740] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:47.413022 24515 consensus_queue.cc:260] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.404299 24366 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:17:47.415401 24515 ts_tablet_manager.cc:1434] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.001s
W20260709 12:17:47.415745 24366 leader_election.cc:343] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:47.415865 24323 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:17:47.416424 24515 tablet_bootstrap.cc:492] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:47.417182 24440 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:47.418375 24712 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:47.421417 24223 catalog_manager.cc:5697] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 0 to 1, leader changed from <none> to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:47.424957 24712 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:47.425953 24583 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:47.430802 24583 raft_consensus.cc:697] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:17:47.427686 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:47.431682 24583 consensus_queue.cc:237] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.430085 24472 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:17:47.442900 24514 tablet_bootstrap.cc:654] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:47.444455 24290 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:47.433713 24712 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:47.451406 24657 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:47.451973 24657 raft_consensus.cc:697] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:17:47.452876 24657 consensus_queue.cc:237] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.455469 24222 catalog_manager.cc:5697] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 0 to 1, leader changed from <none> to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:47.465020 24346 debug-util.cc:398] Leaking SignalData structure 0x7b080011b420 after lost signal to thread 23154
W20260709 12:17:47.466187 24346 debug-util.cc:398] Leaking SignalData structure 0x7b080011bb00 after lost signal to thread 24257
W20260709 12:17:47.469206 24346 debug-util.cc:398] Leaking SignalData structure 0x7b08001db120 after lost signal to thread 24349
W20260709 12:17:47.473601 24346 debug-util.cc:398] Leaking SignalData structure 0x7b080022b4a0 after lost signal to thread 24424
W20260709 12:17:47.475432 24346 debug-util.cc:398] Leaking SignalData structure 0x7b080013f160 after lost signal to thread 24498
I20260709 12:17:47.463754 24395 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:17:47.494671 24516 ts_tablet_manager.cc:1434] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.309s	user 0.008s	sys 0.002s
I20260709 12:17:47.504480 24516 tablet_bootstrap.cc:492] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:47.495230 24515 tablet_bootstrap.cc:654] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:47.496912 24223 catalog_manager.cc:5697] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 0 to 1, leader changed from <none> to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:47.524133 24712 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.525583 24394 raft_consensus.cc:2393] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 2: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:17:47.526777 24637 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.529193 24637 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.531236 24637 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:47.532332 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:47.533138 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:47.533900 24468 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 0.
W20260709 12:17:47.534349 24366 leader_election.cc:343] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:47.535809 24365 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:47.535895 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:47.539548 24637 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:47.540014 24637 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:47.540522 24637 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:47.537212 24712 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:47.541996 24516 tablet_bootstrap.cc:654] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:47.540035 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:47.545032 24321 raft_consensus.cc:2393] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 2: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:17:47.547879 24366 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:47.547297 24221 catalog_manager.cc:5697] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 0 to 2, leader changed from <none> to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 2 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:47.549257 24657 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.549837 24657 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.552942 24657 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:47.553251 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:47.553668 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:47.556591 24468 raft_consensus.cc:2393] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 1: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:17:47.553761 24712 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:47.563733 24290 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:47.565104 24657 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:47.568126 24514 tablet_bootstrap.cc:492] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:47.568735 24514 ts_tablet_manager.cc:1403] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.215s	user 0.015s	sys 0.013s
I20260709 12:17:47.579130 24514 raft_consensus.cc:359] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.579898 24514 raft_consensus.cc:385] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:47.580191 24514 raft_consensus.cc:740] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:47.591634 24514 consensus_queue.cc:260] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.602734 24515 tablet_bootstrap.cc:492] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:47.603317 24515 ts_tablet_manager.cc:1403] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.187s	user 0.016s	sys 0.009s
I20260709 12:17:47.604523 24514 ts_tablet_manager.cc:1434] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:17:47.576848 24637 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.607466 24657 raft_consensus.cc:2749] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:47.609294 24516 tablet_bootstrap.cc:492] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:47.609776 24516 ts_tablet_manager.cc:1403] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.106s	user 0.031s	sys 0.003s
I20260709 12:17:47.610749 24515 raft_consensus.cc:359] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.611469 24515 raft_consensus.cc:385] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:47.611734 24515 raft_consensus.cc:740] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:47.612576 24515 consensus_queue.cc:260] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.621985 24515 ts_tablet_manager.cc:1434] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 12:17:47.622546 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:47.625353 24515 tablet_bootstrap.cc:492] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:47.625792 24514 tablet_bootstrap.cc:492] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
W20260709 12:17:47.625538 24366 leader_election.cc:343] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:47.627429 24516 raft_consensus.cc:359] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.628175 24516 raft_consensus.cc:385] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:47.628464 24516 raft_consensus.cc:740] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:47.631817 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:47.632515 24468 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:47.633247 24514 tablet_bootstrap.cc:654] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:47.634177 24515 tablet_bootstrap.cc:654] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:47.642318 24468 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
I20260709 12:17:47.643783 24365 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:47.644677 24616 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:47.644821 24514 tablet_bootstrap.cc:492] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:47.645177 24616 raft_consensus.cc:697] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:17:47.645315 24514 ts_tablet_manager.cc:1403] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.002s
I20260709 12:17:47.646085 24616 consensus_queue.cc:237] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.648670 24514 raft_consensus.cc:359] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.649329 24514 raft_consensus.cc:385] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:47.649610 24514 raft_consensus.cc:740] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:47.650406 24514 consensus_queue.cc:260] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.651144 24637 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:47.653249 24514 ts_tablet_manager.cc:1434] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:17:47.654287 24514 tablet_bootstrap.cc:492] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:47.655836 24516 consensus_queue.cc:260] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.661306 24514 tablet_bootstrap.cc:654] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:47.662314 24516 ts_tablet_manager.cc:1434] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:17:47.663249 24516 tablet_bootstrap.cc:492] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:47.675344 24515 tablet_bootstrap.cc:492] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:47.676119 24515 ts_tablet_manager.cc:1403] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.051s	user 0.017s	sys 0.018s
I20260709 12:17:47.677958 24514 tablet_bootstrap.cc:492] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:47.678531 24514 ts_tablet_manager.cc:1403] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.005s
I20260709 12:17:47.679637 24515 raft_consensus.cc:359] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.681059 24514 raft_consensus.cc:359] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.687613 24515 raft_consensus.cc:385] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:47.687633 24514 raft_consensus.cc:385] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:47.688191 24515 raft_consensus.cc:740] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:47.688473 24514 raft_consensus.cc:740] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:47.689399 24514 consensus_queue.cc:260] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.690974 24515 consensus_queue.cc:260] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.691789 24514 ts_tablet_manager.cc:1434] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:17:47.688388 24222 catalog_manager.cc:5697] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 0 to 1, leader changed from <none> to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:47.693508 24515 ts_tablet_manager.cc:1434] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:17:47.694656 24515 tablet_bootstrap.cc:492] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:47.696336 24514 tablet_bootstrap.cc:492] T 51965da6bcc444d5b20f7348cba2c649 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:47.703130 24515 tablet_bootstrap.cc:654] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:47.703167 24514 tablet_bootstrap.cc:654] T 51965da6bcc444d5b20f7348cba2c649 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:47.706550 24516 tablet_bootstrap.cc:654] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:47.717825 24514 tablet_bootstrap.cc:492] T 51965da6bcc444d5b20f7348cba2c649 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:47.718358 24514 ts_tablet_manager.cc:1403] T 51965da6bcc444d5b20f7348cba2c649 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.000s
I20260709 12:17:47.721364 24514 raft_consensus.cc:359] T 51965da6bcc444d5b20f7348cba2c649 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.722184 24514 raft_consensus.cc:385] T 51965da6bcc444d5b20f7348cba2c649 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:47.722538 24514 raft_consensus.cc:740] T 51965da6bcc444d5b20f7348cba2c649 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:47.723469 24514 consensus_queue.cc:260] T 51965da6bcc444d5b20f7348cba2c649 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.726173 24514 ts_tablet_manager.cc:1434] T 51965da6bcc444d5b20f7348cba2c649 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:17:47.728482 24514 tablet_bootstrap.cc:492] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:47.734747 24514 tablet_bootstrap.cc:654] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:47.735831 24516 tablet_bootstrap.cc:492] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:47.736315 24516 ts_tablet_manager.cc:1403] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.073s	user 0.010s	sys 0.003s
I20260709 12:17:47.739576 24516 raft_consensus.cc:359] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.740536 24516 raft_consensus.cc:385] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:47.740845 24583 consensus_queue.cc:1048] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:47.744966 24583 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.745940 24583 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.750442 24321 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:47.755591 24583 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:47.755885 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:47.740932 24516 raft_consensus.cc:740] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:47.756850 24319 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:47.768280 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:47.769068 24394 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:47.768308 24440 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:47.775478 24583 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:47.781540 24583 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:47.782398 24583 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:47.793551 24516 consensus_queue.cc:260] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.796604 24516 ts_tablet_manager.cc:1434] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 12:17:47.797873 24516 tablet_bootstrap.cc:492] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:47.798403 24616 consensus_queue.cc:1048] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:47.805002 24616 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.805822 24616 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.809374 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:47.810856 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:17:47.811612 24366 leader_election.cc:343] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:47.818463 24365 leader_election.cc:343] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:47.819166 24365 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:47.820761 24637 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:47.828310 24535 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.829025 24535 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.832325 24535 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:47.833911 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:17:47.835667 24438 leader_election.cc:343] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:47.836278 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:17:47.839018 24440 leader_election.cc:343] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:47.841112 24616 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:47.841403 24440 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:47.843776 24722 raft_consensus.cc:2749] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:47.843876 24607 consensus_queue.cc:1048] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:47.847311 24583 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.851325 24516 tablet_bootstrap.cc:654] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:47.855978 24657 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.856775 24657 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.857172 24583 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:47.860670 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:47.863926 24657 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:47.865604 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:47.867798 24290 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:47.869208 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:47.870064 24323 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:47.877135 24698 raft_consensus.cc:2749] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:47.878985 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:47.879794 24394 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:47.885097 24323 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:47.886960 24440 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:47.889539 24535 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:47.890475 24535 raft_consensus.cc:697] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:17:47.891685 24535 consensus_queue.cc:237] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.912784 24516 tablet_bootstrap.cc:492] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:47.913261 24516 ts_tablet_manager.cc:1403] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.116s	user 0.005s	sys 0.008s
I20260709 12:17:47.915895 24516 raft_consensus.cc:359] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.916556 24516 raft_consensus.cc:385] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:47.916848 24516 raft_consensus.cc:740] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:47.917466 24516 consensus_queue.cc:260] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.919546 24516 ts_tablet_manager.cc:1434] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 12:17:47.920089 24222 catalog_manager.cc:5697] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:47.920432 24516 tablet_bootstrap.cc:492] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:47.924542 24514 tablet_bootstrap.cc:492] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:47.925189 24514 ts_tablet_manager.cc:1403] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.197s	user 0.065s	sys 0.112s
I20260709 12:17:47.928273 24514 raft_consensus.cc:359] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.929028 24514 raft_consensus.cc:385] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:47.929275 24514 raft_consensus.cc:740] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:47.929924 24514 consensus_queue.cc:260] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.931926 24514 ts_tablet_manager.cc:1434] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 12:17:47.932842 24514 tablet_bootstrap.cc:492] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:47.932963 24698 consensus_queue.cc:1048] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:47.937203 24698 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.937707 24698 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.942219 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:47.943145 24393 raft_consensus.cc:2393] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 1: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:17:47.942951 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:47.944271 24516 tablet_bootstrap.cc:654] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:47.944669 24472 raft_consensus.cc:2393] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 1: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:17:47.946647 24394 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:47.947026 24289 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:47.948007 24657 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:47.949280 24514 tablet_bootstrap.cc:654] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:47.940376 24698 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:47.970649 24515 tablet_bootstrap.cc:492] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:47.971422 24515 ts_tablet_manager.cc:1403] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.277s	user 0.030s	sys 0.052s
I20260709 12:17:47.974977 24515 raft_consensus.cc:359] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:47.978192 24637 consensus_queue.cc:1048] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:47.977329 24321 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:47.999034 24515 raft_consensus.cc:385] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:48.000067 24515 raft_consensus.cc:740] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:48.002219 24657 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:48.003358 24515 consensus_queue.cc:260] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.015862 24515 ts_tablet_manager.cc:1434] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:17:48.020877 24395 raft_consensus.cc:1275] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:17:48.025691 24583 consensus_queue.cc:1048] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:48.028791 24637 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.029493 24637 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.032147 24637 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:48.037731 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:48.042181 24319 raft_consensus.cc:1275] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:17:48.044492 24535 consensus_queue.cc:1048] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:17:48.050439 24365 leader_election.cc:343] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:48.058655 24657 consensus_queue.cc:1048] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:48.063419 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:48.065848 24515 tablet_bootstrap.cc:492] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
W20260709 12:17:48.065871 24366 consensus_peers.cc:597] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:48.068660 24366 leader_election.cc:343] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:48.069092 24366 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:48.070472 24712 raft_consensus.cc:2749] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:48.080339 24516 tablet_bootstrap.cc:492] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:48.080880 24516 ts_tablet_manager.cc:1403] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.161s	user 0.037s	sys 0.060s
I20260709 12:17:48.084486 24516 raft_consensus.cc:359] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.085171 24516 raft_consensus.cc:385] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:48.085417 24516 raft_consensus.cc:740] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:48.086133 24516 consensus_queue.cc:260] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.088224 24516 ts_tablet_manager.cc:1434] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:17:48.089140 24516 tablet_bootstrap.cc:492] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:48.091939 24515 tablet_bootstrap.cc:654] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:48.092955 24514 tablet_bootstrap.cc:492] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:48.093843 24514 ts_tablet_manager.cc:1403] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.161s	user 0.037s	sys 0.035s
I20260709 12:17:48.095129 24516 tablet_bootstrap.cc:654] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:48.098199 24514 raft_consensus.cc:359] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.098984 24514 raft_consensus.cc:385] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:48.099305 24514 raft_consensus.cc:740] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:48.103565 24514 consensus_queue.cc:260] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.119417 24514 ts_tablet_manager.cc:1434] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 12:17:48.124972 24514 tablet_bootstrap.cc:492] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:48.132700 24515 tablet_bootstrap.cc:492] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:48.133518 24515 ts_tablet_manager.cc:1403] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.001s
I20260709 12:17:48.137281 24637 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.141048 24637 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.143627 24637 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:48.144419 24516 tablet_bootstrap.cc:492] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:48.144956 24516 ts_tablet_manager.cc:1403] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.056s	user 0.024s	sys 0.026s
I20260709 12:17:48.145516 24515 raft_consensus.cc:359] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.146847 24515 raft_consensus.cc:385] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:48.147146 24515 raft_consensus.cc:740] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:48.147539 24516 raft_consensus.cc:359] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.147962 24515 consensus_queue.cc:260] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.148193 24516 raft_consensus.cc:385] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:48.148197 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:48.149137 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:17:48.150027 24366 leader_election.cc:343] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:48.150596 24516 raft_consensus.cc:740] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
W20260709 12:17:48.150671 24365 leader_election.cc:343] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:48.151006 24514 tablet_bootstrap.cc:654] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:48.151193 24365 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:48.151427 24516 consensus_queue.cc:260] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.152498 24712 raft_consensus.cc:2749] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:48.163410 24516 ts_tablet_manager.cc:1434] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 12:17:48.164407 24516 tablet_bootstrap.cc:492] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:48.165347 24514 tablet_bootstrap.cc:492] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:48.150708 24515 ts_tablet_manager.cc:1434] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:17:48.165876 24514 ts_tablet_manager.cc:1403] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.013s
I20260709 12:17:48.167205 24515 tablet_bootstrap.cc:492] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:48.169203 24514 raft_consensus.cc:359] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.169929 24514 raft_consensus.cc:385] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:48.170223 24516 tablet_bootstrap.cc:654] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:48.170259 24514 raft_consensus.cc:740] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:48.171245 24514 consensus_queue.cc:260] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.173138 24514 ts_tablet_manager.cc:1434] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:17:48.175137 24514 tablet_bootstrap.cc:492] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:48.180932 24514 tablet_bootstrap.cc:654] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:48.186775 24515 tablet_bootstrap.cc:654] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:48.196297 24514 tablet_bootstrap.cc:492] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:48.197089 24514 ts_tablet_manager.cc:1403] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.003s
I20260709 12:17:48.200731 24514 raft_consensus.cc:359] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.201474 24514 raft_consensus.cc:385] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:48.201792 24514 raft_consensus.cc:740] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:48.202567 24514 consensus_queue.cc:260] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.204711 24514 ts_tablet_manager.cc:1434] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:17:48.206015 24514 tablet_bootstrap.cc:492] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:48.219640 24514 tablet_bootstrap.cc:654] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:48.220569 24516 tablet_bootstrap.cc:492] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:48.221139 24516 ts_tablet_manager.cc:1403] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.057s	user 0.019s	sys 0.015s
I20260709 12:17:48.222726 24515 tablet_bootstrap.cc:492] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:48.223325 24515 ts_tablet_manager.cc:1403] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.014s
I20260709 12:17:48.225162 24516 raft_consensus.cc:359] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.226207 24516 raft_consensus.cc:385] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:48.226613 24516 raft_consensus.cc:740] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:48.226397 24515 raft_consensus.cc:359] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.227749 24515 raft_consensus.cc:385] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:48.228132 24515 raft_consensus.cc:740] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:48.227799 24516 consensus_queue.cc:260] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.229095 24515 consensus_queue.cc:260] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.236245 24515 ts_tablet_manager.cc:1434] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:17:48.237421 24515 tablet_bootstrap.cc:492] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:48.239187 24722 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.239665 24722 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.241647 24516 ts_tablet_manager.cc:1434] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:17:48.241952 24722 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:48.243078 24516 tablet_bootstrap.cc:492] T 95c2470f38204e5ba4ee545bb2de933c P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:48.243842 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:48.250253 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:48.251207 24394 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:48.252252 24637 consensus_queue.cc:1048] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:17:48.253903 24440 leader_election.cc:343] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:48.255698 24438 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:48.260677 24607 raft_consensus.cc:2804] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:48.261202 24607 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.261624 24607 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:48.262161 24515 tablet_bootstrap.cc:654] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:48.274802 24637 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.275463 24637 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.276153 24698 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.276687 24698 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.278680 24698 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:48.278681 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:48.280102 24637 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:48.280367 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:48.283273 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:17:48.281021 24366 leader_election.cc:343] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:48.281227 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:48.284026 24472 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
I20260709 12:17:48.284614 24394 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
W20260709 12:17:48.285024 24365 leader_election.cc:343] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:48.285511 24365 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:48.285880 24290 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:48.286412 24712 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:48.287276 24698 raft_consensus.cc:2804] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:48.287716 24698 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.288067 24698 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:48.296671 24698 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.299790 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:48.300402 24394 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:48.292138 24607 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.303325 24514 tablet_bootstrap.cc:492] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:48.317013 24514 ts_tablet_manager.cc:1403] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.111s	user 0.032s	sys 0.044s
I20260709 12:17:48.312970 24515 tablet_bootstrap.cc:492] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:48.324529 24515 ts_tablet_manager.cc:1403] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.087s	user 0.025s	sys 0.000s
I20260709 12:17:48.318861 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:48.320222 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:48.320475 24516 tablet_bootstrap.cc:654] T 95c2470f38204e5ba4ee545bb2de933c P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:48.335973 24395 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:48.325999 24514 raft_consensus.cc:359] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.323123 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:48.339229 24514 raft_consensus.cc:385] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:48.339381 24468 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:48.339632 24514 raft_consensus.cc:740] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:48.340590 24514 consensus_queue.cc:260] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.342705 24514 ts_tablet_manager.cc:1434] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:17:48.343166 24395 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:48.343763 24514 tablet_bootstrap.cc:492] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:48.323925 24698 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:48.317765 24607 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:48.347198 24468 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
W20260709 12:17:48.336568 24440 leader_election.cc:343] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:48.348869 24514 tablet_bootstrap.cc:654] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:48.350142 24290 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:48.318424 24394 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:17:48.338454 24515 raft_consensus.cc:359] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.351320 24515 raft_consensus.cc:385] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:48.351625 24515 raft_consensus.cc:740] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:48.352281 24515 consensus_queue.cc:260] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.352799 24698 raft_consensus.cc:2804] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:48.353111 24438 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:48.353407 24698 raft_consensus.cc:697] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:17:48.353871 24515 ts_tablet_manager.cc:1434] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
W20260709 12:17:48.310218 24271 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:48.354674 24722 raft_consensus.cc:2804] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:48.355167 24722 raft_consensus.cc:697] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:17:48.355340 24515 tablet_bootstrap.cc:492] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:48.354275 24698 consensus_queue.cc:237] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.355967 24722 consensus_queue.cc:237] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.361447 24515 tablet_bootstrap.cc:654] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:48.369760 24722 consensus_queue.cc:1048] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:48.395212 24535 consensus_queue.cc:1048] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:48.396857 24515 tablet_bootstrap.cc:492] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:48.397531 24515 ts_tablet_manager.cc:1403] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.010s
I20260709 12:17:48.399112 24514 tablet_bootstrap.cc:492] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:48.399614 24514 ts_tablet_manager.cc:1403] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.006s
I20260709 12:17:48.402298 24514 raft_consensus.cc:359] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.405812 24514 raft_consensus.cc:385] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:48.406154 24514 raft_consensus.cc:740] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:48.407496 24514 consensus_queue.cc:260] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.410573 24514 ts_tablet_manager.cc:1434] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:17:48.411552 24514 tablet_bootstrap.cc:492] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:48.405103 24515 raft_consensus.cc:359] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.412786 24515 raft_consensus.cc:385] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:48.413050 24515 raft_consensus.cc:740] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:48.413733 24515 consensus_queue.cc:260] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.415118 24515 ts_tablet_manager.cc:1434] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.000s
I20260709 12:17:48.415998 24515 tablet_bootstrap.cc:492] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:48.421720 24515 tablet_bootstrap.cc:654] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:48.427946 24514 tablet_bootstrap.cc:654] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:48.445484 24698 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.436489 24221 catalog_manager.cc:5697] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.446269 24698 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.448354 24516 tablet_bootstrap.cc:492] T 95c2470f38204e5ba4ee545bb2de933c P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:48.448913 24516 ts_tablet_manager.cc:1403] T 95c2470f38204e5ba4ee545bb2de933c P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.206s	user 0.022s	sys 0.025s
I20260709 12:17:48.451020 24607 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.451514 24607 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.451803 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:48.455497 24698 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:48.456771 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:48.458020 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:48.458182 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:48.458622 24607 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:48.458925 24394 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:48.459192 24290 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:48.460399 24438 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:48.460448 24657 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:48.461040 24516 raft_consensus.cc:359] T 95c2470f38204e5ba4ee545bb2de933c P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.461472 24607 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:48.461828 24516 raft_consensus.cc:385] T 95c2470f38204e5ba4ee545bb2de933c P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:48.461961 24607 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.462608 24607 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:48.469053 24535 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.469687 24535 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.471869 24535 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:48.462136 24516 raft_consensus.cc:740] T 95c2470f38204e5ba4ee545bb2de933c P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:48.473541 24516 consensus_queue.cc:260] T 95c2470f38204e5ba4ee545bb2de933c P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.474825 24657 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.469024 24323 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:48.475306 24657 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.475950 24516 ts_tablet_manager.cc:1434] T 95c2470f38204e5ba4ee545bb2de933c P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 12:17:48.477527 24657 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:48.473831 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:48.478935 24514 tablet_bootstrap.cc:492] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:48.479239 24321 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:48.479575 24514 ts_tablet_manager.cc:1403] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.011s
I20260709 12:17:48.480685 24440 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:48.482756 24516 tablet_bootstrap.cc:492] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:48.484887 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:48.485776 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:48.486406 24391 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
I20260709 12:17:48.485764 24535 raft_consensus.cc:2804] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:48.487495 24535 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.487856 24535 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:48.488111 24289 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:48.489777 24698 raft_consensus.cc:2804] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:48.484393 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:48.494314 24394 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:48.497535 24514 raft_consensus.cc:359] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.498288 24514 raft_consensus.cc:385] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:48.498569 24514 raft_consensus.cc:740] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:48.498883 24607 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.499256 24514 consensus_queue.cc:260] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.501668 24514 ts_tablet_manager.cc:1434] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.004s
I20260709 12:17:48.490928 24698 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.502346 24698 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:48.502668 24514 tablet_bootstrap.cc:492] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:48.506772 24515 tablet_bootstrap.cc:492] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:48.507246 24515 ts_tablet_manager.cc:1403] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.091s	user 0.035s	sys 0.032s
I20260709 12:17:48.510082 24607 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:48.509927 24515 raft_consensus.cc:359] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.510705 24515 raft_consensus.cc:385] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:48.510986 24515 raft_consensus.cc:740] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:48.511636 24515 consensus_queue.cc:260] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.512492 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:48.513100 24321 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:48.513700 24515 ts_tablet_manager.cc:1434] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:17:48.514566 24515 tablet_bootstrap.cc:492] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:48.523167 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:48.526926 24394 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:48.522343 24535 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.524756 24514 tablet_bootstrap.cc:654] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:48.520475 24515 tablet_bootstrap.cc:654] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:48.525720 24698 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.523785 24516 tablet_bootstrap.cc:654] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:48.532531 24468 raft_consensus.cc:2393] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 1: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:17:48.539374 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:48.540408 24323 raft_consensus.cc:2393] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 1: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:17:48.541725 24321 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:48.543057 24440 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:48.544034 24583 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:48.544502 24583 raft_consensus.cc:697] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:17:48.545332 24583 consensus_queue.cc:237] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.546312 24220 catalog_manager.cc:5697] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 0 to 1, leader changed from <none> to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:48.548687 24394 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:48.550307 24657 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.550899 24535 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:48.550863 24657 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.553375 24657 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:48.554018 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:48.554685 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:48.555342 24469 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
I20260709 12:17:48.555951 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:48.556849 24391 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
I20260709 12:17:48.557405 24290 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:48.558524 24709 raft_consensus.cc:2804] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:48.558983 24709 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.559419 24709 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:48.563200 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:48.563868 24395 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:48.567766 24698 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:48.570475 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:48.572192 24289 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:48.593847 24395 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:48.595175 24438 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:48.596021 24583 raft_consensus.cc:2804] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:48.595400 24221 catalog_manager.cc:5697] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.578552 24657 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:48.596491 24583 raft_consensus.cc:697] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:17:48.595220 24709 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.613505 24583 consensus_queue.cc:237] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.628037 24516 tablet_bootstrap.cc:492] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:48.628731 24516 ts_tablet_manager.cc:1403] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.146s	user 0.024s	sys 0.007s
I20260709 12:17:48.627293 24607 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.633142 24514 tablet_bootstrap.cc:492] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:48.637735 24515 tablet_bootstrap.cc:492] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:48.641213 24514 ts_tablet_manager.cc:1403] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.139s	user 0.024s	sys 0.031s
I20260709 12:17:48.641111 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:48.642840 24780 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.640926 24607 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.644034 24394 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:48.648417 24607 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:48.650183 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:48.650089 24514 raft_consensus.cc:359] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.650867 24514 raft_consensus.cc:385] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:48.651173 24514 raft_consensus.cc:740] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:48.651127 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:17:48.651825 24440 leader_election.cc:343] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:48.652108 24395 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:48.652159 24514 consensus_queue.cc:260] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.654547 24514 ts_tablet_manager.cc:1434] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:17:48.654915 24438 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:48.644120 24515 ts_tablet_manager.cc:1403] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.130s	user 0.009s	sys 0.014s
I20260709 12:17:48.644964 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:48.655627 24514 tablet_bootstrap.cc:492] T f8dc8357b0c947d9a0f16daa0f4210aa P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:48.655771 24468 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:48.655993 24583 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:48.656489 24583 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.656915 24583 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:48.639420 24709 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:48.641039 24516 raft_consensus.cc:359] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.659432 24516 raft_consensus.cc:385] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:48.659747 24516 raft_consensus.cc:740] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:48.660327 24516 consensus_queue.cc:260] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.663645 24516 ts_tablet_manager.cc:1434] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:17:48.665556 24516 tablet_bootstrap.cc:492] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:48.691553 24514 tablet_bootstrap.cc:654] T f8dc8357b0c947d9a0f16daa0f4210aa P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:48.669895 24221 catalog_manager.cc:5697] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.695974 24321 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:48.700246 24394 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:17:48.716472 24289 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:48.718462 24515 raft_consensus.cc:359] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.719538 24515 raft_consensus.cc:385] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:48.720012 24515 raft_consensus.cc:740] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:48.721580 24515 consensus_queue.cc:260] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.719640 24709 raft_consensus.cc:2804] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:48.723861 24709 raft_consensus.cc:697] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:17:48.724148 24515 ts_tablet_manager.cc:1434] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.065s	user 0.003s	sys 0.008s
I20260709 12:17:48.724802 24709 consensus_queue.cc:237] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.725266 24515 tablet_bootstrap.cc:492] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:48.719230 24468 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:17:48.670928 24780 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.756579 24698 consensus_queue.cc:1048] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:48.768357 24516 tablet_bootstrap.cc:654] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:48.774669 24535 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.775193 24535 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.776857 24535 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:48.777730 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:48.778281 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:17:48.779273 24440 leader_election.cc:343] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:48.780002 24438 leader_election.cc:343] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:48.780500 24438 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:48.781260 24535 raft_consensus.cc:2749] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:48.782066 24514 tablet_bootstrap.cc:492] T f8dc8357b0c947d9a0f16daa0f4210aa P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:48.782727 24514 ts_tablet_manager.cc:1403] T f8dc8357b0c947d9a0f16daa0f4210aa P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.127s	user 0.012s	sys 0.027s
I20260709 12:17:48.759370 24583 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.785005 24780 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:48.786507 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:17:48.788199 24440 leader_election.cc:343] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:48.789935 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:48.789855 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:48.791127 24583 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:17:48.795403 24290 leader_election.cc:343] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:48.796406 24220 catalog_manager.cc:5697] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 0 to 1, leader changed from <none> to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:48.798221 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:48.798825 24391 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:48.799479 24515 tablet_bootstrap.cc:654] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:48.803879 24289 leader_election.cc:343] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:48.804373 24289 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:48.806941 24780 raft_consensus.cc:2749] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:48.807499 24514 raft_consensus.cc:359] T f8dc8357b0c947d9a0f16daa0f4210aa P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.809556 24514 raft_consensus.cc:385] T f8dc8357b0c947d9a0f16daa0f4210aa P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:48.809819 24514 raft_consensus.cc:740] T f8dc8357b0c947d9a0f16daa0f4210aa P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:48.810453 24514 consensus_queue.cc:260] T f8dc8357b0c947d9a0f16daa0f4210aa P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.812557 24514 ts_tablet_manager.cc:1434] T f8dc8357b0c947d9a0f16daa0f4210aa P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 12:17:48.814328 24514 tablet_bootstrap.cc:492] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:48.817800 24391 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:48.824892 24438 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:48.832028 24583 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:48.832574 24583 raft_consensus.cc:697] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:17:48.833446 24583 consensus_queue.cc:237] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:17:48.856926 24785 log.cc:927] Time spent T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:17:48.857161 24516 tablet_bootstrap.cc:492] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:48.858515 24516 ts_tablet_manager.cc:1403] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.193s	user 0.024s	sys 0.029s
I20260709 12:17:48.858629 24709 consensus_queue.cc:1048] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:48.860530 24514 tablet_bootstrap.cc:654] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:48.872403 24516 raft_consensus.cc:359] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.873219 24516 raft_consensus.cc:385] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:48.873507 24516 raft_consensus.cc:740] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:48.874331 24516 consensus_queue.cc:260] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.875510 24515 tablet_bootstrap.cc:492] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:48.876051 24515 ts_tablet_manager.cc:1403] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.151s	user 0.017s	sys 0.013s
I20260709 12:17:48.876502 24516 ts_tablet_manager.cc:1434] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 12:17:48.877568 24516 tablet_bootstrap.cc:492] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:48.878685 24780 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.878806 24515 raft_consensus.cc:359] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.879545 24515 raft_consensus.cc:385] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:48.879215 24780 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.879809 24515 raft_consensus.cc:740] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:48.880511 24515 consensus_queue.cc:260] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.881108 24637 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.881511 24780 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:48.882541 24515 ts_tablet_manager.cc:1434] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:17:48.881543 24637 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.886727 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:48.887439 24468 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
I20260709 12:17:48.889166 24290 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:48.890323 24516 tablet_bootstrap.cc:654] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:48.883502 24515 tablet_bootstrap.cc:492] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:48.892803 24637 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:48.893953 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:48.894708 24780 raft_consensus.cc:2804] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:48.895701 24780 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.896162 24780 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:48.894734 24469 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
I20260709 12:17:48.894043 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:48.896919 24323 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
I20260709 12:17:48.897614 24365 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:48.892474 24321 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:48.898440 24637 raft_consensus.cc:2804] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:48.901247 24637 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.901405 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:48.901692 24637 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:48.902526 24515 tablet_bootstrap.cc:654] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:48.902760 24289 leader_election.cc:343] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:48.910370 24221 catalog_manager.cc:5697] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.914489 24514 tablet_bootstrap.cc:492] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:48.915194 24514 ts_tablet_manager.cc:1403] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.101s	user 0.022s	sys 0.004s
I20260709 12:17:48.916477 24709 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.916999 24709 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.919153 24709 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:48.922127 24712 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.922617 24712 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.923772 24514 raft_consensus.cc:359] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.925521 24514 raft_consensus.cc:385] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:48.925907 24514 raft_consensus.cc:740] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:48.927110 24607 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.927735 24607 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.930347 24607 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:48.930703 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:48.931099 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:48.931679 24391 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
W20260709 12:17:48.932245 24440 leader_election.cc:343] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:48.920209 24780 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.933324 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:17:48.934633 24366 leader_election.cc:343] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:48.934785 24289 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:48.935209 24780 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:48.935886 24709 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:48.936281 24709 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.936617 24709 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:48.936856 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:48.937588 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:48.938244 24391 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
W20260709 12:17:48.938938 24289 leader_election.cc:343] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:48.939447 24438 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:48.941227 24583 consensus_queue.cc:1048] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:48.942288 24514 consensus_queue.cc:260] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.950414 24514 ts_tablet_manager.cc:1434] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.003s
I20260709 12:17:48.946270 24722 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:48.962627 24722 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.964862 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:48.965412 24722 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:48.968986 24637 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:48.972308 24637 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:48.976344 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:48.977211 24470 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:48.978147 24515 tablet_bootstrap.cc:492] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:48.979933 24515 ts_tablet_manager.cc:1403] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.097s	user 0.012s	sys 0.002s
I20260709 12:17:48.985428 24712 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:48.987807 24607 consensus_queue.cc:1048] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:17:49.004801 24516 tablet_bootstrap.cc:492] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:49.005911 24516 ts_tablet_manager.cc:1403] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.129s	user 0.026s	sys 0.052s
I20260709 12:17:48.999511 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:49.020044 24722 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.020438 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:49.021080 24468 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:49.009433 24709 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.026912 24709 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:49.028656 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:49.029313 24394 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:49.034296 24290 leader_election.cc:343] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:49.035578 24470 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:17:49.036459 24657 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.026916 24515 raft_consensus.cc:359] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.038196 24365 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:49.038327 24515 raft_consensus.cc:385] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:49.048240 24514 tablet_bootstrap.cc:492] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:49.059810 24515 raft_consensus.cc:740] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:49.065680 24515 consensus_queue.cc:260] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.069038 24516 raft_consensus.cc:359] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.069828 24516 raft_consensus.cc:385] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:49.070096 24516 raft_consensus.cc:740] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:49.070832 24516 consensus_queue.cc:260] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.072434 24516 ts_tablet_manager.cc:1434] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.066s	user 0.003s	sys 0.000s
I20260709 12:17:49.073877 24469 raft_consensus.cc:2393] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 1: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:17:49.073987 24722 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:49.061959 24793 raft_consensus.cc:2804] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:49.037050 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:49.075966 24516 tablet_bootstrap.cc:492] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:49.080245 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:49.036983 24657 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:17:49.051908 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 108539us
I20260709 12:17:49.085007 24515 ts_tablet_manager.cc:1434] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.105s	user 0.009s	sys 0.005s
I20260709 12:17:49.085371 24793 raft_consensus.cc:697] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:17:49.094532 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:49.085328 24393 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:49.096290 24535 consensus_queue.cc:1048] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:17:49.098112 24440 leader_election.cc:343] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:49.085191 24607 consensus_queue.cc:1048] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
W20260709 12:17:49.097011 24290 leader_election.cc:343] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:49.113425 24583 consensus_queue.cc:1048] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:49.089728 24793 consensus_queue.cc:237] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.133363 24468 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:17:49.133409 24394 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:17:49.138674 24393 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:49.141559 24290 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:49.145164 24780 raft_consensus.cc:2804] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:49.145709 24780 raft_consensus.cc:697] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:17:49.146178 24657 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:49.146569 24780 consensus_queue.cc:237] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.148757 24438 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:49.149263 24365 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:49.149843 24607 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:49.150327 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:49.150369 24607 raft_consensus.cc:697] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:17:49.153410 24607 consensus_queue.cc:237] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.156484 24516 tablet_bootstrap.cc:654] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:49.158186 24515 tablet_bootstrap.cc:492] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:49.160503 24289 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:17:49.163087 24709 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:49.163918 24709 raft_consensus.cc:697] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:17:49.165140 24789 log.cc:927] Time spent T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.086s	user 0.000s	sys 0.003s
I20260709 12:17:49.165082 24709 consensus_queue.cc:237] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.167636 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:49.168289 24320 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:49.169152 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:49.170002 24393 raft_consensus.cc:2393] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 1: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:17:49.173156 24535 consensus_queue.cc:1048] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:49.170846 24794 raft_consensus.cc:2749] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:49.177927 24616 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.180855 24289 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:49.182750 24616 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.184619 24698 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:49.191663 24779 consensus_queue.cc:1048] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:17:49.180505 24607 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.219830 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:49.207223 24607 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:17:49.224439 24365 leader_election.cc:343] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:49.225317 24616 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:49.234776 24709 consensus_queue.cc:1048] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:49.235911 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:49.236264 24698 raft_consensus.cc:2749] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:17:49.239828 24366 leader_election.cc:343] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:49.240322 24366 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:49.226837 24793 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.244750 24616 raft_consensus.cc:2749] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:49.251583 24320 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:17:49.253593 24514 tablet_bootstrap.cc:654] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:49.255461 24607 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:49.258415 24793 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.258651 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:49.282213 24393 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:49.291494 24438 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:49.292991 24535 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:49.293483 24535 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:49.293792 24535 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:49.307899 24222 catalog_manager.cc:5697] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:49.318331 24515 tablet_bootstrap.cc:654] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:49.328588 24514 tablet_bootstrap.cc:492] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:49.329257 24514 ts_tablet_manager.cc:1403] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.281s	user 0.013s	sys 0.006s
I20260709 12:17:49.317660 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:49.349509 24514 raft_consensus.cc:359] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.350807 24514 raft_consensus.cc:385] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:49.351181 24514 raft_consensus.cc:740] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:49.332321 24535 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.356894 24514 consensus_queue.cc:260] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.366814 24535 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:49.370390 24514 ts_tablet_manager.cc:1434] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.000s
I20260709 12:17:49.375950 24793 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:49.378357 24516 tablet_bootstrap.cc:492] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:49.384423 24516 ts_tablet_manager.cc:1403] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.309s	user 0.015s	sys 0.008s
I20260709 12:17:49.388080 24514 tablet_bootstrap.cc:492] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
W20260709 12:17:49.379352 24801 log.cc:927] Time spent T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:17:49.384243 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:49.405267 24811 consensus_queue.cc:1048] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:49.406317 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:49.407034 24392 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:49.423667 24366 leader_election.cc:343] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:49.423951 24515 tablet_bootstrap.cc:492] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:49.424736 24515 ts_tablet_manager.cc:1403] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.267s	user 0.011s	sys 0.012s
W20260709 12:17:49.432919 24440 leader_election.cc:343] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:49.445479 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:49.445978 24515 raft_consensus.cc:359] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.446700 24515 raft_consensus.cc:385] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:49.446964 24515 raft_consensus.cc:740] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:49.447631 24515 consensus_queue.cc:260] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.457122 24220 catalog_manager.cc:5697] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 0 to 1, leader changed from <none> to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:49.460392 24220 catalog_manager.cc:5697] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 0 to 1, leader changed from <none> to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:49.466575 24515 ts_tablet_manager.cc:1434] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.003s
W20260709 12:17:49.468117 24440 leader_election.cc:343] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:49.469020 24515 tablet_bootstrap.cc:492] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:49.484402 24516 raft_consensus.cc:359] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.486542 24516 raft_consensus.cc:385] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:49.486792 24516 raft_consensus.cc:740] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:49.487537 24516 consensus_queue.cc:260] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.488888 24516 ts_tablet_manager.cc:1434] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.102s	user 0.006s	sys 0.000s
I20260709 12:17:49.489766 24516 tablet_bootstrap.cc:492] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:49.491897 24392 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:49.497771 24221 catalog_manager.cc:5697] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 0 to 2, leader changed from <none> to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 2 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:49.498476 24438 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:49.499936 24814 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:49.500430 24814 raft_consensus.cc:697] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:17:49.501348 24814 consensus_queue.cc:237] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.506201 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:49.508683 24607 consensus_queue.cc:1048] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:17:49.512980 24514 tablet_bootstrap.cc:654] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:49.519737 24365 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:49.521099 24637 raft_consensus.cc:2749] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:49.524890 24516 tablet_bootstrap.cc:654] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:49.532162 24607 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.538560 24607 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.544363 24515 tablet_bootstrap.cc:654] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:49.554100 24722 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.558250 24722 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.558928 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:49.559554 24323 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:49.540676 24607 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:49.563469 24440 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:49.563274 24657 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.566912 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:49.567595 24722 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:49.566987 24657 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.570120 24722 raft_consensus.cc:2804] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:49.570505 24722 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:49.571365 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:49.571877 24657 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:49.570878 24722 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:49.574400 24440 leader_election.cc:343] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:49.574910 24438 leader_election.cc:343] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:49.575299 24438 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:49.573778 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:49.578862 24392 raft_consensus.cc:2393] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 1: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:17:49.580323 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:49.563570 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:49.586051 24814 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:49.588598 24516 tablet_bootstrap.cc:492] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:49.589187 24516 ts_tablet_manager.cc:1403] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.100s	user 0.019s	sys 0.001s
I20260709 12:17:49.589694 24514 tablet_bootstrap.cc:492] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
W20260709 12:17:49.590927 24438 leader_election.cc:343] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:49.591403 24514 ts_tablet_manager.cc:1403] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.204s	user 0.015s	sys 0.022s
I20260709 12:17:49.592587 24290 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:49.595109 24780 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:49.598089 24516 raft_consensus.cc:359] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.599082 24516 raft_consensus.cc:385] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:49.599431 24516 raft_consensus.cc:740] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:49.605834 24514 raft_consensus.cc:359] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.606564 24514 raft_consensus.cc:385] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:49.606843 24514 raft_consensus.cc:740] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:49.607738 24514 consensus_queue.cc:260] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.608949 24516 consensus_queue.cc:260] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.612066 24516 ts_tablet_manager.cc:1434] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.001s
I20260709 12:17:49.619856 24516 tablet_bootstrap.cc:492] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:49.612496 24780 raft_consensus.cc:2749] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:49.625929 24514 ts_tablet_manager.cc:1434] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.003s
I20260709 12:17:49.627228 24514 tablet_bootstrap.cc:492] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:49.626955 24722 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.628607 24220 catalog_manager.cc:5697] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:49.636288 24780 consensus_queue.cc:1048] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:49.639086 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:49.639741 24322 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:49.643957 24474 raft_consensus.cc:1275] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:17:49.645728 24637 consensus_queue.cc:1048] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:49.647358 24514 tablet_bootstrap.cc:654] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:49.652119 24322 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:49.653539 24516 tablet_bootstrap.cc:654] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:49.654860 24722 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:49.654808 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:17:49.656543 24438 leader_election.cc:343] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:49.660868 24440 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:49.654821 24515 tablet_bootstrap.cc:492] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:49.668038 24515 ts_tablet_manager.cc:1403] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.201s	user 0.026s	sys 0.030s
I20260709 12:17:49.671355 24515 raft_consensus.cc:359] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.672072 24515 raft_consensus.cc:385] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:49.672346 24515 raft_consensus.cc:740] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:49.672927 24722 raft_consensus.cc:2804] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:49.673465 24722 raft_consensus.cc:697] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:17:49.674320 24722 consensus_queue.cc:237] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.673074 24515 consensus_queue.cc:260] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.677727 24516 tablet_bootstrap.cc:492] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:49.677697 24515 ts_tablet_manager.cc:1434] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:17:49.678589 24516 ts_tablet_manager.cc:1403] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.059s	user 0.016s	sys 0.002s
I20260709 12:17:49.681557 24516 raft_consensus.cc:359] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.682406 24516 raft_consensus.cc:385] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:49.682983 24516 raft_consensus.cc:740] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:49.686967 24515 tablet_bootstrap.cc:492] T 7910ea4d480e41fda4aa4fd10f0fef8f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
W20260709 12:17:49.688855 24290 consensus_peers.cc:597] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 -> Peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Couldn't send request to peer 99b8650fa8324ac2ac5f75eee9b1a1e3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:49.684331 24516 consensus_queue.cc:260] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.693446 24515 tablet_bootstrap.cc:654] T 7910ea4d480e41fda4aa4fd10f0fef8f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:49.695209 24516 ts_tablet_manager.cc:1434] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:17:49.694921 24657 consensus_queue.cc:1048] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:49.697445 24516 tablet_bootstrap.cc:492] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:49.693794 24393 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:49.698745 24322 raft_consensus.cc:1275] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:17:49.700768 24637 consensus_queue.cc:1048] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:49.707444 24657 consensus_queue.cc:1048] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:49.718401 24516 tablet_bootstrap.cc:654] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:49.742008 24607 consensus_queue.cc:1048] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:49.748174 24516 tablet_bootstrap.cc:492] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:49.748876 24516 ts_tablet_manager.cc:1403] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.052s	user 0.007s	sys 0.005s
I20260709 12:17:49.752529 24516 raft_consensus.cc:359] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.753312 24516 raft_consensus.cc:385] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:49.753661 24516 raft_consensus.cc:740] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:49.754426 24516 consensus_queue.cc:260] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.756215 24516 ts_tablet_manager.cc:1434] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:17:49.762964 24722 consensus_queue.cc:1048] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:49.764300 24514 tablet_bootstrap.cc:492] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:49.764858 24514 ts_tablet_manager.cc:1403] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.138s	user 0.009s	sys 0.025s
I20260709 12:17:49.767894 24514 raft_consensus.cc:359] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.769253 24514 raft_consensus.cc:385] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:49.769523 24514 raft_consensus.cc:740] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:49.770304 24514 consensus_queue.cc:260] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.772816 24514 ts_tablet_manager.cc:1434] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:17:49.773801 24514 tablet_bootstrap.cc:492] T daeed7cb347a434082488f5c5807424b P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:49.784286 24794 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.784927 24794 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:17:49.786561 24271 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:49.786978 24514 tablet_bootstrap.cc:654] T daeed7cb347a434082488f5c5807424b P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:49.787137 24794 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:49.788365 24220 catalog_manager.cc:5697] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:49.791760 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:49.794303 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:49.795018 24473 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 0.
I20260709 12:17:49.796262 24516 tablet_bootstrap.cc:492] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:49.798988 24515 tablet_bootstrap.cc:492] T 7910ea4d480e41fda4aa4fd10f0fef8f P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:49.800812 24515 ts_tablet_manager.cc:1403] T 7910ea4d480e41fda4aa4fd10f0fef8f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.113s	user 0.031s	sys 0.040s
W20260709 12:17:49.796274 24366 leader_election.cc:343] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:49.803231 24516 tablet_bootstrap.cc:654] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:49.803716 24365 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:49.807070 24794 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:49.807478 24794 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:49.807829 24794 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:49.819759 24794 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.833957 24794 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:49.825891 24515 raft_consensus.cc:359] T 7910ea4d480e41fda4aa4fd10f0fef8f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.835034 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:49.835301 24515 raft_consensus.cc:385] T 7910ea4d480e41fda4aa4fd10f0fef8f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:49.836762 24515 raft_consensus.cc:740] T 7910ea4d480e41fda4aa4fd10f0fef8f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
W20260709 12:17:49.837441 24366 leader_election.cc:343] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:49.837504 24515 consensus_queue.cc:260] T 7910ea4d480e41fda4aa4fd10f0fef8f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.839843 24515 ts_tablet_manager.cc:1434] T 7910ea4d480e41fda4aa4fd10f0fef8f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.000s
I20260709 12:17:49.844955 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:49.846884 24474 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:49.850205 24516 tablet_bootstrap.cc:492] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:49.850764 24516 ts_tablet_manager.cc:1403] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.003s
I20260709 12:17:49.851511 24514 tablet_bootstrap.cc:492] T daeed7cb347a434082488f5c5807424b P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:49.852106 24514 ts_tablet_manager.cc:1403] T daeed7cb347a434082488f5c5807424b P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.079s	user 0.007s	sys 0.006s
I20260709 12:17:49.853665 24516 raft_consensus.cc:359] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.854362 24516 raft_consensus.cc:385] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:49.854646 24516 raft_consensus.cc:740] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:49.856048 24515 tablet_bootstrap.cc:492] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:49.859728 24474 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
I20260709 12:17:49.863000 24516 consensus_queue.cc:260] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.862418 24514 raft_consensus.cc:359] T daeed7cb347a434082488f5c5807424b P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.864184 24514 raft_consensus.cc:385] T daeed7cb347a434082488f5c5807424b P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:49.864451 24514 raft_consensus.cc:740] T daeed7cb347a434082488f5c5807424b P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:49.864568 24365 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:49.865267 24514 consensus_queue.cc:260] T daeed7cb347a434082488f5c5807424b P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.867525 24514 ts_tablet_manager.cc:1434] T daeed7cb347a434082488f5c5807424b P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:17:49.868531 24514 tablet_bootstrap.cc:492] T ac37baecf20841f7b0a74e07f89c2a09 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:49.881908 24515 tablet_bootstrap.cc:654] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:49.883446 24516 ts_tablet_manager.cc:1434] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 12:17:49.884507 24516 tablet_bootstrap.cc:492] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:49.876708 24794 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:49.895466 24794 raft_consensus.cc:697] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:17:49.896697 24794 consensus_queue.cc:237] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.880992 24607 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.903041 24607 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.947021 24607 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:49.954914 24319 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:49.956040 24514 tablet_bootstrap.cc:654] T ac37baecf20841f7b0a74e07f89c2a09 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:49.957722 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:17:49.968245 24440 leader_election.cc:343] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:49.976369 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:49.981227 24515 tablet_bootstrap.cc:492] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:49.982089 24515 ts_tablet_manager.cc:1403] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.126s	user 0.011s	sys 0.011s
I20260709 12:17:49.980126 24811 consensus_queue.cc:1048] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:17:49.977159 24394 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:49.982591 24637 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.988407 24438 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:49.988497 24637 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:49.989635 24811 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:49.990026 24811 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:49.990350 24811 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:49.990548 24637 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:50.000043 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:50.001886 24515 raft_consensus.cc:359] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.007136 24516 tablet_bootstrap.cc:654] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.014259 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:50.015412 24323 raft_consensus.cc:2393] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 1: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:17:50.002641 24515 raft_consensus.cc:385] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.017342 24515 raft_consensus.cc:740] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.019506 24515 consensus_queue.cc:260] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.019845 24222 catalog_manager.cc:5697] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 0 to 1, leader changed from <none> to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:50.022274 24515 ts_tablet_manager.cc:1434] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.001s
I20260709 12:17:50.023676 24515 tablet_bootstrap.cc:492] T dfa0a0cd756141c094288d3c05139379 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:50.024776 24514 tablet_bootstrap.cc:492] T ac37baecf20841f7b0a74e07f89c2a09 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:50.026091 24514 ts_tablet_manager.cc:1403] T ac37baecf20841f7b0a74e07f89c2a09 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.158s	user 0.017s	sys 0.002s
I20260709 12:17:50.032207 24637 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.032824 24637 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.034155 24515 tablet_bootstrap.cc:654] T dfa0a0cd756141c094288d3c05139379 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.034498 24811 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.035823 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:17:50.037392 24366 leader_election.cc:343] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:50.034174 24514 raft_consensus.cc:359] T ac37baecf20841f7b0a74e07f89c2a09 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.037902 24514 raft_consensus.cc:385] T ac37baecf20841f7b0a74e07f89c2a09 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.038241 24514 raft_consensus.cc:740] T ac37baecf20841f7b0a74e07f89c2a09 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.034894 24637 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:50.045689 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:50.046132 24365 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:50.046397 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:50.047086 24391 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:50.047297 24365 leader_election.cc:343] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:50.047796 24365 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:50.048516 24794 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:50.048856 24637 raft_consensus.cc:2749] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:50.038884 24514 consensus_queue.cc:260] T ac37baecf20841f7b0a74e07f89c2a09 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.056618 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:50.057336 24321 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:50.062855 24607 consensus_queue.cc:1048] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:50.066071 24780 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.066660 24780 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.067999 24514 ts_tablet_manager.cc:1434] T ac37baecf20841f7b0a74e07f89c2a09 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.041s	user 0.002s	sys 0.004s
I20260709 12:17:50.070210 24514 tablet_bootstrap.cc:492] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:50.069243 24811 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:50.081128 24607 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.081650 24607 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.083487 24607 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:50.083671 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:50.084287 24393 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
I20260709 12:17:50.085538 24289 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:50.086908 24838 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:50.087591 24838 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.087170 24321 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:50.088502 24838 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:50.081162 24780 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:50.091920 24440 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:50.092734 24607 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:50.093185 24607 raft_consensus.cc:697] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:17:50.093923 24607 consensus_queue.cc:237] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.118553 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:50.096307 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:50.118916 24391 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:50.138703 24515 tablet_bootstrap.cc:492] T dfa0a0cd756141c094288d3c05139379 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:50.139190 24515 ts_tablet_manager.cc:1403] T dfa0a0cd756141c094288d3c05139379 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.116s	user 0.016s	sys 0.028s
I20260709 12:17:50.130987 24473 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
I20260709 12:17:50.140900 24794 raft_consensus.cc:2749] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:50.149221 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:50.150357 24393 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:50.151146 24514 tablet_bootstrap.cc:654] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.156724 24438 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:50.157567 24535 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:50.157918 24535 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.158231 24535 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:50.169292 24516 tablet_bootstrap.cc:492] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:50.170018 24516 ts_tablet_manager.cc:1403] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.286s	user 0.027s	sys 0.021s
I20260709 12:17:50.174129 24515 raft_consensus.cc:359] T dfa0a0cd756141c094288d3c05139379 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.174986 24515 raft_consensus.cc:385] T dfa0a0cd756141c094288d3c05139379 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.175324 24515 raft_consensus.cc:740] T dfa0a0cd756141c094288d3c05139379 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.175068 24516 raft_consensus.cc:359] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.175746 24516 raft_consensus.cc:385] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.176010 24516 raft_consensus.cc:740] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.176036 24515 consensus_queue.cc:260] T dfa0a0cd756141c094288d3c05139379 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.194646 24516 consensus_queue.cc:260] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.211354 24515 ts_tablet_manager.cc:1434] T dfa0a0cd756141c094288d3c05139379 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.072s	user 0.004s	sys 0.006s
I20260709 12:17:50.212340 24515 tablet_bootstrap.cc:492] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:50.210338 24838 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.214571 24319 raft_consensus.cc:2393] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 1: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:17:50.214789 24473 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:50.215430 24838 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:50.224186 24535 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.223974 24221 catalog_manager.cc:5697] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:50.226367 24516 ts_tablet_manager.cc:1434] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.000s
I20260709 12:17:50.230237 24514 tablet_bootstrap.cc:492] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:50.230453 24516 tablet_bootstrap.cc:492] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:50.230718 24514 ts_tablet_manager.cc:1403] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.161s	user 0.036s	sys 0.008s
I20260709 12:17:50.233899 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:50.234795 24474 raft_consensus.cc:2393] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 1: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:17:50.235021 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:50.235688 24323 raft_consensus.cc:2393] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 1: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:17:50.238807 24535 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:50.251075 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:50.251549 24814 consensus_queue.cc:1048] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:50.253419 24392 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:50.254261 24616 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.254760 24616 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.258002 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:17:50.259737 24366 leader_election.cc:343] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:50.264163 24616 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:50.266618 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:50.267352 24472 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 0.
I20260709 12:17:50.268775 24515 tablet_bootstrap.cc:654] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.268859 24365 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:50.270124 24616 raft_consensus.cc:2804] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:50.270519 24616 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.270916 24616 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:50.276307 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:50.276737 24516 tablet_bootstrap.cc:654] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.283721 24514 raft_consensus.cc:359] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.285158 24514 raft_consensus.cc:385] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.285609 24514 raft_consensus.cc:740] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.287825 24514 consensus_queue.cc:260] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.290776 24514 ts_tablet_manager.cc:1434] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.060s	user 0.009s	sys 0.001s
I20260709 12:17:50.292078 24514 tablet_bootstrap.cc:492] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:50.279469 24698 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.298338 24289 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:50.300688 24780 raft_consensus.cc:2749] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:50.297071 24698 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.306406 24698 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:50.316419 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:50.327771 24535 consensus_queue.cc:1048] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:50.334153 24392 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:50.339067 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:50.339931 24469 raft_consensus.cc:2393] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 1: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:17:50.341256 24438 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:50.326138 24616 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.342540 24814 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:50.355536 24814 raft_consensus.cc:697] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:17:50.356765 24516 tablet_bootstrap.cc:492] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:50.356534 24814 consensus_queue.cc:237] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.357249 24516 ts_tablet_manager.cc:1403] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.130s	user 0.008s	sys 0.009s
I20260709 12:17:50.354873 24515 tablet_bootstrap.cc:492] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:50.358412 24515 ts_tablet_manager.cc:1403] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.146s	user 0.015s	sys 0.000s
I20260709 12:17:50.378522 24290 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:50.381135 24780 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:50.387053 24794 consensus_queue.cc:1048] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:50.399082 24515 raft_consensus.cc:359] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.399859 24515 raft_consensus.cc:385] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.400156 24515 raft_consensus.cc:740] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.411371 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:17:50.417014 24366 leader_election.cc:343] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:50.424762 24514 tablet_bootstrap.cc:654] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.424746 24515 consensus_queue.cc:260] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.430754 24516 raft_consensus.cc:359] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.431915 24516 raft_consensus.cc:385] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.432243 24516 raft_consensus.cc:740] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.433012 24516 consensus_queue.cc:260] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.439203 24616 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:50.440328 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:50.441216 24472 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:50.441908 24780 raft_consensus.cc:2749] T daeed7cb347a434082488f5c5807424b P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:50.443456 24515 ts_tablet_manager.cc:1434] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.085s	user 0.004s	sys 0.003s
I20260709 12:17:50.452935 24515 tablet_bootstrap.cc:492] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:50.453532 24516 ts_tablet_manager.cc:1434] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.096s	user 0.007s	sys 0.000s
I20260709 12:17:50.457069 24516 tablet_bootstrap.cc:492] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:50.455482 24221 catalog_manager.cc:5697] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:50.469429 24472 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
I20260709 12:17:50.472324 24365 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:50.474016 24637 raft_consensus.cc:2804] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:50.474472 24637 raft_consensus.cc:697] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:17:50.476943 24637 consensus_queue.cc:237] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.483911 24793 consensus_queue.cc:1048] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:50.522938 24515 tablet_bootstrap.cc:654] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.529784 24516 tablet_bootstrap.cc:654] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.530779 24514 tablet_bootstrap.cc:492] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:50.531266 24514 ts_tablet_manager.cc:1403] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.240s	user 0.010s	sys 0.012s
I20260709 12:17:50.540043 24514 raft_consensus.cc:359] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.540901 24514 raft_consensus.cc:385] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.541193 24514 raft_consensus.cc:740] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.541893 24514 consensus_queue.cc:260] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.548825 24514 ts_tablet_manager.cc:1434] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:17:50.549880 24514 tablet_bootstrap.cc:492] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:50.565073 24221 catalog_manager.cc:5697] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 0 to 1, leader changed from <none> to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:50.572419 24515 tablet_bootstrap.cc:492] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:50.573114 24515 ts_tablet_manager.cc:1403] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.120s	user 0.013s	sys 0.008s
I20260709 12:17:50.573364 24514 tablet_bootstrap.cc:654] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.576227 24515 raft_consensus.cc:359] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.577122 24515 raft_consensus.cc:385] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.577471 24515 raft_consensus.cc:740] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.578469 24516 tablet_bootstrap.cc:492] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:50.578177 24515 consensus_queue.cc:260] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.579015 24516 ts_tablet_manager.cc:1403] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.122s	user 0.014s	sys 0.002s
I20260709 12:17:50.581923 24516 raft_consensus.cc:359] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.582461 24514 tablet_bootstrap.cc:492] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:50.582615 24516 raft_consensus.cc:385] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.582943 24514 ts_tablet_manager.cc:1403] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.004s
I20260709 12:17:50.584431 24515 ts_tablet_manager.cc:1434] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 12:17:50.585456 24515 tablet_bootstrap.cc:492] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:50.585836 24514 raft_consensus.cc:359] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.586500 24514 raft_consensus.cc:385] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.586766 24514 raft_consensus.cc:740] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.587445 24514 consensus_queue.cc:260] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.590094 24514 ts_tablet_manager.cc:1434] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:17:50.591143 24514 tablet_bootstrap.cc:492] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:50.582899 24516 raft_consensus.cc:740] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.593194 24516 consensus_queue.cc:260] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.595566 24516 ts_tablet_manager.cc:1434] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:17:50.596429 24516 tablet_bootstrap.cc:492] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:50.596977 24514 tablet_bootstrap.cc:654] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.604027 24516 tablet_bootstrap.cc:654] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.592597 24515 tablet_bootstrap.cc:654] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.626474 24814 consensus_queue.cc:1048] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:50.649832 24515 tablet_bootstrap.cc:492] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:50.650548 24515 ts_tablet_manager.cc:1403] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.065s	user 0.005s	sys 0.010s
I20260709 12:17:50.656844 24516 tablet_bootstrap.cc:492] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:50.657374 24516 ts_tablet_manager.cc:1403] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.007s
I20260709 12:17:50.660252 24516 raft_consensus.cc:359] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.660964 24516 raft_consensus.cc:385] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.661230 24516 raft_consensus.cc:740] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.670710 24514 tablet_bootstrap.cc:492] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:50.672349 24514 ts_tablet_manager.cc:1403] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.081s	user 0.036s	sys 0.028s
I20260709 12:17:50.664913 24516 consensus_queue.cc:260] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.674479 24516 ts_tablet_manager.cc:1434] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:17:50.675424 24516 tablet_bootstrap.cc:492] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:50.672078 24515 raft_consensus.cc:359] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.675989 24515 raft_consensus.cc:385] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.676266 24515 raft_consensus.cc:740] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.676968 24515 consensus_queue.cc:260] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.675436 24514 raft_consensus.cc:359] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.683990 24514 raft_consensus.cc:385] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.684280 24514 raft_consensus.cc:740] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.684331 24814 consensus_queue.cc:1048] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:50.685056 24514 consensus_queue.cc:260] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.687399 24514 ts_tablet_manager.cc:1434] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 12:17:50.688442 24514 tablet_bootstrap.cc:492] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:50.690795 24515 ts_tablet_manager.cc:1434] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.002s
I20260709 12:17:50.691814 24515 tablet_bootstrap.cc:492] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:50.692852 24856 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.693396 24856 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.696328 24516 tablet_bootstrap.cc:654] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.696676 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:50.697399 24319 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 0.
I20260709 12:17:50.697984 24515 tablet_bootstrap.cc:654] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.698721 24366 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:50.699632 24637 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:50.699954 24637 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.700225 24637 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:50.704772 24814 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.705276 24814 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.706192 24514 tablet_bootstrap.cc:654] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.711552 24814 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:50.714140 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:50.714793 24319 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:50.714917 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:50.715724 24392 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:50.716421 24856 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:50.717659 24515 tablet_bootstrap.cc:492] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:50.717639 24438 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:50.718298 24515 ts_tablet_manager.cc:1403] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.000s
I20260709 12:17:50.718645 24535 raft_consensus.cc:2804] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:50.719008 24535 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.719295 24535 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:50.720594 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:50.721271 24472 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 0.
I20260709 12:17:50.721837 24515 raft_consensus.cc:359] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.722681 24515 raft_consensus.cc:385] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.723014 24515 raft_consensus.cc:740] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.723891 24515 consensus_queue.cc:260] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.726466 24515 ts_tablet_manager.cc:1434] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:17:50.727438 24515 tablet_bootstrap.cc:492] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:50.734896 24515 tablet_bootstrap.cc:654] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.741050 24514 tablet_bootstrap.cc:492] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:50.741559 24514 ts_tablet_manager.cc:1403] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.003s
I20260709 12:17:50.744915 24514 raft_consensus.cc:359] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.745894 24514 raft_consensus.cc:385] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.746318 24514 raft_consensus.cc:740] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.745368 24637 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.747334 24514 consensus_queue.cc:260] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.745546 24535 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.748510 24856 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.750414 24514 ts_tablet_manager.cc:1434] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:17:50.750502 24856 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.751974 24514 tablet_bootstrap.cc:492] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:50.752394 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:50.753070 24472 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:50.755259 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:50.755885 24469 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 0.
I20260709 12:17:50.757229 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:50.757812 24391 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:50.758231 24365 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:50.759061 24794 raft_consensus.cc:2804] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:50.759406 24794 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.759711 24794 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:50.760790 24514 tablet_bootstrap.cc:654] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.764101 24515 tablet_bootstrap.cc:492] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:50.764815 24515 ts_tablet_manager.cc:1403] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.014s
I20260709 12:17:50.764772 24391 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:50.766237 24637 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:50.768442 24535 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:50.768321 24856 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:50.769611 24794 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.821182 24516 tablet_bootstrap.cc:492] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:50.766588 24438 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:50.823134 24516 ts_tablet_manager.cc:1403] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.148s	user 0.017s	sys 0.022s
W20260709 12:17:50.823421 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 56750.7us
I20260709 12:17:50.824750 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:50.826517 24319 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:50.829521 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:50.830644 24320 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:50.830888 24535 raft_consensus.cc:2804] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:50.831789 24535 raft_consensus.cc:697] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:17:50.832316 24794 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:50.848476 24535 consensus_queue.cc:237] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.854143 24811 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.855103 24811 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.828517 24515 raft_consensus.cc:359] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:50.856031 24515 raft_consensus.cc:385] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.856667 24515 raft_consensus.cc:740] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.861550 24320 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:50.887569 24811 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:50.927304 24472 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
I20260709 12:17:51.011336 24780 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.063050 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:51.064198 24469 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.066627 24698 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.067476 24698 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:51.086694 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:51.087904 24320 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 0.
I20260709 12:17:51.090602 24514 tablet_bootstrap.cc:492] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:51.091467 24514 ts_tablet_manager.cc:1403] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.340s	user 0.012s	sys 0.011s
I20260709 12:17:51.017163 24794 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.106009 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:51.106860 24322 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.108995 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:51.110630 24515 consensus_queue.cc:260] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:51.112921 24515 ts_tablet_manager.cc:1434] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.347s	user 0.025s	sys 0.046s
I20260709 12:17:51.117187 24794 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:17:51.123690 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 103831us
I20260709 12:17:51.135159 24365 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:51.103842 24780 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:51.147831 24516 raft_consensus.cc:359] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:51.156143 24516 raft_consensus.cc:385] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.150121 24469 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
W20260709 12:17:51.142138 24438 leader_election.cc:343] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.152724 24794 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:51.156481 24516 raft_consensus.cc:740] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.161592 24698 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:51.168993 24319 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
I20260709 12:17:51.173120 24780 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:51.174017 24856 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:51.174616 24856 raft_consensus.cc:697] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:17:51.178797 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:51.179929 24392 raft_consensus.cc:2393] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 1: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:17:51.164646 24516 consensus_queue.cc:260] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:51.183913 24516 ts_tablet_manager.cc:1434] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.360s	user 0.011s	sys 0.003s
I20260709 12:17:51.184921 24322 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
I20260709 12:17:51.175930 24856 consensus_queue.cc:237] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:51.210985 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:51.214277 24222 catalog_manager.cc:5697] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:51.217027 24515 tablet_bootstrap.cc:492] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:51.220240 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:51.208601 24514 raft_consensus.cc:359] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:51.224834 24514 raft_consensus.cc:385] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.225258 24514 raft_consensus.cc:740] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.238108 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:51.240182 24468 raft_consensus.cc:2393] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 1: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:17:51.242349 24514 consensus_queue.cc:260] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:51.245537 24365 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:51.244267 24514 ts_tablet_manager.cc:1434] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.152s	user 0.007s	sys 0.003s
I20260709 12:17:51.247927 24514 tablet_bootstrap.cc:492] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:51.256788 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:51.257926 24471 raft_consensus.cc:2393] T dfa0a0cd756141c094288d3c05139379 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 1: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:17:51.258502 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:51.259338 24320 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:51.266340 24878 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.267115 24878 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:51.280740 24878 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:51.281561 24290 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:51.284909 24516 tablet_bootstrap.cc:492] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:51.283820 24780 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:51.286418 24365 leader_election.cc:343] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.302747 24880 consensus_queue.cc:1048] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:51.306121 24290 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:51.307996 24515 tablet_bootstrap.cc:654] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.312770 24882 raft_consensus.cc:2804] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:51.314189 24709 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:51.318713 24882 raft_consensus.cc:697] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:17:51.328847 24607 consensus_queue.cc:1048] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:17:51.332896 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:51.334688 24223 catalog_manager.cc:5697] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 0 to 1, leader changed from <none> to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.347179 24780 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:51.351708 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:51.352190 24514 tablet_bootstrap.cc:654] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.352512 24319 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:51.352787 24878 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.353379 24878 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:51.320050 24882 consensus_queue.cc:237] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:51.364023 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:51.368659 24516 tablet_bootstrap.cc:654] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.369016 24880 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.355753 24878 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:51.370695 24440 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:17:51.374953 24438 leader_election.cc:343] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:51.390645 24271 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:51.399374 24535 consensus_queue.cc:1048] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:51.396533 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:51.399732 24875 raft_consensus.cc:2804] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:51.416456 24440 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:51.419850 24514 tablet_bootstrap.cc:492] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:51.420605 24514 ts_tablet_manager.cc:1403] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.173s	user 0.019s	sys 0.010s
I20260709 12:17:51.426433 24515 tablet_bootstrap.cc:492] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:51.427203 24515 ts_tablet_manager.cc:1403] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.217s	user 0.016s	sys 0.010s
I20260709 12:17:51.427099 24514 raft_consensus.cc:359] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:51.428218 24514 raft_consensus.cc:385] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.428599 24514 raft_consensus.cc:740] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.384483 24880 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:17:51.431411 24438 leader_election.cc:343] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.399756 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:51.409068 24875 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.438297 24793 consensus_queue.cc:1048] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
W20260709 12:17:51.441067 24440 leader_election.cc:343] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.442881 24440 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:51.447108 24607 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:51.449678 24880 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:51.450702 24514 consensus_queue.cc:260] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:51.452521 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:51.453459 24514 ts_tablet_manager.cc:1434] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.001s
I20260709 12:17:51.456115 24514 tablet_bootstrap.cc:492] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:51.438337 24876 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:51.440505 24875 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.457873 24876 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.460987 24876 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.467617 24515 raft_consensus.cc:359] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:51.469849 24515 raft_consensus.cc:385] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.470423 24515 raft_consensus.cc:740] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.470208 24878 consensus_queue.cc:1048] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:17:51.481827 24515 consensus_queue.cc:260] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:17:51.486680 24366 leader_election.cc:343] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.487198 24366 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:51.490797 24856 raft_consensus.cc:2749] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:51.495128 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:51.495926 24318 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 0.
I20260709 12:17:51.497608 24366 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:51.498477 24880 raft_consensus.cc:2804] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:51.498845 24880 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.499184 24880 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.499460 24515 ts_tablet_manager.cc:1434] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.071s	user 0.005s	sys 0.003s
I20260709 12:17:51.500324 24516 tablet_bootstrap.cc:492] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:51.500873 24516 ts_tablet_manager.cc:1403] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.239s	user 0.022s	sys 0.010s
I20260709 12:17:51.520273 24515 tablet_bootstrap.cc:492] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:51.503167 24875 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:51.524027 24471 raft_consensus.cc:2393] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 1: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:17:51.526959 24516 raft_consensus.cc:359] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:51.527629 24516 raft_consensus.cc:385] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.527940 24516 raft_consensus.cc:740] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.505854 24876 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:51.565032 24516 consensus_queue.cc:260] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:51.587838 24535 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.588575 24535 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:51.606871 24514 tablet_bootstrap.cc:654] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.617096 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:17:51.618897 24440 leader_election.cc:343] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.622915 24709 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.623430 24709 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:51.627558 24709 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:51.627964 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:51.628355 24878 consensus_queue.cc:1048] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:17:51.630776 24882 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:51.631220 24289 leader_election.cc:343] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.631363 24882 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:51.631764 24880 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:51.631801 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:51.634375 24882 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:51.635375 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:51.637461 24516 ts_tablet_manager.cc:1434] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.136s	user 0.009s	sys 0.001s
I20260709 12:17:51.642086 24876 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:17:51.644495 24366 leader_election.cc:343] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.683528 24516 tablet_bootstrap.cc:492] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:51.709897 24875 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:51.712376 24515 tablet_bootstrap.cc:654] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.712168 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:51.712813 24321 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.715971 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:17:51.718137 24290 leader_election.cc:343] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.718717 24290 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:51.720007 24698 raft_consensus.cc:2749] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:51.733541 24321 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:51.736263 24318 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.756479 24880 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:51.748705 24440 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:51.765463 24883 raft_consensus.cc:2804] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:51.770140 24883 raft_consensus.cc:697] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:17:51.771133 24883 consensus_queue.cc:237] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:51.775940 24535 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:51.783069 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:51.783927 24391 raft_consensus.cc:2393] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 1: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:17:51.784759 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:51.785414 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:51.785655 24320 raft_consensus.cc:2393] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 1: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:17:51.806579 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:51.846323 24514 tablet_bootstrap.cc:492] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:51.962402 24514 ts_tablet_manager.cc:1403] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.508s	user 0.013s	sys 0.017s
I20260709 12:17:51.963585 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:51.964453 24471 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 0.
I20260709 12:17:51.966421 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:17:51.977470 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 116327us
W20260709 12:17:51.978312 24438 leader_election.cc:343] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.978772 24438 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:51.980391 24875 raft_consensus.cc:2749] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:51.987435 24318 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:52.001749 24516 tablet_bootstrap.cc:654] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.015890 24440 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:52.004917 24515 tablet_bootstrap.cc:492] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:52.016970 24515 ts_tablet_manager.cc:1403] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.498s	user 0.014s	sys 0.013s
I20260709 12:17:52.006127 24365 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:52.006650 24856 consensus_queue.cc:1048] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:52.018623 24365 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
W20260709 12:17:52.021224 24438 leader_election.cc:343] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:52.022486 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 233109us
I20260709 12:17:52.024853 24722 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:52.027814 24722 raft_consensus.cc:697] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:17:52.019764 24882 raft_consensus.cc:2749] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:52.044483 24516 tablet_bootstrap.cc:492] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:52.045390 24516 ts_tablet_manager.cc:1403] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.396s	user 0.011s	sys 0.023s
I20260709 12:17:52.050959 24516 raft_consensus.cc:359] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.053470 24516 raft_consensus.cc:385] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.053833 24516 raft_consensus.cc:740] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.054662 24516 consensus_queue.cc:260] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.023118 24879 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:52.071839 24515 raft_consensus.cc:359] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.073189 24515 raft_consensus.cc:385] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.073441 24515 raft_consensus.cc:740] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.063750 24879 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.081758 24514 raft_consensus.cc:359] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.082551 24514 raft_consensus.cc:385] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.082842 24514 raft_consensus.cc:740] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.085207 24515 consensus_queue.cc:260] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.028780 24722 consensus_queue.cc:237] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.082330 24879 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.098460 24221 catalog_manager.cc:5697] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 0 to 1, leader changed from <none> to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:52.124457 24514 consensus_queue.cc:260] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:17:52.133167 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 49741.9us
I20260709 12:17:52.141250 24514 ts_tablet_manager.cc:1434] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.178s	user 0.005s	sys 0.004s
I20260709 12:17:52.142481 24514 tablet_bootstrap.cc:492] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:52.145503 24516 ts_tablet_manager.cc:1434] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.100s	user 0.019s	sys 0.013s
I20260709 12:17:52.207137 24514 tablet_bootstrap.cc:654] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.210369 24516 tablet_bootstrap.cc:492] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:52.222048 24793 consensus_queue.cc:1048] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:52.229786 24515 ts_tablet_manager.cc:1434] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.212s	user 0.014s	sys 0.012s
I20260709 12:17:52.256714 24515 tablet_bootstrap.cc:492] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:52.258814 24880 consensus_queue.cc:1048] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:52.266731 24919 consensus_queue.cc:1048] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:52.268043 24879 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.270654 24879 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:52.289528 24882 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.290053 24882 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.291973 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:52.296149 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:52.296892 24473 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.297001 24882 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:52.299609 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:17:52.302472 24366 leader_election.cc:343] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:52.304621 24366 leader_election.cc:343] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.308017 24516 tablet_bootstrap.cc:654] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.346410 24883 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.350564 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:52.344103 24877 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.355738 24877 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.345484 24473 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
I20260709 12:17:52.366753 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:52.368319 24365 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
W20260709 12:17:52.370062 24365 leader_election.cc:343] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.370630 24365 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:52.371042 24515 tablet_bootstrap.cc:654] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:52.374344 24289 leader_election.cc:343] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.350611 24883 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.371977 24856 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:52.382947 24917 raft_consensus.cc:2749] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:52.387117 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:52.388013 24469 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
I20260709 12:17:52.389262 24883 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:52.390214 24290 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:52.362890 24877 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:52.394848 24918 raft_consensus.cc:2804] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:52.395386 24918 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.395817 24918 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.386112 24856 raft_consensus.cc:697] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:17:52.396317 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:52.404744 24921 consensus_queue.cc:1048] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260709 12:17:52.406430 24438 leader_election.cc:343] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.407764 24856 consensus_queue.cc:237] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.410382 24923 consensus_queue.cc:1048] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:17:52.408396 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:52.414274 24516 tablet_bootstrap.cc:492] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:52.430106 24516 ts_tablet_manager.cc:1403] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.269s	user 0.011s	sys 0.017s
I20260709 12:17:52.477237 24514 tablet_bootstrap.cc:492] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:52.477747 24514 ts_tablet_manager.cc:1403] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.336s	user 0.014s	sys 0.005s
I20260709 12:17:52.491801 24515 tablet_bootstrap.cc:492] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:52.491556 24516 raft_consensus.cc:359] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.492480 24515 ts_tablet_manager.cc:1403] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.243s	user 0.024s	sys 0.023s
W20260709 12:17:52.493073 24271 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:52.492508 24516 raft_consensus.cc:385] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.493805 24516 raft_consensus.cc:740] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.508491 24516 consensus_queue.cc:260] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.514194 24514 raft_consensus.cc:359] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.516304 24514 raft_consensus.cc:385] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.516676 24514 raft_consensus.cc:740] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.534745 24516 ts_tablet_manager.cc:1434] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.104s	user 0.006s	sys 0.005s
I20260709 12:17:52.537521 24514 consensus_queue.cc:260] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.541640 24515 raft_consensus.cc:359] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.542701 24515 raft_consensus.cc:385] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.543679 24515 raft_consensus.cc:740] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.545563 24515 consensus_queue.cc:260] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.550835 24223 catalog_manager.cc:5697] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:52.537076 24918 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.557469 24318 raft_consensus.cc:2393] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 1: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:17:52.563690 24514 ts_tablet_manager.cc:1434] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.000s
I20260709 12:17:52.564895 24514 tablet_bootstrap.cc:492] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:52.566008 24440 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:52.570657 24918 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:52.571619 24516 tablet_bootstrap.cc:492] T 36992a1e3818480c9a2705bd569f099a P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:52.571969 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:52.574186 24515 ts_tablet_manager.cc:1434] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.081s	user 0.005s	sys 0.002s
I20260709 12:17:52.575187 24515 tablet_bootstrap.cc:492] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:52.575981 24883 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.583112 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:52.593713 24396 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.616133 24514 tablet_bootstrap.cc:654] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.628666 24883 raft_consensus.cc:2749] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:52.641162 24516 tablet_bootstrap.cc:654] T 36992a1e3818480c9a2705bd569f099a P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.650314 24396 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:17:52.706085 24289 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:52.708917 24918 raft_consensus.cc:2804] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:52.709380 24918 raft_consensus.cc:697] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:17:52.709444 24472 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:17:52.710256 24918 consensus_queue.cc:237] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.711519 24515 tablet_bootstrap.cc:654] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:52.726413 24934 log.cc:927] Time spent T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.067s	user 0.010s	sys 0.000s
W20260709 12:17:52.737941 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 146555us
I20260709 12:17:52.733494 24221 catalog_manager.cc:5697] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 0 to 1, leader changed from <none> to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:52.744604 24514 tablet_bootstrap.cc:492] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:52.747589 24514 ts_tablet_manager.cc:1403] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.183s	user 0.012s	sys 0.006s
W20260709 12:17:52.756817 24438 consensus_peers.cc:597] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:52.756309 24883 consensus_queue.cc:1048] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:17:52.774374 24514 raft_consensus.cc:359] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.775488 24514 raft_consensus.cc:385] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.775835 24514 raft_consensus.cc:740] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.776655 24514 consensus_queue.cc:260] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.782614 24515 tablet_bootstrap.cc:492] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:52.783182 24515 ts_tablet_manager.cc:1403] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.208s	user 0.015s	sys 0.026s
I20260709 12:17:52.785723 24514 ts_tablet_manager.cc:1434] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 12:17:52.794878 24515 raft_consensus.cc:359] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.795699 24515 raft_consensus.cc:385] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.795992 24515 raft_consensus.cc:740] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.796820 24515 consensus_queue.cc:260] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.799206 24516 tablet_bootstrap.cc:492] T 36992a1e3818480c9a2705bd569f099a P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:52.799760 24516 ts_tablet_manager.cc:1403] T 36992a1e3818480c9a2705bd569f099a P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.228s	user 0.030s	sys 0.036s
I20260709 12:17:52.804579 24515 ts_tablet_manager.cc:1434] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.001s
I20260709 12:17:52.815990 24915 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.815691 24515 tablet_bootstrap.cc:492] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:52.816490 24915 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.821653 24915 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:52.822690 24514 tablet_bootstrap.cc:492] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:52.824712 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:52.825470 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:17:52.827442 24440 leader_election.cc:343] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:52.831555 24438 leader_election.cc:343] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.832062 24438 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:52.832808 24846 raft_consensus.cc:2749] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:52.835270 24515 tablet_bootstrap.cc:654] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.837945 24223 catalog_manager.cc:5697] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 0 to 1, leader changed from <none> to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:52.840083 24515 tablet_bootstrap.cc:492] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:52.839834 24516 raft_consensus.cc:359] T 36992a1e3818480c9a2705bd569f099a P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.840516 24516 raft_consensus.cc:385] T 36992a1e3818480c9a2705bd569f099a P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.840553 24515 ts_tablet_manager.cc:1403] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.002s
I20260709 12:17:52.841030 24516 raft_consensus.cc:740] T 36992a1e3818480c9a2705bd569f099a P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.842805 24516 consensus_queue.cc:260] T 36992a1e3818480c9a2705bd569f099a P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.843694 24515 raft_consensus.cc:359] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.844501 24515 raft_consensus.cc:385] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.844867 24515 raft_consensus.cc:740] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.845666 24516 ts_tablet_manager.cc:1434] T 36992a1e3818480c9a2705bd569f099a P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.001s
I20260709 12:17:52.846432 24514 tablet_bootstrap.cc:654] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.847122 24516 tablet_bootstrap.cc:492] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:52.845706 24515 consensus_queue.cc:260] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.854157 24515 ts_tablet_manager.cc:1434] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:17:52.855484 24515 tablet_bootstrap.cc:492] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:52.858670 24516 tablet_bootstrap.cc:654] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.865003 24515 tablet_bootstrap.cc:654] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.908311 24909 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.908914 24909 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.909448 24514 tablet_bootstrap.cc:492] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:52.911118 24909 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:52.915318 24515 tablet_bootstrap.cc:492] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:52.915844 24515 ts_tablet_manager.cc:1403] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.009s
I20260709 12:17:52.918488 24515 raft_consensus.cc:359] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.919832 24515 raft_consensus.cc:385] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.920159 24515 raft_consensus.cc:740] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.920969 24515 consensus_queue.cc:260] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.922690 24515 ts_tablet_manager.cc:1434] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:17:52.923779 24515 tablet_bootstrap.cc:492] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:52.910012 24514 ts_tablet_manager.cc:1403] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.105s	user 0.043s	sys 0.020s
I20260709 12:17:52.911814 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:52.925168 24396 raft_consensus.cc:2468] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
I20260709 12:17:52.925555 24516 tablet_bootstrap.cc:492] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:52.905308 24222 catalog_manager.cc:5697] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:52.913748 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:52.926028 24516 ts_tablet_manager.cc:1403] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.079s	user 0.020s	sys 0.005s
I20260709 12:17:52.926280 24472 raft_consensus.cc:2468] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
I20260709 12:17:52.927728 24290 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:52.928587 24909 raft_consensus.cc:2804] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:52.929136 24909 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.928639 24514 raft_consensus.cc:359] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.929507 24909 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.929569 24514 raft_consensus.cc:385] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.930035 24514 raft_consensus.cc:740] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.929867 24516 raft_consensus.cc:359] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.930612 24516 raft_consensus.cc:385] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.930896 24514 consensus_queue.cc:260] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.930879 24516 raft_consensus.cc:740] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.933449 24514 ts_tablet_manager.cc:1434] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:17:52.933435 24516 consensus_queue.cc:260] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.942983 24909 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:52.945986 24909 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:52.944123 24516 ts_tablet_manager.cc:1434] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 12:17:52.947117 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:52.947178 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:52.947798 24472 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.947980 24396 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.949286 24515 tablet_bootstrap.cc:654] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.934866 24514 tablet_bootstrap.cc:492] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:52.961397 24514 tablet_bootstrap.cc:654] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.972419 24472 raft_consensus.cc:2468] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:17:52.975253 24515 tablet_bootstrap.cc:492] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:52.975874 24515 ts_tablet_manager.cc:1403] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.009s
I20260709 12:17:52.974982 24856 consensus_queue.cc:1048] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:52.947367 24516 tablet_bootstrap.cc:492] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:52.978739 24396 raft_consensus.cc:2468] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:17:52.982347 24289 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:52.984081 24909 raft_consensus.cc:2804] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:52.984866 24909 raft_consensus.cc:697] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:17:52.985821 24909 consensus_queue.cc:237] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.011283 24317 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.008450 24918 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.017380 24918 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.019492 24918 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:53.020390 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:53.021397 24516 tablet_bootstrap.cc:654] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.024241 24397 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
I20260709 12:17:53.025537 24289 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:53.027637 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:53.028262 24472 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
I20260709 12:17:53.030488 24514 tablet_bootstrap.cc:492] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:53.032531 24514 ts_tablet_manager.cc:1403] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.098s	user 0.017s	sys 0.020s
I20260709 12:17:53.036562 24909 raft_consensus.cc:2804] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:53.037112 24909 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.037583 24909 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.035696 24222 catalog_manager.cc:5697] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 0 to 1, leader changed from <none> to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:53.059667 24515 raft_consensus.cc:359] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.060391 24515 raft_consensus.cc:385] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.060664 24515 raft_consensus.cc:740] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.061259 24515 consensus_queue.cc:260] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.063216 24515 ts_tablet_manager.cc:1434] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.087s	user 0.004s	sys 0.000s
I20260709 12:17:53.064203 24515 tablet_bootstrap.cc:492] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:53.064986 24918 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.065464 24918 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.067095 24917 consensus_queue.cc:1048] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.073758 24514 raft_consensus.cc:359] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.074487 24514 raft_consensus.cc:385] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.074743 24514 raft_consensus.cc:740] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.075096 24880 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.075388 24514 consensus_queue.cc:260] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.075575 24880 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.077844 24880 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:53.078421 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:53.079093 24321 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 0.
I20260709 12:17:53.079100 24514 ts_tablet_manager.cc:1434] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.000s
I20260709 12:17:53.080334 24514 tablet_bootstrap.cc:492] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:53.080410 24366 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:53.082006 24917 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:53.082382 24917 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.082513 24918 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:53.082726 24917 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.085439 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:53.087132 24514 tablet_bootstrap.cc:654] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.088840 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:53.089386 24814 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.089883 24814 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.090381 24290 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:53.092104 24814 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:53.094029 24515 tablet_bootstrap.cc:654] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.095247 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:53.096746 24516 tablet_bootstrap.cc:492] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
W20260709 12:17:53.097044 24365 leader_election.cc:343] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.097260 24516 ts_tablet_manager.cc:1403] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.150s	user 0.033s	sys 0.011s
I20260709 12:17:53.101177 24516 raft_consensus.cc:359] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.102284 24516 raft_consensus.cc:385] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.102623 24516 raft_consensus.cc:740] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.103340 24516 consensus_queue.cc:260] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.096866 24909 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.097754 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:17:53.106585 24438 leader_election.cc:343] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.106843 24909 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:53.108233 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:53.108946 24397 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.111153 24516 ts_tablet_manager.cc:1434] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:17:53.112373 24516 tablet_bootstrap.cc:492] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:53.113261 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:53.118345 24397 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:17:53.119796 24289 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:53.120990 24910 raft_consensus.cc:2804] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:53.121490 24910 raft_consensus.cc:697] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:17:53.121765 24515 tablet_bootstrap.cc:492] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:53.122264 24515 ts_tablet_manager.cc:1403] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.001s
I20260709 12:17:53.123199 24514 tablet_bootstrap.cc:492] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:53.122782 24910 consensus_queue.cc:237] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.123740 24514 ts_tablet_manager.cc:1403] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.003s
I20260709 12:17:53.126525 24514 raft_consensus.cc:359] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.127408 24514 raft_consensus.cc:385] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.127745 24514 raft_consensus.cc:740] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.128599 24514 consensus_queue.cc:260] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.132862 24514 ts_tablet_manager.cc:1434] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:17:53.134332 24514 tablet_bootstrap.cc:492] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
W20260709 12:17:53.135147 24440 leader_election.cc:343] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.135641 24440 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:53.135941 24516 tablet_bootstrap.cc:654] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.124923 24515 raft_consensus.cc:359] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.137073 24515 raft_consensus.cc:385] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.137425 24515 raft_consensus.cc:740] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.138131 24515 consensus_queue.cc:260] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.140393 24814 raft_consensus.cc:2749] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:53.142252 24515 ts_tablet_manager.cc:1434] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:17:53.143265 24514 tablet_bootstrap.cc:654] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.144044 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:53.143620 24917 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.144683 24465 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.149842 24917 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:53.143307 24515 tablet_bootstrap.cc:492] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:53.149959 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:53.150635 24321 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.155397 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:53.157120 24515 tablet_bootstrap.cc:654] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:53.158805 24365 leader_election.cc:343] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.174947 24516 tablet_bootstrap.cc:492] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:53.175494 24516 ts_tablet_manager.cc:1403] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.013s
I20260709 12:17:53.178622 24846 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.179755 24915 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.179991 24515 tablet_bootstrap.cc:492] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:53.179409 24846 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.180444 24515 ts_tablet_manager.cc:1403] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.004s
I20260709 12:17:53.180281 24915 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.182507 24698 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:53.182936 24846 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:53.184863 24516 raft_consensus.cc:359] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.185828 24516 raft_consensus.cc:385] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.186146 24516 raft_consensus.cc:740] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.186185 24915 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:53.188791 24515 raft_consensus.cc:359] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.195750 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:53.196550 24397 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:53.187009 24516 consensus_queue.cc:260] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.197449 24515 raft_consensus.cc:385] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.197799 24515 raft_consensus.cc:740] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.198247 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:53.198870 24396 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:53.198621 24515 consensus_queue.cc:260] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.200306 24515 ts_tablet_manager.cc:1434] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 12:17:53.200527 24438 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:53.201336 24515 tablet_bootstrap.cc:492] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:53.201628 24923 raft_consensus.cc:2804] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:53.201989 24923 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.202292 24923 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.203616 24514 tablet_bootstrap.cc:492] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:53.204099 24514 ts_tablet_manager.cc:1403] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.070s	user 0.011s	sys 0.027s
I20260709 12:17:53.206686 24514 raft_consensus.cc:359] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.207442 24514 raft_consensus.cc:385] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.207742 24514 raft_consensus.cc:740] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.208705 24514 consensus_queue.cc:260] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.211063 24514 ts_tablet_manager.cc:1434] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 12:17:53.215397 24438 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:53.216536 24814 raft_consensus.cc:2804] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:53.216995 24814 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.217407 24814 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.225543 24514 tablet_bootstrap.cc:492] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:53.231343 24514 tablet_bootstrap.cc:654] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.224608 24814 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.237543 24814 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:53.241745 24516 ts_tablet_manager.cc:1434] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.001s
I20260709 12:17:53.252060 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:53.254091 24516 tablet_bootstrap.cc:492] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:53.212226 24923 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.162678 24321 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
I20260709 12:17:53.260918 24909 consensus_queue.cc:1048] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.261390 24366 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:17:53.261910 24698 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.262378 24698 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.263437 24923 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:53.266184 24223 catalog_manager.cc:5697] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 0 to 1, leader changed from <none> to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:53.268090 24465 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:17:53.268810 24914 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:53.269843 24914 raft_consensus.cc:697] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:17:53.271274 24914 consensus_queue.cc:237] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.274801 24909 consensus_queue.cc:1048] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:53.274930 24915 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.279021 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:53.279775 24395 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.280855 24515 tablet_bootstrap.cc:654] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.282897 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:53.285935 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:53.286615 24398 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:53.293617 24440 leader_election.cc:343] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.276685 24915 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.294030 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:17:53.295997 24440 leader_election.cc:343] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.298451 24698 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:53.300698 24915 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:17:53.302747 24440 leader_election.cc:343] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.289515 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:53.310413 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:53.310410 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:53.313055 24325 raft_consensus.cc:2393] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 1: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:17:53.324345 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:17:53.326560 24289 leader_election.cc:343] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.334482 24440 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:53.344786 24514 tablet_bootstrap.cc:492] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:53.346144 24514 ts_tablet_manager.cc:1403] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.121s	user 0.005s	sys 0.037s
I20260709 12:17:53.341615 24883 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.382246 24516 tablet_bootstrap.cc:654] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.359835 24395 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:53.387874 24883 raft_consensus.cc:2749] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:53.394277 24398 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:53.376040 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:53.397905 24438 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:53.401218 24515 tablet_bootstrap.cc:492] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:53.401762 24515 ts_tablet_manager.cc:1403] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.201s	user 0.019s	sys 0.014s
W20260709 12:17:53.402594 24290 leader_election.cc:343] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.403220 24290 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:17:53.405296 24440 leader_election.cc:343] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.408440 24923 raft_consensus.cc:2804] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:53.414094 24923 raft_consensus.cc:697] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:17:53.418124 24923 consensus_queue.cc:237] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.407557 24909 raft_consensus.cc:2749] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:53.407829 24915 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.422623 24915 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.437245 24515 raft_consensus.cc:359] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.438092 24515 raft_consensus.cc:385] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.438371 24515 raft_consensus.cc:740] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.441370 24515 consensus_queue.cc:260] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.445972 24438 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:53.458134 24914 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.465409 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:53.465597 24914 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.466315 24515 ts_tablet_manager.cc:1434] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.001s
I20260709 12:17:53.467514 24515 tablet_bootstrap.cc:492] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3: Bootstrap starting.
I20260709 12:17:53.467959 24914 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:53.458227 24909 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.430529 24915 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:53.459815 24962 raft_consensus.cc:2804] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:53.471674 24909 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.473264 24396 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:53.500679 24222 catalog_manager.cc:5697] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 0 to 1, leader changed from <none> to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:53.509424 24514 raft_consensus.cc:359] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.511798 24514 raft_consensus.cc:385] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.512084 24514 raft_consensus.cc:740] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
W20260709 12:17:53.508031 24965 log.cc:927] Time spent T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:17:53.513556 24514 consensus_queue.cc:260] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.496441 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:53.512784 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:53.504492 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:53.508332 24962 raft_consensus.cc:697] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
W20260709 12:17:53.519372 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 104217us
I20260709 12:17:53.517185 24325 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 0.
I20260709 12:17:53.522012 24465 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 0.
I20260709 12:17:53.523072 24962 consensus_queue.cc:237] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.525316 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:53.528479 24321 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:53.617594 24514 ts_tablet_manager.cc:1434] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.271s	user 0.011s	sys 0.004s
I20260709 12:17:53.525647 24909 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:53.701995 24365 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:17:53.703250 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 163602us
I20260709 12:17:53.704679 24879 raft_consensus.cc:2804] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:53.705106 24879 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.705474 24879 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.709017 24223 catalog_manager.cc:5697] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:53.712551 24879 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.721359 24515 tablet_bootstrap.cc:654] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.722453 24438 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:53.735226 24698 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.744669 24516 tablet_bootstrap.cc:492] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:53.745504 24516 ts_tablet_manager.cc:1403] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.496s	user 0.040s	sys 0.021s
I20260709 12:17:53.735988 24698 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.751435 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:53.752120 24969 raft_consensus.cc:2804] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:53.752588 24969 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.752945 24969 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.767033 24514 tablet_bootstrap.cc:492] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:53.772249 24698 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:53.732721 24879 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:53.752115 24317 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.826233 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:53.834170 24516 raft_consensus.cc:359] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.834921 24516 raft_consensus.cc:385] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.835171 24516 raft_consensus.cc:740] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.835704 24516 consensus_queue.cc:260] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.862886 24969 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:53.864205 24472 raft_consensus.cc:2393] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 1: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:17:53.865975 24969 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:53.866122 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:53.868352 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:53.870268 24393 raft_consensus.cc:2393] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 1: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:17:53.867556 24467 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
I20260709 12:17:53.884894 24698 consensus_queue.cc:1048] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.888264 24698 consensus_queue.cc:1048] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.888903 24516 ts_tablet_manager.cc:1434] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.143s	user 0.007s	sys 0.001s
I20260709 12:17:53.890097 24516 tablet_bootstrap.cc:492] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:53.893424 24514 tablet_bootstrap.cc:654] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.894582 24290 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:53.895975 24290 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:53.897080 24910 raft_consensus.cc:2804] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:53.897411 24910 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.897712 24910 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:53.907552 24271 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:53.927578 24317 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
I20260709 12:17:53.954378 24698 raft_consensus.cc:2749] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:53.939729 24967 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.974321 24515 tablet_bootstrap.cc:492] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3: No bootstrap required, opened a new log
I20260709 12:17:53.974891 24515 ts_tablet_manager.cc:1403] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent bootstrapping tablet: real 0.508s	user 0.013s	sys 0.018s
I20260709 12:17:53.983022 24698 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.983565 24698 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:54.031893 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:54.032977 24321 raft_consensus.cc:2393] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 1: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:17:54.080868 24698 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:53.960021 24967 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:54.082504 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:54.055197 24923 consensus_queue.cc:1048] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 12:17:54.097327 24471 raft_consensus.cc:2393] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 1: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:17:54.087826 24914 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.100658 24914 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:54.101759 24516 tablet_bootstrap.cc:654] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.101082 24910 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:17:54.109511 24978 log.cc:927] Time spent T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:17:54.109776 24515 raft_consensus.cc:359] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:54.110559 24515 raft_consensus.cc:385] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.110837 24515 raft_consensus.cc:740] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.111603 24515 consensus_queue.cc:260] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:54.115269 24515 ts_tablet_manager.cc:1434] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent starting tablet: real 0.140s	user 0.005s	sys 0.001s
I20260709 12:17:54.115521 24967 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:54.123857 24910 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:54.137686 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:54.138074 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:54.138971 24473 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 0.
W20260709 12:17:54.145149 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 194444us
I20260709 12:17:54.146605 24514 tablet_bootstrap.cc:492] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:54.153206 24514 ts_tablet_manager.cc:1403] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.421s	user 0.021s	sys 0.010s
I20260709 12:17:54.164978 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:54.177523 24914 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:54.184547 24440 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:54.187530 24915 raft_consensus.cc:2749] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:54.210628 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:54.211473 24471 raft_consensus.cc:2468] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 0.
W20260709 12:17:54.212119 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 228820us
W20260709 12:17:54.214581 24289 leader_election.cc:343] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:54.233270 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:54.235136 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:17:54.244691 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 102123us
I20260709 12:17:54.255505 24290 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:54.252326 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:54.265451 24319 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 0.
I20260709 12:17:54.272874 24981 consensus_queue.cc:1048] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:17:54.288731 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:54.289394 24472 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.291244 24365 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:17:54.294586 24289 leader_election.cc:343] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:54.282337 24981 raft_consensus.cc:2804] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:54.295928 24981 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:54.296056 24289 leader_election.cc:343] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:54.296608 24981 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.296643 24917 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:54.297220 24917 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.280185 24223 catalog_manager.cc:5697] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
W20260709 12:17:54.295871 24440 consensus_peers.cc:597] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:54.300304 24472 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:17:54.302119 24440 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
W20260709 12:17:54.312099 24440 consensus_peers.cc:597] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:54.315421 24969 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:54.315908 24969 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.316256 24969 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.301659 24917 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.301420 24909 consensus_queue.cc:1048] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:17:54.298645 24914 consensus_queue.cc:1048] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:17:54.324409 24514 raft_consensus.cc:359] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:54.333827 24514 raft_consensus.cc:385] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.334441 24290 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:54.306906 24366 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:17:54.334152 24514 raft_consensus.cc:740] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.343618 24914 raft_consensus.cc:2804] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:54.344885 24918 raft_consensus.cc:2804] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:54.345386 24918 raft_consensus.cc:697] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:17:54.350332 24914 raft_consensus.cc:697] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:17:54.350520 24990 consensus_queue.cc:1048] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:54.384727 24516 tablet_bootstrap.cc:492] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:54.418828 24516 ts_tablet_manager.cc:1403] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.529s	user 0.013s	sys 0.028s
I20260709 12:17:54.362865 24514 consensus_queue.cc:260] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:17:54.420449 24366 leader_election.cc:343] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:54.444305 24917 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:54.472705 24514 ts_tablet_manager.cc:1434] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.318s	user 0.011s	sys 0.006s
I20260709 12:17:54.361716 24918 consensus_queue.cc:237] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:54.351547 24914 consensus_queue.cc:237] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:54.518568 24514 tablet_bootstrap.cc:492] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:54.492691 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:54.521610 24969 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:54.624184 24516 raft_consensus.cc:359] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:54.625080 24516 raft_consensus.cc:385] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.625362 24516 raft_consensus.cc:740] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.628357 24516 consensus_queue.cc:260] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:54.635957 24516 ts_tablet_manager.cc:1434] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.217s	user 0.010s	sys 0.000s
W20260709 12:17:54.677790 24438 leader_election.cc:343] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:54.705140 24516 tablet_bootstrap.cc:492] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:54.636337 24981 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:54.718554 24917 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:17:54.741019 25000 log.cc:927] Time spent T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:17:54.744939 24971 consensus_queue.cc:1048] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.054s
I20260709 12:17:54.747999 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:54.748859 24470 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.753226 24969 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:54.757961 24981 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:54.770294 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:17:54.788373 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 75278.7us
W20260709 12:17:54.792596 24289 leader_election.cc:343] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:54.828604 24514 tablet_bootstrap.cc:654] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:54.865526 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 81658.8us
I20260709 12:17:54.881125 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:54.881842 24323 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.882720 24516 tablet_bootstrap.cc:654] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.903730 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:17:54.934350 24469 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.929210 24470 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
I20260709 12:17:54.982838 24365 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:17:54.986021 24993 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:54.986649 24993 raft_consensus.cc:697] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:17:55.048800 25006 log.cc:927] Time spent T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:17:55.073220 24323 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:17:54.987774 24993 consensus_queue.cc:237] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:55.093621 24514 tablet_bootstrap.cc:492] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:55.094168 24514 ts_tablet_manager.cc:1403] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.605s	user 0.038s	sys 0.033s
I20260709 12:17:55.105610 24698 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.106393 24698 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:55.109127 24698 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:55.128832 24992 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.129559 24992 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:55.145572 24514 raft_consensus.cc:359] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:55.146366 24514 raft_consensus.cc:385] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:55.146606 24514 raft_consensus.cc:740] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:55.147183 24514 consensus_queue.cc:260] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:55.154150 24514 ts_tablet_manager.cc:1434] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.060s	user 0.011s	sys 0.002s
I20260709 12:17:55.151647 24469 raft_consensus.cc:2468] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
W20260709 12:17:55.158015 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 175307us
I20260709 12:17:55.152324 24992 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:55.169734 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:55.170949 24468 raft_consensus.cc:2393] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 1: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:17:55.176461 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 216085us
W20260709 12:17:55.187605 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 203059us
W20260709 12:17:55.339247 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 62157.4us
I20260709 12:17:55.468372 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:55.484522 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:55.515897 24366 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:17:55.519062 24271 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:55.522727 24516 tablet_bootstrap.cc:492] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:55.523370 24516 ts_tablet_manager.cc:1403] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.832s	user 0.020s	sys 0.017s
I20260709 12:17:55.524437 24856 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:55.531893 24516 raft_consensus.cc:359] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:55.536221 24516 raft_consensus.cc:385] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:55.536496 24516 raft_consensus.cc:740] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:55.544598 24516 consensus_queue.cc:260] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:55.546342 24516 ts_tablet_manager.cc:1434] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 12:17:55.543562 24856 raft_consensus.cc:2749] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:55.552211 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:17:55.553088 24514 tablet_bootstrap.cc:492] T 5a08303c706b4fcda5778a1f60dc1915 P c711faa13ead43ebbea0192cb74a4756: Bootstrap starting.
I20260709 12:17:55.554898 24318 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:55.562043 24977 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:17:55.564093 24514 tablet_bootstrap.cc:654] T 5a08303c706b4fcda5778a1f60dc1915 P c711faa13ead43ebbea0192cb74a4756: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:55.560448 24221 catalog_manager.cc:5697] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 0 to 1, leader changed from <none> to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:55.565274 24516 tablet_bootstrap.cc:492] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:55.571570 24222 catalog_manager.cc:5697] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 0 to 1, leader changed from <none> to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:55.576865 24290 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:55.577956 24982 raft_consensus.cc:2804] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:55.578023 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:17:55.578562 24982 raft_consensus.cc:697] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:17:55.583873 24440 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:17:55.562706 24977 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:55.591838 24977 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:55.607465 25013 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:55.608409 25013 raft_consensus.cc:697] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:17:55.595458 24318 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
W20260709 12:17:55.601213 24438 leader_election.cc:343] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:55.618821 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:55.624965 24319 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:55.621331 25034 consensus_queue.cc:1048] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:17:55.633021 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:55.633983 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:55.635188 24474 raft_consensus.cc:2393] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 1: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:17:55.618512 24982 consensus_queue.cc:237] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:55.659569 24399 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:55.689980 24365 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:55.640794 25013 consensus_queue.cc:237] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:55.697120 25020 raft_consensus.cc:2749] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:55.689960 25017 consensus_queue.cc:1048] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:17:55.704169 25028 consensus_queue.cc:1048] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:55.717401 24290 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:55.718991 25030 raft_consensus.cc:2749] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:55.719573 25034 consensus_queue.cc:1048] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:55.786381 25020 consensus_queue.cc:1048] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:55.788360 24516 tablet_bootstrap.cc:654] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:55.816236 24514 tablet_bootstrap.cc:492] T 5a08303c706b4fcda5778a1f60dc1915 P c711faa13ead43ebbea0192cb74a4756: No bootstrap required, opened a new log
I20260709 12:17:55.845582 24514 ts_tablet_manager.cc:1403] T 5a08303c706b4fcda5778a1f60dc1915 P c711faa13ead43ebbea0192cb74a4756: Time spent bootstrapping tablet: real 0.293s	user 0.011s	sys 0.008s
I20260709 12:17:55.924985 24879 consensus_queue.cc:1048] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:55.926450 24514 raft_consensus.cc:359] T 5a08303c706b4fcda5778a1f60dc1915 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:55.928004 24514 raft_consensus.cc:385] T 5a08303c706b4fcda5778a1f60dc1915 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:55.928237 24514 raft_consensus.cc:740] T 5a08303c706b4fcda5778a1f60dc1915 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Initialized, Role: FOLLOWER
I20260709 12:17:55.937052 24514 consensus_queue.cc:260] T 5a08303c706b4fcda5778a1f60dc1915 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:55.947583 24514 ts_tablet_manager.cc:1434] T 5a08303c706b4fcda5778a1f60dc1915 P c711faa13ead43ebbea0192cb74a4756: Time spent starting tablet: real 0.098s	user 0.005s	sys 0.001s
I20260709 12:17:55.948547 24516 tablet_bootstrap.cc:492] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:55.949126 24516 ts_tablet_manager.cc:1403] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.384s	user 0.023s	sys 0.021s
I20260709 12:17:55.966739 24516 raft_consensus.cc:359] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:55.971611 24516 raft_consensus.cc:385] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:55.972908 24516 raft_consensus.cc:740] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:55.977486 24221 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54244 (request call id 94) took 1026 ms. Trace:
I20260709 12:17:55.978834 24221 rpcz_store.cc:276] 0709 12:17:54.969616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.975069 (+  5453us) service_pool.cc:224] Handling call
0709 12:17:55.977421 (+1002352us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:55.767651 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:55.795343 (+ 27692us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:55.795376 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:17:55.795393 (+    17us) tablet.cc:662] Decoding operations
0709 12:17:55.795725 (+   332us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:55.795775 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:55.795804 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:17:55.795988 (+   184us) tablet.cc:701] Row locks acquired
0709 12:17:55.796007 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:17:55.796141 (+   134us) write_op.cc:270] Start()
0709 12:17:55.796242 (+   101us) write_op.cc:276] Timestamp: P: 1783599475796102 usec, L: 0
0709 12:17:55.796260 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:17:55.796901 (+   641us) log.cc:844] Serialized 543 byte log entry
0709 12:17:55.910165 (+113264us) op_driver.cc:464] REPLICATION: finished
0709 12:17:55.961562 (+ 51397us) write_op.cc:301] APPLY: starting
0709 12:17:55.962844 (+  1282us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:55.962960 (+   116us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:55.963268 (+   308us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:55.963519 (+   251us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:55.963695 (+   176us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:17:55.963748 (+    53us) write_op.cc:312] APPLY: finished
0709 12:17:55.963946 (+   198us) log.cc:844] Serialized 22 byte log entry
0709 12:17:55.968608 (+  4662us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:55.970519 (+  1911us) write_op.cc:454] Released schema lock
0709 12:17:55.970557 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:55.971303 (+   746us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:55.971346 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":234099,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":47102,"apply.run_cpu_time_us":2045,"apply.run_wall_time_us":13771,"num_ops":1,"prepare.queue_time_us":168377,"prepare.run_cpu_time_us":8208,"prepare.run_wall_time_us":71666,"raft.queue_time_us":151918,"raft.run_cpu_time_us":20109,"raft.run_wall_time_us":47163,"replication_time_us":113778,"thread_start_us":162823,"threads_started":4,"wal-append.queue_time_us":38122}]]}
I20260709 12:17:55.991276 24516 consensus_queue.cc:260] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:55.999365 24516 ts_tablet_manager.cc:1434] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.003s
I20260709 12:17:56.008894 24220 catalog_manager.cc:5697] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 0 to 1, leader changed from <none> to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:56.010694 24220 catalog_manager.cc:5697] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 0 to 1, leader changed from <none> to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:17:56.020820 24516 tablet_bootstrap.cc:492] T 01bd4c6351f24e35abba86aef1ce23be P c855242ec9d34a5397741ef20db9de8a: Bootstrap starting.
I20260709 12:17:56.024187 25034 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.025009 25034 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:56.027431 25034 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:56.028726 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:56.031123 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:17:56.035729 24516 tablet_bootstrap.cc:654] T 01bd4c6351f24e35abba86aef1ce23be P c855242ec9d34a5397741ef20db9de8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:56.040647 24289 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:17:56.044449 24982 raft_consensus.cc:2749] T 5a08303c706b4fcda5778a1f60dc1915 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:56.066767 24516 tablet_bootstrap.cc:492] T 01bd4c6351f24e35abba86aef1ce23be P c855242ec9d34a5397741ef20db9de8a: No bootstrap required, opened a new log
I20260709 12:17:56.067239 24516 ts_tablet_manager.cc:1403] T 01bd4c6351f24e35abba86aef1ce23be P c855242ec9d34a5397741ef20db9de8a: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.007s
I20260709 12:17:56.071920 24516 raft_consensus.cc:359] T 01bd4c6351f24e35abba86aef1ce23be P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:56.073184 24516 raft_consensus.cc:385] T 01bd4c6351f24e35abba86aef1ce23be P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:56.073519 24516 raft_consensus.cc:740] T 01bd4c6351f24e35abba86aef1ce23be P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.074245 24516 consensus_queue.cc:260] T 01bd4c6351f24e35abba86aef1ce23be P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:56.076692 24516 ts_tablet_manager.cc:1434] T 01bd4c6351f24e35abba86aef1ce23be P c855242ec9d34a5397741ef20db9de8a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:17:56.096911 25028 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.097538 25028 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:17:56.100356 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:17:56.101670 25028 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:17:56.103457 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:17:56.104423 24471 raft_consensus.cc:2393] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 1: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:17:56.106736 24365 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:17:56.107645 25009 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:56.122174 25009 raft_consensus.cc:2749] T 01bd4c6351f24e35abba86aef1ce23be P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:56.123195 24221 catalog_manager.cc:5697] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:56.130995 24317 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P c711faa13ead43ebbea0192cb74a4756 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:56.152477 25034 consensus_queue.cc:1048] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:56.161674 24400 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:56.174582 25016 consensus_queue.cc:1048] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:56.233978 24915 consensus_queue.cc:1048] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:56.249989 25034 consensus_queue.cc:1048] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:57.883817 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:57.907555 25073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:57.917826 25072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:57.928478 25075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:57.939162 23151 server_base.cc:1061] running on GCE node
I20260709 12:17:57.940977 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:57.941308 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:57.941568 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599477941550 us; error 0 us; skew 500 ppm
I20260709 12:17:57.942215 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:57.948858 23151 webserver.cc:533] Webserver started at http://127.22.155.196:41353/ using document root <none> and password file <none>
I20260709 12:17:57.949425 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:57.949644 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:57.950006 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:57.951368 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-3-root/instance:
uuid: "d99d5d772cfe4a96afcab3d3b009a281"
format_stamp: "Formatted at 2026-07-09 12:17:57 on dist-test-slave-p7fg"
I20260709 12:17:57.957871 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.003s
I20260709 12:17:57.961903 25080 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:57.963016 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:17:57.963544 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-3-root
uuid: "d99d5d772cfe4a96afcab3d3b009a281"
format_stamp: "Formatted at 2026-07-09 12:17:57 on dist-test-slave-p7fg"
I20260709 12:17:57.963989 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:58.024375 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:58.026355 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:58.028839 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:58.032825 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:58.033208 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:58.033550 23151 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:58.033803 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:58.229012 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.196:35511
I20260709 12:17:58.229096 25143 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.196:35511 every 8 connection(s)
I20260709 12:17:58.238474 23151 auto_leader_rebalancer-test.cc:439] add a tserver: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:17:58.262775 25144 heartbeater.cc:344] Connected to a master server at 127.22.155.254:34311
I20260709 12:17:58.263306 25144 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:58.264219 25144 heartbeater.cc:507] Master 127.22.155.254:34311 requested a full tablet report, sending...
I20260709 12:17:58.266501 24223 ts_manager.cc:194] Registered new tserver with Master: d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:17:58.268383 24223 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35986
I20260709 12:17:58.763067 24317 consensus_queue.cc:237] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:17:58.773283 24468 raft_consensus.cc:1275] T d9034e708c454259aebd10b80eeab667 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:58.775375 24400 raft_consensus.cc:1275] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:58.775835 25030 consensus_queue.cc:1048] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:58.777416 25034 consensus_queue.cc:1048] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:17:58.796000 25154 raft_consensus.cc:2955] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:17:58.806193 24471 raft_consensus.cc:2955] T d9034e708c454259aebd10b80eeab667 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
W20260709 12:17:58.820422 24291 consensus_peers.cc:597] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d9034e708c454259aebd10b80eeab667. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:58.829118 24400 raft_consensus.cc:2955] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:17:58.830862 24317 consensus_queue.cc:237] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:17:58.838933 24223 catalog_manager.cc:5697] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:58.863472 24291 consensus_peers.cc:597] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 72fa7cd50b4c4a12af95a9accb7dd947. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:58.868484 24470 raft_consensus.cc:1275] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:58.868475 24400 raft_consensus.cc:1275] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:58.870362 25030 consensus_queue.cc:1048] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:58.871268 25154 consensus_queue.cc:1048] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:58.896009 25030 raft_consensus.cc:2955] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:17:58.898574 24400 raft_consensus.cc:2955] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:17:58.924410 24471 raft_consensus.cc:2955] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:17:58.972692 24222 catalog_manager.cc:5697] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:58.973681 24395 consensus_queue.cc:237] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:17:59.027882 24471 raft_consensus.cc:1275] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:59.029769 25148 consensus_queue.cc:1048] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:17:59.040342 24317 raft_consensus.cc:1275] T 0ff0373496af48a585a7d6ceab63908f P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:59.043671 25148 consensus_queue.cc:1048] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:17:59.052379 25107 raft_consensus.cc:2955] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:17:59.054688 24470 raft_consensus.cc:2955] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
W20260709 12:17:59.061231 24366 consensus_peers.cc:597] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0ff0373496af48a585a7d6ceab63908f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:59.065382 24317 raft_consensus.cc:2955] T 0ff0373496af48a585a7d6ceab63908f P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:17:59.078608 24221 catalog_manager.cc:5697] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:17:59.113492 24317 consensus_queue.cc:237] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
W20260709 12:17:59.131371 24291 consensus_peers.cc:597] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 36992a1e3818480c9a2705bd569f099a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:59.139267 24470 raft_consensus.cc:1275] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:59.140578 25030 consensus_queue.cc:1048] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:59.144094 24400 raft_consensus.cc:1275] T 36992a1e3818480c9a2705bd569f099a P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:59.153966 25154 consensus_queue.cc:1048] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:59.174554 25159 raft_consensus.cc:2955] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:17:59.177023 24395 raft_consensus.cc:2955] T 36992a1e3818480c9a2705bd569f099a P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:17:59.197592 24223 catalog_manager.cc:5697] T 36992a1e3818480c9a2705bd569f099a P c855242ec9d34a5397741ef20db9de8a reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:17:59.220351 24470 raft_consensus.cc:2955] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:17:59.271126 25144 heartbeater.cc:499] Master 127.22.155.254:34311 was elected leader, sending a full tablet report...
I20260709 12:17:59.300961 25175 ts_tablet_manager.cc:933] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:17:59.310137 25175 tablet_copy_client.cc:323] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.193:36951
I20260709 12:17:59.343624 24335 tablet_copy_service.cc:140] P c711faa13ead43ebbea0192cb74a4756: Received BeginTabletCopySession request for tablet d9034e708c454259aebd10b80eeab667 from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:57702)
I20260709 12:17:59.344231 24335 tablet_copy_service.cc:161] P c711faa13ead43ebbea0192cb74a4756: Beginning new tablet copy session on tablet d9034e708c454259aebd10b80eeab667 from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:57702: session id = d99d5d772cfe4a96afcab3d3b009a281-d9034e708c454259aebd10b80eeab667
I20260709 12:17:59.350916 24335 tablet_copy_source_session.cc:215] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:59.354390 25175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9034e708c454259aebd10b80eeab667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:59.373744 25175 tablet_copy_client.cc:806] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:59.374433 25175 tablet_copy_client.cc:670] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:59.379670 25175 tablet_copy_client.cc:538] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:59.395531 25175 tablet_bootstrap.cc:492] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:17:59.402619 25179 ts_tablet_manager.cc:933] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:17:59.433015 25179 tablet_copy_client.cc:323] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.193:36951
I20260709 12:17:59.435431 24335 tablet_copy_service.cc:140] P c711faa13ead43ebbea0192cb74a4756: Received BeginTabletCopySession request for tablet 72fa7cd50b4c4a12af95a9accb7dd947 from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:57702)
I20260709 12:17:59.436033 24335 tablet_copy_service.cc:161] P c711faa13ead43ebbea0192cb74a4756: Beginning new tablet copy session on tablet 72fa7cd50b4c4a12af95a9accb7dd947 from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:57702: session id = d99d5d772cfe4a96afcab3d3b009a281-72fa7cd50b4c4a12af95a9accb7dd947
I20260709 12:17:59.436681 25175 tablet_bootstrap.cc:492] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:59.437918 25175 tablet_bootstrap.cc:492] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:17:59.438709 25175 ts_tablet_manager.cc:1403] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.043s	user 0.021s	sys 0.008s
I20260709 12:17:59.442250 25175 raft_consensus.cc:359] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:17:59.443270 25175 raft_consensus.cc:740] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:17:59.444028 25175 consensus_queue.cc:260] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:17:59.463366 25175 ts_tablet_manager.cc:1434] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.016s
I20260709 12:17:59.465556 24334 tablet_copy_service.cc:342] P c711faa13ead43ebbea0192cb74a4756: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-d9034e708c454259aebd10b80eeab667 received from {username='slave'} at 127.0.0.1:57702
I20260709 12:17:59.466099 24334 tablet_copy_service.cc:434] P c711faa13ead43ebbea0192cb74a4756: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-d9034e708c454259aebd10b80eeab667 on tablet d9034e708c454259aebd10b80eeab667 with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:17:59.466761 24335 tablet_copy_source_session.cc:215] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:59.472368 25179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72fa7cd50b4c4a12af95a9accb7dd947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:59.493026 25179 tablet_copy_client.cc:806] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:59.493698 25179 tablet_copy_client.cc:670] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:59.500855 25179 tablet_copy_client.cc:538] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:59.531281 25179 tablet_bootstrap.cc:492] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:17:59.565884 25179 tablet_bootstrap.cc:492] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:59.567039 25179 tablet_bootstrap.cc:492] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:17:59.567895 25179 ts_tablet_manager.cc:1403] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.037s	user 0.026s	sys 0.008s
I20260709 12:17:59.570793 25179 raft_consensus.cc:359] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:17:59.571705 25179 raft_consensus.cc:740] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:17:59.572407 25179 consensus_queue.cc:260] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:17:59.579633 25179 ts_tablet_manager.cc:1434] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.003s
I20260709 12:17:59.587764 24335 tablet_copy_service.cc:342] P c711faa13ead43ebbea0192cb74a4756: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-72fa7cd50b4c4a12af95a9accb7dd947 received from {username='slave'} at 127.0.0.1:57702
I20260709 12:17:59.588223 24335 tablet_copy_service.cc:434] P c711faa13ead43ebbea0192cb74a4756: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-72fa7cd50b4c4a12af95a9accb7dd947 on tablet 72fa7cd50b4c4a12af95a9accb7dd947 with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:17:59.611758 25179 ts_tablet_manager.cc:933] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:17:59.625576 25179 tablet_copy_client.cc:323] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.194:35893
I20260709 12:17:59.647812 24410 tablet_copy_service.cc:140] P c855242ec9d34a5397741ef20db9de8a: Received BeginTabletCopySession request for tablet 0ff0373496af48a585a7d6ceab63908f from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:50950)
I20260709 12:17:59.648331 24410 tablet_copy_service.cc:161] P c855242ec9d34a5397741ef20db9de8a: Beginning new tablet copy session on tablet 0ff0373496af48a585a7d6ceab63908f from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:50950: session id = d99d5d772cfe4a96afcab3d3b009a281-0ff0373496af48a585a7d6ceab63908f
I20260709 12:17:59.661681 24410 tablet_copy_source_session.cc:215] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:59.684787 25175 ts_tablet_manager.cc:933] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:17:59.685628 25179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff0373496af48a585a7d6ceab63908f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:59.705431 25175 tablet_copy_client.cc:323] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.193:36951
I20260709 12:17:59.707582 24335 tablet_copy_service.cc:140] P c711faa13ead43ebbea0192cb74a4756: Received BeginTabletCopySession request for tablet 36992a1e3818480c9a2705bd569f099a from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:57702)
I20260709 12:17:59.708196 24335 tablet_copy_service.cc:161] P c711faa13ead43ebbea0192cb74a4756: Beginning new tablet copy session on tablet 36992a1e3818480c9a2705bd569f099a from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:57702: session id = d99d5d772cfe4a96afcab3d3b009a281-36992a1e3818480c9a2705bd569f099a
I20260709 12:17:59.728127 24335 tablet_copy_source_session.cc:215] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:59.732245 25175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36992a1e3818480c9a2705bd569f099a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:59.724355 25179 tablet_copy_client.cc:806] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:59.734607 25179 tablet_copy_client.cc:670] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:59.756138 25175 tablet_copy_client.cc:806] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:59.756927 25175 tablet_copy_client.cc:670] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:59.763089 25175 tablet_copy_client.cc:538] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:59.775535 25175 tablet_bootstrap.cc:492] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:17:59.781518 25119 raft_consensus.cc:1217] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:59.791026 25179 tablet_copy_client.cc:538] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:59.801785 25119 raft_consensus.cc:1217] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:59.818439 25179 tablet_bootstrap.cc:492] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:17:59.869033 25175 tablet_bootstrap.cc:492] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:59.870163 25175 tablet_bootstrap.cc:492] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:17:59.870937 25175 ts_tablet_manager.cc:1403] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.096s	user 0.025s	sys 0.005s
I20260709 12:17:59.874117 25175 raft_consensus.cc:359] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:17:59.874969 25175 raft_consensus.cc:740] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:17:59.875731 25175 consensus_queue.cc:260] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:17:59.884114 25179 tablet_bootstrap.cc:492] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:59.885335 25179 tablet_bootstrap.cc:492] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:17:59.886142 25179 ts_tablet_manager.cc:1403] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.068s	user 0.028s	sys 0.007s
I20260709 12:17:59.887230 25175 ts_tablet_manager.cc:1434] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.003s
I20260709 12:17:59.895814 24335 tablet_copy_service.cc:342] P c711faa13ead43ebbea0192cb74a4756: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-36992a1e3818480c9a2705bd569f099a received from {username='slave'} at 127.0.0.1:57702
I20260709 12:17:59.896282 24335 tablet_copy_service.cc:434] P c711faa13ead43ebbea0192cb74a4756: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-36992a1e3818480c9a2705bd569f099a on tablet 36992a1e3818480c9a2705bd569f099a with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:17:59.898470 25179 raft_consensus.cc:359] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:17:59.899475 25179 raft_consensus.cc:740] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:17:59.900164 25179 consensus_queue.cc:260] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:17:59.903226 25179 ts_tablet_manager.cc:1434] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.003s
I20260709 12:17:59.907687 24410 tablet_copy_service.cc:342] P c855242ec9d34a5397741ef20db9de8a: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-0ff0373496af48a585a7d6ceab63908f received from {username='slave'} at 127.0.0.1:50950
I20260709 12:17:59.908221 24410 tablet_copy_service.cc:434] P c855242ec9d34a5397741ef20db9de8a: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-0ff0373496af48a585a7d6ceab63908f on tablet 0ff0373496af48a585a7d6ceab63908f with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:00.033162 25119 raft_consensus.cc:1217] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:00.191584 25119 raft_consensus.cc:1217] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:00.401782 25154 raft_consensus.cc:1064] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:00.406267 25154 consensus_queue.cc:237] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:00.428346 24470 raft_consensus.cc:1275] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:00.429944 25030 consensus_queue.cc:1048] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:00.438194 25119 raft_consensus.cc:1275] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:00.447316 25030 raft_consensus.cc:1064] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:00.456566 25030 consensus_queue.cc:237] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:00.471417 25107 raft_consensus.cc:1064] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:00.474498 25107 consensus_queue.cc:237] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:00.499488 24400 raft_consensus.cc:1275] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:00.501315 25154 consensus_queue.cc:1048] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:00.538379 25191 raft_consensus.cc:2955] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:00.540611 25119 raft_consensus.cc:1275] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:00.548493 24474 raft_consensus.cc:1275] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:00.552073 25170 consensus_queue.cc:1048] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:00.554857 24395 raft_consensus.cc:2955] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:00.577867 24318 raft_consensus.cc:1275] T 0ff0373496af48a585a7d6ceab63908f P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:00.576810 24221 catalog_manager.cc:5697] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:00.579079 25170 consensus_queue.cc:1048] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:00.582134 25171 consensus_queue.cc:1048] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:00.597009 24397 raft_consensus.cc:1275] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:00.599977 25159 consensus_queue.cc:1048] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:00.603106 25118 raft_consensus.cc:1275] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:00.609467 25191 consensus_queue.cc:1048] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:00.611613 25191 consensus_queue.cc:1048] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:00.612432 24470 raft_consensus.cc:2955] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:00.627650 24471 raft_consensus.cc:1275] T d9034e708c454259aebd10b80eeab667 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:00.668965 25197 raft_consensus.cc:2955] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:00.670791 25154 consensus_queue.cc:1048] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:00.681429 24468 raft_consensus.cc:2955] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:00.694518 24323 raft_consensus.cc:2955] T 0ff0373496af48a585a7d6ceab63908f P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:00.737435 24221 catalog_manager.cc:5697] T 0ff0373496af48a585a7d6ceab63908f P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:00.711300 25193 raft_consensus.cc:2955] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:00.736274 25118 raft_consensus.cc:2955] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:00.736567 25119 raft_consensus.cc:2955] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:00.784415 25154 raft_consensus.cc:1064] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:00.806063 24397 raft_consensus.cc:2955] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:00.808547 24221 catalog_manager.cc:5697] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:00.820989 25154 consensus_queue.cc:237] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:00.842435 24323 consensus_queue.cc:237] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:00.859671 24395 raft_consensus.cc:1275] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:00.861348 25118 raft_consensus.cc:2955] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:00.865468 25191 consensus_queue.cc:1048] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:00.869791 25117 raft_consensus.cc:1275] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:00.910382 25193 consensus_queue.cc:1048] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:00.910964 24395 raft_consensus.cc:1275] T 36992a1e3818480c9a2705bd569f099a P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:00.915846 24474 raft_consensus.cc:1275] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:18:00.922860 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 101906us
I20260709 12:18:00.938354 25193 consensus_queue.cc:1048] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:00.952821 25193 consensus_queue.cc:1048] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:00.923805 25119 raft_consensus.cc:1275] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:00.968688 25154 raft_consensus.cc:2955] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:00.976653 25192 consensus_queue.cc:1048] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:00.986840 25119 raft_consensus.cc:2955] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:00.994918 24400 raft_consensus.cc:2955] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:01.043143 24395 consensus_queue.cc:237] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:01.049049 25118 raft_consensus.cc:1275] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:01.051213 25218 consensus_queue.cc:1048] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:01.052007 24474 raft_consensus.cc:1275] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:01.089845 24210 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d9034e708c454259aebd10b80eeab667 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:01.101572 24221 catalog_manager.cc:5697] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:01.112061 25211 consensus_queue.cc:1048] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:18:01.125061 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 70108.4us
I20260709 12:18:01.111177 25030 raft_consensus.cc:2955] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:01.141675 25198 raft_consensus.cc:2955] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:01.148185 25118 raft_consensus.cc:2955] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:01.200656 24461 tablet_service.cc:1558] Processing DeleteTablet for tablet d9034e708c454259aebd10b80eeab667 with delete_type TABLET_DATA_TOMBSTONED (TS 99b8650fa8324ac2ac5f75eee9b1a1e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33256
W20260709 12:18:01.203086 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 106663us
I20260709 12:18:01.205039 24474 raft_consensus.cc:2955] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:18:01.230712 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 43549us
I20260709 12:18:01.231009 24221 catalog_manager.cc:5697] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:01.236663 25119 raft_consensus.cc:2955] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:01.246807 24397 raft_consensus.cc:2955] T 36992a1e3818480c9a2705bd569f099a P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:01.271284 24208 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0ff0373496af48a585a7d6ceab63908f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:01.278374 24470 raft_consensus.cc:2955] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:01.335968 24308 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ff0373496af48a585a7d6ceab63908f with delete_type TABLET_DATA_TOMBSTONED (TS c711faa13ead43ebbea0192cb74a4756 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44272
I20260709 12:18:01.344872 24223 catalog_manager.cc:5697] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:01.366715 25225 tablet_replica.cc:333] T d9034e708c454259aebd10b80eeab667 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:18:01.397954 25226 tablet_replica.cc:333] T 0ff0373496af48a585a7d6ceab63908f P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:18:01.399566 25226 raft_consensus.cc:2243] T 0ff0373496af48a585a7d6ceab63908f P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.400496 25226 raft_consensus.cc:2272] T 0ff0373496af48a585a7d6ceab63908f P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.411051 24318 consensus_queue.cc:237] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:01.414574 24323 consensus_queue.cc:237] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:01.422976 25225 raft_consensus.cc:2243] T d9034e708c454259aebd10b80eeab667 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.424096 25225 pending_rounds.cc:70] T d9034e708c454259aebd10b80eeab667 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Trying to abort 1 pending ops.
I20260709 12:18:01.415688 25226 ts_tablet_manager.cc:1916] T 0ff0373496af48a585a7d6ceab63908f P c711faa13ead43ebbea0192cb74a4756: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:01.424459 25225 pending_rounds.cc:77] T d9034e708c454259aebd10b80eeab667 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305623471938502656 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "d9034e708c454259aebd10b80eeab667" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } } }
I20260709 12:18:01.427946 25225 raft_consensus.cc:2917] T d9034e708c454259aebd10b80eeab667 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:18:01.429260 24470 raft_consensus.cc:1275] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:01.429556 25225 raft_consensus.cc:2889] T d9034e708c454259aebd10b80eeab667 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:18:01.430361 25225 raft_consensus.cc:2272] T d9034e708c454259aebd10b80eeab667 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.433985 25118 raft_consensus.cc:1275] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:01.434798 25224 consensus_queue.cc:1048] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:01.429260 25119 raft_consensus.cc:1275] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:01.437041 25030 consensus_queue.cc:1048] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:01.441145 24470 raft_consensus.cc:1275] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:01.438472 25225 ts_tablet_manager.cc:1916] T d9034e708c454259aebd10b80eeab667 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:01.446556 25193 consensus_queue.cc:1048] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:01.452466 25192 raft_consensus.cc:2955] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:01.445400 25224 consensus_queue.cc:1048] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:18:01.470961 25191 raft_consensus.cc:2955] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:01.507937 25119 raft_consensus.cc:2955] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:01.514343 25226 ts_tablet_manager.cc:1929] T 0ff0373496af48a585a7d6ceab63908f P c711faa13ead43ebbea0192cb74a4756: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:01.515292 25226 log.cc:1199] T 0ff0373496af48a585a7d6ceab63908f P c711faa13ead43ebbea0192cb74a4756: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-0-root/wals/0ff0373496af48a585a7d6ceab63908f
I20260709 12:18:01.456840 25118 raft_consensus.cc:2955] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:01.490249 24470 raft_consensus.cc:2955] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:01.517549 24210 catalog_manager.cc:5028] TS c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): tablet 0ff0373496af48a585a7d6ceab63908f (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:01.539826 24220 catalog_manager.cc:5697] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:01.546020 25225 ts_tablet_manager.cc:1929] T d9034e708c454259aebd10b80eeab667 P 99b8650fa8324ac2ac5f75eee9b1a1e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:01.546517 25225 log.cc:1199] T d9034e708c454259aebd10b80eeab667 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-2-root/wals/d9034e708c454259aebd10b80eeab667
I20260709 12:18:01.548775 24209 catalog_manager.cc:5028] TS 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): tablet d9034e708c454259aebd10b80eeab667 (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:01.553215 24383 tablet_service.cc:1558] Processing DeleteTablet for tablet 36992a1e3818480c9a2705bd569f099a with delete_type TABLET_DATA_TOMBSTONED (TS c855242ec9d34a5397741ef20db9de8a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51466
I20260709 12:18:01.553997 24466 raft_consensus.cc:2955] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:01.572239 24220 catalog_manager.cc:5697] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:01.577425 25227 tablet_replica.cc:333] T 36992a1e3818480c9a2705bd569f099a P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:18:01.578929 25227 raft_consensus.cc:2243] T 36992a1e3818480c9a2705bd569f099a P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.579705 25227 raft_consensus.cc:2272] T 36992a1e3818480c9a2705bd569f099a P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.585892 25227 ts_tablet_manager.cc:1916] T 36992a1e3818480c9a2705bd569f099a P c855242ec9d34a5397741ef20db9de8a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:01.586952 24383 tablet_service.cc:1558] Processing DeleteTablet for tablet 72fa7cd50b4c4a12af95a9accb7dd947 with delete_type TABLET_DATA_TOMBSTONED (TS c855242ec9d34a5397741ef20db9de8a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51466
I20260709 12:18:01.606238 24210 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 72fa7cd50b4c4a12af95a9accb7dd947 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:01.609295 24210 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 36992a1e3818480c9a2705bd569f099a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:01.639362 25227 ts_tablet_manager.cc:1929] T 36992a1e3818480c9a2705bd569f099a P c855242ec9d34a5397741ef20db9de8a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:01.640034 25227 log.cc:1199] T 36992a1e3818480c9a2705bd569f099a P c855242ec9d34a5397741ef20db9de8a: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-1-root/wals/36992a1e3818480c9a2705bd569f099a
I20260709 12:18:01.642916 24208 catalog_manager.cc:5028] TS c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): tablet 36992a1e3818480c9a2705bd569f099a (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:01.643896 25227 tablet_replica.cc:333] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:18:01.645089 25227 raft_consensus.cc:2243] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.646238 25227 raft_consensus.cc:2272] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.649469 25227 ts_tablet_manager.cc:1916] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:01.667702 25227 ts_tablet_manager.cc:1929] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:01.668331 25227 log.cc:1199] T 72fa7cd50b4c4a12af95a9accb7dd947 P c855242ec9d34a5397741ef20db9de8a: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-1-root/wals/72fa7cd50b4c4a12af95a9accb7dd947
I20260709 12:18:01.670122 24208 catalog_manager.cc:5028] TS c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): tablet 72fa7cd50b4c4a12af95a9accb7dd947 (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:02.670238 24319 consensus_queue.cc:237] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
W20260709 12:18:02.679699 24291 consensus_peers.cc:597] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3f669315af0d426da28d57b462979ebd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:02.680254 24398 raft_consensus.cc:1275] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:02.683720 25159 consensus_queue.cc:1048] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:02.683988 24466 raft_consensus.cc:1275] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:02.696099 25159 consensus_queue.cc:1048] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:02.698910 25159 raft_consensus.cc:2955] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:02.701944 24398 raft_consensus.cc:2955] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:02.748703 24470 raft_consensus.cc:2955] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:02.751579 24223 catalog_manager.cc:5697] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:02.773815 24470 consensus_queue.cc:237] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:02.794729 24395 raft_consensus.cc:1275] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:02.803594 24319 raft_consensus.cc:1275] T f8dc8357b0c947d9a0f16daa0f4210aa P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:02.806195 25223 consensus_queue.cc:1048] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:02.809792 25232 consensus_queue.cc:1048] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:18:02.831148 24440 consensus_peers.cc:597] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f8dc8357b0c947d9a0f16daa0f4210aa. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:02.831420 25223 raft_consensus.cc:2955] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:02.833432 24319 raft_consensus.cc:2955] T f8dc8357b0c947d9a0f16daa0f4210aa P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:02.833760 24397 raft_consensus.cc:2955] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:02.851308 24398 consensus_queue.cc:237] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:02.858536 24221 catalog_manager.cc:5697] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:02.875428 24470 raft_consensus.cc:1275] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:02.876763 24318 raft_consensus.cc:1275] T daeed7cb347a434082488f5c5807424b P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:18:02.876602 24366 consensus_peers.cc:597] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: daeed7cb347a434082488f5c5807424b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:02.878602 25228 consensus_queue.cc:1048] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:02.879958 25171 consensus_queue.cc:1048] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:02.900992 25247 raft_consensus.cc:2955] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:02.902657 24470 raft_consensus.cc:2955] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:02.914717 24319 raft_consensus.cc:2955] T daeed7cb347a434082488f5c5807424b P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:02.922436 24223 catalog_manager.cc:5697] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:02.930349 24323 consensus_queue.cc:237] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:02.942553 24466 raft_consensus.cc:1275] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:02.944240 24397 raft_consensus.cc:1275] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:02.944082 25191 consensus_queue.cc:1048] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:18:02.945133 24291 consensus_peers.cc:597] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9e8cc498654c4fde9917eeb605fdc906. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:02.947021 25191 consensus_queue.cc:1048] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:02.960309 25230 raft_consensus.cc:2955] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:02.962222 24397 raft_consensus.cc:2955] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:02.966395 24466 raft_consensus.cc:2955] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:02.979779 24223 catalog_manager.cc:5697] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:03.273644 25253 ts_tablet_manager.cc:933] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:03.275655 25253 tablet_copy_client.cc:323] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.194:35893
I20260709 12:18:03.277820 24410 tablet_copy_service.cc:140] P c855242ec9d34a5397741ef20db9de8a: Received BeginTabletCopySession request for tablet daeed7cb347a434082488f5c5807424b from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:50950)
I20260709 12:18:03.278488 24410 tablet_copy_service.cc:161] P c855242ec9d34a5397741ef20db9de8a: Beginning new tablet copy session on tablet daeed7cb347a434082488f5c5807424b from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:50950: session id = d99d5d772cfe4a96afcab3d3b009a281-daeed7cb347a434082488f5c5807424b
I20260709 12:18:03.286736 24410 tablet_copy_source_session.cc:215] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:03.290933 25253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daeed7cb347a434082488f5c5807424b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.308756 25253 tablet_copy_client.cc:806] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:03.309495 25253 tablet_copy_client.cc:670] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:03.314136 25253 tablet_copy_client.cc:538] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:03.325626 25255 ts_tablet_manager.cc:933] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:18:03.327355 25253 tablet_bootstrap.cc:492] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:18:03.338194 25255 tablet_copy_client.cc:323] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.193:36951
I20260709 12:18:03.340823 24335 tablet_copy_service.cc:140] P c711faa13ead43ebbea0192cb74a4756: Received BeginTabletCopySession request for tablet 3f669315af0d426da28d57b462979ebd from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:57702)
I20260709 12:18:03.341379 24335 tablet_copy_service.cc:161] P c711faa13ead43ebbea0192cb74a4756: Beginning new tablet copy session on tablet 3f669315af0d426da28d57b462979ebd from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:57702: session id = d99d5d772cfe4a96afcab3d3b009a281-3f669315af0d426da28d57b462979ebd
I20260709 12:18:03.355383 24335 tablet_copy_source_session.cc:215] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:03.360432 25255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f669315af0d426da28d57b462979ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.365839 25253 tablet_bootstrap.cc:492] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:03.366933 25253 tablet_bootstrap.cc:492] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:03.371556 25253 ts_tablet_manager.cc:1403] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.044s	user 0.020s	sys 0.010s
I20260709 12:18:03.375507 25253 raft_consensus.cc:359] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:03.376477 25253 raft_consensus.cc:740] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:03.377233 25253 consensus_queue.cc:260] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:03.378436 25257 ts_tablet_manager.cc:933] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:03.390537 25253 ts_tablet_manager.cc:1434] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.007s
I20260709 12:18:03.393266 24410 tablet_copy_service.cc:342] P c855242ec9d34a5397741ef20db9de8a: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-daeed7cb347a434082488f5c5807424b received from {username='slave'} at 127.0.0.1:50950
I20260709 12:18:03.393843 24410 tablet_copy_service.cc:434] P c855242ec9d34a5397741ef20db9de8a: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-daeed7cb347a434082488f5c5807424b on tablet daeed7cb347a434082488f5c5807424b with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:03.396713 25257 tablet_copy_client.cc:323] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.195:44453
I20260709 12:18:03.401283 25255 tablet_copy_client.cc:806] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:03.401970 25255 tablet_copy_client.cc:670] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:03.406371 25255 tablet_copy_client.cc:538] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:03.415516 25255 tablet_bootstrap.cc:492] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:18:03.445513 24484 tablet_copy_service.cc:140] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Received BeginTabletCopySession request for tablet f8dc8357b0c947d9a0f16daa0f4210aa from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:33198)
I20260709 12:18:03.446214 24484 tablet_copy_service.cc:161] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Beginning new tablet copy session on tablet f8dc8357b0c947d9a0f16daa0f4210aa from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:33198: session id = d99d5d772cfe4a96afcab3d3b009a281-f8dc8357b0c947d9a0f16daa0f4210aa
I20260709 12:18:03.455552 24484 tablet_copy_source_session.cc:215] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:03.457034 25255 tablet_bootstrap.cc:492] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:03.459822 25257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8dc8357b0c947d9a0f16daa0f4210aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.465858 25255 tablet_bootstrap.cc:492] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:03.466475 25255 ts_tablet_manager.cc:1403] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.012s
I20260709 12:18:03.470166 25255 raft_consensus.cc:359] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:03.471100 25255 raft_consensus.cc:740] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:03.471673 25255 consensus_queue.cc:260] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:03.473896 25255 ts_tablet_manager.cc:1434] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:18:03.475812 24335 tablet_copy_service.cc:342] P c711faa13ead43ebbea0192cb74a4756: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-3f669315af0d426da28d57b462979ebd received from {username='slave'} at 127.0.0.1:57702
I20260709 12:18:03.476270 24335 tablet_copy_service.cc:434] P c711faa13ead43ebbea0192cb74a4756: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-3f669315af0d426da28d57b462979ebd on tablet 3f669315af0d426da28d57b462979ebd with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:03.482266 25257 tablet_copy_client.cc:806] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:03.482949 25257 tablet_copy_client.cc:670] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:03.487741 25257 tablet_copy_client.cc:538] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:03.496558 25257 tablet_bootstrap.cc:492] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:18:03.514357 25257 tablet_bootstrap.cc:492] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:03.515216 25257 tablet_bootstrap.cc:492] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:03.515792 25257 ts_tablet_manager.cc:1403] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.004s
I20260709 12:18:03.518210 25257 raft_consensus.cc:359] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:03.519073 25257 raft_consensus.cc:740] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:03.519748 25257 consensus_queue.cc:260] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:03.520995 25255 ts_tablet_manager.cc:933] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:18:03.522190 25257 ts_tablet_manager.cc:1434] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:18:03.527803 25255 tablet_copy_client.cc:323] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.193:36951
I20260709 12:18:03.529018 24484 tablet_copy_service.cc:342] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-f8dc8357b0c947d9a0f16daa0f4210aa received from {username='slave'} at 127.0.0.1:33198
I20260709 12:18:03.529507 24484 tablet_copy_service.cc:434] P 99b8650fa8324ac2ac5f75eee9b1a1e3: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-f8dc8357b0c947d9a0f16daa0f4210aa on tablet f8dc8357b0c947d9a0f16daa0f4210aa with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:03.531802 24335 tablet_copy_service.cc:140] P c711faa13ead43ebbea0192cb74a4756: Received BeginTabletCopySession request for tablet 9e8cc498654c4fde9917eeb605fdc906 from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:57702)
I20260709 12:18:03.532362 24335 tablet_copy_service.cc:161] P c711faa13ead43ebbea0192cb74a4756: Beginning new tablet copy session on tablet 9e8cc498654c4fde9917eeb605fdc906 from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:57702: session id = d99d5d772cfe4a96afcab3d3b009a281-9e8cc498654c4fde9917eeb605fdc906
I20260709 12:18:03.540735 24335 tablet_copy_source_session.cc:215] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:03.544595 25255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e8cc498654c4fde9917eeb605fdc906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.558828 25255 tablet_copy_client.cc:806] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:03.559533 25255 tablet_copy_client.cc:670] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:03.565311 25255 tablet_copy_client.cc:538] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:03.575477 25255 tablet_bootstrap.cc:492] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:18:03.603672 25255 tablet_bootstrap.cc:492] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:03.604789 25255 tablet_bootstrap.cc:492] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:03.605515 25255 ts_tablet_manager.cc:1403] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.010s
I20260709 12:18:03.608554 25255 raft_consensus.cc:359] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:03.609434 25255 raft_consensus.cc:740] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:03.610088 25255 consensus_queue.cc:260] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:03.612444 25255 ts_tablet_manager.cc:1434] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:18:03.614374 24335 tablet_copy_service.cc:342] P c711faa13ead43ebbea0192cb74a4756: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-9e8cc498654c4fde9917eeb605fdc906 received from {username='slave'} at 127.0.0.1:57702
I20260709 12:18:03.614840 24335 tablet_copy_service.cc:434] P c711faa13ead43ebbea0192cb74a4756: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-9e8cc498654c4fde9917eeb605fdc906 on tablet 9e8cc498654c4fde9917eeb605fdc906 with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:03.890312 25118 raft_consensus.cc:1217] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:03.924602 25118 raft_consensus.cc:1217] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:03.941628 25118 raft_consensus.cc:1217] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:04.114763 25118 raft_consensus.cc:1217] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:04.376258 25232 raft_consensus.cc:1064] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:04.378477 25232 consensus_queue.cc:237] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:04.387177 24398 raft_consensus.cc:1275] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:04.388154 25118 raft_consensus.cc:1275] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:04.391932 25263 consensus_queue.cc:1048] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:04.388386 24318 raft_consensus.cc:1275] T f8dc8357b0c947d9a0f16daa0f4210aa P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:04.393085 25209 consensus_queue.cc:1048] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:04.395129 25269 consensus_queue.cc:1048] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:04.399123 25159 raft_consensus.cc:1064] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:04.401609 25159 consensus_queue.cc:237] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:04.455638 25119 raft_consensus.cc:1275] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:04.471300 25228 raft_consensus.cc:1064] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:04.475136 25118 raft_consensus.cc:2955] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:04.491918 25273 consensus_queue.cc:1048] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:04.480851 25270 raft_consensus.cc:2955] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:04.511289 24223 catalog_manager.cc:5697] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:04.474987 25228 consensus_queue.cc:237] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:04.558346 24400 raft_consensus.cc:2955] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:18:04.579438 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 144988us
W20260709 12:18:04.581148 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 152824us
W20260709 12:18:04.582260 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 72630us
W20260709 12:18:04.656025 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 84199.6us
I20260709 12:18:04.666394 24325 raft_consensus.cc:2955] T f8dc8357b0c947d9a0f16daa0f4210aa P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:04.700263 24470 raft_consensus.cc:1275] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:04.704667 24323 raft_consensus.cc:1275] T daeed7cb347a434082488f5c5807424b P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:04.703516 25118 raft_consensus.cc:1275] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:04.708464 24466 consensus_queue.cc:237] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:04.710547 25230 raft_consensus.cc:1064] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:04.716956 25230 consensus_queue.cc:237] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:04.726179 24400 raft_consensus.cc:1275] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:04.732188 25118 raft_consensus.cc:1275] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:04.734970 25224 consensus_queue.cc:1048] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:04.749351 25279 consensus_queue.cc:1048] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:04.754143 25288 consensus_queue.cc:1048] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:04.757928 25279 consensus_queue.cc:1048] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:04.760788 24470 raft_consensus.cc:1275] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:04.775664 24474 raft_consensus.cc:1275] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:04.794147 25274 consensus_queue.cc:1048] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:04.793689 24397 raft_consensus.cc:1275] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:04.801259 25159 consensus_queue.cc:1048] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:04.819773 25119 raft_consensus.cc:1275] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:04.831041 25274 consensus_queue.cc:1048] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:18:04.838248 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 45925.6us
I20260709 12:18:04.842056 25263 consensus_queue.cc:1048] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:04.851341 25209 raft_consensus.cc:2955] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:04.864038 25118 raft_consensus.cc:2955] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:18:04.873865 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 71805.9us
I20260709 12:18:04.875453 25273 consensus_queue.cc:1048] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:04.876060 24398 raft_consensus.cc:1275] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:04.878123 25263 consensus_queue.cc:1048] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:04.887782 25274 raft_consensus.cc:2955] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:04.892347 24398 raft_consensus.cc:2955] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:04.891661 24397 raft_consensus.cc:2955] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:04.904980 25119 raft_consensus.cc:2955] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:04.936976 24220 catalog_manager.cc:5697] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:04.949549 24209 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f8dc8357b0c947d9a0f16daa0f4210aa with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:04.941955 24223 catalog_manager.cc:5697] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:04.969884 25280 raft_consensus.cc:2955] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:04.976074 24317 raft_consensus.cc:2955] T daeed7cb347a434082488f5c5807424b P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:04.979164 25273 raft_consensus.cc:2955] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:04.989336 24399 raft_consensus.cc:2955] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:04.992127 24325 consensus_queue.cc:237] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:05.002028 24397 raft_consensus.cc:1275] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:05.003480 25274 consensus_queue.cc:1048] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:05.024124 25118 raft_consensus.cc:1275] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:05.023416 25276 raft_consensus.cc:2955] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:05.044664 24308 tablet_service.cc:1558] Processing DeleteTablet for tablet f8dc8357b0c947d9a0f16daa0f4210aa with delete_type TABLET_DATA_TOMBSTONED (TS c711faa13ead43ebbea0192cb74a4756 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44272
I20260709 12:18:05.034631 24394 raft_consensus.cc:2955] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:05.056974 25274 consensus_queue.cc:1048] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:18:05.064260 25119 raft_consensus.cc:2955] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:05.090247 25304 tablet_replica.cc:333] T f8dc8357b0c947d9a0f16daa0f4210aa P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:18:05.115557 24210 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3f669315af0d426da28d57b462979ebd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:05.105981 25117 raft_consensus.cc:2955] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:05.135878 24470 raft_consensus.cc:2955] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:18:05.137931 24210 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 3f669315af0d426da28d57b462979ebd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 12:18:05.127861 25116 raft_consensus.cc:2955] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:05.161810 24221 catalog_manager.cc:5697] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:05.163098 24470 raft_consensus.cc:2955] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:05.185129 24223 catalog_manager.cc:5697] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:05.190224 24223 catalog_manager.cc:5697] T daeed7cb347a434082488f5c5807424b P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:05.200137 25304 raft_consensus.cc:2243] T f8dc8357b0c947d9a0f16daa0f4210aa P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:05.201079 25304 raft_consensus.cc:2272] T f8dc8357b0c947d9a0f16daa0f4210aa P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:05.205191 25304 ts_tablet_manager.cc:1916] T f8dc8357b0c947d9a0f16daa0f4210aa P c711faa13ead43ebbea0192cb74a4756: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:05.220419 24319 consensus_queue.cc:237] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:05.221629 24461 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f669315af0d426da28d57b462979ebd with delete_type TABLET_DATA_TOMBSTONED (TS 99b8650fa8324ac2ac5f75eee9b1a1e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33256
I20260709 12:18:05.228521 25304 ts_tablet_manager.cc:1929] T f8dc8357b0c947d9a0f16daa0f4210aa P c711faa13ead43ebbea0192cb74a4756: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:05.229094 25117 raft_consensus.cc:1275] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:05.229142 25304 log.cc:1199] T f8dc8357b0c947d9a0f16daa0f4210aa P c711faa13ead43ebbea0192cb74a4756: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-0-root/wals/f8dc8357b0c947d9a0f16daa0f4210aa
I20260709 12:18:05.230250 24398 raft_consensus.cc:1275] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:05.230921 25294 consensus_queue.cc:1048] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:05.232406 25295 consensus_queue.cc:1048] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:05.243571 24395 raft_consensus.cc:2955] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:05.247637 25276 raft_consensus.cc:2955] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:05.256412 25117 raft_consensus.cc:2955] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:05.231931 24210 catalog_manager.cc:5028] TS c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): tablet f8dc8357b0c947d9a0f16daa0f4210aa (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:05.298591 24395 consensus_queue.cc:237] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:05.299045 24222 catalog_manager.cc:5697] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:05.307785 25306 tablet_replica.cc:333] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:18:05.310947 25306 raft_consensus.cc:2243] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:05.312315 24210 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9e8cc498654c4fde9917eeb605fdc906 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:05.317520 25306 pending_rounds.cc:70] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3: Trying to abort 1 pending ops.
I20260709 12:18:05.317859 25306 pending_rounds.cc:77] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305623488103182336 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "3f669315af0d426da28d57b462979ebd" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } } }
I20260709 12:18:05.319386 25306 raft_consensus.cc:2917] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:18:05.319872 25306 raft_consensus.cc:2889] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:18:05.320309 25306 raft_consensus.cc:2272] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:05.324079 24461 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e8cc498654c4fde9917eeb605fdc906 with delete_type TABLET_DATA_TOMBSTONED (TS 99b8650fa8324ac2ac5f75eee9b1a1e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33256
I20260709 12:18:05.324621 25117 raft_consensus.cc:1275] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:05.326511 25288 consensus_queue.cc:1048] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:05.337409 24466 raft_consensus.cc:1275] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:05.338032 25287 raft_consensus.cc:2955] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:05.339850 25279 consensus_queue.cc:1048] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:05.346164 25116 raft_consensus.cc:2955] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:05.351652 24466 raft_consensus.cc:2955] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:05.363734 25306 ts_tablet_manager.cc:1916] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:05.367770 24220 catalog_manager.cc:5697] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:05.380002 24208 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet daeed7cb347a434082488f5c5807424b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:05.430059 25306 ts_tablet_manager.cc:1929] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:05.430632 25306 log.cc:1199] T 3f669315af0d426da28d57b462979ebd P 99b8650fa8324ac2ac5f75eee9b1a1e3: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-2-root/wals/3f669315af0d426da28d57b462979ebd
I20260709 12:18:05.432615 25306 tablet_replica.cc:333] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:18:05.434954 24209 catalog_manager.cc:5028] TS 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): tablet 3f669315af0d426da28d57b462979ebd (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:05.447494 24308 tablet_service.cc:1558] Processing DeleteTablet for tablet daeed7cb347a434082488f5c5807424b with delete_type TABLET_DATA_TOMBSTONED (TS c711faa13ead43ebbea0192cb74a4756 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44272
I20260709 12:18:05.450570 25304 tablet_replica.cc:333] T daeed7cb347a434082488f5c5807424b P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:18:05.459849 25306 raft_consensus.cc:2243] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:05.460832 25306 raft_consensus.cc:2272] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:05.468714 25306 ts_tablet_manager.cc:1916] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:05.479511 25304 raft_consensus.cc:2243] T daeed7cb347a434082488f5c5807424b P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:05.480404 25304 raft_consensus.cc:2272] T daeed7cb347a434082488f5c5807424b P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:05.484120 25304 ts_tablet_manager.cc:1916] T daeed7cb347a434082488f5c5807424b P c711faa13ead43ebbea0192cb74a4756: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:05.491916 25306 ts_tablet_manager.cc:1929] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:05.492524 25306 log.cc:1199] T 9e8cc498654c4fde9917eeb605fdc906 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-2-root/wals/9e8cc498654c4fde9917eeb605fdc906
I20260709 12:18:05.494164 24209 catalog_manager.cc:5028] TS 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): tablet 9e8cc498654c4fde9917eeb605fdc906 (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:05.501063 25304 ts_tablet_manager.cc:1929] T daeed7cb347a434082488f5c5807424b P c711faa13ead43ebbea0192cb74a4756: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:05.502022 25304 log.cc:1199] T daeed7cb347a434082488f5c5807424b P c711faa13ead43ebbea0192cb74a4756: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-0-root/wals/daeed7cb347a434082488f5c5807424b
I20260709 12:18:05.503507 24210 catalog_manager.cc:5028] TS c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): tablet daeed7cb347a434082488f5c5807424b (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:06.524266 24466 consensus_queue.cc:237] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
W20260709 12:18:06.531134 24440 consensus_peers.cc:597] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218e3bf7807b42d09ac3db0dad69fcf9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:06.533144 24317 raft_consensus.cc:1275] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:06.533221 24395 raft_consensus.cc:1275] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:06.537181 25209 consensus_queue.cc:1048] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:06.546250 25270 consensus_queue.cc:1048] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:06.552742 25270 raft_consensus.cc:2955] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:06.554646 24325 raft_consensus.cc:2955] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:06.556800 24394 raft_consensus.cc:2955] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:06.571434 24319 consensus_queue.cc:237] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:06.574359 24220 catalog_manager.cc:5697] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:06.581346 24466 raft_consensus.cc:1275] T 9f31ae8f765347f0b4ac12809516729c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:06.581971 24394 raft_consensus.cc:1275] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:18:06.583160 24291 consensus_peers.cc:597] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9f31ae8f765347f0b4ac12809516729c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:06.583523 25276 consensus_queue.cc:1048] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:06.584822 25295 consensus_queue.cc:1048] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:06.593361 25295 raft_consensus.cc:2955] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:06.598292 24398 raft_consensus.cc:2955] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:06.621966 24470 raft_consensus.cc:2955] T 9f31ae8f765347f0b4ac12809516729c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:06.644582 24466 consensus_queue.cc:237] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
W20260709 12:18:06.660844 24440 consensus_peers.cc:597] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ac37baecf20841f7b0a74e07f89c2a09. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:06.661285 24394 raft_consensus.cc:1275] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:06.663189 24319 raft_consensus.cc:1275] T ac37baecf20841f7b0a74e07f89c2a09 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:06.665141 25270 consensus_queue.cc:1048] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:06.666087 25232 consensus_queue.cc:1048] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:06.704342 25270 raft_consensus.cc:2955] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:06.710563 24319 raft_consensus.cc:2955] T ac37baecf20841f7b0a74e07f89c2a09 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:06.720543 24395 raft_consensus.cc:2955] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:06.732791 24221 catalog_manager.cc:5697] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:06.744948 24319 consensus_queue.cc:237] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:06.755654 24221 catalog_manager.cc:5697] T ac37baecf20841f7b0a74e07f89c2a09 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
W20260709 12:18:06.771833 24291 consensus_peers.cc:597] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1246d2a6c02a457f97a768233aa6cf6d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:06.776001 24470 raft_consensus.cc:1275] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:06.782792 25276 consensus_queue.cc:1048] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:06.784600 24395 raft_consensus.cc:1275] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:06.789321 25276 consensus_queue.cc:1048] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:06.797082 25323 raft_consensus.cc:2955] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:06.799486 24398 raft_consensus.cc:2955] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:06.801352 24470 raft_consensus.cc:2955] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:06.822065 24220 catalog_manager.cc:5697] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:07.016595 25326 ts_tablet_manager.cc:933] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:07.022862 25326 tablet_copy_client.cc:323] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.195:44453
I20260709 12:18:07.025717 24484 tablet_copy_service.cc:140] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Received BeginTabletCopySession request for tablet 218e3bf7807b42d09ac3db0dad69fcf9 from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:33198)
I20260709 12:18:07.026347 24484 tablet_copy_service.cc:161] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Beginning new tablet copy session on tablet 218e3bf7807b42d09ac3db0dad69fcf9 from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:33198: session id = d99d5d772cfe4a96afcab3d3b009a281-218e3bf7807b42d09ac3db0dad69fcf9
I20260709 12:18:07.036893 24484 tablet_copy_source_session.cc:215] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:07.041234 25326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 218e3bf7807b42d09ac3db0dad69fcf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:07.065053 25328 ts_tablet_manager.cc:933] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:07.075461 25326 tablet_copy_client.cc:806] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:07.075736 25328 tablet_copy_client.cc:323] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.195:44453
I20260709 12:18:07.076146 25326 tablet_copy_client.cc:670] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:07.077984 24484 tablet_copy_service.cc:140] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Received BeginTabletCopySession request for tablet ac37baecf20841f7b0a74e07f89c2a09 from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:33198)
I20260709 12:18:07.078600 24484 tablet_copy_service.cc:161] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Beginning new tablet copy session on tablet ac37baecf20841f7b0a74e07f89c2a09 from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:33198: session id = d99d5d772cfe4a96afcab3d3b009a281-ac37baecf20841f7b0a74e07f89c2a09
I20260709 12:18:07.087936 25326 tablet_copy_client.cc:538] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:07.089128 24484 tablet_copy_source_session.cc:215] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:07.102087 25328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac37baecf20841f7b0a74e07f89c2a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:07.104321 25326 tablet_bootstrap.cc:492] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:18:07.124639 25328 tablet_copy_client.cc:806] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:07.125375 25328 tablet_copy_client.cc:670] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:07.130059 25328 tablet_copy_client.cc:538] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:07.136739 25326 tablet_bootstrap.cc:492] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:07.137985 25326 tablet_bootstrap.cc:492] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:07.139696 25328 tablet_bootstrap.cc:492] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:18:07.139654 25326 ts_tablet_manager.cc:1403] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.007s
I20260709 12:18:07.144268 25326 raft_consensus.cc:359] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:07.145030 25326 raft_consensus.cc:740] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:07.145679 25326 consensus_queue.cc:260] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:07.155755 25326 ts_tablet_manager.cc:1434] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.007s
I20260709 12:18:07.168341 25328 tablet_bootstrap.cc:492] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:07.169780 25328 tablet_bootstrap.cc:492] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:07.170202 24484 tablet_copy_service.cc:342] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-218e3bf7807b42d09ac3db0dad69fcf9 received from {username='slave'} at 127.0.0.1:33198
I20260709 12:18:07.170665 24484 tablet_copy_service.cc:434] P 99b8650fa8324ac2ac5f75eee9b1a1e3: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-218e3bf7807b42d09ac3db0dad69fcf9 on tablet 218e3bf7807b42d09ac3db0dad69fcf9 with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:07.172065 25328 ts_tablet_manager.cc:1403] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.015s
I20260709 12:18:07.175127 25328 raft_consensus.cc:359] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:07.175998 25328 raft_consensus.cc:740] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:07.176605 25328 consensus_queue.cc:260] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:07.179656 25328 ts_tablet_manager.cc:1434] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 12:18:07.179752 25326 ts_tablet_manager.cc:933] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:18:07.184604 24484 tablet_copy_service.cc:342] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-ac37baecf20841f7b0a74e07f89c2a09 received from {username='slave'} at 127.0.0.1:33198
I20260709 12:18:07.185141 24484 tablet_copy_service.cc:434] P 99b8650fa8324ac2ac5f75eee9b1a1e3: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-ac37baecf20841f7b0a74e07f89c2a09 on tablet ac37baecf20841f7b0a74e07f89c2a09 with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:07.189460 25326 tablet_copy_client.cc:323] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.193:36951
I20260709 12:18:07.191432 24335 tablet_copy_service.cc:140] P c711faa13ead43ebbea0192cb74a4756: Received BeginTabletCopySession request for tablet 9f31ae8f765347f0b4ac12809516729c from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:57702)
I20260709 12:18:07.192091 24335 tablet_copy_service.cc:161] P c711faa13ead43ebbea0192cb74a4756: Beginning new tablet copy session on tablet 9f31ae8f765347f0b4ac12809516729c from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:57702: session id = d99d5d772cfe4a96afcab3d3b009a281-9f31ae8f765347f0b4ac12809516729c
I20260709 12:18:07.199862 24335 tablet_copy_source_session.cc:215] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:07.203356 25326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f31ae8f765347f0b4ac12809516729c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:07.218708 25326 tablet_copy_client.cc:806] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:07.219318 25326 tablet_copy_client.cc:670] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:07.223344 25326 tablet_copy_client.cc:538] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:07.230896 25326 tablet_bootstrap.cc:492] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:18:07.258275 25326 tablet_bootstrap.cc:492] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:07.259069 25326 tablet_bootstrap.cc:492] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:07.259752 25326 ts_tablet_manager.cc:1403] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.007s
I20260709 12:18:07.262811 25326 raft_consensus.cc:359] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:07.263841 25326 raft_consensus.cc:740] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:07.264499 25326 consensus_queue.cc:260] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:07.267247 25326 ts_tablet_manager.cc:1434] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:18:07.272152 24335 tablet_copy_service.cc:342] P c711faa13ead43ebbea0192cb74a4756: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-9f31ae8f765347f0b4ac12809516729c received from {username='slave'} at 127.0.0.1:57702
I20260709 12:18:07.272665 24335 tablet_copy_service.cc:434] P c711faa13ead43ebbea0192cb74a4756: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-9f31ae8f765347f0b4ac12809516729c on tablet 9f31ae8f765347f0b4ac12809516729c with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:07.377333 25326 ts_tablet_manager.cc:933] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:18:07.381369 25326 tablet_copy_client.cc:323] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.193:36951
I20260709 12:18:07.383160 24335 tablet_copy_service.cc:140] P c711faa13ead43ebbea0192cb74a4756: Received BeginTabletCopySession request for tablet 1246d2a6c02a457f97a768233aa6cf6d from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:57702)
I20260709 12:18:07.383791 24335 tablet_copy_service.cc:161] P c711faa13ead43ebbea0192cb74a4756: Beginning new tablet copy session on tablet 1246d2a6c02a457f97a768233aa6cf6d from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:57702: session id = d99d5d772cfe4a96afcab3d3b009a281-1246d2a6c02a457f97a768233aa6cf6d
I20260709 12:18:07.398461 24335 tablet_copy_source_session.cc:215] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:07.403816 25116 raft_consensus.cc:1217] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:07.408321 25326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1246d2a6c02a457f97a768233aa6cf6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:07.426962 25326 tablet_copy_client.cc:806] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:07.427573 25326 tablet_copy_client.cc:670] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:07.431437 25326 tablet_copy_client.cc:538] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:07.440795 25326 tablet_bootstrap.cc:492] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:18:07.458310 25326 tablet_bootstrap.cc:492] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:07.459153 25326 tablet_bootstrap.cc:492] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:07.459741 25326 ts_tablet_manager.cc:1403] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.008s
I20260709 12:18:07.462024 25326 raft_consensus.cc:359] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:07.463274 25326 raft_consensus.cc:740] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:07.464154 25326 consensus_queue.cc:260] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:07.467100 25326 ts_tablet_manager.cc:1434] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:18:07.469741 24335 tablet_copy_service.cc:342] P c711faa13ead43ebbea0192cb74a4756: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-1246d2a6c02a457f97a768233aa6cf6d received from {username='slave'} at 127.0.0.1:57702
I20260709 12:18:07.470167 24335 tablet_copy_service.cc:434] P c711faa13ead43ebbea0192cb74a4756: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-1246d2a6c02a457f97a768233aa6cf6d on tablet 1246d2a6c02a457f97a768233aa6cf6d with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:07.643036 25116 raft_consensus.cc:1217] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:07.665446 25116 raft_consensus.cc:1217] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:07.822283 25116 raft_consensus.cc:1217] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:07.956983 25232 raft_consensus.cc:1064] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:07.959228 25232 consensus_queue.cc:237] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:07.969537 25116 raft_consensus.cc:1275] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:07.971311 24395 raft_consensus.cc:1275] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:07.971465 25270 consensus_queue.cc:1048] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:07.972177 24319 raft_consensus.cc:1275] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:07.972836 25209 consensus_queue.cc:1048] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:07.973977 25232 consensus_queue.cc:1048] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:08.008760 25209 raft_consensus.cc:2955] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.010262 24325 raft_consensus.cc:2955] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.014130 24395 raft_consensus.cc:2955] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.029489 25116 raft_consensus.cc:2955] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.039492 25232 raft_consensus.cc:1064] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:08.041888 25232 consensus_queue.cc:237] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:08.049938 24221 catalog_manager.cc:5697] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.058549 25117 raft_consensus.cc:1275] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:08.061767 24325 raft_consensus.cc:1275] T ac37baecf20841f7b0a74e07f89c2a09 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:08.062017 25209 consensus_queue.cc:1048] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:18:08.073525 25346 consensus_queue.cc:1048] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:18:08.082369 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 44707.2us
I20260709 12:18:08.085099 24398 raft_consensus.cc:1275] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:08.085552 25270 raft_consensus.cc:2955] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.088006 25209 consensus_queue.cc:1048] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:08.099671 24398 raft_consensus.cc:2955] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.103578 24325 raft_consensus.cc:2955] T ac37baecf20841f7b0a74e07f89c2a09 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.115541 25116 raft_consensus.cc:2955] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.146761 24220 catalog_manager.cc:5697] T ac37baecf20841f7b0a74e07f89c2a09 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.151111 24466 consensus_queue.cc:237] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:08.157781 25117 raft_consensus.cc:1275] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:08.160010 25270 consensus_queue.cc:1048] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:08.160498 24325 raft_consensus.cc:1275] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:08.164347 25232 consensus_queue.cc:1048] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:08.175872 25270 raft_consensus.cc:2955] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.188755 24209 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 218e3bf7807b42d09ac3db0dad69fcf9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:08.188778 25116 raft_consensus.cc:2955] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.189772 24325 raft_consensus.cc:2955] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.197386 24222 catalog_manager.cc:5697] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:08.219403 24383 tablet_service.cc:1558] Processing DeleteTablet for tablet 218e3bf7807b42d09ac3db0dad69fcf9 with delete_type TABLET_DATA_TOMBSTONED (TS c855242ec9d34a5397741ef20db9de8a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51466
I20260709 12:18:08.244930 25295 raft_consensus.cc:1064] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:08.245333 25353 tablet_replica.cc:333] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:18:08.246495 25353 raft_consensus.cc:2243] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:08.247337 25353 raft_consensus.cc:2272] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:08.247709 25295 consensus_queue.cc:237] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:08.244828 25307 raft_consensus.cc:1064] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:08.255730 25307 consensus_queue.cc:237] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:08.253051 25353 ts_tablet_manager.cc:1916] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:08.272105 25116 raft_consensus.cc:1275] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:08.274873 24466 raft_consensus.cc:1275] T 9f31ae8f765347f0b4ac12809516729c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:08.279281 25338 consensus_queue.cc:1048] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:08.285756 25276 consensus_queue.cc:1048] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:18:08.294039 24398 raft_consensus.cc:1275] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:08.297041 25338 consensus_queue.cc:1048] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:18:08.354599 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 44086.2us
I20260709 12:18:08.361665 25119 raft_consensus.cc:1275] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:08.406749 25307 consensus_queue.cc:1048] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:08.422088 24398 raft_consensus.cc:1275] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:08.432070 25360 consensus_queue.cc:1048] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:08.440279 25353 ts_tablet_manager.cc:1929] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:08.452651 24469 raft_consensus.cc:1275] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:08.472360 25353 log.cc:1199] T 218e3bf7807b42d09ac3db0dad69fcf9 P c855242ec9d34a5397741ef20db9de8a: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-1-root/wals/218e3bf7807b42d09ac3db0dad69fcf9
I20260709 12:18:08.467052 25356 raft_consensus.cc:2955] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.468789 24466 raft_consensus.cc:2955] T 9f31ae8f765347f0b4ac12809516729c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.476349 24208 catalog_manager.cc:5028] TS c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): tablet 218e3bf7807b42d09ac3db0dad69fcf9 (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:08.483649 25361 consensus_queue.cc:1048] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:08.487416 25116 raft_consensus.cc:2955] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.495338 24221 catalog_manager.cc:5697] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:08.519232 25359 raft_consensus.cc:2955] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.521867 24395 raft_consensus.cc:2955] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.538882 24398 raft_consensus.cc:2955] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.542837 25118 raft_consensus.cc:2955] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.548709 24469 raft_consensus.cc:2955] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.582377 24221 catalog_manager.cc:5697] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.608512 24325 consensus_queue.cc:237] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:08.609393 24319 consensus_queue.cc:237] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:08.615388 25118 raft_consensus.cc:1275] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:08.616169 25116 raft_consensus.cc:1275] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:08.617857 25295 consensus_queue.cc:1048] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:08.618675 25361 consensus_queue.cc:1048] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:08.618991 24469 raft_consensus.cc:1275] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:08.622272 25361 consensus_queue.cc:1048] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:08.622293 24398 raft_consensus.cc:1275] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:08.631289 25360 consensus_queue.cc:1048] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:08.632025 25359 raft_consensus.cc:2955] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.633002 25118 raft_consensus.cc:2955] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.638252 25356 raft_consensus.cc:2955] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.649469 24398 raft_consensus.cc:2955] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.655479 25116 raft_consensus.cc:2955] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.658934 24223 catalog_manager.cc:5697] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.672917 24210 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9f31ae8f765347f0b4ac12809516729c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:08.676164 24210 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1246d2a6c02a457f97a768233aa6cf6d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:08.691570 24383 tablet_service.cc:1558] Processing DeleteTablet for tablet 1246d2a6c02a457f97a768233aa6cf6d with delete_type TABLET_DATA_TOMBSTONED (TS c855242ec9d34a5397741ef20db9de8a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51466
I20260709 12:18:08.692526 25353 tablet_replica.cc:333] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:18:08.695689 25353 raft_consensus.cc:2243] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:08.696525 25353 raft_consensus.cc:2272] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:08.699589 24221 catalog_manager.cc:5697] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a reported cstate change: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.705060 25353 ts_tablet_manager.cc:1916] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:08.708315 24471 raft_consensus.cc:2955] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.709671 24469 consensus_queue.cc:237] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:08.729687 25116 raft_consensus.cc:1275] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:08.735145 25232 consensus_queue.cc:1048] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:08.741331 24398 raft_consensus.cc:1275] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:08.759594 25232 raft_consensus.cc:2955] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.763959 24461 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f31ae8f765347f0b4ac12809516729c with delete_type TABLET_DATA_TOMBSTONED (TS 99b8650fa8324ac2ac5f75eee9b1a1e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33256
I20260709 12:18:08.773299 25343 consensus_queue.cc:1048] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:08.777144 25116 raft_consensus.cc:2955] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.779515 25368 tablet_replica.cc:333] T 9f31ae8f765347f0b4ac12809516729c P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:18:08.781030 25368 raft_consensus.cc:2243] T 9f31ae8f765347f0b4ac12809516729c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:08.781859 25368 raft_consensus.cc:2272] T 9f31ae8f765347f0b4ac12809516729c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:08.787015 25368 ts_tablet_manager.cc:1916] T 9f31ae8f765347f0b4ac12809516729c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:08.791378 24209 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ac37baecf20841f7b0a74e07f89c2a09 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:08.796131 25353 ts_tablet_manager.cc:1929] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:08.797029 25353 log.cc:1199] T 1246d2a6c02a457f97a768233aa6cf6d P c855242ec9d34a5397741ef20db9de8a: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-1-root/wals/1246d2a6c02a457f97a768233aa6cf6d
I20260709 12:18:08.796358 24221 catalog_manager.cc:5697] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.808497 24399 raft_consensus.cc:2955] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:08.809355 24208 catalog_manager.cc:5028] TS c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): tablet 1246d2a6c02a457f97a768233aa6cf6d (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:08.821378 24308 tablet_service.cc:1558] Processing DeleteTablet for tablet ac37baecf20841f7b0a74e07f89c2a09 with delete_type TABLET_DATA_TOMBSTONED (TS c711faa13ead43ebbea0192cb74a4756 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44272
I20260709 12:18:08.834234 25368 ts_tablet_manager.cc:1929] T 9f31ae8f765347f0b4ac12809516729c P 99b8650fa8324ac2ac5f75eee9b1a1e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:08.835515 25369 tablet_replica.cc:333] T ac37baecf20841f7b0a74e07f89c2a09 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:18:08.836267 25368 log.cc:1199] T 9f31ae8f765347f0b4ac12809516729c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-2-root/wals/9f31ae8f765347f0b4ac12809516729c
I20260709 12:18:08.837862 24209 catalog_manager.cc:5028] TS 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): tablet 9f31ae8f765347f0b4ac12809516729c (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:08.845527 25369 raft_consensus.cc:2243] T ac37baecf20841f7b0a74e07f89c2a09 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:08.846522 25369 raft_consensus.cc:2272] T ac37baecf20841f7b0a74e07f89c2a09 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:08.849361 25369 ts_tablet_manager.cc:1916] T ac37baecf20841f7b0a74e07f89c2a09 P c711faa13ead43ebbea0192cb74a4756: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:08.861871 25369 ts_tablet_manager.cc:1929] T ac37baecf20841f7b0a74e07f89c2a09 P c711faa13ead43ebbea0192cb74a4756: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:08.862372 25369 log.cc:1199] T ac37baecf20841f7b0a74e07f89c2a09 P c711faa13ead43ebbea0192cb74a4756: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-0-root/wals/ac37baecf20841f7b0a74e07f89c2a09
I20260709 12:18:08.864171 24210 catalog_manager.cc:5028] TS c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): tablet ac37baecf20841f7b0a74e07f89c2a09 (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:09.896255 24319 consensus_queue.cc:237] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:09.903393 24398 raft_consensus.cc:1275] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:09.905058 25295 consensus_queue.cc:1048] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:18:09.909387 24291 consensus_peers.cc:597] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 125e800842274e17a2c01df7bb749005. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:09.912071 24469 raft_consensus.cc:1275] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:09.913642 25361 consensus_queue.cc:1048] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:09.923883 25295 raft_consensus.cc:2955] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:09.925976 24469 raft_consensus.cc:2955] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:09.927124 24398 raft_consensus.cc:2955] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:09.952158 24399 consensus_queue.cc:237] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:09.951339 24221 catalog_manager.cc:5697] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:09.963228 24469 raft_consensus.cc:1275] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:09.964489 24319 raft_consensus.cc:1275] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:18:09.964592 24366 consensus_peers.cc:597] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7fd01a911fd14f38a5e1ca5b30c7da18. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:09.966063 25287 consensus_queue.cc:1048] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:09.967082 25371 consensus_queue.cc:1048] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:09.989948 25287 raft_consensus.cc:2955] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:10.005136 24471 consensus_queue.cc:237] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:10.006188 24319 raft_consensus.cc:2955] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:10.010481 24222 catalog_manager.cc:5697] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:10.027561 24399 raft_consensus.cc:1275] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:10.026099 24469 raft_consensus.cc:2955] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:10.029277 25343 consensus_queue.cc:1048] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:10.030316 24319 raft_consensus.cc:1275] T 5a08303c706b4fcda5778a1f60dc1915 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:18:10.033545 24440 consensus_peers.cc:597] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5a08303c706b4fcda5778a1f60dc1915. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:10.040771 25343 consensus_queue.cc:1048] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:10.047046 25346 raft_consensus.cc:2955] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:10.059834 24398 raft_consensus.cc:2955] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:10.078594 24325 raft_consensus.cc:2955] T 5a08303c706b4fcda5778a1f60dc1915 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:10.093173 24223 catalog_manager.cc:5697] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:10.094123 24319 consensus_queue.cc:237] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
W20260709 12:18:10.121196 24291 consensus_peers.cc:597] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 95c2470f38204e5ba4ee545bb2de933c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:10.121206 24398 raft_consensus.cc:1275] T 95c2470f38204e5ba4ee545bb2de933c P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:10.122857 24469 raft_consensus.cc:1275] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:10.124400 25391 consensus_queue.cc:1048] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:10.125317 25373 consensus_queue.cc:1048] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:10.134939 25391 raft_consensus.cc:2955] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:10.137454 24469 raft_consensus.cc:2955] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:10.137610 24399 raft_consensus.cc:2955] T 95c2470f38204e5ba4ee545bb2de933c P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:10.154193 24223 catalog_manager.cc:5697] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:10.332682 25394 ts_tablet_manager.cc:933] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:18:10.345584 25394 tablet_copy_client.cc:323] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.193:36951
I20260709 12:18:10.347775 24335 tablet_copy_service.cc:140] P c711faa13ead43ebbea0192cb74a4756: Received BeginTabletCopySession request for tablet 125e800842274e17a2c01df7bb749005 from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:57702)
I20260709 12:18:10.348423 24335 tablet_copy_service.cc:161] P c711faa13ead43ebbea0192cb74a4756: Beginning new tablet copy session on tablet 125e800842274e17a2c01df7bb749005 from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:57702: session id = d99d5d772cfe4a96afcab3d3b009a281-125e800842274e17a2c01df7bb749005
I20260709 12:18:10.357234 24335 tablet_copy_source_session.cc:215] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:10.361192 25394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 125e800842274e17a2c01df7bb749005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:10.383882 25394 tablet_copy_client.cc:806] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:10.384619 25394 tablet_copy_client.cc:670] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:10.390060 25394 tablet_copy_client.cc:538] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:10.399742 25394 tablet_bootstrap.cc:492] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:18:10.436832 25394 tablet_bootstrap.cc:492] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:10.437781 25394 tablet_bootstrap.cc:492] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:10.438457 25394 ts_tablet_manager.cc:1403] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.008s
I20260709 12:18:10.442222 25394 raft_consensus.cc:359] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:10.442993 25394 raft_consensus.cc:740] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:10.443648 25394 consensus_queue.cc:260] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:10.467731 25394 ts_tablet_manager.cc:1434] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.029s	user 0.012s	sys 0.004s
I20260709 12:18:10.478929 24335 tablet_copy_service.cc:342] P c711faa13ead43ebbea0192cb74a4756: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-125e800842274e17a2c01df7bb749005 received from {username='slave'} at 127.0.0.1:57702
I20260709 12:18:10.479395 24335 tablet_copy_service.cc:434] P c711faa13ead43ebbea0192cb74a4756: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-125e800842274e17a2c01df7bb749005 on tablet 125e800842274e17a2c01df7bb749005 with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:10.483879 25394 ts_tablet_manager.cc:933] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:10.492409 25398 ts_tablet_manager.cc:933] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:10.508165 25394 tablet_copy_client.cc:323] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.195:44453
I20260709 12:18:10.508934 25398 tablet_copy_client.cc:323] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.194:35893
I20260709 12:18:10.510746 24484 tablet_copy_service.cc:140] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Received BeginTabletCopySession request for tablet 5a08303c706b4fcda5778a1f60dc1915 from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:33198)
I20260709 12:18:10.510941 24410 tablet_copy_service.cc:140] P c855242ec9d34a5397741ef20db9de8a: Received BeginTabletCopySession request for tablet 7fd01a911fd14f38a5e1ca5b30c7da18 from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:50950)
I20260709 12:18:10.511353 24484 tablet_copy_service.cc:161] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Beginning new tablet copy session on tablet 5a08303c706b4fcda5778a1f60dc1915 from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:33198: session id = d99d5d772cfe4a96afcab3d3b009a281-5a08303c706b4fcda5778a1f60dc1915
I20260709 12:18:10.511591 24410 tablet_copy_service.cc:161] P c855242ec9d34a5397741ef20db9de8a: Beginning new tablet copy session on tablet 7fd01a911fd14f38a5e1ca5b30c7da18 from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:50950: session id = d99d5d772cfe4a96afcab3d3b009a281-7fd01a911fd14f38a5e1ca5b30c7da18
I20260709 12:18:10.520462 24410 tablet_copy_source_session.cc:215] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:10.524087 25398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fd01a911fd14f38a5e1ca5b30c7da18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:10.524303 24484 tablet_copy_source_session.cc:215] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:10.528007 25394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a08303c706b4fcda5778a1f60dc1915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:10.535396 25399 ts_tablet_manager.cc:933] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:18:10.544554 25398 tablet_copy_client.cc:806] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:10.545497 25398 tablet_copy_client.cc:670] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:10.546139 25399 tablet_copy_client.cc:323] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.193:36951
I20260709 12:18:10.548061 25394 tablet_copy_client.cc:806] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:10.548820 25394 tablet_copy_client.cc:670] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:10.549356 24335 tablet_copy_service.cc:140] P c711faa13ead43ebbea0192cb74a4756: Received BeginTabletCopySession request for tablet 95c2470f38204e5ba4ee545bb2de933c from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:57702)
I20260709 12:18:10.550063 24335 tablet_copy_service.cc:161] P c711faa13ead43ebbea0192cb74a4756: Beginning new tablet copy session on tablet 95c2470f38204e5ba4ee545bb2de933c from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:57702: session id = d99d5d772cfe4a96afcab3d3b009a281-95c2470f38204e5ba4ee545bb2de933c
I20260709 12:18:10.550825 25398 tablet_copy_client.cc:538] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:10.553387 25394 tablet_copy_client.cc:538] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:10.558535 24335 tablet_copy_source_session.cc:215] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:10.562455 25399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95c2470f38204e5ba4ee545bb2de933c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:10.566398 25398 tablet_bootstrap.cc:492] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:18:10.581449 25394 tablet_bootstrap.cc:492] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:18:10.583920 25399 tablet_copy_client.cc:806] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:10.591737 25399 tablet_copy_client.cc:670] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:10.605036 25399 tablet_copy_client.cc:538] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:10.626899 25399 tablet_bootstrap.cc:492] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:18:10.665349 25394 tablet_bootstrap.cc:492] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:10.666478 25394 tablet_bootstrap.cc:492] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:10.670626 25394 ts_tablet_manager.cc:1403] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.090s	user 0.019s	sys 0.016s
I20260709 12:18:10.673812 25394 raft_consensus.cc:359] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:10.675743 25398 tablet_bootstrap.cc:492] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:10.676945 25398 tablet_bootstrap.cc:492] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:10.675822 25394 raft_consensus.cc:740] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:10.678086 25398 ts_tablet_manager.cc:1403] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.112s	user 0.017s	sys 0.026s
I20260709 12:18:10.678154 25399 tablet_bootstrap.cc:492] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:10.678342 25394 consensus_queue.cc:260] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:10.679519 25399 tablet_bootstrap.cc:492] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:10.680606 25399 ts_tablet_manager.cc:1403] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.054s	user 0.026s	sys 0.006s
I20260709 12:18:10.681973 25394 ts_tablet_manager.cc:1434] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:18:10.682199 25398 raft_consensus.cc:359] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:10.683301 25398 raft_consensus.cc:740] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:10.683699 25399 raft_consensus.cc:359] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:10.684104 25398 consensus_queue.cc:260] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:10.685022 25399 raft_consensus.cc:740] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:10.685678 25399 consensus_queue.cc:260] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:10.689915 24484 tablet_copy_service.cc:342] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-5a08303c706b4fcda5778a1f60dc1915 received from {username='slave'} at 127.0.0.1:33198
I20260709 12:18:10.690375 24484 tablet_copy_service.cc:434] P 99b8650fa8324ac2ac5f75eee9b1a1e3: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-5a08303c706b4fcda5778a1f60dc1915 on tablet 5a08303c706b4fcda5778a1f60dc1915 with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:10.690716 25399 ts_tablet_manager.cc:1434] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.007s
I20260709 12:18:10.692687 24335 tablet_copy_service.cc:342] P c711faa13ead43ebbea0192cb74a4756: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-95c2470f38204e5ba4ee545bb2de933c received from {username='slave'} at 127.0.0.1:57702
I20260709 12:18:10.693051 24335 tablet_copy_service.cc:434] P c711faa13ead43ebbea0192cb74a4756: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-95c2470f38204e5ba4ee545bb2de933c on tablet 95c2470f38204e5ba4ee545bb2de933c with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:10.693943 25398 ts_tablet_manager.cc:1434] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:18:10.695785 24410 tablet_copy_service.cc:342] P c855242ec9d34a5397741ef20db9de8a: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-7fd01a911fd14f38a5e1ca5b30c7da18 received from {username='slave'} at 127.0.0.1:50950
I20260709 12:18:10.696233 24410 tablet_copy_service.cc:434] P c855242ec9d34a5397741ef20db9de8a: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-7fd01a911fd14f38a5e1ca5b30c7da18 on tablet 7fd01a911fd14f38a5e1ca5b30c7da18 with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:10.803992 25118 raft_consensus.cc:1217] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:10.832247 25118 raft_consensus.cc:1217] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:10.920506 25118 raft_consensus.cc:1217] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:11.008984 25118 raft_consensus.cc:1217] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:11.410045 25414 raft_consensus.cc:1064] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:11.414067 25295 raft_consensus.cc:1064] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:11.418569 25295 consensus_queue.cc:237] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:11.462039 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 49647.5us
I20260709 12:18:11.472574 25414 consensus_queue.cc:237] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:11.535905 25116 raft_consensus.cc:1275] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:11.537966 24466 raft_consensus.cc:1275] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:11.548893 25411 consensus_queue.cc:1048] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:18:11.541862 25295 consensus_queue.cc:1048] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:18:11.558808 24399 raft_consensus.cc:1275] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:18:11.533298 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 126729us
I20260709 12:18:11.570281 24323 raft_consensus.cc:1275] T 5a08303c706b4fcda5778a1f60dc1915 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:11.575986 25408 consensus_queue.cc:1048] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:18:11.578109 25118 raft_consensus.cc:1275] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:11.592621 25289 raft_consensus.cc:1064] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:11.595359 25388 consensus_queue.cc:1048] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:11.601169 25289 consensus_queue.cc:237] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:11.593293 25295 consensus_queue.cc:1048] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:11.634616 24399 raft_consensus.cc:1275] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:11.640967 25410 raft_consensus.cc:2955] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:11.643054 24466 raft_consensus.cc:2955] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:11.651161 25117 raft_consensus.cc:1275] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:11.654474 25423 consensus_queue.cc:1048] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:11.669129 24325 raft_consensus.cc:1275] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:11.671005 25423 consensus_queue.cc:1048] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:11.694489 24221 catalog_manager.cc:5697] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:11.704527 25414 consensus_queue.cc:1048] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:11.709573 24470 raft_consensus.cc:1275] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:11.724367 25412 raft_consensus.cc:1064] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:11.745957 25289 consensus_queue.cc:1048] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:18:11.762174 25412 consensus_queue.cc:237] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:11.767621 25414 raft_consensus.cc:2955] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:11.782570 24319 raft_consensus.cc:2955] T 5a08303c706b4fcda5778a1f60dc1915 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:11.786092 25422 raft_consensus.cc:2955] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:11.792045 25116 raft_consensus.cc:2955] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:11.797492 24323 raft_consensus.cc:2955] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:11.811012 24394 raft_consensus.cc:2955] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:11.821201 25117 raft_consensus.cc:1275] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:11.822705 24469 raft_consensus.cc:1275] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:11.825027 25413 consensus_queue.cc:1048] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:11.829782 25413 consensus_queue.cc:1048] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:11.840921 24399 raft_consensus.cc:1275] T 95c2470f38204e5ba4ee545bb2de933c P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:11.844231 25413 consensus_queue.cc:1048] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:11.852257 24399 raft_consensus.cc:2955] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:11.882447 25413 raft_consensus.cc:2955] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:11.880887 24470 raft_consensus.cc:2955] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:11.892071 24471 raft_consensus.cc:2955] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:11.910866 25117 raft_consensus.cc:2955] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:11.913117 24398 raft_consensus.cc:2955] T 95c2470f38204e5ba4ee545bb2de933c P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:11.935685 25115 raft_consensus.cc:2955] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:11.950578 24220 catalog_manager.cc:5697] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:11.951962 25117 raft_consensus.cc:2955] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:11.990171 24222 catalog_manager.cc:5697] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:11.991974 24222 catalog_manager.cc:5697] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:12.022382 24394 consensus_queue.cc:237] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:12.022384 24319 consensus_queue.cc:237] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:12.023005 24325 consensus_queue.cc:237] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:12.028553 24471 consensus_queue.cc:237] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:12.032697 24470 raft_consensus.cc:1275] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:12.034533 25413 consensus_queue.cc:1048] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:12.035730 25117 raft_consensus.cc:1275] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:12.036413 25115 raft_consensus.cc:1275] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:12.039897 25116 raft_consensus.cc:1275] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:12.041530 25119 raft_consensus.cc:1275] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:12.041848 25423 consensus_queue.cc:1048] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:12.045008 24398 raft_consensus.cc:1275] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:12.051337 25409 consensus_queue.cc:1048] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:12.051558 25414 consensus_queue.cc:1048] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:12.052281 25408 consensus_queue.cc:1048] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:12.056587 25417 raft_consensus.cc:2955] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:12.058825 24471 raft_consensus.cc:1275] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:12.059216 25411 consensus_queue.cc:1048] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:12.062225 25413 raft_consensus.cc:2955] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:12.070544 24319 raft_consensus.cc:1275] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:12.071337 25116 raft_consensus.cc:2955] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:12.072762 25410 consensus_queue.cc:1048] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:12.075932 25423 consensus_queue.cc:1048] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:12.069110 25119 raft_consensus.cc:2955] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:12.083798 24323 raft_consensus.cc:2955] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:12.091346 24208 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7fd01a911fd14f38a5e1ca5b30c7da18 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:12.091934 25385 raft_consensus.cc:2955] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:12.092780 25115 raft_consensus.cc:2955] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:12.096292 24471 raft_consensus.cc:2955] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:12.106510 24210 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 125e800842274e17a2c01df7bb749005 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:12.112150 24220 catalog_manager.cc:5697] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a reported cstate change: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:12.115049 24394 raft_consensus.cc:2955] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:12.123006 24223 catalog_manager.cc:5697] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:12.123572 25413 raft_consensus.cc:2955] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:12.147224 24383 tablet_service.cc:1558] Processing DeleteTablet for tablet 125e800842274e17a2c01df7bb749005 with delete_type TABLET_DATA_TOMBSTONED (TS c855242ec9d34a5397741ef20db9de8a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51466
I20260709 12:18:12.148178 24470 raft_consensus.cc:2955] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:12.154282 24210 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 95c2470f38204e5ba4ee545bb2de933c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:12.151346 25117 raft_consensus.cc:2955] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:12.161417 24461 tablet_service.cc:1558] Processing DeleteTablet for tablet 7fd01a911fd14f38a5e1ca5b30c7da18 with delete_type TABLET_DATA_TOMBSTONED (TS 99b8650fa8324ac2ac5f75eee9b1a1e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33256
I20260709 12:18:12.186858 24223 catalog_manager.cc:5697] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:12.192834 25444 tablet_replica.cc:333] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:18:12.200943 25444 raft_consensus.cc:2243] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:12.202003 25444 raft_consensus.cc:2272] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:12.207921 25445 tablet_replica.cc:333] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:18:12.208137 24308 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a08303c706b4fcda5778a1f60dc1915 with delete_type TABLET_DATA_TOMBSTONED (TS c711faa13ead43ebbea0192cb74a4756 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44272
I20260709 12:18:12.209380 25445 raft_consensus.cc:2243] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:12.210265 25445 raft_consensus.cc:2272] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:12.215518 25445 ts_tablet_manager.cc:1916] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:12.216789 24209 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5a08303c706b4fcda5778a1f60dc1915 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:12.244414 24220 catalog_manager.cc:5697] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:12.246778 25444 ts_tablet_manager.cc:1916] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:12.247498 25445 ts_tablet_manager.cc:1929] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:12.248389 25445 log.cc:1199] T 7fd01a911fd14f38a5e1ca5b30c7da18 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-2-root/wals/7fd01a911fd14f38a5e1ca5b30c7da18
I20260709 12:18:12.251286 24209 catalog_manager.cc:5028] TS 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): tablet 7fd01a911fd14f38a5e1ca5b30c7da18 (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:12.252806 25446 tablet_replica.cc:333] T 5a08303c706b4fcda5778a1f60dc1915 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:18:12.253995 25446 raft_consensus.cc:2243] T 5a08303c706b4fcda5778a1f60dc1915 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:12.254880 25446 raft_consensus.cc:2272] T 5a08303c706b4fcda5778a1f60dc1915 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:12.258925 25446 ts_tablet_manager.cc:1916] T 5a08303c706b4fcda5778a1f60dc1915 P c711faa13ead43ebbea0192cb74a4756: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:12.278385 25444 ts_tablet_manager.cc:1929] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:12.279062 25444 log.cc:1199] T 125e800842274e17a2c01df7bb749005 P c855242ec9d34a5397741ef20db9de8a: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-1-root/wals/125e800842274e17a2c01df7bb749005
I20260709 12:18:12.279320 24383 tablet_service.cc:1558] Processing DeleteTablet for tablet 95c2470f38204e5ba4ee545bb2de933c with delete_type TABLET_DATA_TOMBSTONED (TS c855242ec9d34a5397741ef20db9de8a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51466
I20260709 12:18:12.281239 25444 tablet_replica.cc:333] T 95c2470f38204e5ba4ee545bb2de933c P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:18:12.282399 25444 raft_consensus.cc:2243] T 95c2470f38204e5ba4ee545bb2de933c P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:12.283336 25444 raft_consensus.cc:2272] T 95c2470f38204e5ba4ee545bb2de933c P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:12.284442 24208 catalog_manager.cc:5028] TS c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): tablet 125e800842274e17a2c01df7bb749005 (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:12.287273 25444 ts_tablet_manager.cc:1916] T 95c2470f38204e5ba4ee545bb2de933c P c855242ec9d34a5397741ef20db9de8a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:12.287963 25446 ts_tablet_manager.cc:1929] T 5a08303c706b4fcda5778a1f60dc1915 P c711faa13ead43ebbea0192cb74a4756: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:12.288420 25446 log.cc:1199] T 5a08303c706b4fcda5778a1f60dc1915 P c711faa13ead43ebbea0192cb74a4756: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-0-root/wals/5a08303c706b4fcda5778a1f60dc1915
I20260709 12:18:12.290475 24210 catalog_manager.cc:5028] TS c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): tablet 5a08303c706b4fcda5778a1f60dc1915 (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:12.302953 25444 ts_tablet_manager.cc:1929] T 95c2470f38204e5ba4ee545bb2de933c P c855242ec9d34a5397741ef20db9de8a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:12.303408 25444 log.cc:1199] T 95c2470f38204e5ba4ee545bb2de933c P c855242ec9d34a5397741ef20db9de8a: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-1-root/wals/95c2470f38204e5ba4ee545bb2de933c
I20260709 12:18:12.305150 24208 catalog_manager.cc:5028] TS c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): tablet 95c2470f38204e5ba4ee545bb2de933c (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:13.412583 24466 consensus_queue.cc:237] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:13.422309 24319 raft_consensus.cc:1275] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:13.422372 24398 raft_consensus.cc:1275] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:18:13.422911 24440 consensus_peers.cc:597] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3ae398278b05401c9dbc83b30a800655. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:13.423763 25448 consensus_queue.cc:1048] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:13.424959 25385 consensus_queue.cc:1048] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:13.440052 25385 raft_consensus.cc:2955] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:13.441901 24319 raft_consensus.cc:2955] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:13.459595 24319 consensus_queue.cc:237] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:13.461689 24398 raft_consensus.cc:2955] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:13.464936 24223 catalog_manager.cc:5697] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:13.468704 24394 raft_consensus.cc:1275] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:18:13.470191 24291 consensus_peers.cc:597] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 40ccde13a66c45c8bd6d8780ee632ea8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:13.470690 25413 consensus_queue.cc:1048] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:13.472244 24466 raft_consensus.cc:1275] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:13.476904 25413 consensus_queue.cc:1048] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:13.506098 24398 raft_consensus.cc:2955] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:13.499955 25412 raft_consensus.cc:2955] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:13.525255 24470 raft_consensus.cc:2955] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:13.538622 24319 consensus_queue.cc:237] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:13.543745 24220 catalog_manager.cc:5697] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:13.561738 24470 raft_consensus.cc:1275] T 48b5441f03704ebb94ffdbb55b9f33c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:13.564013 25413 consensus_queue.cc:1048] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:18:13.564996 24291 consensus_peers.cc:597] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 48b5441f03704ebb94ffdbb55b9f33c6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:13.568619 24398 raft_consensus.cc:1275] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:13.570964 25413 consensus_queue.cc:1048] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:13.573222 25413 raft_consensus.cc:2955] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:13.575135 24470 raft_consensus.cc:2955] T 48b5441f03704ebb94ffdbb55b9f33c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:13.590937 24470 consensus_queue.cc:237] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
W20260709 12:18:13.599982 24440 consensus_peers.cc:597] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 101287bb58d2418bad8554ed0a096407. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:13.600185 24398 raft_consensus.cc:1275] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:13.602077 25448 consensus_queue.cc:1048] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:13.604063 24325 raft_consensus.cc:1275] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:13.609189 25448 consensus_queue.cc:1048] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:13.617645 24221 catalog_manager.cc:5697] T 48b5441f03704ebb94ffdbb55b9f33c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:13.625648 24395 raft_consensus.cc:2955] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:13.636566 25388 raft_consensus.cc:2955] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:13.645011 24394 raft_consensus.cc:2955] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:13.731302 24325 raft_consensus.cc:2955] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:13.732901 24222 catalog_manager.cc:5697] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:13.871059 25468 ts_tablet_manager.cc:933] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:13.873745 25468 tablet_copy_client.cc:323] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.195:44453
I20260709 12:18:13.876247 24484 tablet_copy_service.cc:140] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Received BeginTabletCopySession request for tablet 3ae398278b05401c9dbc83b30a800655 from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:33198)
I20260709 12:18:13.876793 24484 tablet_copy_service.cc:161] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Beginning new tablet copy session on tablet 3ae398278b05401c9dbc83b30a800655 from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:33198: session id = d99d5d772cfe4a96afcab3d3b009a281-3ae398278b05401c9dbc83b30a800655
I20260709 12:18:13.883421 24484 tablet_copy_source_session.cc:215] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:13.887964 25468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae398278b05401c9dbc83b30a800655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:13.904829 25468 tablet_copy_client.cc:806] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:13.905542 25468 tablet_copy_client.cc:670] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:13.910354 25468 tablet_copy_client.cc:538] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:13.923606 25468 tablet_bootstrap.cc:492] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:18:13.949595 25468 tablet_bootstrap.cc:492] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:13.950708 25468 tablet_bootstrap.cc:492] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:13.951530 25468 ts_tablet_manager.cc:1403] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.012s
I20260709 12:18:13.957001 25468 raft_consensus.cc:359] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:13.958940 25468 raft_consensus.cc:740] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:13.959679 25468 consensus_queue.cc:260] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:13.966506 25468 ts_tablet_manager.cc:1434] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.005s
I20260709 12:18:13.969151 24484 tablet_copy_service.cc:342] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-3ae398278b05401c9dbc83b30a800655 received from {username='slave'} at 127.0.0.1:33198
I20260709 12:18:13.969672 24484 tablet_copy_service.cc:434] P 99b8650fa8324ac2ac5f75eee9b1a1e3: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-3ae398278b05401c9dbc83b30a800655 on tablet 3ae398278b05401c9dbc83b30a800655 with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:14.075392 25468 ts_tablet_manager.cc:933] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:18:14.077246 25468 tablet_copy_client.cc:323] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.193:36951
I20260709 12:18:14.079210 24335 tablet_copy_service.cc:140] P c711faa13ead43ebbea0192cb74a4756: Received BeginTabletCopySession request for tablet 40ccde13a66c45c8bd6d8780ee632ea8 from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:57702)
I20260709 12:18:14.079758 24335 tablet_copy_service.cc:161] P c711faa13ead43ebbea0192cb74a4756: Beginning new tablet copy session on tablet 40ccde13a66c45c8bd6d8780ee632ea8 from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:57702: session id = d99d5d772cfe4a96afcab3d3b009a281-40ccde13a66c45c8bd6d8780ee632ea8
I20260709 12:18:14.087931 24335 tablet_copy_source_session.cc:215] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:14.091712 25468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40ccde13a66c45c8bd6d8780ee632ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:14.107858 25468 tablet_copy_client.cc:806] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:14.108554 25468 tablet_copy_client.cc:670] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:14.112556 25468 tablet_copy_client.cc:538] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:14.122200 25468 tablet_bootstrap.cc:492] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:18:14.141567 25468 tablet_bootstrap.cc:492] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:14.142553 25468 tablet_bootstrap.cc:492] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:14.143260 25468 ts_tablet_manager.cc:1403] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.005s
I20260709 12:18:14.148799 25468 raft_consensus.cc:359] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:14.149760 25468 raft_consensus.cc:740] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:14.150475 25468 consensus_queue.cc:260] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:14.157611 25468 ts_tablet_manager.cc:1434] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:18:14.159541 24335 tablet_copy_service.cc:342] P c711faa13ead43ebbea0192cb74a4756: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-40ccde13a66c45c8bd6d8780ee632ea8 received from {username='slave'} at 127.0.0.1:57702
I20260709 12:18:14.160024 24335 tablet_copy_service.cc:434] P c711faa13ead43ebbea0192cb74a4756: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-40ccde13a66c45c8bd6d8780ee632ea8 on tablet 40ccde13a66c45c8bd6d8780ee632ea8 with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:14.168042 25468 ts_tablet_manager.cc:933] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:18:14.172555 25468 tablet_copy_client.cc:323] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.193:36951
I20260709 12:18:14.175282 24335 tablet_copy_service.cc:140] P c711faa13ead43ebbea0192cb74a4756: Received BeginTabletCopySession request for tablet 48b5441f03704ebb94ffdbb55b9f33c6 from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:57702)
I20260709 12:18:14.175902 24335 tablet_copy_service.cc:161] P c711faa13ead43ebbea0192cb74a4756: Beginning new tablet copy session on tablet 48b5441f03704ebb94ffdbb55b9f33c6 from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:57702: session id = d99d5d772cfe4a96afcab3d3b009a281-48b5441f03704ebb94ffdbb55b9f33c6
I20260709 12:18:14.185369 24335 tablet_copy_source_session.cc:215] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:14.200220 25468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48b5441f03704ebb94ffdbb55b9f33c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:14.201747 25475 ts_tablet_manager.cc:933] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:14.229600 25475 tablet_copy_client.cc:323] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.195:44453
I20260709 12:18:14.231930 24484 tablet_copy_service.cc:140] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Received BeginTabletCopySession request for tablet 101287bb58d2418bad8554ed0a096407 from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:33198)
I20260709 12:18:14.232288 25468 tablet_copy_client.cc:806] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:14.232605 24484 tablet_copy_service.cc:161] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Beginning new tablet copy session on tablet 101287bb58d2418bad8554ed0a096407 from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:33198: session id = d99d5d772cfe4a96afcab3d3b009a281-101287bb58d2418bad8554ed0a096407
I20260709 12:18:14.233148 25468 tablet_copy_client.cc:670] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:14.241784 25468 tablet_copy_client.cc:538] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:14.245713 24484 tablet_copy_source_session.cc:215] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:14.249683 25475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 101287bb58d2418bad8554ed0a096407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:14.253160 25468 tablet_bootstrap.cc:492] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:18:14.271657 25475 tablet_copy_client.cc:806] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:14.284205 25475 tablet_copy_client.cc:670] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:14.289206 25119 raft_consensus.cc:1217] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:14.289618 25475 tablet_copy_client.cc:538] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:14.298449 25468 tablet_bootstrap.cc:492] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:14.299407 25468 tablet_bootstrap.cc:492] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:14.300076 25468 ts_tablet_manager.cc:1403] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.013s
I20260709 12:18:14.302960 25468 raft_consensus.cc:359] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:14.303747 25468 raft_consensus.cc:740] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:14.304340 25468 consensus_queue.cc:260] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:14.306509 25468 ts_tablet_manager.cc:1434] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:18:14.308339 24335 tablet_copy_service.cc:342] P c711faa13ead43ebbea0192cb74a4756: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-48b5441f03704ebb94ffdbb55b9f33c6 received from {username='slave'} at 127.0.0.1:57702
I20260709 12:18:14.308799 24335 tablet_copy_service.cc:434] P c711faa13ead43ebbea0192cb74a4756: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-48b5441f03704ebb94ffdbb55b9f33c6 on tablet 48b5441f03704ebb94ffdbb55b9f33c6 with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:14.313910 25475 tablet_bootstrap.cc:492] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:18:14.333029 25475 tablet_bootstrap.cc:492] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:14.333840 25475 tablet_bootstrap.cc:492] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:14.334544 25475 ts_tablet_manager.cc:1403] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 12:18:14.336980 25475 raft_consensus.cc:359] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:14.337584 25475 raft_consensus.cc:740] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:14.338124 25475 consensus_queue.cc:260] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:14.340169 25475 ts_tablet_manager.cc:1434] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 12:18:14.342259 24484 tablet_copy_service.cc:342] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-101287bb58d2418bad8554ed0a096407 received from {username='slave'} at 127.0.0.1:33198
I20260709 12:18:14.342741 24484 tablet_copy_service.cc:434] P 99b8650fa8324ac2ac5f75eee9b1a1e3: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-101287bb58d2418bad8554ed0a096407 on tablet 101287bb58d2418bad8554ed0a096407 with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:14.667361 25119 raft_consensus.cc:1217] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:14.691809 25119 raft_consensus.cc:1217] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:14.711648 25119 raft_consensus.cc:1217] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:14.873481 25385 raft_consensus.cc:1064] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:14.876072 25385 consensus_queue.cc:237] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:14.888372 25119 raft_consensus.cc:1275] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:14.890303 25388 consensus_queue.cc:1048] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:14.893370 24323 raft_consensus.cc:1275] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:14.894975 25388 consensus_queue.cc:1048] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:14.896721 24395 raft_consensus.cc:1275] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:14.901240 25467 consensus_queue.cc:1048] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:14.923529 25388 raft_consensus.cc:2955] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:14.925611 24395 raft_consensus.cc:2955] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:14.936520 25119 raft_consensus.cc:2955] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:14.943666 24220 catalog_manager.cc:5697] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:14.939015 24325 raft_consensus.cc:2955] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:14.995319 24466 consensus_queue.cc:237] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:15.002413 25117 raft_consensus.cc:1275] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:15.004345 25388 consensus_queue.cc:1048] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:15.007563 24395 raft_consensus.cc:1275] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:15.009281 25388 consensus_queue.cc:1048] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:15.016050 25485 raft_consensus.cc:2955] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:15.025187 24395 raft_consensus.cc:2955] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:15.027438 25117 raft_consensus.cc:2955] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:15.038900 24209 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3ae398278b05401c9dbc83b30a800655 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:15.055538 24220 catalog_manager.cc:5697] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a reported cstate change: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:15.069923 24308 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ae398278b05401c9dbc83b30a800655 with delete_type TABLET_DATA_TOMBSTONED (TS c711faa13ead43ebbea0192cb74a4756 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44272
I20260709 12:18:15.085582 25493 tablet_replica.cc:333] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:18:15.086911 25493 raft_consensus.cc:2243] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:15.087833 25493 raft_consensus.cc:2272] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:15.092013 25493 ts_tablet_manager.cc:1916] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:15.110221 25493 ts_tablet_manager.cc:1929] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:15.110752 25493 log.cc:1199] T 3ae398278b05401c9dbc83b30a800655 P c711faa13ead43ebbea0192cb74a4756: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-0-root/wals/3ae398278b05401c9dbc83b30a800655
I20260709 12:18:15.112457 24210 catalog_manager.cc:5028] TS c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): tablet 3ae398278b05401c9dbc83b30a800655 (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:15.162492 25483 raft_consensus.cc:1064] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:15.165169 25483 consensus_queue.cc:237] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:15.173799 25117 raft_consensus.cc:1275] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:15.175040 24466 raft_consensus.cc:1275] T 48b5441f03704ebb94ffdbb55b9f33c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:15.176302 24395 raft_consensus.cc:1275] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:15.175982 25463 consensus_queue.cc:1048] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:15.186547 25412 consensus_queue.cc:1048] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:15.189647 25483 consensus_queue.cc:1048] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:15.209779 25412 raft_consensus.cc:2955] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:15.215521 24395 raft_consensus.cc:2955] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:15.219748 24466 raft_consensus.cc:2955] T 48b5441f03704ebb94ffdbb55b9f33c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:15.257583 25117 raft_consensus.cc:2955] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:15.265647 24220 catalog_manager.cc:5697] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:15.288178 25463 raft_consensus.cc:1064] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:15.291071 25463 consensus_queue.cc:237] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:15.301395 24323 consensus_queue.cc:237] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:15.313865 24394 raft_consensus.cc:1275] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:15.315469 25483 consensus_queue.cc:1048] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:15.318746 25117 raft_consensus.cc:1275] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:15.322570 25117 raft_consensus.cc:1275] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:15.322882 24470 raft_consensus.cc:1275] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:15.323247 25412 raft_consensus.cc:2955] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:15.324678 25483 consensus_queue.cc:1048] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:15.326646 25498 consensus_queue.cc:1048] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:15.331194 24395 raft_consensus.cc:2955] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:15.333717 25119 raft_consensus.cc:2955] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:15.335295 24398 raft_consensus.cc:1275] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:15.340117 25498 consensus_queue.cc:1048] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:15.349009 25485 raft_consensus.cc:1064] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:15.354797 25485 consensus_queue.cc:237] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:15.359654 25483 consensus_queue.cc:1048] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:15.375496 24210 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 48b5441f03704ebb94ffdbb55b9f33c6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:15.374722 24223 catalog_manager.cc:5697] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a reported cstate change: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:18:15.414978 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 90589.7us
I20260709 12:18:15.457926 25117 raft_consensus.cc:1275] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:15.458832 24395 raft_consensus.cc:1275] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:15.463546 24461 tablet_service.cc:1558] Processing DeleteTablet for tablet 48b5441f03704ebb94ffdbb55b9f33c6 with delete_type TABLET_DATA_TOMBSTONED (TS 99b8650fa8324ac2ac5f75eee9b1a1e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33256
I20260709 12:18:15.467324 25485 consensus_queue.cc:1048] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:15.488780 25513 tablet_replica.cc:333] T 48b5441f03704ebb94ffdbb55b9f33c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
W20260709 12:18:15.489385 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 46345.7us
I20260709 12:18:15.496783 24325 raft_consensus.cc:1275] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:15.504917 25485 consensus_queue.cc:1048] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:18:15.511497 25505 log.cc:927] Time spent T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.056s	user 0.004s	sys 0.000s
I20260709 12:18:15.519397 25467 consensus_queue.cc:1048] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:15.530136 25511 raft_consensus.cc:2955] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:15.538895 25513 raft_consensus.cc:2243] T 48b5441f03704ebb94ffdbb55b9f33c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:15.540264 25513 raft_consensus.cc:2272] T 48b5441f03704ebb94ffdbb55b9f33c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:15.546597 25513 ts_tablet_manager.cc:1916] T 48b5441f03704ebb94ffdbb55b9f33c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:15.549938 24398 raft_consensus.cc:2955] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:15.574513 24471 raft_consensus.cc:2955] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:15.588359 25119 raft_consensus.cc:2955] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:15.578207 25517 raft_consensus.cc:2955] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:15.588434 24220 catalog_manager.cc:5697] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:15.607241 25116 raft_consensus.cc:2955] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:15.629189 24394 raft_consensus.cc:2955] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:15.631925 25513 ts_tablet_manager.cc:1929] T 48b5441f03704ebb94ffdbb55b9f33c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:15.632495 25513 log.cc:1199] T 48b5441f03704ebb94ffdbb55b9f33c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-2-root/wals/48b5441f03704ebb94ffdbb55b9f33c6
I20260709 12:18:15.639986 24325 raft_consensus.cc:2955] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:15.642025 24209 catalog_manager.cc:5028] TS 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): tablet 48b5441f03704ebb94ffdbb55b9f33c6 (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:15.661487 24318 consensus_queue.cc:237] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:15.670264 25119 raft_consensus.cc:1275] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:15.673769 24220 catalog_manager.cc:5697] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:15.678335 24395 raft_consensus.cc:1275] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:15.685113 25511 consensus_queue.cc:1048] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:15.702555 25509 consensus_queue.cc:1048] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:18:15.715341 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 54983.8us
I20260709 12:18:15.716758 25512 raft_consensus.cc:2955] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:15.726655 24394 raft_consensus.cc:2955] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:15.739537 25119 raft_consensus.cc:2955] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:15.741108 24210 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 40ccde13a66c45c8bd6d8780ee632ea8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:15.744238 24466 consensus_queue.cc:237] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:15.753403 24220 catalog_manager.cc:5697] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:15.756433 24398 raft_consensus.cc:1275] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:15.755128 25119 raft_consensus.cc:1275] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:15.758764 25516 consensus_queue.cc:1048] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:15.761408 25385 consensus_queue.cc:1048] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:15.766786 25517 raft_consensus.cc:2955] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:15.773368 24398 raft_consensus.cc:2955] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:15.776729 25119 raft_consensus.cc:2955] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:15.779436 24209 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 101287bb58d2418bad8554ed0a096407 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:15.783747 24461 tablet_service.cc:1558] Processing DeleteTablet for tablet 40ccde13a66c45c8bd6d8780ee632ea8 with delete_type TABLET_DATA_TOMBSTONED (TS 99b8650fa8324ac2ac5f75eee9b1a1e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33256
I20260709 12:18:15.785109 25513 tablet_replica.cc:333] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:18:15.786113 25513 raft_consensus.cc:2243] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:15.786865 25513 raft_consensus.cc:2272] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:15.791289 25513 ts_tablet_manager.cc:1916] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:15.795697 24220 catalog_manager.cc:5697] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:15.819702 24308 tablet_service.cc:1558] Processing DeleteTablet for tablet 101287bb58d2418bad8554ed0a096407 with delete_type TABLET_DATA_TOMBSTONED (TS c711faa13ead43ebbea0192cb74a4756 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44272
I20260709 12:18:15.825213 25521 tablet_replica.cc:333] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:18:15.826531 25521 raft_consensus.cc:2243] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:15.827059 25513 ts_tablet_manager.cc:1929] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:15.827488 25521 raft_consensus.cc:2272] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:15.827646 25513 log.cc:1199] T 40ccde13a66c45c8bd6d8780ee632ea8 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-2-root/wals/40ccde13a66c45c8bd6d8780ee632ea8
I20260709 12:18:15.829699 24209 catalog_manager.cc:5028] TS 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): tablet 40ccde13a66c45c8bd6d8780ee632ea8 (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:15.834962 25521 ts_tablet_manager.cc:1916] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:15.848613 25521 ts_tablet_manager.cc:1929] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:15.849058 25521 log.cc:1199] T 101287bb58d2418bad8554ed0a096407 P c711faa13ead43ebbea0192cb74a4756: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-0-root/wals/101287bb58d2418bad8554ed0a096407
I20260709 12:18:15.850585 24210 catalog_manager.cc:5028] TS c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): tablet 101287bb58d2418bad8554ed0a096407 (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:16.888046 24318 consensus_queue.cc:237] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:16.896937 24471 raft_consensus.cc:1275] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:18:16.897437 24291 consensus_peers.cc:597] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 01bd4c6351f24e35abba86aef1ce23be. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:16.898059 24398 raft_consensus.cc:1275] T 01bd4c6351f24e35abba86aef1ce23be P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:16.898255 25509 consensus_queue.cc:1048] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:16.899447 25463 consensus_queue.cc:1048] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:16.913049 25463 raft_consensus.cc:2955] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:16.914731 24398 raft_consensus.cc:2955] T 01bd4c6351f24e35abba86aef1ce23be P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:16.916841 24471 raft_consensus.cc:2955] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:16.932024 24471 consensus_queue.cc:237] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:16.934625 24223 catalog_manager.cc:5697] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:16.951793 24398 raft_consensus.cc:1275] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:16.952765 24318 raft_consensus.cc:1275] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:16.953624 25522 consensus_queue.cc:1048] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:18:16.954682 24440 consensus_peers.cc:597] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 400165817fe74ada9a4793982993a5e3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:16.955691 25522 consensus_queue.cc:1048] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:16.964046 25522 raft_consensus.cc:2955] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:16.973362 24394 raft_consensus.cc:2955] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:16.984702 24395 consensus_queue.cc:237] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:16.995213 24221 catalog_manager.cc:5697] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 2 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:17.002844 24319 raft_consensus.cc:2955] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:17.009874 24471 raft_consensus.cc:1275] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:18:17.013295 24366 consensus_peers.cc:597] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83efb40b1c6f4c9385b9e7c153e902bc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:17.014818 24318 raft_consensus.cc:1275] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:17.015084 25507 consensus_queue.cc:1048] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:17.019728 25422 consensus_queue.cc:1048] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:17.054816 25538 raft_consensus.cc:2955] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:17.057380 24319 raft_consensus.cc:2955] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:17.061805 24466 raft_consensus.cc:2955] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:17.075261 24395 consensus_queue.cc:237] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:17.075165 24221 catalog_manager.cc:5697] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
W20260709 12:18:17.092939 24366 consensus_peers.cc:597] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dfa0a0cd756141c094288d3c05139379. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:17.093277 24325 raft_consensus.cc:1275] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:17.095911 24466 raft_consensus.cc:1275] T dfa0a0cd756141c094288d3c05139379 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:17.098775 25422 consensus_queue.cc:1048] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:17.099745 25507 consensus_queue.cc:1048] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:17.109112 25538 raft_consensus.cc:2955] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:17.110918 24466 raft_consensus.cc:2955] T dfa0a0cd756141c094288d3c05139379 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:17.113212 24319 raft_consensus.cc:2955] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:17.131145 24220 catalog_manager.cc:5697] T dfa0a0cd756141c094288d3c05139379 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:17.349012 25545 ts_tablet_manager.cc:933] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:18:17.352085 25545 tablet_copy_client.cc:323] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.193:36951
I20260709 12:18:17.353766 24335 tablet_copy_service.cc:140] P c711faa13ead43ebbea0192cb74a4756: Received BeginTabletCopySession request for tablet 01bd4c6351f24e35abba86aef1ce23be from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:57702)
I20260709 12:18:17.354230 24335 tablet_copy_service.cc:161] P c711faa13ead43ebbea0192cb74a4756: Beginning new tablet copy session on tablet 01bd4c6351f24e35abba86aef1ce23be from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:57702: session id = d99d5d772cfe4a96afcab3d3b009a281-01bd4c6351f24e35abba86aef1ce23be
I20260709 12:18:17.365222 24335 tablet_copy_source_session.cc:215] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:17.376096 25547 ts_tablet_manager.cc:933] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:17.383006 25545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01bd4c6351f24e35abba86aef1ce23be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:17.413981 25545 tablet_copy_client.cc:806] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:17.414688 25545 tablet_copy_client.cc:670] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:17.455546 25545 tablet_copy_client.cc:538] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:17.472941 25545 tablet_bootstrap.cc:492] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:18:17.486707 25547 tablet_copy_client.cc:323] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.195:44453
I20260709 12:18:17.489562 24484 tablet_copy_service.cc:140] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Received BeginTabletCopySession request for tablet 400165817fe74ada9a4793982993a5e3 from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:33198)
I20260709 12:18:17.490264 24484 tablet_copy_service.cc:161] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Beginning new tablet copy session on tablet 400165817fe74ada9a4793982993a5e3 from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:33198: session id = d99d5d772cfe4a96afcab3d3b009a281-400165817fe74ada9a4793982993a5e3
I20260709 12:18:17.496493 25549 ts_tablet_manager.cc:933] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:17.512068 24484 tablet_copy_source_session.cc:215] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:17.523723 25547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400165817fe74ada9a4793982993a5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:17.557345 25547 tablet_copy_client.cc:806] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:17.558133 25547 tablet_copy_client.cc:670] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:17.563822 25545 tablet_bootstrap.cc:492] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:17.565163 25545 tablet_bootstrap.cc:492] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:17.565999 25545 ts_tablet_manager.cc:1403] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.093s	user 0.026s	sys 0.004s
I20260709 12:18:17.569187 25549 tablet_copy_client.cc:323] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.194:35893
I20260709 12:18:17.569691 25545 raft_consensus.cc:359] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:17.570566 25547 tablet_copy_client.cc:538] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:17.570722 25545 raft_consensus.cc:740] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:17.571605 25545 consensus_queue.cc:260] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:17.737526 24410 tablet_copy_service.cc:140] P c855242ec9d34a5397741ef20db9de8a: Received BeginTabletCopySession request for tablet 83efb40b1c6f4c9385b9e7c153e902bc from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:50950)
I20260709 12:18:17.740070 24410 tablet_copy_service.cc:161] P c855242ec9d34a5397741ef20db9de8a: Beginning new tablet copy session on tablet 83efb40b1c6f4c9385b9e7c153e902bc from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:50950: session id = d99d5d772cfe4a96afcab3d3b009a281-83efb40b1c6f4c9385b9e7c153e902bc
I20260709 12:18:17.766433 24410 tablet_copy_source_session.cc:215] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:17.776929 25545 ts_tablet_manager.cc:1434] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.211s	user 0.014s	sys 0.043s
I20260709 12:18:17.779563 24335 tablet_copy_service.cc:342] P c711faa13ead43ebbea0192cb74a4756: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-01bd4c6351f24e35abba86aef1ce23be received from {username='slave'} at 127.0.0.1:57702
I20260709 12:18:17.780222 24335 tablet_copy_service.cc:434] P c711faa13ead43ebbea0192cb74a4756: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-01bd4c6351f24e35abba86aef1ce23be on tablet 01bd4c6351f24e35abba86aef1ce23be with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:17.816098 25119 raft_consensus.cc:1217] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:18:17.810698 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 61378.6us
I20260709 12:18:17.819890 25545 ts_tablet_manager.cc:933] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:17.827886 25549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83efb40b1c6f4c9385b9e7c153e902bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:17.919147 25545 tablet_copy_client.cc:323] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.194:35893
W20260709 12:18:17.920766 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 45468.1us
I20260709 12:18:17.921221 24410 tablet_copy_service.cc:140] P c855242ec9d34a5397741ef20db9de8a: Received BeginTabletCopySession request for tablet dfa0a0cd756141c094288d3c05139379 from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:50950)
I20260709 12:18:17.921763 24410 tablet_copy_service.cc:161] P c855242ec9d34a5397741ef20db9de8a: Beginning new tablet copy session on tablet dfa0a0cd756141c094288d3c05139379 from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:50950: session id = d99d5d772cfe4a96afcab3d3b009a281-dfa0a0cd756141c094288d3c05139379
I20260709 12:18:17.934073 24410 tablet_copy_source_session.cc:215] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:17.904552 25547 tablet_bootstrap.cc:492] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:18:17.951771 25545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfa0a0cd756141c094288d3c05139379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:17.965817 25549 tablet_copy_client.cc:806] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:17.966527 25549 tablet_copy_client.cc:670] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:17.971529 25549 tablet_copy_client.cc:538] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:17.982410 25549 tablet_bootstrap.cc:492] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:18:17.996567 25545 tablet_copy_client.cc:806] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:17.997296 25545 tablet_copy_client.cc:670] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:18.001271 25545 tablet_copy_client.cc:538] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:18.009781 25549 tablet_bootstrap.cc:492] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:18.011407 25549 tablet_bootstrap.cc:492] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:18.012261 25549 ts_tablet_manager.cc:1403] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.030s	user 0.022s	sys 0.006s
I20260709 12:18:18.014905 25547 tablet_bootstrap.cc:492] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:18.016012 25547 tablet_bootstrap.cc:492] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:18.015756 25549 raft_consensus.cc:359] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:18.016721 25549 raft_consensus.cc:740] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:18.016948 25547 ts_tablet_manager.cc:1403] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.113s	user 0.027s	sys 0.012s
I20260709 12:18:18.019644 25549 consensus_queue.cc:260] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:18.021067 25547 raft_consensus.cc:359] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:18.022137 25547 raft_consensus.cc:740] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:18.022998 25549 ts_tablet_manager.cc:1434] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:18:18.027823 25547 consensus_queue.cc:260] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:18.029675 24410 tablet_copy_service.cc:342] P c855242ec9d34a5397741ef20db9de8a: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-83efb40b1c6f4c9385b9e7c153e902bc received from {username='slave'} at 127.0.0.1:50950
I20260709 12:18:18.030238 24410 tablet_copy_service.cc:434] P c855242ec9d34a5397741ef20db9de8a: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-83efb40b1c6f4c9385b9e7c153e902bc on tablet 83efb40b1c6f4c9385b9e7c153e902bc with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:18.031100 25547 ts_tablet_manager.cc:1434] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:18:18.023605 25545 tablet_bootstrap.cc:492] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:18:18.034385 24484 tablet_copy_service.cc:342] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-400165817fe74ada9a4793982993a5e3 received from {username='slave'} at 127.0.0.1:33198
I20260709 12:18:18.034852 24484 tablet_copy_service.cc:434] P 99b8650fa8324ac2ac5f75eee9b1a1e3: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-400165817fe74ada9a4793982993a5e3 on tablet 400165817fe74ada9a4793982993a5e3 with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:18.061657 25545 tablet_bootstrap.cc:492] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:18.062389 25545 tablet_bootstrap.cc:492] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:18.063038 25545 ts_tablet_manager.cc:1403] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.007s
I20260709 12:18:18.066236 25545 raft_consensus.cc:359] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:18.067181 25545 raft_consensus.cc:740] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:18.068033 25545 consensus_queue.cc:260] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:18.070474 25545 ts_tablet_manager.cc:1434] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:18:18.073417 24410 tablet_copy_service.cc:342] P c855242ec9d34a5397741ef20db9de8a: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-dfa0a0cd756141c094288d3c05139379 received from {username='slave'} at 127.0.0.1:50950
I20260709 12:18:18.073936 24410 tablet_copy_service.cc:434] P c855242ec9d34a5397741ef20db9de8a: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-dfa0a0cd756141c094288d3c05139379 on tablet dfa0a0cd756141c094288d3c05139379 with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:18.171587 25554 raft_consensus.cc:1064] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:18.174764 25554 consensus_queue.cc:237] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:18.186941 25119 raft_consensus.cc:1275] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:18.188385 24400 raft_consensus.cc:1275] T 01bd4c6351f24e35abba86aef1ce23be P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:18.191701 25528 consensus_queue.cc:1048] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:18.194113 25509 consensus_queue.cc:1048] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:18.196038 24470 raft_consensus.cc:1275] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:18.197988 25509 consensus_queue.cc:1048] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:18.211377 25509 raft_consensus.cc:2955] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:18.219542 24399 raft_consensus.cc:2955] T 01bd4c6351f24e35abba86aef1ce23be P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:18.236390 24470 raft_consensus.cc:2955] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:18.240990 25119 raft_consensus.cc:2955] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:18.249651 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:18.260370 24223 catalog_manager.cc:5697] T 01bd4c6351f24e35abba86aef1ce23be P c855242ec9d34a5397741ef20db9de8a reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:18.304150 24319 consensus_queue.cc:237] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:18.307672 25117 raft_consensus.cc:1217] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:18.311791 24470 raft_consensus.cc:1275] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:18.328205 25509 consensus_queue.cc:1048] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:18.330602 25117 raft_consensus.cc:1275] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:18.332823 25509 consensus_queue.cc:1048] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:18.343489 25554 raft_consensus.cc:2955] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:18.363715 24470 raft_consensus.cc:2955] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:18.381847 25119 raft_consensus.cc:2955] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:18.426254 24222 catalog_manager.cc:5697] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:18.438362 24210 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 01bd4c6351f24e35abba86aef1ce23be with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:18.455767 24383 tablet_service.cc:1558] Processing DeleteTablet for tablet 01bd4c6351f24e35abba86aef1ce23be with delete_type TABLET_DATA_TOMBSTONED (TS c855242ec9d34a5397741ef20db9de8a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51466
I20260709 12:18:18.458103 25119 raft_consensus.cc:1217] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:18:18.460455 25576 tablet_replica.cc:333] T 01bd4c6351f24e35abba86aef1ce23be P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:18:18.461731 25576 raft_consensus.cc:2243] T 01bd4c6351f24e35abba86aef1ce23be P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.462507 25576 raft_consensus.cc:2272] T 01bd4c6351f24e35abba86aef1ce23be P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.478767 24470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
mode: GRACEFUL
new_leader_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:42866
I20260709 12:18:18.479573 24470 raft_consensus.cc:606] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Received request to transfer leadership to TS c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:18.484586 24470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
mode: GRACEFUL
new_leader_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:42866
I20260709 12:18:18.485229 24470 raft_consensus.cc:606] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Received request to transfer leadership to TS c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:18.491258 24470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "626f1d05390b4454b317c19d513384be"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
mode: GRACEFUL
new_leader_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:42866
I20260709 12:18:18.491992 24470 raft_consensus.cc:606] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Received request to transfer leadership to TS c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:18.494881 24470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ae0187acc6343ef874010bc79580048"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
mode: GRACEFUL
new_leader_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:42866
I20260709 12:18:18.495539 24470 raft_consensus.cc:606] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Received request to transfer leadership to TS c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:18.498594 25576 ts_tablet_manager.cc:1916] T 01bd4c6351f24e35abba86aef1ce23be P c855242ec9d34a5397741ef20db9de8a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:18.501192 25117 raft_consensus.cc:1217] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:18.522722 25576 ts_tablet_manager.cc:1929] T 01bd4c6351f24e35abba86aef1ce23be P c855242ec9d34a5397741ef20db9de8a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:18.530920 25576 log.cc:1199] T 01bd4c6351f24e35abba86aef1ce23be P c855242ec9d34a5397741ef20db9de8a: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-1-root/wals/01bd4c6351f24e35abba86aef1ce23be
I20260709 12:18:18.534114 24208 catalog_manager.cc:5028] TS c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): tablet 01bd4c6351f24e35abba86aef1ce23be (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:18.544504 24399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:18:18.545246 24399 raft_consensus.cc:606] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Received request to transfer leadership to TS c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:18.565006 24319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:42226
I20260709 12:18:18.565641 24319 raft_consensus.cc:606] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:18.569018 24470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
mode: GRACEFUL
new_leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
 from {username='slave'} at 127.0.0.1:42866
I20260709 12:18:18.569334 25522 raft_consensus.cc:993] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3: : Instructing follower c855242ec9d34a5397741ef20db9de8a to start an election
I20260709 12:18:18.569645 24470 raft_consensus.cc:606] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Received request to transfer leadership to TS d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:18.570013 25522 raft_consensus.cc:1081] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Signalling peer c855242ec9d34a5397741ef20db9de8a to start an election
I20260709 12:18:18.571638 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:18:18.573544 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:18.574738 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:18.578334 24399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:51474
I20260709 12:18:18.579066 24399 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:18.579425 24399 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:18.586169 24399 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:18.588003 24399 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:18.589051 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:18.589624 24319 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:18.591913 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:18.592463 24470 raft_consensus.cc:3055] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:18.592731 24470 raft_consensus.cc:740] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:18.593389 24470 consensus_queue.cc:260] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:18.594182 24470 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:18.638988 25509 raft_consensus.cc:993] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756: : Instructing follower 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
I20260709 12:18:18.639659 25509 raft_consensus.cc:1081] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Signalling peer 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
I20260709 12:18:18.641502 24469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:33272
I20260709 12:18:18.642095 24469 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:18.642192 24470 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:18.642449 24469 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:18.646813 24365 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:18.647804 25507 raft_consensus.cc:2804] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:18.648461 25507 raft_consensus.cc:697] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:18.649587 24469 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:18.649444 25507 consensus_queue.cc:237] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:18.660763 24319 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:18.670607 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:18.671528 24325 raft_consensus.cc:3055] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:18.670809 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:18.672127 24399 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:18.674170 24469 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:18.675408 24325 raft_consensus.cc:740] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:18.676223 24325 consensus_queue.cc:260] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:18.679349 24399 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:18.679493 24325 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:18.680684 25561 raft_consensus.cc:993] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3: : Instructing follower c711faa13ead43ebbea0192cb74a4756 to start an election
I20260709 12:18:18.681126 25561 raft_consensus.cc:1081] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Signalling peer c711faa13ead43ebbea0192cb74a4756 to start an election
I20260709 12:18:18.684572 24318 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ae0187acc6343ef874010bc79580048"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:44278
I20260709 12:18:18.685786 24438 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:18.686591 25516 raft_consensus.cc:2804] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:18.687189 25516 raft_consensus.cc:697] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:18.687282 24318 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:18.687671 24318 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:18.688103 25516 consensus_queue.cc:237] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:18.702458 24318 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:18.709128 24318 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:18.711962 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:18.712939 24469 raft_consensus.cc:3055] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:18.713295 24469 raft_consensus.cc:740] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:18.714313 24469 consensus_queue.cc:260] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:18.715649 24469 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:18.710783 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:18.720239 24399 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:18.722689 25557 raft_consensus.cc:993] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3: : Instructing follower d99d5d772cfe4a96afcab3d3b009a281 to start an election
I20260709 12:18:18.723308 25561 raft_consensus.cc:1081] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Signalling peer d99d5d772cfe4a96afcab3d3b009a281 to start an election
I20260709 12:18:18.725288 25117 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa"
dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
 from {username='slave'} at 127.0.0.1:48252
I20260709 12:18:18.725881 25117 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:18.726228 25117 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:18.727950 24222 catalog_manager.cc:5697] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 1 to 2, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 2 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:18.734120 25117 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:18.737757 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:18.738432 24398 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:18.741750 25117 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:18.742851 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:18.743522 24470 raft_consensus.cc:3055] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:18.743829 24470 raft_consensus.cc:740] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:18.744589 24470 consensus_queue.cc:260] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:18.746011 24470 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:18.754733 25557 raft_consensus.cc:993] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3: : Instructing follower c855242ec9d34a5397741ef20db9de8a to start an election
I20260709 12:18:18.754468 24221 catalog_manager.cc:5697] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 1 to 2, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 2 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:18.755322 25516 raft_consensus.cc:1081] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Signalling peer c855242ec9d34a5397741ef20db9de8a to start an election
I20260709 12:18:18.758317 24400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "626f1d05390b4454b317c19d513384be"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:51474
I20260709 12:18:18.758893 24400 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:18.759280 24400 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:18.762204 24469 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:18.711063 24325 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:18.770382 24470 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:18.768369 24398 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:18.772583 25082 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:18.773852 25552 raft_consensus.cc:2804] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:18.775099 24400 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:18.775951 24399 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:18.777307 24289 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:18.778193 25509 raft_consensus.cc:2804] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:18.778491 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:18.778714 25509 raft_consensus.cc:697] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:18.779091 24318 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:18.779667 25509 consensus_queue.cc:237] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:18.787559 24318 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:18.792557 24366 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:18.793553 25507 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:18.794131 25507 raft_consensus.cc:697] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:18.794987 25507 consensus_queue.cc:237] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:18.796813 25552 raft_consensus.cc:697] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:18.798132 25552 consensus_queue.cc:237] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:18.802557 24400 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:18.790908 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:18.804957 24221 catalog_manager.cc:5697] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 1 to 2, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:18.804621 24469 raft_consensus.cc:3055] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:18.809453 24469 raft_consensus.cc:740] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:18.810411 24469 consensus_queue.cc:260] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:18.811863 24469 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:18.813105 24222 catalog_manager.cc:5697] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 1 to 2, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 2 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:18.824456 24469 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:18.828505 24222 catalog_manager.cc:5697] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 1 to 2, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 2 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:18.841226 25507 raft_consensus.cc:1064] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:18.843575 25507 consensus_queue.cc:237] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:18.849629 25117 raft_consensus.cc:1275] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:18.849932 24318 raft_consensus.cc:1275] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:18.850149 24469 raft_consensus.cc:1275] T dfa0a0cd756141c094288d3c05139379 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:18.851233 25507 consensus_queue.cc:1048] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:18.852118 25538 consensus_queue.cc:1048] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:18.853942 25555 consensus_queue.cc:1048] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:18:18.885521 24254 debug-util.cc:398] Leaking SignalData structure 0x7b08000349e0 after lost signal to thread 23154
W20260709 12:18:18.886777 24254 debug-util.cc:398] Leaking SignalData structure 0x7b0800067780 after lost signal to thread 24257
W20260709 12:18:18.890542 24254 debug-util.cc:398] Leaking SignalData structure 0x7b0800342480 after lost signal to thread 25143
I20260709 12:18:18.904367 25558 raft_consensus.cc:1064] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:18.908557 25558 consensus_queue.cc:237] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:18.946789 24400 raft_consensus.cc:1275] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:18:18.953089 25538 raft_consensus.cc:2955] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:18.954991 25116 raft_consensus.cc:2955] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:18.953150 25119 raft_consensus.cc:1275] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEARNER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:18:18.968654 25558 consensus_queue.cc:1048] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:18.972990 24325 raft_consensus.cc:1275] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:18:18.992599 25560 raft_consensus.cc:1064] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:18.998512 24222 catalog_manager.cc:5697] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:19.000836 25560 consensus_queue.cc:237] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:19.041301 25558 consensus_queue.cc:1048] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:19.068961 25558 consensus_queue.cc:1048] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:18:19.090147 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 87691.9us
I20260709 12:18:19.091707 24470 raft_consensus.cc:1275] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:19.095265 24325 raft_consensus.cc:1275] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:19.095265 25117 raft_consensus.cc:1275] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:19.098927 24325 raft_consensus.cc:1275] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:19.103047 25592 raft_consensus.cc:993] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a: : Instructing follower c711faa13ead43ebbea0192cb74a4756 to start an election
I20260709 12:18:19.103935 25592 raft_consensus.cc:1081] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Signalling peer c711faa13ead43ebbea0192cb74a4756 to start an election
I20260709 12:18:19.125440 25591 consensus_queue.cc:1048] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:19.125908 24325 raft_consensus.cc:2955] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:19.127666 25591 consensus_queue.cc:1048] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:19.133647 24319 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:44280
I20260709 12:18:19.134347 24319 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:19.134730 24319 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:19.142892 24319 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:19.145808 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:19.146456 24399 raft_consensus.cc:3055] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:19.146788 24399 raft_consensus.cc:740] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:19.146998 25591 consensus_queue.cc:1048] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:19.147686 24399 consensus_queue.cc:260] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:19.152043 24399 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:19.165040 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:19.165833 24470 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:19.168347 24398 raft_consensus.cc:1275] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:19.170058 25509 consensus_queue.cc:1048] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:19.175420 24470 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:19.165505 24319 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:19.183228 24399 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:19.184729 24289 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:19.186131 25529 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:19.186718 25529 raft_consensus.cc:697] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:19.187808 25529 consensus_queue.cc:237] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:19.191862 25522 raft_consensus.cc:993] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3: : Instructing follower c855242ec9d34a5397741ef20db9de8a to start an election
I20260709 12:18:19.192683 25561 raft_consensus.cc:1081] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Signalling peer c855242ec9d34a5397741ef20db9de8a to start an election
W20260709 12:18:19.271230 25601 log.cc:927] Time spent T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.078s	user 0.002s	sys 0.003s
W20260709 12:18:19.274086 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 76211.2us
I20260709 12:18:19.284541 24317 raft_consensus.cc:1275] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:19.291652 24399 consensus_queue.cc:237] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:19.293504 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 97892.9us
W20260709 12:18:19.298808 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 103806us
I20260709 12:18:19.302335 24470 raft_consensus.cc:1275] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:19.304809 25522 raft_consensus.cc:2955] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:19.327976 25573 consensus_queue.cc:1048] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:18:19.349310 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 60578.7us
I20260709 12:18:19.351161 25592 consensus_queue.cc:1048] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:19.348122 24222 catalog_manager.cc:5697] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 1 to 2, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:19.358103 24398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:51474
I20260709 12:18:19.358798 24398 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:19.359190 24398 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:19.371064 24398 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:19.373299 24398 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:19.388458 24323 raft_consensus.cc:1275] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:19.393337 25117 raft_consensus.cc:1275] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:19.395591 24318 raft_consensus.cc:1275] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:19.398387 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:19.399096 24323 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:19.400158 24398 raft_consensus.cc:1275] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:19.402454 24398 raft_consensus.cc:1275] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:19.404619 25116 raft_consensus.cc:2955] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:19.411948 24323 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:19.420418 25593 consensus_queue.cc:1048] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:19.421015 24399 raft_consensus.cc:2955] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:19.429844 24466 raft_consensus.cc:1275] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:19.431608 25552 consensus_queue.cc:1048] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:19.458714 24318 raft_consensus.cc:1240] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:19.468283 24318 raft_consensus.cc:2955] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:19.492343 25561 consensus_queue.cc:1048] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:19.497483 25592 raft_consensus.cc:2955] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:19.501288 24222 catalog_manager.cc:5697] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:18:19.510272 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 47829.1us
I20260709 12:18:19.511396 25591 consensus_queue.cc:1048] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:19.525414 24466 consensus_queue.cc:237] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:19.532141 24469 raft_consensus.cc:1275] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:19.535786 24366 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:19.538293 24471 raft_consensus.cc:2955] T dfa0a0cd756141c094288d3c05139379 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:19.543812 25516 consensus_queue.cc:1048] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:19.555657 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:19.556347 24466 raft_consensus.cc:3055] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:19.557063 24466 raft_consensus.cc:740] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:19.559319 24466 consensus_queue.cc:260] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:19.560691 24466 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:19.561100 25591 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:19.561750 25591 raft_consensus.cc:697] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:19.562753 25591 consensus_queue.cc:237] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:19.570947 25611 consensus_queue.cc:1048] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:19.573314 25538 consensus_queue.cc:1048] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:19.570969 24470 raft_consensus.cc:1275] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:19.583536 24466 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:19.597452 24399 raft_consensus.cc:1275] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:19.598754 24222 catalog_manager.cc:5697] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:19.600531 25573 consensus_queue.cc:1048] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:18:19.616029 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 123377us
I20260709 12:18:19.627441 25593 consensus_queue.cc:1048] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:19.638010 24317 raft_consensus.cc:2955] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:18:19.707079 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 69068.6us
W20260709 12:18:19.711869 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 95085.6us
I20260709 12:18:19.720552 25591 consensus_queue.cc:1048] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:19.739392 25115 raft_consensus.cc:1275] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:18:19.743973 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:19.750722 25116 raft_consensus.cc:2955] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:19.762488 24470 raft_consensus.cc:2955] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:19.772382 24466 raft_consensus.cc:1275] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:19.775512 24317 raft_consensus.cc:1275] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:18:19.813071 25592 raft_consensus.cc:2955] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:19.816363 24222 catalog_manager.cc:5697] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 1 to 2, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 2 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:19.821727 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.871652 25516 consensus_queue.cc:1048] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:19.871409 24317 raft_consensus.cc:2955] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:19.878676 25522 consensus_queue.cc:1048] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
W20260709 12:18:20.022051 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 104214us
W20260709 12:18:20.030107 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 205666us
I20260709 12:18:20.031836 24468 raft_consensus.cc:1275] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:18:20.051113 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 185474us
I20260709 12:18:20.070842 24325 raft_consensus.cc:1275] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:18:20.073642 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 293339us
I20260709 12:18:20.058259 25621 consensus_queue.cc:1048] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:18:20.106208 24208 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dfa0a0cd756141c094288d3c05139379 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:20.145812 25538 consensus_queue.cc:1048] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
W20260709 12:18:20.206141 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 176202us
I20260709 12:18:20.246084 24222 catalog_manager.cc:5697] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:20.299122 24470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "101287bb58d2418bad8554ed0a096407"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
mode: GRACEFUL
new_leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
 from {username='slave'} at 127.0.0.1:42866
I20260709 12:18:20.299850 24470 raft_consensus.cc:606] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Received request to transfer leadership to TS d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:18:20.271075 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 101531us
W20260709 12:18:20.296922 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 91022.6us
I20260709 12:18:20.315392 25116 raft_consensus.cc:2955] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:18:20.323733 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 121594us
I20260709 12:18:20.344333 25593 consensus_queue.cc:1048] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:20.360145 24470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
mode: GRACEFUL
new_leader_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:42866
I20260709 12:18:20.360950 24470 raft_consensus.cc:606] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Received request to transfer leadership to TS c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:20.372679 25636 raft_consensus.cc:2955] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:20.390219 24318 raft_consensus.cc:2955] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:20.394181 24470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
mode: GRACEFUL
new_leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
 from {username='slave'} at 127.0.0.1:42866
I20260709 12:18:20.394927 24470 raft_consensus.cc:606] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Received request to transfer leadership to TS d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:20.396956 24461 tablet_service.cc:1558] Processing DeleteTablet for tablet dfa0a0cd756141c094288d3c05139379 with delete_type TABLET_DATA_TOMBSTONED (TS 99b8650fa8324ac2ac5f75eee9b1a1e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33256
I20260709 12:18:20.435504 24395 consensus_queue.cc:237] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:20.459342 24470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "400165817fe74ada9a4793982993a5e3"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
mode: GRACEFUL
new_leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
 from {username='slave'} at 127.0.0.1:42866
I20260709 12:18:20.472870 24468 raft_consensus.cc:1275] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:20.480986 25642 tablet_replica.cc:333] T dfa0a0cd756141c094288d3c05139379 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:18:20.488715 25631 consensus_queue.cc:1048] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:18:20.491861 25642 raft_consensus.cc:2243] T dfa0a0cd756141c094288d3c05139379 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:20.495383 25118 raft_consensus.cc:1275] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:20.508917 25631 consensus_queue.cc:1048] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:18:20.525432 25636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:33256 (request call id 72) took 1002 ms. Trace:
I20260709 12:18:20.540558 25642 raft_consensus.cc:2272] T dfa0a0cd756141c094288d3c05139379 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:20.526075 25636 rpcz_store.cc:276] 0709 12:18:19.523373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.523542 (+   169us) service_pool.cc:224] Handling call
0709 12:18:19.540314 (+ 16772us) log.cc:844] Serialized 508 byte log entry
0709 12:18:20.525321 (+985007us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3804,"raft.queue_time_us":4108,"raft.run_cpu_time_us":1324,"raft.run_wall_time_us":1322}
I20260709 12:18:20.532336 25115 raft_consensus.cc:2955] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:20.583956 24470 raft_consensus.cc:606] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Received request to transfer leadership to TS d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:20.590292 24209 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 400165817fe74ada9a4793982993a5e3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:20.597031 25642 ts_tablet_manager.cc:1916] T dfa0a0cd756141c094288d3c05139379 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:20.604408 25507 raft_consensus.cc:2955] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:20.609702 24469 raft_consensus.cc:2955] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:20.621382 24322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:42226
I20260709 12:18:20.622180 24322 raft_consensus.cc:606] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:20.629230 24400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:18:20.629853 24400 raft_consensus.cc:606] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:20.640033 25630 raft_consensus.cc:993] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3: : Instructing follower c855242ec9d34a5397741ef20db9de8a to start an election
I20260709 12:18:20.640738 25630 raft_consensus.cc:1081] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Signalling peer c855242ec9d34a5397741ef20db9de8a to start an election
I20260709 12:18:20.612653 25118 raft_consensus.cc:2955] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:20.642266 24474 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
mode: GRACEFUL
new_leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
 from {username='slave'} at 127.0.0.1:42866
I20260709 12:18:20.642973 24474 raft_consensus.cc:606] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Received request to transfer leadership to TS d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:20.644532 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:18:20.646660 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:20.648890 24400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:51474
I20260709 12:18:20.649518 24400 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:20.649861 24400 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:20.657076 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:20.683180 24400 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:20.685150 24400 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:20.687122 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:20.687907 24316 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:20.689709 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:20.690351 24468 raft_consensus.cc:3055] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:20.690659 24468 raft_consensus.cc:740] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:20.692109 24221 catalog_manager.cc:5697] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New cstate: current_term: 2 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:20.699477 25639 raft_consensus.cc:993] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756: : Instructing follower 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
I20260709 12:18:20.708654 25639 raft_consensus.cc:1081] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Signalling peer 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
I20260709 12:18:20.710843 24208 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 83efb40b1c6f4c9385b9e7c153e902bc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:20.711297 24468 consensus_queue.cc:260] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:20.712539 24468 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:20.728590 24468 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:20.729773 25636 raft_consensus.cc:993] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3: : Instructing follower d99d5d772cfe4a96afcab3d3b009a281 to start an election
I20260709 12:18:20.737756 25636 raft_consensus.cc:1081] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Signalling peer d99d5d772cfe4a96afcab3d3b009a281 to start an election
I20260709 12:18:20.740967 24365 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:20.754089 25635 raft_consensus.cc:993] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3: : Instructing follower d99d5d772cfe4a96afcab3d3b009a281 to start an election
I20260709 12:18:20.755841 25635 raft_consensus.cc:1081] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Signalling peer d99d5d772cfe4a96afcab3d3b009a281 to start an election
I20260709 12:18:20.766535 24223 catalog_manager.cc:5697] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a reported cstate change: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:20.765214 25115 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "101287bb58d2418bad8554ed0a096407"
dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
 from {username='slave'} at 127.0.0.1:48252
I20260709 12:18:20.775290 24383 tablet_service.cc:1558] Processing DeleteTablet for tablet 400165817fe74ada9a4793982993a5e3 with delete_type TABLET_DATA_TOMBSTONED (TS c855242ec9d34a5397741ef20db9de8a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51466
I20260709 12:18:20.783665 24468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:33272
I20260709 12:18:20.787868 24468 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:20.788333 24468 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:20.789153 25115 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:20.789779 25115 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:20.775408 25626 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:20.789073 25637 raft_consensus.cc:993] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3: : Instructing follower d99d5d772cfe4a96afcab3d3b009a281 to start an election
I20260709 12:18:20.792706 24316 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:20.805944 25628 raft_consensus.cc:1081] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Signalling peer d99d5d772cfe4a96afcab3d3b009a281 to start an election
I20260709 12:18:20.806152 24322 raft_consensus.cc:1240] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:20.809873 25118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09"
dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
 from {username='slave'} at 127.0.0.1:48252
I20260709 12:18:20.810515 25118 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:20.811000 25118 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:20.818022 24468 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:20.814610 24308 tablet_service.cc:1558] Processing DeleteTablet for tablet 83efb40b1c6f4c9385b9e7c153e902bc with delete_type TABLET_DATA_TOMBSTONED (TS c711faa13ead43ebbea0192cb74a4756 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44272
I20260709 12:18:20.799037 25626 raft_consensus.cc:697] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:20.830221 25117 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "400165817fe74ada9a4793982993a5e3"
dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
 from {username='slave'} at 127.0.0.1:48252
I20260709 12:18:20.830878 25117 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:20.831202 25117 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:20.831194 24468 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:20.840337 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:20.841110 24318 raft_consensus.cc:3055] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:20.841478 24318 raft_consensus.cc:740] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:20.842303 24318 consensus_queue.cc:260] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:20.843566 25117 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:20.843214 25644 raft_consensus.cc:993] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3: : Instructing follower d99d5d772cfe4a96afcab3d3b009a281 to start an election
I20260709 12:18:20.847945 25644 raft_consensus.cc:1081] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Signalling peer d99d5d772cfe4a96afcab3d3b009a281 to start an election
I20260709 12:18:20.848431 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:20.849056 24400 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:20.843972 25118 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:20.852022 25626 consensus_queue.cc:237] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:20.854179 25118 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:20.855073 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:20.855765 24395 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:20.856381 25642 ts_tablet_manager.cc:1929] T dfa0a0cd756141c094288d3c05139379 P 99b8650fa8324ac2ac5f75eee9b1a1e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:20.856841 25642 log.cc:1199] T dfa0a0cd756141c094288d3c05139379 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-2-root/wals/dfa0a0cd756141c094288d3c05139379
I20260709 12:18:20.858388 24318 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:20.858397 24209 catalog_manager.cc:5028] TS 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): tablet dfa0a0cd756141c094288d3c05139379 (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:20.860245 24400 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:20.865494 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:20.866072 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:20.868709 24468 raft_consensus.cc:3055] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:20.869033 24468 raft_consensus.cc:740] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:20.855259 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:20.869740 25649 tablet_replica.cc:333] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:18:20.869851 24468 consensus_queue.cc:260] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:20.908960 24468 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:20.909288 25649 raft_consensus.cc:2243] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:20.910173 25649 raft_consensus.cc:2272] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:20.872877 24438 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:20.913597 25644 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:20.915222 25644 raft_consensus.cc:697] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:20.874402 25115 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:20.878968 24318 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:20.882898 25117 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:20.879877 25648 tablet_replica.cc:333] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:18:20.866163 24317 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:20.922782 25648 raft_consensus.cc:2243] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:20.923501 25648 raft_consensus.cc:2272] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:20.923647 25118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655"
dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
 from {username='slave'} at 127.0.0.1:48252
I20260709 12:18:20.924345 25118 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:20.924751 25118 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:20.925890 25115 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:20.926995 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:20.927600 24466 raft_consensus.cc:3055] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:20.927899 24466 raft_consensus.cc:740] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:20.927942 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:20.928730 24466 consensus_queue.cc:260] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:20.929889 24466 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:20.931324 25649 ts_tablet_manager.cc:1916] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:20.921563 25644 consensus_queue.cc:237] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:20.899938 25507 raft_consensus.cc:993] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a: : Instructing follower 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
I20260709 12:18:20.870180 24470 raft_consensus.cc:3055] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:20.936772 24470 raft_consensus.cc:740] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:20.937781 25507 raft_consensus.cc:1081] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Signalling peer 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
I20260709 12:18:20.874919 24395 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:20.965260 25082 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:20.966636 25646 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:21.025043 24317 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:18:21.026486 25084 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:21.027875 25646 raft_consensus.cc:697] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:21.030983 24468 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:18:21.030766 24470 consensus_queue.cc:260] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:21.031962 24466 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:21.033666 24474 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:33278
I20260709 12:18:21.034341 24474 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:21.034714 24474 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.034966 24470 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.043893 25118 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:21.047137 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:21.047894 24400 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.054885 24400 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:21.057868 25118 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:21.056784 24222 catalog_manager.cc:5697] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 1 to 2, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 2 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:21.056335 25082 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:21.071794 24470 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:21.067979 25611 raft_consensus.cc:2804] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:21.084321 25083 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:21.086544 25646 consensus_queue.cc:237] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:21.076474 24220 catalog_manager.cc:5697] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 1 to 2, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 2 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:21.092931 24474 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:21.068372 25652 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:21.112512 24474 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:21.116407 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:21.117033 24317 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.123180 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:21.125957 24317 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:21.133285 24440 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:18:21.137964 25628 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:21.138480 25648 ts_tablet_manager.cc:1916] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:21.138530 25628 raft_consensus.cc:697] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:21.139886 25628 consensus_queue.cc:237] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:21.143282 24400 raft_consensus.cc:3055] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:21.143724 24400 raft_consensus.cc:740] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:21.150184 24400 consensus_queue.cc:260] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:21.151721 24400 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.142696 25611 raft_consensus.cc:697] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:21.159827 24400 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
W20260709 12:18:21.175001 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 103689us
I20260709 12:18:21.157420 25611 consensus_queue.cc:237] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:21.175077 25655 raft_consensus.cc:2804] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:21.181260 25655 raft_consensus.cc:697] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:21.182337 25655 consensus_queue.cc:237] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:21.209152 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:21.210151 24474 raft_consensus.cc:3055] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:21.210520 24474 raft_consensus.cc:740] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:21.211540 24474 consensus_queue.cc:260] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:21.213975 24474 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.226908 24474 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:21.215528 25652 raft_consensus.cc:697] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:21.233868 25118 raft_consensus.cc:1240] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:21.239663 25652 consensus_queue.cc:237] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:21.247826 24220 catalog_manager.cc:5697] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 1 to 2, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 2 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:21.244424 24222 catalog_manager.cc:5697] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 1 to 2, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 2 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:21.267315 25648 ts_tablet_manager.cc:1929] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:18:21.267932 25648 log.cc:1199] T 400165817fe74ada9a4793982993a5e3 P c855242ec9d34a5397741ef20db9de8a: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-1-root/wals/400165817fe74ada9a4793982993a5e3
I20260709 12:18:21.268280 25649 ts_tablet_manager.cc:1929] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:21.268844 25649 log.cc:1199] T 83efb40b1c6f4c9385b9e7c153e902bc P c711faa13ead43ebbea0192cb74a4756: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-0-root/wals/83efb40b1c6f4c9385b9e7c153e902bc
I20260709 12:18:21.270125 24208 catalog_manager.cc:5028] TS c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): tablet 400165817fe74ada9a4793982993a5e3 (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:21.271116 24210 catalog_manager.cc:5028] TS c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): tablet 83efb40b1c6f4c9385b9e7c153e902bc (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:21.302510 24220 catalog_manager.cc:5697] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 1 to 2, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 2 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:21.304921 24220 catalog_manager.cc:5697] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 2 to 3, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 3 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:21.310621 24220 catalog_manager.cc:5697] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 1 to 2, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 2 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:21.324793 24316 raft_consensus.cc:1275] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:21.349985 25637 consensus_queue.cc:1048] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:21.381479 24318 raft_consensus.cc:1275] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:21.384670 25631 consensus_queue.cc:1048] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:21.392797 24471 raft_consensus.cc:1275] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:21.395790 25593 consensus_queue.cc:1048] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:21.431067 24395 raft_consensus.cc:1275] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:21.433719 25628 consensus_queue.cc:1048] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:21.588428 24471 raft_consensus.cc:1275] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:21.599944 25655 consensus_queue.cc:1048] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:21.632617 24474 raft_consensus.cc:1275] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:21.646775 25655 consensus_queue.cc:1048] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:21.679332 24466 raft_consensus.cc:1275] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:21.686391 25655 consensus_queue.cc:1048] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:21.690110 24395 raft_consensus.cc:1275] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:21.693861 25655 consensus_queue.cc:1048] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:21.699213 24398 raft_consensus.cc:1275] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:21.705404 25636 consensus_queue.cc:1048] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:21.795790 24317 raft_consensus.cc:1275] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:21.799499 25644 consensus_queue.cc:1048] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:21.767024 24398 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.882745 24398 raft_consensus.cc:1275] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:21.896080 24316 raft_consensus.cc:1275] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:21.901044 24470 raft_consensus.cc:1275] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:21.902742 25675 consensus_queue.cc:1048] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:21.906903 24399 raft_consensus.cc:1275] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:22.024133 25679 consensus_queue.cc:1048] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:18:22.023212 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 147399us
W20260709 12:18:22.045571 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 54172us
I20260709 12:18:22.055316 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:22.056885 25686 consensus_queue.cc:1048] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:18:22.156483 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 66501.1us
W20260709 12:18:22.200371 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 133635us
I20260709 12:18:22.204857 25686 consensus_queue.cc:1048] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:18:22.270272 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 43718.2us
W20260709 12:18:22.324473 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 54360.9us
I20260709 12:18:22.472529 24325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
mode: GRACEFUL
new_leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
 from {username='slave'} at 127.0.0.1:42226
I20260709 12:18:22.473440 24325 raft_consensus.cc:606] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Received request to transfer leadership to TS d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:22.477546 24325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:42226
I20260709 12:18:22.478101 24325 raft_consensus.cc:606] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:22.481298 24466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
mode: GRACEFUL
new_leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
 from {username='slave'} at 127.0.0.1:42866
I20260709 12:18:22.481851 24466 raft_consensus.cc:606] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Received request to transfer leadership to TS d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:22.485535 24399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:18:22.486124 24399 raft_consensus.cc:606] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Received request to transfer leadership to TS c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:22.490247 24466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
mode: GRACEFUL
new_leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
 from {username='slave'} at 127.0.0.1:42866
I20260709 12:18:22.491645 24466 raft_consensus.cc:606] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Received request to transfer leadership to TS d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:22.495395 24318 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:42226
I20260709 12:18:22.496001 24318 raft_consensus.cc:606] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:22.497370 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:18:22.499387 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:22.500519 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:22.528271 24325 consensus_queue.cc:237] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:22.546566 24466 raft_consensus.cc:1275] T 7910ea4d480e41fda4aa4fd10f0fef8f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:22.548339 24395 raft_consensus.cc:1275] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:18:22.553347 24291 consensus_peers.cc:597] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7910ea4d480e41fda4aa4fd10f0fef8f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:22.554490 25633 consensus_queue.cc:1048] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:22.556037 25509 consensus_queue.cc:1048] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:22.564322 25639 raft_consensus.cc:993] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756: : Instructing follower d99d5d772cfe4a96afcab3d3b009a281 to start an election
I20260709 12:18:22.564985 25639 raft_consensus.cc:1081] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Signalling peer d99d5d772cfe4a96afcab3d3b009a281 to start an election
I20260709 12:18:22.567626 25117 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be"
dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
 from {username='slave'} at 127.0.0.1:35188
I20260709 12:18:22.568302 25117 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:22.568828 25117 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:22.572844 25639 raft_consensus.cc:2955] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:22.578382 25117 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:22.581775 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:22.583081 24325 raft_consensus.cc:3055] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:22.583467 24325 raft_consensus.cc:740] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:22.584746 24325 consensus_queue.cc:260] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:22.585114 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:22.585789 24466 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:22.586089 24325 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:22.583815 24472 raft_consensus.cc:2955] T 7910ea4d480e41fda4aa4fd10f0fef8f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:22.594658 24325 raft_consensus.cc:2468] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:22.602874 25084 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:22.603993 25691 raft_consensus.cc:2804] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:22.604560 25691 raft_consensus.cc:697] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:22.605760 25691 consensus_queue.cc:237] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:22.606884 24470 consensus_queue.cc:237] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:22.614645 25117 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:22.628183 24466 raft_consensus.cc:2468] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:22.632596 24223 catalog_manager.cc:5697] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:22.635361 24440 consensus_peers.cc:597] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 82c31a779e7949a590cf168eef01e405. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:22.637667 24399 raft_consensus.cc:1275] T 82c31a779e7949a590cf168eef01e405 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:22.639495 24220 catalog_manager.cc:5697] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 1 to 2, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 2 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:22.640205 25705 consensus_queue.cc:1048] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:18:22.649549 24399 raft_consensus.cc:2955] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:22.657915 24325 raft_consensus.cc:1275] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:22.660332 25705 consensus_queue.cc:1048] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:22.674355 25633 raft_consensus.cc:993] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756: : Instructing follower 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
I20260709 12:18:22.674893 25633 raft_consensus.cc:1081] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Signalling peer 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
I20260709 12:18:22.681759 24471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:33272
I20260709 12:18:22.682390 24471 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:22.682766 24471 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:22.688441 25704 raft_consensus.cc:993] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3: : Instructing follower d99d5d772cfe4a96afcab3d3b009a281 to start an election
I20260709 12:18:22.689152 25704 raft_consensus.cc:1081] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Signalling peer d99d5d772cfe4a96afcab3d3b009a281 to start an election
I20260709 12:18:22.693311 25118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915"
dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
 from {username='slave'} at 127.0.0.1:48252
I20260709 12:18:22.694140 25118 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:22.694479 25118 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:22.760483 24471 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:22.770946 25118 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:22.775483 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:22.776144 24325 raft_consensus.cc:3055] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:22.776480 24325 raft_consensus.cc:740] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:22.777482 24325 consensus_queue.cc:260] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:22.785538 24325 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:22.787176 24471 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:22.788388 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:22.788585 25118 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:22.789968 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:22.793124 24399 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:22.797752 25696 raft_consensus.cc:2955] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:22.799371 24398 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:22.799631 24316 raft_consensus.cc:2955] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:22.802273 24399 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
I20260709 12:18:22.805053 24438 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:22.805981 25704 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:22.806493 25704 raft_consensus.cc:697] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:22.807467 25704 consensus_queue.cc:237] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:22.812469 25509 raft_consensus.cc:993] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756: : Instructing follower 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
I20260709 12:18:22.813076 25509 raft_consensus.cc:1081] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Signalling peer 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
I20260709 12:18:22.815768 24471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:33272
I20260709 12:18:22.816370 24471 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:22.816769 24471 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:22.795583 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:22.819677 24472 raft_consensus.cc:3055] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:22.820080 24472 raft_consensus.cc:740] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:22.823745 25701 raft_consensus.cc:993] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a: : Instructing follower c711faa13ead43ebbea0192cb74a4756 to start an election
I20260709 12:18:22.826241 25701 raft_consensus.cc:1081] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Signalling peer c711faa13ead43ebbea0192cb74a4756 to start an election
I20260709 12:18:22.829074 24472 consensus_queue.cc:260] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:22.830654 24472 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:22.830737 24325 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
I20260709 12:18:22.839315 24316 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:44280
I20260709 12:18:22.841924 24316 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:22.842308 24316 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:22.832587 24471 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:22.845769 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:22.846134 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:22.846542 24322 raft_consensus.cc:3055] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:22.846755 25118 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:22.846987 24322 raft_consensus.cc:740] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:22.847966 24322 consensus_queue.cc:260] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:22.849363 24322 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:22.847929 24395 raft_consensus.cc:2955] T 82c31a779e7949a590cf168eef01e405 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:22.845827 24398 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:22.853741 25082 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:22.854691 25691 raft_consensus.cc:2804] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:22.855191 25691 raft_consensus.cc:697] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:22.856279 25691 consensus_queue.cc:237] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:22.857692 25118 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:22.858013 24322 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:22.859459 24440 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:18:22.844473 24471 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:22.860837 25705 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:22.861366 25705 raft_consensus.cc:697] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:22.862308 25705 consensus_queue.cc:237] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:22.876204 24472 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:22.887547 25644 raft_consensus.cc:993] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: : Instructing follower d99d5d772cfe4a96afcab3d3b009a281 to start an election
I20260709 12:18:22.888144 25644 raft_consensus.cc:1081] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Signalling peer d99d5d772cfe4a96afcab3d3b009a281 to start an election
I20260709 12:18:22.891844 25117 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9"
dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
 from {username='slave'} at 127.0.0.1:48252
I20260709 12:18:22.892499 25117 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:22.892879 25117 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:22.902012 24471 consensus_queue.cc:237] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:22.912770 25117 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:22.915899 25117 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:22.921270 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:22.922219 24472 raft_consensus.cc:3055] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:22.922541 24472 raft_consensus.cc:740] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:22.921411 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:22.932816 24322 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:22.935081 24316 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:22.956950 24316 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:22.961700 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:22.962477 24395 raft_consensus.cc:3055] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:22.962877 24395 raft_consensus.cc:740] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:22.963884 24395 consensus_queue.cc:260] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:22.966683 24395 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:22.982650 24398 raft_consensus.cc:1275] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:22.984926 24322 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:22.984967 25705 consensus_queue.cc:1048] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:22.986341 25084 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:22.987267 25691 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:22.987741 25691 raft_consensus.cc:697] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:22.988652 25691 consensus_queue.cc:237] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:22.930728 24472 consensus_queue.cc:260] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:22.992600 24472 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:23.012301 25727 raft_consensus.cc:2955] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
W20260709 12:18:23.013648 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 60809.3us
I20260709 12:18:23.011132 24395 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:23.015645 24289 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:23.016502 25639 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:23.017180 25639 raft_consensus.cc:697] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:23.019047 24399 raft_consensus.cc:2955] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:23.033087 24322 raft_consensus.cc:1275] T 51965da6bcc444d5b20f7348cba2c649 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:18:23.034518 24440 consensus_peers.cc:597] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 51965da6bcc444d5b20f7348cba2c649. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:23.034979 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:23.042202 24471 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:23.018141 25639 consensus_queue.cc:237] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:23.055446 24472 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:23.062304 25705 consensus_queue.cc:1048] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:23.100147 24399 consensus_queue.cc:237] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:23.113183 24471 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:23.105618 24222 catalog_manager.cc:5697] T 82c31a779e7949a590cf168eef01e405 P c855242ec9d34a5397741ef20db9de8a reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:23.115293 24223 catalog_manager.cc:5697] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 1 to 2, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 2 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:23.121862 24223 catalog_manager.cc:5697] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 1 to 2, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 2 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:23.117558 25736 ts_tablet_manager.cc:933] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:23.150014 25736 tablet_copy_client.cc:323] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.195:44453
I20260709 12:18:23.128145 24316 raft_consensus.cc:2955] T 51965da6bcc444d5b20f7348cba2c649 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:23.134191 24220 catalog_manager.cc:5697] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 1 to 2, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:23.141008 24222 catalog_manager.cc:5697] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:23.155076 24471 raft_consensus.cc:1275] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:23.156418 24322 raft_consensus.cc:1275] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:18:23.162320 24366 consensus_peers.cc:597] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 67fce41b64ab4350b88ec02abbcd9c82. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:23.166146 25692 consensus_queue.cc:1048] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:23.173015 24484 tablet_copy_service.cc:140] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Received BeginTabletCopySession request for tablet 82c31a779e7949a590cf168eef01e405 from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:33198)
I20260709 12:18:23.174010 24484 tablet_copy_service.cc:161] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Beginning new tablet copy session on tablet 82c31a779e7949a590cf168eef01e405 from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:33198: session id = d99d5d772cfe4a96afcab3d3b009a281-82c31a779e7949a590cf168eef01e405
I20260709 12:18:23.185520 25739 ts_tablet_manager.cc:933] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:18:23.187906 24221 catalog_manager.cc:5697] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 2 to 3, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 3 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:23.189709 24221 catalog_manager.cc:5697] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 1 to 2, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 2 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:23.196668 24471 raft_consensus.cc:1275] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:23.198220 25692 consensus_queue.cc:1048] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:23.222638 25701 consensus_queue.cc:1048] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:23.229597 24316 raft_consensus.cc:1275] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:23.233089 25729 consensus_queue.cc:1048] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:23.234761 24484 tablet_copy_source_session.cc:215] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:23.253407 25736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82c31a779e7949a590cf168eef01e405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.257728 25739 tablet_copy_client.cc:323] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.193:36951
I20260709 12:18:23.259974 24335 tablet_copy_service.cc:140] P c711faa13ead43ebbea0192cb74a4756: Received BeginTabletCopySession request for tablet 7910ea4d480e41fda4aa4fd10f0fef8f from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:57702)
I20260709 12:18:23.260597 24335 tablet_copy_service.cc:161] P c711faa13ead43ebbea0192cb74a4756: Beginning new tablet copy session on tablet 7910ea4d480e41fda4aa4fd10f0fef8f from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:57702: session id = d99d5d772cfe4a96afcab3d3b009a281-7910ea4d480e41fda4aa4fd10f0fef8f
I20260709 12:18:23.265260 24318 raft_consensus.cc:2955] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:23.261986 25701 raft_consensus.cc:2955] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:23.276682 24335 tablet_copy_source_session.cc:215] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:23.280583 25739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7910ea4d480e41fda4aa4fd10f0fef8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.301595 24471 raft_consensus.cc:1275] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:23.315012 25691 consensus_queue.cc:1048] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:23.365278 25115 raft_consensus.cc:1275] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:23.368373 25705 consensus_queue.cc:1048] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:18:23.401137 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 58984.6us
I20260709 12:18:23.374770 24316 raft_consensus.cc:1275] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:18:23.412537 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 88475.6us
I20260709 12:18:23.424863 24395 raft_consensus.cc:1275] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:23.428812 24466 raft_consensus.cc:1275] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:23.433228 25736 tablet_copy_client.cc:806] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:23.443162 25736 tablet_copy_client.cc:670] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:23.447687 24222 catalog_manager.cc:5697] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 2 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:23.444558 25529 consensus_queue.cc:1048] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:18:23.458675 24395 raft_consensus.cc:1275] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:23.423557 25704 consensus_queue.cc:1048] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:18:23.463791 24466 raft_consensus.cc:1275] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:23.434649 25686 consensus_queue.cc:1048] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:18:23.467456 25691 consensus_queue.cc:1048] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:23.493544 25736 tablet_copy_client.cc:538] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:23.532861 24322 raft_consensus.cc:1275] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:23.562544 24397 raft_consensus.cc:1275] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:23.592047 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:23.600150 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 46328.8us
W20260709 12:18:23.604280 25756 log.cc:927] Time spent T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 12:18:23.593886 25721 log.cc:927] Time spent T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:18:23.538779 25727 consensus_queue.cc:1048] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
W20260709 12:18:23.637357 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 72278.9us
I20260709 12:18:23.564713 25705 consensus_queue.cc:1048] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 12:18:23.656608 25736 tablet_bootstrap.cc:492] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
W20260709 12:18:23.671844 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 70868.5us
W20260709 12:18:23.729615 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 78883.5us
W20260709 12:18:23.744251 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 70309us
W20260709 12:18:23.789227 25755 log.cc:927] Time spent T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.133s	user 0.001s	sys 0.002s
I20260709 12:18:23.810060 25772 ts_tablet_manager.cc:933] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:23.823303 25739 tablet_copy_client.cc:806] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
W20260709 12:18:23.824477 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 62992.3us
I20260709 12:18:23.832458 24318 raft_consensus.cc:1275] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:23.827819 25739 tablet_copy_client.cc:670] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:23.930311 25736 tablet_bootstrap.cc:700] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281: Time spent opening tablet: real 0.110s	user 0.001s	sys 0.003s
W20260709 12:18:23.969352 24289 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.22.155.254:34311, user_credentials={real_user=slave}} blocked reactor thread for 71106.6us
I20260709 12:18:23.971781 25509 consensus_queue.cc:1048] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:23.941776 25686 consensus_queue.cc:1048] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:18:24.025136 25772 tablet_copy_client.cc:323] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.194:35893
I20260709 12:18:24.030750 25739 tablet_copy_client.cc:538] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:24.033296 24471 raft_consensus.cc:2955] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:24.058075 25778 ts_tablet_manager.cc:933] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:24.065173 24410 tablet_copy_service.cc:140] P c855242ec9d34a5397741ef20db9de8a: Received BeginTabletCopySession request for tablet 67fce41b64ab4350b88ec02abbcd9c82 from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:50950)
I20260709 12:18:24.082805 24410 tablet_copy_service.cc:161] P c855242ec9d34a5397741ef20db9de8a: Beginning new tablet copy session on tablet 67fce41b64ab4350b88ec02abbcd9c82 from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:50950: session id = d99d5d772cfe4a96afcab3d3b009a281-67fce41b64ab4350b88ec02abbcd9c82
I20260709 12:18:24.134814 24410 tablet_copy_source_session.cc:215] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:24.140075 25739 tablet_bootstrap.cc:492] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:18:24.167008 25772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67fce41b64ab4350b88ec02abbcd9c82. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:18:24.203629 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 451509us
I20260709 12:18:24.377375 25778 tablet_copy_client.cc:323] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.195:44453
W20260709 12:18:24.396509 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 85111.9us
I20260709 12:18:24.414598 24484 tablet_copy_service.cc:140] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Received BeginTabletCopySession request for tablet 51965da6bcc444d5b20f7348cba2c649 from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:33198)
I20260709 12:18:24.415287 24484 tablet_copy_service.cc:161] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Beginning new tablet copy session on tablet 51965da6bcc444d5b20f7348cba2c649 from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:33198: session id = d99d5d772cfe4a96afcab3d3b009a281-51965da6bcc444d5b20f7348cba2c649
I20260709 12:18:24.421841 25772 tablet_copy_client.cc:806] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:24.422701 25772 tablet_copy_client.cc:670] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:24.424820 24484 tablet_copy_source_session.cc:215] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:24.427702 25772 tablet_copy_client.cc:538] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:24.437132 25736 tablet_bootstrap.cc:492] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:24.438335 25736 tablet_bootstrap.cc:492] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:24.439133 25736 ts_tablet_manager.cc:1403] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.823s	user 0.030s	sys 0.011s
I20260709 12:18:24.457581 24325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f669315af0d426da28d57b462979ebd"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
mode: GRACEFUL
new_leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
 from {username='slave'} at 127.0.0.1:42226
I20260709 12:18:24.458493 24325 raft_consensus.cc:606] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Received request to transfer leadership to TS d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:24.474882 25778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51965da6bcc444d5b20f7348cba2c649. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:18:24.508388 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 105000us
I20260709 12:18:24.524451 25736 raft_consensus.cc:359] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:24.525552 25736 raft_consensus.cc:740] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:24.526335 25736 consensus_queue.cc:260] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:24.528687 24399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:18:24.529368 24399 raft_consensus.cc:606] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:24.554375 24395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:18:24.555195 24395 raft_consensus.cc:606] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Received request to transfer leadership to TS c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:24.555891 25736 ts_tablet_manager.cc:1434] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.116s	user 0.007s	sys 0.004s
I20260709 12:18:24.558434 24484 tablet_copy_service.cc:342] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-82c31a779e7949a590cf168eef01e405 received from {username='slave'} at 127.0.0.1:33198
I20260709 12:18:24.558970 24484 tablet_copy_service.cc:434] P 99b8650fa8324ac2ac5f75eee9b1a1e3: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-82c31a779e7949a590cf168eef01e405 on tablet 82c31a779e7949a590cf168eef01e405 with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:24.569142 25772 tablet_bootstrap.cc:492] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:18:24.574029 24472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
mode: GRACEFUL
new_leader_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:42866
I20260709 12:18:24.574672 24472 raft_consensus.cc:606] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Received request to transfer leadership to TS c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:24.577317 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:18:24.579155 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:24.580018 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:24.597194 25778 tablet_copy_client.cc:806] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:24.597848 25778 tablet_copy_client.cc:670] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:24.614655 25778 tablet_copy_client.cc:538] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:24.634653 25778 tablet_bootstrap.cc:492] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:18:24.636293 25739 tablet_bootstrap.cc:492] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:24.653451 25739 tablet_bootstrap.cc:492] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:24.654325 25739 ts_tablet_manager.cc:1403] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.515s	user 0.023s	sys 0.010s
I20260709 12:18:24.657550 25739 raft_consensus.cc:359] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:24.658403 25739 raft_consensus.cc:740] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:24.659078 25739 consensus_queue.cc:260] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:24.663269 25739 ts_tablet_manager.cc:1434] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:18:24.665199 25780 raft_consensus.cc:993] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: : Instructing follower c711faa13ead43ebbea0192cb74a4756 to start an election
I20260709 12:18:24.667591 25780 raft_consensus.cc:1081] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Signalling peer c711faa13ead43ebbea0192cb74a4756 to start an election
I20260709 12:18:24.670255 24335 tablet_copy_service.cc:342] P c711faa13ead43ebbea0192cb74a4756: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-7910ea4d480e41fda4aa4fd10f0fef8f received from {username='slave'} at 127.0.0.1:57702
I20260709 12:18:24.670727 24335 tablet_copy_service.cc:434] P c711faa13ead43ebbea0192cb74a4756: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-7910ea4d480e41fda4aa4fd10f0fef8f on tablet 7910ea4d480e41fda4aa4fd10f0fef8f with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:24.708586 24325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:44278
I20260709 12:18:24.709287 24325 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:24.709694 24325 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:24.841784 24325 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:24.844751 24325 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:18:24.853747 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 108217us
I20260709 12:18:24.840838 25117 raft_consensus.cc:1217] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:24.857792 25118 raft_consensus.cc:1217] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:24.906723 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:24.907476 24469 raft_consensus.cc:3055] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:24.907809 24469 raft_consensus.cc:740] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:24.926474 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:24.927305 24395 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:24.908592 24469 consensus_queue.cc:260] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:24.948873 24469 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:24.956802 25772 tablet_bootstrap.cc:492] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:24.985806 24395 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:24.989575 24289 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:24.991288 24469 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
W20260709 12:18:24.996866 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 73764.8us
I20260709 12:18:25.000944 25789 raft_consensus.cc:2804] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:25.041051 25789 raft_consensus.cc:697] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:18:25.082203 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 77755.1us
I20260709 12:18:25.055354 25772 tablet_bootstrap.cc:492] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:25.042126 25789 consensus_queue.cc:237] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:25.113348 25772 ts_tablet_manager.cc:1403] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.545s	user 0.025s	sys 0.037s
W20260709 12:18:25.155261 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 43761.6us
I20260709 12:18:25.186518 25798 raft_consensus.cc:993] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a: : Instructing follower 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
I20260709 12:18:25.187273 25798 raft_consensus.cc:1081] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Signalling peer 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
I20260709 12:18:25.198518 25772 raft_consensus.cc:359] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:25.199880 25772 raft_consensus.cc:740] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:25.208184 25778 tablet_bootstrap.cc:492] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:25.209805 25778 tablet_bootstrap.cc:492] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:25.211035 25778 ts_tablet_manager.cc:1403] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.577s	user 0.071s	sys 0.070s
I20260709 12:18:25.264990 25777 raft_consensus.cc:1064] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:25.302451 25777 consensus_queue.cc:237] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:25.312187 25772 consensus_queue.cc:260] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:25.331804 25772 ts_tablet_manager.cc:1434] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.178s	user 0.008s	sys 0.001s
W20260709 12:18:25.373185 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 310904us
W20260709 12:18:25.373920 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 290641us
W20260709 12:18:25.374687 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 294593us
W20260709 12:18:25.375123 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 317740us
I20260709 12:18:25.471580 25770 raft_consensus.cc:993] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756: : Instructing follower d99d5d772cfe4a96afcab3d3b009a281 to start an election
I20260709 12:18:25.376204 25814 raft_consensus.cc:993] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a: : Instructing follower c711faa13ead43ebbea0192cb74a4756 to start an election
W20260709 12:18:25.395651 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 321382us
I20260709 12:18:25.474045 25759 raft_consensus.cc:1081] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Signalling peer d99d5d772cfe4a96afcab3d3b009a281 to start an election
I20260709 12:18:25.493450 25814 raft_consensus.cc:1081] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Signalling peer c711faa13ead43ebbea0192cb74a4756 to start an election
W20260709 12:18:25.373811 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 288625us
I20260709 12:18:25.552572 24471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:33278
I20260709 12:18:25.553299 24471 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:25.553675 24471 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:25.572269 24320 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:44280
I20260709 12:18:25.574685 24320 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:25.575194 24320 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:25.607770 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.622530 24471 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:25.624858 24471 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:25.637223 24320 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:25.647517 24410 tablet_copy_service.cc:342] P c855242ec9d34a5397741ef20db9de8a: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-67fce41b64ab4350b88ec02abbcd9c82 received from {username='slave'} at 127.0.0.1:50950
I20260709 12:18:25.648052 24410 tablet_copy_service.cc:434] P c855242ec9d34a5397741ef20db9de8a: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-67fce41b64ab4350b88ec02abbcd9c82 on tablet 67fce41b64ab4350b88ec02abbcd9c82 with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:25.649418 24319 raft_consensus.cc:1240] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:25.643039 25115 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f669315af0d426da28d57b462979ebd"
dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
 from {username='slave'} at 127.0.0.1:35188
I20260709 12:18:25.655431 25115 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:25.655913 25115 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:25.661664 24320 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:25.669667 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:25.670325 24471 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:25.679064 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:25.679816 24398 raft_consensus.cc:3055] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:25.680099 24398 raft_consensus.cc:740] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:25.685261 24469 raft_consensus.cc:1240] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:25.689554 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:25.690202 24319 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:25.681706 24398 consensus_queue.cc:260] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:25.694028 24398 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:25.667424 25778 raft_consensus.cc:359] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:25.704021 24398 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:25.696846 25778 raft_consensus.cc:740] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:25.716987 24323 raft_consensus.cc:1275] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:25.716960 25116 raft_consensus.cc:1217] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:18:25.717051 24471 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:25.718564 24472 raft_consensus.cc:1240] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:25.720762 24290 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:18:25.721594 25529 raft_consensus.cc:2804] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:25.722152 25529 raft_consensus.cc:697] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:25.726269 25117 raft_consensus.cc:1275] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:25.727875 25791 consensus_queue.cc:1048] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:25.728688 25529 consensus_queue.cc:237] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:25.731418 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:25.749687 24319 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
I20260709 12:18:25.733248 25778 consensus_queue.cc:260] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:25.753630 24440 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:18:25.737403 25791 consensus_queue.cc:1048] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:18:25.737839 25818 consensus_queue.cc:1059] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
W20260709 12:18:25.780221 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 60413.7us
I20260709 12:18:25.774426 25792 raft_consensus.cc:2804] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:25.789845 25792 raft_consensus.cc:697] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:25.791435 25792 consensus_queue.cc:237] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:25.826092 25778 ts_tablet_manager.cc:1434] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.528s	user 0.005s	sys 0.009s
W20260709 12:18:25.826539 25778 ts_tablet_manager.cc:1467] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281: Tablet startup took 528ms
I20260709 12:18:25.832564 25115 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:25.835892 25115 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:25.836400 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:25.837186 24394 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:25.840363 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:25.841256 24323 raft_consensus.cc:3055] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:25.841627 24323 raft_consensus.cc:740] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:25.842523 24323 consensus_queue.cc:260] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:25.844195 24323 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:25.844791 24398 raft_consensus.cc:3055] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:25.845250 24398 raft_consensus.cc:740] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:25.846134 24398 consensus_queue.cc:260] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:25.847514 24398 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:25.826871 25778 ts_tablet_manager.cc:1469] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281: Trace:
0709 12:18:23.760477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.760788 (+   311us) service_pool.cc:224] Handling call
0709 12:18:24.058531 (+297743us) ts_tablet_manager.cc:934] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
0709 12:18:24.213466 (+154935us) spinlock_profiling.cc:243] Waited 877 us on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a942420ac 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425bcaa 00007f4a9425bbd2 00007f4a9c2c0131
0709 12:18:24.473404 (+259938us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:18:24.578414 (+105010us) tablet_metadata.cc:665] Metadata flushed
0709 12:18:24.578586 (+   172us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:18:24.585218 (+  6632us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:18:24.585504 (+   286us) tablet_replica.cc:206] Creating consensus instance
0709 12:18:24.596740 (+ 11236us) ts_tablet_manager.cc:989] Replica registered.
0709 12:18:24.596961 (+   221us) inbound_call.cc:177] Queueing success response
0709 12:18:24.634250 (+ 37289us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:18:25.297752 (+663502us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:18:25.319825 (+ 22073us) tablet_replica.cc:261] Starting instrumentation
0709 12:18:25.617289 (+297464us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":22416,"mutex_wait_us":573,"raft.queue_time_us":6144,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":4805,"spinlock_wait_cycles":2016128,"tablet-copy.queue_time_us":227274,"tablet-download-pool.queue_time_us":122,"tablet-download-pool.run_cpu_time_us":1410,"tablet-download-pool.run_wall_time_us":13313,"thread_start_us":490692,"threads_started":2}
I20260709 12:18:25.852125 24396 raft_consensus.cc:1275] T 82c31a779e7949a590cf168eef01e405 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:25.855000 24393 raft_consensus.cc:1275] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:25.859378 24484 tablet_copy_service.cc:342] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-51965da6bcc444d5b20f7348cba2c649 received from {username='slave'} at 127.0.0.1:33198
I20260709 12:18:25.859887 24484 tablet_copy_service.cc:434] P 99b8650fa8324ac2ac5f75eee9b1a1e3: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-51965da6bcc444d5b20f7348cba2c649 on tablet 51965da6bcc444d5b20f7348cba2c649 with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:25.860617 25759 consensus_queue.cc:1048] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:25.870512 24219 catalog_manager.cc:5697] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 1 to 2, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:25.879309 24394 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:25.886309 25082 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:25.889714 24323 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:25.887188 25815 raft_consensus.cc:2804] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:25.891359 25766 consensus_queue.cc:1048] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:25.891826 25815 raft_consensus.cc:697] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:25.894181 24472 raft_consensus.cc:1275] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:25.894340 24398 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
W20260709 12:18:25.895520 25750 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:18:25.896104 25529 consensus_queue.cc:1048] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:25.912662 25705 raft_consensus.cc:2955] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:25.892987 25815 consensus_queue.cc:237] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:25.920917 24319 raft_consensus.cc:2955] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:25.945005 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:25.951711 24223 catalog_manager.cc:5697] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 2 to 3, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 3 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:25.960393 25821 raft_consensus.cc:1064] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:25.966156 25821 consensus_queue.cc:237] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:25.939898 24394 raft_consensus.cc:2955] T 82c31a779e7949a590cf168eef01e405 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:26.014403 25117 raft_consensus.cc:2955] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:26.042392 25115 raft_consensus.cc:1275] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:26.043455 24472 raft_consensus.cc:1275] T 7910ea4d480e41fda4aa4fd10f0fef8f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:26.045176 24398 raft_consensus.cc:1275] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:26.044942 25759 consensus_queue.cc:1048] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:26.048026 25509 consensus_queue.cc:1048] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:26.050104 25811 consensus_queue.cc:1048] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:26.123217 24221 catalog_manager.cc:5697] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 1 to 2, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 2 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:26.127568 24220 catalog_manager.cc:5697] T 82c31a779e7949a590cf168eef01e405 P c855242ec9d34a5397741ef20db9de8a reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:26.143251 25759 raft_consensus.cc:2955] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:26.145977 25115 raft_consensus.cc:2955] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:26.180450 24472 consensus_queue.cc:237] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:26.182932 25117 raft_consensus.cc:1217] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:26.182037 24219 catalog_manager.cc:5697] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 2 to 3, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 3 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:26.191808 25116 raft_consensus.cc:1275] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:26.185778 25115 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEARNER]: Advancing to term 3
I20260709 12:18:26.219816 24323 raft_consensus.cc:1275] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:26.233996 25705 consensus_queue.cc:1048] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:26.244572 25115 raft_consensus.cc:1275] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 LEARNER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:26.248080 25509 consensus_queue.cc:1048] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:26.254352 24472 raft_consensus.cc:2955] T 7910ea4d480e41fda4aa4fd10f0fef8f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:26.246907 25766 consensus_queue.cc:1048] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:18:26.269444 24394 raft_consensus.cc:2955] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:18:26.292286 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 45229.5us
I20260709 12:18:26.295683 25696 raft_consensus.cc:2955] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:26.299820 25117 raft_consensus.cc:2955] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:26.305667 24220 catalog_manager.cc:5697] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:26.334033 24319 raft_consensus.cc:2955] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:26.343209 24472 raft_consensus.cc:1275] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:26.345350 25846 consensus_queue.cc:1048] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:26.346444 24323 raft_consensus.cc:1275] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:26.348409 25809 consensus_queue.cc:1048] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:26.355122 24393 raft_consensus.cc:1275] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:26.357373 25846 consensus_queue.cc:1048] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:26.406836 24209 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 82c31a779e7949a590cf168eef01e405 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:26.428473 24323 raft_consensus.cc:1275] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:26.432693 25509 raft_consensus.cc:1064] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:26.444962 25509 consensus_queue.cc:237] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:26.448364 25792 consensus_queue.cc:1048] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:26.453930 24393 raft_consensus.cc:1275] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:26.457038 25827 consensus_queue.cc:1048] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:26.457350 24472 raft_consensus.cc:1275] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:18:26.459031 25509 consensus_queue.cc:1048] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:26.464644 24394 raft_consensus.cc:1275] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:26.469550 24317 consensus_queue.cc:237] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:26.469574 25816 consensus_queue.cc:1048] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:26.480406 25115 raft_consensus.cc:1275] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:26.481904 25811 consensus_queue.cc:1048] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:26.485795 24396 raft_consensus.cc:1275] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:26.487797 24398 raft_consensus.cc:1275] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:18:26.512969 25811 consensus_queue.cc:1048] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:26.516902 25811 consensus_queue.cc:1048] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:18:26.534149 25853 log.cc:927] Time spent T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:18:26.545435 25117 raft_consensus.cc:1275] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 LEARNER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:18:26.552079 25759 raft_consensus.cc:2955] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:26.512526 24222 catalog_manager.cc:5697] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:26.556860 25529 consensus_queue.cc:1048] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:26.558830 25529 raft_consensus.cc:2955] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:26.577081 24395 raft_consensus.cc:2955] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:26.591753 25705 raft_consensus.cc:1064] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:26.594549 25705 consensus_queue.cc:237] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:26.595383 24396 raft_consensus.cc:2955] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:26.605801 24383 tablet_service.cc:1558] Processing DeleteTablet for tablet 82c31a779e7949a590cf168eef01e405 with delete_type TABLET_DATA_TOMBSTONED (TS c855242ec9d34a5397741ef20db9de8a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51466
I20260709 12:18:26.610189 25115 raft_consensus.cc:2955] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:26.634581 25116 raft_consensus.cc:2955] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:26.653913 25857 tablet_replica.cc:333] T 82c31a779e7949a590cf168eef01e405 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:18:26.656548 24210 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7910ea4d480e41fda4aa4fd10f0fef8f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:26.658512 25857 raft_consensus.cc:2243] T 82c31a779e7949a590cf168eef01e405 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:26.650882 24222 catalog_manager.cc:5697] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a reported cstate change: config changed from index 3 to 4, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New cstate: current_term: 1 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:26.670341 25857 raft_consensus.cc:2272] T 82c31a779e7949a590cf168eef01e405 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.676307 24395 raft_consensus.cc:1275] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:26.682626 25827 consensus_queue.cc:1048] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:26.690477 25857 ts_tablet_manager.cc:1916] T 82c31a779e7949a590cf168eef01e405 P c855242ec9d34a5397741ef20db9de8a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:26.701752 24461 tablet_service.cc:1558] Processing DeleteTablet for tablet 7910ea4d480e41fda4aa4fd10f0fef8f with delete_type TABLET_DATA_TOMBSTONED (TS 99b8650fa8324ac2ac5f75eee9b1a1e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33256
I20260709 12:18:26.708097 25115 raft_consensus.cc:1275] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:26.709007 24317 raft_consensus.cc:1275] T 51965da6bcc444d5b20f7348cba2c649 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:26.721072 24394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:18:26.721675 24394 raft_consensus.cc:606] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Received request to transfer leadership to TS d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:26.722045 24471 raft_consensus.cc:2955] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:26.731707 25792 consensus_queue.cc:1048] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:26.723726 24217 catalog_manager.cc:5697] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: config changed from index 2 to 4, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:26.751482 25805 raft_consensus.cc:993] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a: : Instructing follower d99d5d772cfe4a96afcab3d3b009a281 to start an election
I20260709 12:18:26.753621 25805 raft_consensus.cc:1081] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Signalling peer d99d5d772cfe4a96afcab3d3b009a281 to start an election
I20260709 12:18:26.752307 25777 consensus_queue.cc:1048] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:26.755427 25115 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f"
dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
 from {username='slave'} at 127.0.0.1:35194
I20260709 12:18:26.756034 25115 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:26.756403 25115 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:26.760774 24323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:42226
I20260709 12:18:26.761525 24323 raft_consensus.cc:606] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:26.765708 25115 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:26.767865 24472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82c31a779e7949a590cf168eef01e405"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
mode: GRACEFUL
new_leader_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:42866
I20260709 12:18:26.768537 24472 raft_consensus.cc:606] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Received request to transfer leadership to TS c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:26.768795 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:26.769340 24394 raft_consensus.cc:3055] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:26.769647 24394 raft_consensus.cc:740] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:26.752977 25860 tablet_replica.cc:333] T 7910ea4d480e41fda4aa4fd10f0fef8f P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:18:26.770501 24394 consensus_queue.cc:260] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:26.771443 25860 raft_consensus.cc:2243] T 7910ea4d480e41fda4aa4fd10f0fef8f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:26.771637 24394 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:26.774425 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:26.775069 24472 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:26.772418 25860 raft_consensus.cc:2272] T 7910ea4d480e41fda4aa4fd10f0fef8f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.781944 24394 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:26.783370 25082 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:26.783838 25115 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:26.784196 25815 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:26.784763 25815 raft_consensus.cc:697] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:26.785626 25815 consensus_queue.cc:237] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:26.798501 25860 ts_tablet_manager.cc:1916] T 7910ea4d480e41fda4aa4fd10f0fef8f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:26.801023 24396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:18:26.802790 24396 raft_consensus.cc:606] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Received request to transfer leadership to TS c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:26.804191 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:18:26.805892 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:26.806717 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:26.807649 24472 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:26.807519 24222 catalog_manager.cc:5697] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 1 to 2, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 2 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:26.821149 25766 raft_consensus.cc:2955] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:26.825654 25857 ts_tablet_manager.cc:1929] T 82c31a779e7949a590cf168eef01e405 P c855242ec9d34a5397741ef20db9de8a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:26.826256 25857 log.cc:1199] T 82c31a779e7949a590cf168eef01e405 P c855242ec9d34a5397741ef20db9de8a: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-1-root/wals/82c31a779e7949a590cf168eef01e405
I20260709 12:18:26.828218 24208 catalog_manager.cc:5028] TS c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): tablet 82c31a779e7949a590cf168eef01e405 (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:26.830502 25116 raft_consensus.cc:2955] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:26.836619 24317 raft_consensus.cc:2955] T 51965da6bcc444d5b20f7348cba2c649 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:26.860212 25860 ts_tablet_manager.cc:1929] T 7910ea4d480e41fda4aa4fd10f0fef8f P 99b8650fa8324ac2ac5f75eee9b1a1e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:26.860716 25860 log.cc:1199] T 7910ea4d480e41fda4aa4fd10f0fef8f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-2-root/wals/7910ea4d480e41fda4aa4fd10f0fef8f
I20260709 12:18:26.862577 24209 catalog_manager.cc:5028] TS 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): tablet 7910ea4d480e41fda4aa4fd10f0fef8f (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:26.866580 24396 raft_consensus.cc:2955] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:26.875974 24217 catalog_manager.cc:5697] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:26.906275 25696 raft_consensus.cc:993] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3: : Instructing follower c711faa13ead43ebbea0192cb74a4756 to start an election
I20260709 12:18:26.906894 25696 raft_consensus.cc:1081] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Signalling peer c711faa13ead43ebbea0192cb74a4756 to start an election
I20260709 12:18:26.908533 24317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82c31a779e7949a590cf168eef01e405"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:44278
I20260709 12:18:26.909132 24317 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:26.909492 24317 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:26.925846 24472 consensus_queue.cc:237] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:26.933320 25805 raft_consensus.cc:993] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a: : Instructing follower c711faa13ead43ebbea0192cb74a4756 to start an election
I20260709 12:18:26.934042 25750 raft_consensus.cc:1081] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Signalling peer c711faa13ead43ebbea0192cb74a4756 to start an election
I20260709 12:18:26.935949 24319 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:44280
I20260709 12:18:26.936514 24319 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:26.936904 24319 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:26.947427 24396 raft_consensus.cc:1275] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:26.948863 25116 raft_consensus.cc:1275] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:26.949163 25792 consensus_queue.cc:1048] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:26.944017 24319 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:26.953047 25777 consensus_queue.cc:1048] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:26.959590 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:26.960234 24396 raft_consensus.cc:3055] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:26.960579 24396 raft_consensus.cc:740] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:26.960667 25696 raft_consensus.cc:2955] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:26.961515 24396 consensus_queue.cc:260] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:26.962678 24396 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:26.967629 24394 raft_consensus.cc:2955] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:26.969679 25116 raft_consensus.cc:2955] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:26.984294 24319 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:26.986527 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:26.987903 24472 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:26.986817 24396 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:26.990626 24289 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:26.991761 25811 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:26.992290 25811 raft_consensus.cc:697] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:27.002089 25811 consensus_queue.cc:237] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:26.982347 24317 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:26.997649 24209 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 51965da6bcc444d5b20f7348cba2c649 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:27.011329 24317 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:27.012529 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:27.013301 25116 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:27.018119 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:27.018793 24466 raft_consensus.cc:3055] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:27.019078 24466 raft_consensus.cc:740] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:27.019841 24466 consensus_queue.cc:260] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:27.021193 24466 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:27.022890 25858 raft_consensus.cc:993] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756: : Instructing follower 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
I20260709 12:18:27.023437 25858 raft_consensus.cc:1081] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Signalling peer 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
I20260709 12:18:26.998181 24218 catalog_manager.cc:5697] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a reported cstate change: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:27.031387 24472 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:27.032398 25116 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:27.033802 24291 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:27.028964 24466 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:27.030902 24468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:33272
I20260709 12:18:27.036589 24468 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:27.037122 24468 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:27.035437 25858 raft_consensus.cc:2804] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:27.044536 25858 raft_consensus.cc:697] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:27.045612 25858 consensus_queue.cc:237] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:27.073272 24468 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:27.075654 24468 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:27.081496 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:27.081688 24308 tablet_service.cc:1558] Processing DeleteTablet for tablet 51965da6bcc444d5b20f7348cba2c649 with delete_type TABLET_DATA_TOMBSTONED (TS c711faa13ead43ebbea0192cb74a4756 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44272
I20260709 12:18:27.082113 25115 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:27.087634 24220 catalog_manager.cc:5697] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 1 to 2, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:27.093309 25115 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:27.096915 24440 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:27.099303 25766 raft_consensus.cc:2804] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:27.100729 25766 raft_consensus.cc:697] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:27.101675 25766 consensus_queue.cc:237] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:27.104393 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:27.106667 24319 raft_consensus.cc:3055] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:27.107016 24319 raft_consensus.cc:740] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:27.107822 24319 consensus_queue.cc:260] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:27.117426 25865 tablet_replica.cc:333] T 51965da6bcc444d5b20f7348cba2c649 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:18:27.119165 25116 raft_consensus.cc:1240] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:27.122406 25865 raft_consensus.cc:2243] T 51965da6bcc444d5b20f7348cba2c649 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:27.123371 25865 raft_consensus.cc:2272] T 51965da6bcc444d5b20f7348cba2c649 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:27.123230 24319 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:27.131580 25865 ts_tablet_manager.cc:1916] T 51965da6bcc444d5b20f7348cba2c649 P c711faa13ead43ebbea0192cb74a4756: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:27.139963 24319 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:27.163434 24217 catalog_manager.cc:5697] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 1 to 2, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:27.165176 24220 catalog_manager.cc:5697] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 1 to 2, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 2 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:27.194444 24317 consensus_queue.cc:237] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:27.200973 25865 ts_tablet_manager.cc:1929] T 51965da6bcc444d5b20f7348cba2c649 P c711faa13ead43ebbea0192cb74a4756: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:27.201462 25865 log.cc:1199] T 51965da6bcc444d5b20f7348cba2c649 P c711faa13ead43ebbea0192cb74a4756: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-0-root/wals/51965da6bcc444d5b20f7348cba2c649
I20260709 12:18:27.204535 25115 raft_consensus.cc:1275] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:27.206331 25811 consensus_queue.cc:1048] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:27.209115 24210 catalog_manager.cc:5028] TS c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): tablet 51965da6bcc444d5b20f7348cba2c649 (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:27.216226 24396 raft_consensus.cc:1275] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:27.218623 25529 consensus_queue.cc:1048] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:27.233688 25858 raft_consensus.cc:2955] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:27.237135 25116 raft_consensus.cc:2955] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:27.250525 24210 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 67fce41b64ab4350b88ec02abbcd9c82 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:27.266503 24220 catalog_manager.cc:5697] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index 4 to 5, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New cstate: current_term: 3 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:27.282241 24461 tablet_service.cc:1558] Processing DeleteTablet for tablet 67fce41b64ab4350b88ec02abbcd9c82 with delete_type TABLET_DATA_TOMBSTONED (TS 99b8650fa8324ac2ac5f75eee9b1a1e3 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33256
I20260709 12:18:27.283219 25860 tablet_replica.cc:333] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:18:27.301928 24395 raft_consensus.cc:2955] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:27.310264 25860 raft_consensus.cc:2243] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:27.311328 25860 raft_consensus.cc:2272] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:27.315198 25860 ts_tablet_manager.cc:1916] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:27.330798 24395 raft_consensus.cc:1275] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:27.332878 25816 consensus_queue.cc:1048] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:27.350029 24466 raft_consensus.cc:1275] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:27.355020 25816 consensus_queue.cc:1048] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:27.375077 25860 ts_tablet_manager.cc:1929] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:18:27.375645 25860 log.cc:1199] T 67fce41b64ab4350b88ec02abbcd9c82 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-2-root/wals/67fce41b64ab4350b88ec02abbcd9c82
I20260709 12:18:27.379024 24209 catalog_manager.cc:5028] TS 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): tablet 67fce41b64ab4350b88ec02abbcd9c82 (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:27.391870 24396 raft_consensus.cc:1275] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:27.393677 25858 consensus_queue.cc:1048] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:27.422210 24468 raft_consensus.cc:1275] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:27.428058 25858 consensus_queue.cc:1048] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:27.468792 24471 raft_consensus.cc:1275] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:27.470180 25858 consensus_queue.cc:1048] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:27.487644 25116 raft_consensus.cc:1275] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:27.489014 25858 consensus_queue.cc:1048] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:27.615796 24319 raft_consensus.cc:1275] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:27.617471 25777 consensus_queue.cc:1048] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:27.620888 25115 raft_consensus.cc:1275] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:27.622562 25777 consensus_queue.cc:1048] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:27.930215 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:27.988018 24319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:42226
I20260709 12:18:27.988720 24319 raft_consensus.cc:606] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:27.991978 24319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
mode: GRACEFUL
new_leader_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:42226
I20260709 12:18:27.992622 24319 raft_consensus.cc:606] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Received request to transfer leadership to TS c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:27.998621 24471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
mode: GRACEFUL
new_leader_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:42866
I20260709 12:18:27.999310 24471 raft_consensus.cc:606] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Received request to transfer leadership to TS c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:28.006820 24471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
mode: GRACEFUL
new_leader_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:42866
I20260709 12:18:28.007586 24471 raft_consensus.cc:606] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Received request to transfer leadership to TS c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:28.009155 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:18:28.011314 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:28.011984 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:28.208935 25766 raft_consensus.cc:993] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3: : Instructing follower c855242ec9d34a5397741ef20db9de8a to start an election
I20260709 12:18:28.209570 25879 raft_consensus.cc:1081] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Signalling peer c855242ec9d34a5397741ef20db9de8a to start an election
I20260709 12:18:28.211237 24395 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:51474
I20260709 12:18:28.212232 24395 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:28.212695 24395 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:28.216612 25811 raft_consensus.cc:993] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756: : Instructing follower 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
I20260709 12:18:28.217265 25811 raft_consensus.cc:1081] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Signalling peer 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
I20260709 12:18:28.218745 24468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:33272
I20260709 12:18:28.219236 24468 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:28.219549 24468 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:28.221673 24395 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:28.225051 24395 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:28.225314 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:28.226123 24471 raft_consensus.cc:3055] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:28.226511 24471 raft_consensus.cc:740] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:28.228340 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:28.228950 24319 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:28.227370 24471 consensus_queue.cc:260] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:28.230186 24471 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:28.232915 24468 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:28.236337 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:28.236935 24317 raft_consensus.cc:3055] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:28.237252 24317 raft_consensus.cc:740] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:28.237993 24317 consensus_queue.cc:260] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:28.239054 24317 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:28.242419 24471 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:28.244046 24365 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:28.253363 25814 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:28.253904 25814 raft_consensus.cc:697] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:28.255111 25814 consensus_queue.cc:237] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:28.255445 24317 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
I20260709 12:18:28.261689 24440 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:18:28.264473 25879 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:28.267835 24468 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:28.288033 24319 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:28.293053 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:28.293707 24394 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:28.296517 25879 raft_consensus.cc:697] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:28.297652 25879 consensus_queue.cc:237] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:28.300323 24394 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
I20260709 12:18:28.326669 24220 catalog_manager.cc:5697] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 2 to 3, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 3 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:28.341781 25766 raft_consensus.cc:993] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3: : Instructing follower c855242ec9d34a5397741ef20db9de8a to start an election
I20260709 12:18:28.342419 25777 raft_consensus.cc:1081] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Signalling peer c855242ec9d34a5397741ef20db9de8a to start an election
I20260709 12:18:28.344223 24394 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:51474
I20260709 12:18:28.344832 24394 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:28.345181 24394 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:28.351934 24394 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:28.353617 25858 raft_consensus.cc:993] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756: : Instructing follower c855242ec9d34a5397741ef20db9de8a to start an election
I20260709 12:18:28.353919 24394 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:28.354209 25858 raft_consensus.cc:1081] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Signalling peer c855242ec9d34a5397741ef20db9de8a to start an election
I20260709 12:18:28.355965 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:28.356608 25116 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:28.356839 24394 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:51478
I20260709 12:18:28.357424 24394 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:28.357772 24394 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:28.357699 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:28.358306 24472 raft_consensus.cc:3055] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:28.358592 24472 raft_consensus.cc:740] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:28.359301 24472 consensus_queue.cc:260] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:28.360482 24472 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:28.364436 24394 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:28.378454 24394 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:28.387250 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:28.388108 25115 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:28.400585 24472 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:28.400772 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:28.402050 24319 raft_consensus.cc:3055] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:28.402421 24319 raft_consensus.cc:740] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:28.403373 24319 consensus_queue.cc:260] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:28.404839 24319 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:28.410467 24365 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:28.411365 25814 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:28.412143 25814 raft_consensus.cc:697] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:28.413084 25814 consensus_queue.cc:237] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:28.477913 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 62675.5us
I20260709 12:18:28.411134 25116 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:28.483302 24319 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:28.484561 25115 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:28.486227 24366 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:28.502692 24217 catalog_manager.cc:5697] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 2 to 3, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 3 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:28.495765 25880 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:28.517246 25880 raft_consensus.cc:697] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:28.529022 25880 consensus_queue.cc:237] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:28.577543 24217 catalog_manager.cc:5697] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 1 to 2, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 2 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:28.579241 24217 catalog_manager.cc:5697] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 1 to 2, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 2 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:28.626343 24394 consensus_queue.cc:237] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:28.633459 24468 raft_consensus.cc:1275] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:18:28.633463 24366 consensus_peers.cc:597] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7cd3bd910f7f47f9acdd1792db910842. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:28.635092 25889 consensus_queue.cc:1048] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:28.638159 24319 raft_consensus.cc:1275] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:28.639516 25889 consensus_queue.cc:1048] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:28.653101 25886 raft_consensus.cc:2955] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:28.657400 24319 raft_consensus.cc:2955] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:28.670831 24472 raft_consensus.cc:2955] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
W20260709 12:18:28.723290 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 45126.3us
I20260709 12:18:28.729192 24217 catalog_manager.cc:5697] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:28.738080 24323 raft_consensus.cc:1275] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:28.746426 25887 consensus_queue.cc:1048] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:28.769342 24471 raft_consensus.cc:1275] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:28.773373 25889 consensus_queue.cc:1048] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:28.795462 24394 raft_consensus.cc:1275] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:28.797832 25777 consensus_queue.cc:1048] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:28.807969 24471 consensus_queue.cc:237] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:28.813243 24323 raft_consensus.cc:1275] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:28.862304 25766 consensus_queue.cc:1048] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:18:28.911199 24440 consensus_peers.cc:597] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 63debf83121c430e9dffcd1c5035cf3a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:28.917294 24395 raft_consensus.cc:1275] T 63debf83121c430e9dffcd1c5035cf3a P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:28.919307 25879 consensus_queue.cc:1048] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:28.922072 24323 raft_consensus.cc:1275] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:28.924072 25900 consensus_queue.cc:1048] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:28.957057 25899 raft_consensus.cc:2955] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:28.965034 24319 raft_consensus.cc:2955] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:28.977383 24472 raft_consensus.cc:1275] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:28.981493 25115 raft_consensus.cc:1275] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:28.983999 25887 consensus_queue.cc:1048] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:28.999787 25890 consensus_queue.cc:1048] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:29.008502 25116 raft_consensus.cc:1275] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:29.010989 25890 consensus_queue.cc:1048] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:29.056854 24472 consensus_queue.cc:237] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:29.072583 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:29.135973 24319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:42226
I20260709 12:18:29.137138 24319 raft_consensus.cc:606] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:29.146916 24469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
mode: GRACEFUL
new_leader_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:42866
W20260709 12:18:29.147372 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 46320.4us
I20260709 12:18:29.167966 24317 raft_consensus.cc:1275] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:29.152546 24217 catalog_manager.cc:5697] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:29.203853 25887 consensus_queue.cc:1048] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:29.210803 24317 raft_consensus.cc:1275] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:18:29.211300 24440 consensus_peers.cc:597] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 27d97e40dd274a2ea3734c2982741e3c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:29.211309 24469 raft_consensus.cc:606] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Received request to transfer leadership to TS c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:29.215107 25879 consensus_queue.cc:1048] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:29.219542 25846 raft_consensus.cc:993] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756: : Instructing follower 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
I20260709 12:18:29.220047 25846 raft_consensus.cc:1081] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Signalling peer 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
I20260709 12:18:29.223064 24395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:18:29.223258 24468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:33272
I20260709 12:18:29.223754 24468 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:29.224264 24468 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:29.223724 24395 raft_consensus.cc:606] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Received request to transfer leadership to TS c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:29.230082 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:18:29.231841 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:29.234464 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:29.242733 24468 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:29.244900 24468 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:29.246801 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:29.247818 24319 raft_consensus.cc:3055] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:29.248238 24319 raft_consensus.cc:740] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:29.262805 24319 consensus_queue.cc:260] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:29.264163 24319 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:29.282012 24395 raft_consensus.cc:1275] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:29.283492 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:29.284075 24395 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:29.294342 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 98678us
I20260709 12:18:29.295279 25900 raft_consensus.cc:993] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3: : Instructing follower c711faa13ead43ebbea0192cb74a4756 to start an election
I20260709 12:18:29.295946 25900 raft_consensus.cc:1081] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Signalling peer c711faa13ead43ebbea0192cb74a4756 to start an election
I20260709 12:18:29.296109 24394 raft_consensus.cc:2955] T 63debf83121c430e9dffcd1c5035cf3a P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:29.297938 25766 raft_consensus.cc:2955] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:29.314926 24323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:44278
I20260709 12:18:29.316213 24323 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:29.319423 24323 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:29.326048 25899 consensus_queue.cc:1048] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:29.369102 24396 consensus_queue.cc:237] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:29.378129 24323 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:29.383518 24324 raft_consensus.cc:1240] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:29.385073 24323 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:29.388298 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:29.388924 24398 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:29.387988 24218 catalog_manager.cc:5697] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:29.398175 25900 consensus_queue.cc:1059] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:29.399252 25766 raft_consensus.cc:3055] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:29.399770 25766 raft_consensus.cc:740] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:29.402817 25766 consensus_queue.cc:260] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:29.406867 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:29.408051 25766 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:29.295334 24395 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:29.436159 24472 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:29.449831 24398 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:29.466239 24438 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:29.469204 24366 consensus_peers.cc:597] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1541b2ab674f43ca8c6b46df9171c32d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:29.481751 25766 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:29.473104 24290 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:18:29.482285 25766 raft_consensus.cc:697] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:29.483274 25766 consensus_queue.cc:237] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:29.486939 25811 raft_consensus.cc:2804] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:29.488202 25811 raft_consensus.cc:697] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:29.475972 24319 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:29.477324 25920 ts_tablet_manager.cc:933] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:29.491820 25811 consensus_queue.cc:237] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:29.503387 25920 tablet_copy_client.cc:323] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.195:44453
I20260709 12:18:29.505380 24484 tablet_copy_service.cc:140] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Received BeginTabletCopySession request for tablet 63debf83121c430e9dffcd1c5035cf3a from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:33198)
I20260709 12:18:29.506003 24484 tablet_copy_service.cc:161] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Beginning new tablet copy session on tablet 63debf83121c430e9dffcd1c5035cf3a from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:33198: session id = d99d5d772cfe4a96afcab3d3b009a281-63debf83121c430e9dffcd1c5035cf3a
I20260709 12:18:29.508849 24319 raft_consensus.cc:1275] T 1541b2ab674f43ca8c6b46df9171c32d P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:29.513226 25887 consensus_queue.cc:1048] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:29.515108 24484 tablet_copy_source_session.cc:215] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:29.517625 24400 raft_consensus.cc:1240] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 12:18:29.522600 25922 ts_tablet_manager.cc:933] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:29.526140 25920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63debf83121c430e9dffcd1c5035cf3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:29.551540 24468 raft_consensus.cc:1275] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:29.550905 24218 catalog_manager.cc:5697] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 1 to 2, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 2 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:29.570066 25886 consensus_queue.cc:1048] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:29.572448 25922 tablet_copy_client.cc:323] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.194:35893
I20260709 12:18:29.574419 24410 tablet_copy_service.cc:140] P c855242ec9d34a5397741ef20db9de8a: Received BeginTabletCopySession request for tablet 7cd3bd910f7f47f9acdd1792db910842 from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:50950)
I20260709 12:18:29.575060 24410 tablet_copy_service.cc:161] P c855242ec9d34a5397741ef20db9de8a: Beginning new tablet copy session on tablet 7cd3bd910f7f47f9acdd1792db910842 from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:50950: session id = d99d5d772cfe4a96afcab3d3b009a281-7cd3bd910f7f47f9acdd1792db910842
I20260709 12:18:29.586436 24410 tablet_copy_source_session.cc:215] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:29.598212 24219 catalog_manager.cc:5697] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index 2 to -1, term changed from 1 to 2, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193), NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) evicted, now has a pending config: VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193), VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194), VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195), NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 2 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:29.599277 25886 raft_consensus.cc:2955] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:29.602596 24324 raft_consensus.cc:2955] T 1541b2ab674f43ca8c6b46df9171c32d P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:29.607704 24468 raft_consensus.cc:2955] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:29.619287 25922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cd3bd910f7f47f9acdd1792db910842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:29.625384 25920 tablet_copy_client.cc:806] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:29.626175 25920 tablet_copy_client.cc:670] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:29.636071 25920 tablet_copy_client.cc:538] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:29.656595 25920 tablet_bootstrap.cc:492] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:18:29.680737 24217 catalog_manager.cc:5697] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:29.696732 25887 raft_consensus.cc:993] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a: : Instructing follower c711faa13ead43ebbea0192cb74a4756 to start an election
I20260709 12:18:29.697312 25887 raft_consensus.cc:1081] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Signalling peer c711faa13ead43ebbea0192cb74a4756 to start an election
I20260709 12:18:29.701021 24324 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:44280
I20260709 12:18:29.701654 24324 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:29.702090 24324 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:29.739984 25922 tablet_copy_client.cc:806] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:29.740727 25922 tablet_copy_client.cc:670] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:29.745675 24324 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:29.748607 24324 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:29.748934 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:29.749552 24400 raft_consensus.cc:3055] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:29.749853 24400 raft_consensus.cc:740] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:29.750626 24400 consensus_queue.cc:260] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:29.751977 24400 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:29.763293 25109 tablet_service.cc:1558] Processing DeleteTablet for tablet 27d97e40dd274a2ea3734c2982741e3c with delete_type TABLET_DATA_TOMBSTONED (TS d99d5d772cfe4a96afcab3d3b009a281 not found in new config with opid_index -1) from {username='slave'} at 127.0.0.1:33956
I20260709 12:18:29.785257 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:29.786185 24468 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:29.792737 25922 tablet_copy_client.cc:538] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:29.802337 24400 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:29.810842 24289 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:29.811808 25923 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:29.812937 25922 tablet_bootstrap.cc:492] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:18:29.812358 25923 raft_consensus.cc:697] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:18:29.814154 24210 catalog_manager.cc:4995] TS d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): delete failed for tablet 27d97e40dd274a2ea3734c2982741e3c because the tablet was not found. No further retry: Not found: Tablet not found: 27d97e40dd274a2ea3734c2982741e3c
I20260709 12:18:29.815480 25923 consensus_queue.cc:237] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:29.816823 24468 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:29.834973 25920 tablet_bootstrap.cc:492] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:29.836062 25920 tablet_bootstrap.cc:492] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:29.839249 25920 ts_tablet_manager.cc:1403] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.183s	user 0.028s	sys 0.013s
I20260709 12:18:29.842551 25920 raft_consensus.cc:359] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:29.843482 25920 raft_consensus.cc:740] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:29.844218 25920 consensus_queue.cc:260] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:29.847136 25920 ts_tablet_manager.cc:1434] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:18:29.849082 24484 tablet_copy_service.cc:342] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-63debf83121c430e9dffcd1c5035cf3a received from {username='slave'} at 127.0.0.1:33198
I20260709 12:18:29.849617 24484 tablet_copy_service.cc:434] P 99b8650fa8324ac2ac5f75eee9b1a1e3: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-63debf83121c430e9dffcd1c5035cf3a on tablet 63debf83121c430e9dffcd1c5035cf3a with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:29.860972 24219 catalog_manager.cc:5697] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 1 to 2, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:29.879984 25922 tablet_bootstrap.cc:492] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:29.881374 25922 tablet_bootstrap.cc:492] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:29.882004 25922 ts_tablet_manager.cc:1403] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.069s	user 0.018s	sys 0.012s
I20260709 12:18:29.901388 25922 raft_consensus.cc:359] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:29.902608 25922 raft_consensus.cc:740] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:29.903272 25922 consensus_queue.cc:260] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:29.921582 25922 ts_tablet_manager.cc:1434] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 12:18:29.923110 24410 tablet_copy_service.cc:342] P c855242ec9d34a5397741ef20db9de8a: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-7cd3bd910f7f47f9acdd1792db910842 received from {username='slave'} at 127.0.0.1:50950
I20260709 12:18:29.923501 24410 tablet_copy_service.cc:434] P c855242ec9d34a5397741ef20db9de8a: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-7cd3bd910f7f47f9acdd1792db910842 on tablet 7cd3bd910f7f47f9acdd1792db910842 with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:29.930886 24324 raft_consensus.cc:1275] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:29.934135 25879 consensus_queue.cc:1048] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:29.956609 25115 raft_consensus.cc:1217] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:18:29.959932 24291 consensus_peers.cc:597] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 27d97e40dd274a2ea3734c2982741e3c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:29.996964 24395 raft_consensus.cc:1275] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:29.999444 25919 consensus_queue.cc:1048] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:30.008836 24396 raft_consensus.cc:1275] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:18:30.012797 25858 consensus_queue.cc:1048] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:30.050334 24396 raft_consensus.cc:2955] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:30.053551 25846 raft_consensus.cc:2955] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:30.067216 25922 ts_tablet_manager.cc:933] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:30.080155 24468 raft_consensus.cc:1275] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:18:30.083478 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 47731.5us
I20260709 12:18:30.089607 25922 tablet_copy_client.cc:323] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.194:35893
I20260709 12:18:30.088888 24219 catalog_manager.cc:5697] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index -1 to 2, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added, no longer has a pending config: VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193), VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194), VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195), NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 2 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:30.093709 24410 tablet_copy_service.cc:140] P c855242ec9d34a5397741ef20db9de8a: Received BeginTabletCopySession request for tablet 1541b2ab674f43ca8c6b46df9171c32d from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:50950)
I20260709 12:18:30.094311 24410 tablet_copy_service.cc:161] P c855242ec9d34a5397741ef20db9de8a: Beginning new tablet copy session on tablet 1541b2ab674f43ca8c6b46df9171c32d from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:50950: session id = d99d5d772cfe4a96afcab3d3b009a281-1541b2ab674f43ca8c6b46df9171c32d
I20260709 12:18:30.091095 25923 consensus_queue.cc:1048] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:18:30.133188 24410 tablet_copy_source_session.cc:215] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:30.151250 25922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1541b2ab674f43ca8c6b46df9171c32d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:30.187649 25922 tablet_copy_client.cc:806] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:30.188305 25922 tablet_copy_client.cc:670] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:30.200789 25922 tablet_copy_client.cc:538] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:30.212030 25922 tablet_bootstrap.cc:492] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:18:30.249354 25922 tablet_bootstrap.cc:492] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:30.252085 25922 tablet_bootstrap.cc:492] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:30.253247 25922 ts_tablet_manager.cc:1403] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.041s	user 0.020s	sys 0.008s
I20260709 12:18:30.256193 25922 raft_consensus.cc:359] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:30.257298 25922 raft_consensus.cc:740] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:30.257965 25922 consensus_queue.cc:260] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:30.261235 25922 ts_tablet_manager.cc:1434] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:18:30.263563 24410 tablet_copy_service.cc:342] P c855242ec9d34a5397741ef20db9de8a: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-1541b2ab674f43ca8c6b46df9171c32d received from {username='slave'} at 127.0.0.1:50950
I20260709 12:18:30.264067 24410 tablet_copy_service.cc:434] P c855242ec9d34a5397741ef20db9de8a: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-1541b2ab674f43ca8c6b46df9171c32d on tablet 1541b2ab674f43ca8c6b46df9171c32d with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:30.287038 24395 raft_consensus.cc:1275] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:30.293581 25846 consensus_queue.cc:1048] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:30.299266 25115 raft_consensus.cc:1217] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:30.339762 25879 raft_consensus.cc:1064] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:30.342482 25879 consensus_queue.cc:237] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:30.395345 24468 raft_consensus.cc:1275] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:30.407322 25846 consensus_queue.cc:1048] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:30.422658 25117 raft_consensus.cc:1275] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:30.428423 25900 consensus_queue.cc:1048] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:30.466166 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:30.488839 25118 raft_consensus.cc:1217] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:30.506109 24396 raft_consensus.cc:1275] T 63debf83121c430e9dffcd1c5035cf3a P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:30.508744 25766 consensus_queue.cc:1048] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:30.512046 24324 raft_consensus.cc:1275] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:30.516202 25766 consensus_queue.cc:1048] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:30.566452 25879 raft_consensus.cc:2955] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:30.572935 24396 raft_consensus.cc:2955] T 63debf83121c430e9dffcd1c5035cf3a P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:30.583256 25922 ts_tablet_manager.cc:933] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:18:30.626587 25922 tablet_copy_client.cc:323] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.193:36951
I20260709 12:18:30.628285 24335 tablet_copy_service.cc:140] P c711faa13ead43ebbea0192cb74a4756: Received BeginTabletCopySession request for tablet 27d97e40dd274a2ea3734c2982741e3c from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:57702)
I20260709 12:18:30.627820 25117 raft_consensus.cc:2955] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:30.628885 24335 tablet_copy_service.cc:161] P c711faa13ead43ebbea0192cb74a4756: Beginning new tablet copy session on tablet 27d97e40dd274a2ea3734c2982741e3c from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:57702: session id = d99d5d772cfe4a96afcab3d3b009a281-27d97e40dd274a2ea3734c2982741e3c
I20260709 12:18:30.640453 24324 raft_consensus.cc:2955] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:30.638532 24217 catalog_manager.cc:5697] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:30.653888 24472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
mode: GRACEFUL
new_leader_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:42866
I20260709 12:18:30.654714 24472 raft_consensus.cc:606] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Received request to transfer leadership to TS c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:30.659265 24396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:18:30.663183 24396 raft_consensus.cc:606] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Received request to transfer leadership to TS c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:30.666723 24317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:42226
I20260709 12:18:30.667439 24317 raft_consensus.cc:606] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:30.671100 24319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
mode: GRACEFUL
new_leader_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:42226
I20260709 12:18:30.671703 24319 raft_consensus.cc:606] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Received request to transfer leadership to TS c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:30.673636 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:18:30.676177 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:30.682073 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:30.689038 25887 raft_consensus.cc:1064] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:30.691771 25887 consensus_queue.cc:237] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:30.698801 24335 tablet_copy_source_session.cc:215] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:30.727989 25922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27d97e40dd274a2ea3734c2982741e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:30.734867 24324 raft_consensus.cc:1275] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:30.736284 25887 consensus_queue.cc:1048] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:30.737828 24472 raft_consensus.cc:1275] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:30.739392 25886 consensus_queue.cc:1048] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:30.761906 25117 raft_consensus.cc:1275] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:30.800998 25886 consensus_queue.cc:1048] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
W20260709 12:18:30.821709 25951 log.cc:927] Time spent T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:18:30.825512 25915 raft_consensus.cc:993] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a: : Instructing follower c711faa13ead43ebbea0192cb74a4756 to start an election
I20260709 12:18:30.826645 25915 raft_consensus.cc:1081] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Signalling peer c711faa13ead43ebbea0192cb74a4756 to start an election
I20260709 12:18:30.834021 24324 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:44280
I20260709 12:18:30.834656 24324 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:30.836720 24324 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:30.880339 24324 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:30.901391 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 98054us
I20260709 12:18:30.908479 24324 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:18:30.970037 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 68207.4us
I20260709 12:18:30.982528 25922 tablet_copy_client.cc:806] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:31.010391 25922 tablet_copy_client.cc:670] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:30.909511 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:31.011237 25118 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:31.043488 25118 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
W20260709 12:18:31.074352 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 71616.5us
I20260709 12:18:31.091481 24291 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:31.095791 25811 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:31.137132 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:31.138031 24395 raft_consensus.cc:3055] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:31.138404 24395 raft_consensus.cc:740] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:31.139390 24395 consensus_queue.cc:260] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:31.144281 24395 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:31.150050 25811 raft_consensus.cc:697] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:31.155234 25811 consensus_queue.cc:237] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:31.179738 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 298261us
I20260709 12:18:31.103065 25956 raft_consensus.cc:2955] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:31.207207 24317 raft_consensus.cc:2955] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:31.219846 25886 raft_consensus.cc:1064] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:31.223002 25886 consensus_queue.cc:237] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:31.230391 25959 raft_consensus.cc:993] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3: : Instructing follower c855242ec9d34a5397741ef20db9de8a to start an election
I20260709 12:18:31.230978 25959 raft_consensus.cc:1081] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Signalling peer c855242ec9d34a5397741ef20db9de8a to start an election
I20260709 12:18:31.246285 24395 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:31.248085 24398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:51474
I20260709 12:18:31.248732 24398 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:31.249130 24398 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:31.272473 25858 raft_consensus.cc:993] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756: : Instructing follower 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
I20260709 12:18:31.297817 25858 raft_consensus.cc:1081] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Signalling peer 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
I20260709 12:18:31.280337 24472 consensus_queue.cc:237] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:31.313136 24469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:33272
I20260709 12:18:31.313802 24469 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:31.314174 24469 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:31.294224 25118 raft_consensus.cc:2955] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:31.297163 24468 raft_consensus.cc:2955] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:31.276453 24398 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:31.343807 25922 tablet_copy_client.cc:538] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:31.351238 24471 raft_consensus.cc:1275] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:31.353880 24469 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:31.357182 24324 raft_consensus.cc:1275] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:31.367231 25922 tablet_bootstrap.cc:492] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:18:31.369002 25858 raft_consensus.cc:993] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756: : Instructing follower c855242ec9d34a5397741ef20db9de8a to start an election
I20260709 12:18:31.377455 25858 raft_consensus.cc:1081] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Signalling peer c855242ec9d34a5397741ef20db9de8a to start an election
I20260709 12:18:31.370563 25117 raft_consensus.cc:1275] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:31.370514 24398 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:31.374780 24469 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:31.375694 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:31.381019 24324 raft_consensus.cc:3055] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:31.381371 24324 raft_consensus.cc:740] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:31.382479 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:31.383114 24317 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:31.385885 24319 raft_consensus.cc:1275] T 1541b2ab674f43ca8c6b46df9171c32d P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:31.385916 25117 raft_consensus.cc:1275] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 1 LEARNER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:31.388931 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:31.391240 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:31.391887 24469 raft_consensus.cc:3055] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:31.391782 24396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:51478
I20260709 12:18:31.392326 24469 raft_consensus.cc:740] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:31.392760 24396 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:31.393172 24396 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:31.393790 24469 consensus_queue.cc:260] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:31.394920 24469 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:31.392900 25966 consensus_queue.cc:1048] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:31.405016 24469 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:31.409317 24324 consensus_queue.cc:260] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:31.411280 24365 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:31.413584 24395 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:31.415732 24396 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:31.421674 24317 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:31.423448 24396 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:31.427295 24324 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:31.420818 25964 consensus_queue.cc:1048] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:18:31.432828 25955 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:31.433509 25955 raft_consensus.cc:697] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:31.439174 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:31.440397 24317 raft_consensus.cc:3055] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:31.440822 24317 raft_consensus.cc:740] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:31.434548 25955 consensus_queue.cc:237] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:31.444753 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:31.422341 24220 catalog_manager.cc:5697] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:31.444852 24317 consensus_queue.cc:260] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:31.445480 25117 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:31.449687 24317 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:31.450628 24395 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:31.452328 24438 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:31.376052 25967 consensus_queue.cc:1048] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:18:31.483239 25766 consensus_queue.cc:1048] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:31.485250 24317 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:31.477628 25959 raft_consensus.cc:2804] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:31.505121 24366 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:31.510475 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 120397us
I20260709 12:18:31.450505 25886 consensus_queue.cc:1048] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:18:31.519265 24324 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:31.500412 25959 raft_consensus.cc:697] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:31.518395 25915 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:31.559255 25117 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:31.563663 24324 raft_consensus.cc:2955] T 1541b2ab674f43ca8c6b46df9171c32d P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:31.561116 25972 raft_consensus.cc:2955] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:31.567072 25915 raft_consensus.cc:697] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:31.573014 25915 consensus_queue.cc:237] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:31.583989 25117 raft_consensus.cc:2955] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:31.549927 25959 consensus_queue.cc:237] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:31.584864 25900 raft_consensus.cc:2955] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:31.615803 24217 catalog_manager.cc:5697] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 2 to 3, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 3 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:31.628530 24324 raft_consensus.cc:2955] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:31.653906 24395 consensus_queue.cc:237] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:31.668851 25117 raft_consensus.cc:1275] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:31.670578 25811 consensus_queue.cc:1048] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:18:31.725705 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 58803.7us
I20260709 12:18:31.728364 25118 raft_consensus.cc:1275] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:31.730118 25922 tablet_bootstrap.cc:492] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:31.731153 25922 tablet_bootstrap.cc:492] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:31.731870 25922 ts_tablet_manager.cc:1403] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.365s	user 0.021s	sys 0.008s
I20260709 12:18:31.734612 25922 raft_consensus.cc:359] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
W20260709 12:18:31.735014 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 52026.8us
I20260709 12:18:31.735436 25922 raft_consensus.cc:740] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:31.736128 25922 consensus_queue.cc:260] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:31.737881 24469 raft_consensus.cc:1275] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:31.739598 25922 ts_tablet_manager.cc:1434] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:18:31.748324 24468 raft_consensus.cc:2955] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:31.796365 24209 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 63debf83121c430e9dffcd1c5035cf3a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:31.801400 24218 catalog_manager.cc:5697] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 1 to 2, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 2 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:31.807673 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:31.818189 24220 catalog_manager.cc:5697] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: config changed from index 3 to 4, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New cstate: current_term: 1 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:31.830564 24335 tablet_copy_service.cc:342] P c711faa13ead43ebbea0192cb74a4756: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-27d97e40dd274a2ea3734c2982741e3c received from {username='slave'} at 127.0.0.1:57702
I20260709 12:18:31.831800 24335 tablet_copy_service.cc:434] P c711faa13ead43ebbea0192cb74a4756: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-27d97e40dd274a2ea3734c2982741e3c on tablet 27d97e40dd274a2ea3734c2982741e3c with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:31.851073 24395 raft_consensus.cc:1275] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:31.935201 25887 consensus_queue.cc:1048] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:18:31.945987 25963 consensus_queue.cc:1048] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:18:31.988858 24217 catalog_manager.cc:5697] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 1 to 2, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 2 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:31.992329 25915 raft_consensus.cc:2955] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:31.997938 25119 raft_consensus.cc:1217] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEARNER]: Deduplicated request from leader. Original: 1.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:18:32.013417 25115 raft_consensus.cc:2955] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:32.015918 24469 raft_consensus.cc:1275] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:32.025508 24217 catalog_manager.cc:5697] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 1 to 2, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 2 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:32.038527 25116 raft_consensus.cc:1275] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:32.042276 25965 consensus_queue.cc:1048] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:18:32.050415 25962 consensus_queue.cc:1048] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:18:32.076015 25846 consensus_queue.cc:1048] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:32.063669 24218 catalog_manager.cc:5697] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:32.043733 25117 raft_consensus.cc:2955] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:32.110426 24383 tablet_service.cc:1558] Processing DeleteTablet for tablet 63debf83121c430e9dffcd1c5035cf3a with delete_type TABLET_DATA_TOMBSTONED (TS c855242ec9d34a5397741ef20db9de8a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51466
I20260709 12:18:32.133922 24472 raft_consensus.cc:2955] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:32.216099 24325 raft_consensus.cc:1275] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:32.218726 24322 raft_consensus.cc:1275] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:32.250391 24393 raft_consensus.cc:1275] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:32.313030 24324 raft_consensus.cc:1275] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:32.329555 25960 consensus_queue.cc:1048] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:32.388325 25970 consensus_queue.cc:1048] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:18:32.425343 25766 consensus_queue.cc:1048] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:18:32.432747 25973 consensus_queue.cc:1048] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:18:32.426321 26000 tablet_replica.cc:333] T 63debf83121c430e9dffcd1c5035cf3a P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:18:32.457677 26000 raft_consensus.cc:2243] T 63debf83121c430e9dffcd1c5035cf3a P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.458882 26000 raft_consensus.cc:2272] T 63debf83121c430e9dffcd1c5035cf3a P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.470053 24208 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7cd3bd910f7f47f9acdd1792db910842 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:32.474818 25976 raft_consensus.cc:1064] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:18:32.526868 24217 catalog_manager.cc:5697] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:32.481684 25976 consensus_queue.cc:237] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:32.622521 26000 ts_tablet_manager.cc:1916] T 63debf83121c430e9dffcd1c5035cf3a P c855242ec9d34a5397741ef20db9de8a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:32.713353 25923 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:32.714195 25923 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:32.786206 25923 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:32.808660 24308 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cd3bd910f7f47f9acdd1792db910842 with delete_type TABLET_DATA_TOMBSTONED (TS c711faa13ead43ebbea0192cb74a4756 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44272
I20260709 12:18:32.769084 24393 consensus_queue.cc:237] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:32.821152 26000 ts_tablet_manager.cc:1929] T 63debf83121c430e9dffcd1c5035cf3a P c855242ec9d34a5397741ef20db9de8a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:32.821854 26000 log.cc:1199] T 63debf83121c430e9dffcd1c5035cf3a P c855242ec9d34a5397741ef20db9de8a: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-1-root/wals/63debf83121c430e9dffcd1c5035cf3a
W20260709 12:18:32.837764 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 78571us
I20260709 12:18:32.842724 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:32.847880 24208 catalog_manager.cc:5028] TS c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): tablet 63debf83121c430e9dffcd1c5035cf3a (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:32.937871 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:18:32.938565 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 83948.8us
I20260709 12:18:32.956096 25116 raft_consensus.cc:1275] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEARNER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:18:32.976248 24289 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:32.997308 24395 raft_consensus.cc:1275] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:18:32.998431 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:33.001024 26019 tablet_replica.cc:333] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:18:33.001066 25975 raft_consensus.cc:2749] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:33.005448 25117 raft_consensus.cc:1275] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:33.007222 24472 raft_consensus.cc:1275] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:18:33.016453 26019 raft_consensus.cc:2243] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:33.017750 25962 consensus_queue.cc:1048] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:33.038795 24466 raft_consensus.cc:1275] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:33.044613 25994 consensus_queue.cc:1048] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:33.045428 26019 raft_consensus.cc:2272] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.053865 25994 consensus_queue.cc:1048] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:33.063205 24466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
mode: GRACEFUL
new_leader_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:42866
I20260709 12:18:33.063974 24466 raft_consensus.cc:606] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Received request to transfer leadership to TS c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:33.064924 25975 consensus_queue.cc:1048] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:33.067879 24395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:18:33.068676 24395 raft_consensus.cc:606] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:33.075438 24325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
mode: GRACEFUL
new_leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
 from {username='slave'} at 127.0.0.1:42226
I20260709 12:18:33.076097 24325 raft_consensus.cc:606] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Received request to transfer leadership to TS d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:33.081944 25966 raft_consensus.cc:993] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a: : Instructing follower 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
I20260709 12:18:33.082517 25966 raft_consensus.cc:1081] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Signalling peer 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
I20260709 12:18:33.087574 25955 consensus_queue.cc:1048] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:33.096814 24396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:18:33.097553 24396 raft_consensus.cc:606] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Received request to transfer leadership to TS c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:33.097586 25969 raft_consensus.cc:993] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3: : Instructing follower c711faa13ead43ebbea0192cb74a4756 to start an election
I20260709 12:18:33.099138 25969 raft_consensus.cc:1081] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Signalling peer c711faa13ead43ebbea0192cb74a4756 to start an election
I20260709 12:18:33.101084 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:18:33.102982 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:33.104111 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:33.112198 26019 ts_tablet_manager.cc:1916] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:33.123015 24472 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:33278
I20260709 12:18:33.115836 25962 raft_consensus.cc:2955] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:33.127972 24325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:44278
I20260709 12:18:33.134927 25972 raft_consensus.cc:993] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a: : Instructing follower c711faa13ead43ebbea0192cb74a4756 to start an election
I20260709 12:18:33.142578 25116 raft_consensus.cc:2955] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:33.149061 24472 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:33.150568 24325 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:33.153400 24325 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:33.152864 24472 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:33.154803 25955 raft_consensus.cc:1081] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Signalling peer c711faa13ead43ebbea0192cb74a4756 to start an election
I20260709 12:18:33.170504 24472 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:33.171814 24317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:44280
I20260709 12:18:33.172767 24317 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:33.173231 24317 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:33.173641 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:33.174270 24320 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:33.176818 24472 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:33.170012 24325 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:33.178438 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:33.185631 25975 raft_consensus.cc:2955] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:33.193902 25117 raft_consensus.cc:2955] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:33.199491 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:33.235404 24325 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:33.240247 24394 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:33.246619 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:33.252910 24395 raft_consensus.cc:3055] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:33.253085 24466 raft_consensus.cc:3055] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:33.252259 24471 raft_consensus.cc:2955] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:33.255796 24466 raft_consensus.cc:740] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:33.272306 24466 consensus_queue.cc:260] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:33.273548 24466 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:33.253397 24395 raft_consensus.cc:740] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:33.285333 24472 raft_consensus.cc:1240] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:33.255525 24320 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
I20260709 12:18:33.297024 24317 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:33.290992 24396 raft_consensus.cc:2955] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:33.313248 24317 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:33.314512 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:33.315176 25116 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:33.319521 24220 catalog_manager.cc:5697] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New cstate: current_term: 1 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:33.326853 24395 consensus_queue.cc:260] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:33.336684 24395 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:33.331482 24217 catalog_manager.cc:5697] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index 2 to 4, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:33.339910 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:33.364480 24440 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:18:33.367254 25969 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:33.367826 25969 raft_consensus.cc:697] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:33.365589 24393 raft_consensus.cc:3055] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:33.371927 24393 raft_consensus.cc:740] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:33.372700 24393 consensus_queue.cc:260] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:33.385299 24466 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:33.385941 25116 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:33.388857 24393 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:33.396077 24291 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:33.397169 25993 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:33.397676 25993 raft_consensus.cc:697] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:33.398619 25993 consensus_queue.cc:237] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:33.410825 24471 raft_consensus.cc:2955] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:33.376222 25969 consensus_queue.cc:237] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:33.422312 24208 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1541b2ab674f43ca8c6b46df9171c32d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:33.444451 25977 raft_consensus.cc:993] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756: : Instructing follower d99d5d772cfe4a96afcab3d3b009a281 to start an election
I20260709 12:18:33.455108 24395 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
I20260709 12:18:33.458503 24394 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:33.461432 25811 raft_consensus.cc:1081] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Signalling peer d99d5d772cfe4a96afcab3d3b009a281 to start an election
I20260709 12:18:33.469031 24289 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:33.521795 24393 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:33.494303 25994 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:18:33.540352 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 168460us
W20260709 12:18:33.332805 25955 consensus_queue.cc:1175] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:18:33.554546 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 137510us
I20260709 12:18:33.544484 25994 raft_consensus.cc:697] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:18:33.643625 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 153111us
W20260709 12:18:33.659267 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.669260 25994 consensus_queue.cc:237] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:33.671456 26019 ts_tablet_manager.cc:1929] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:33.672088 26019 log.cc:1199] T 7cd3bd910f7f47f9acdd1792db910842 P c711faa13ead43ebbea0192cb74a4756: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-0-root/wals/7cd3bd910f7f47f9acdd1792db910842
I20260709 12:18:33.680907 25116 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6"
dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
 from {username='slave'} at 127.0.0.1:35188
I20260709 12:18:33.681926 25116 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:33.682497 25116 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:33.753995 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 54439.3us
I20260709 12:18:33.756903 24210 catalog_manager.cc:5028] TS c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): tablet 7cd3bd910f7f47f9acdd1792db910842 (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:33.756039 25116 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:33.828153 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:33.828924 24317 raft_consensus.cc:3055] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:33.829236 24317 raft_consensus.cc:740] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:33.829972 24317 consensus_queue.cc:260] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:33.830986 24317 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:33.833585 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.848218 25116 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:33.862443 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:33.863109 24398 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:33.875193 24398 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:18:33.884145 24317 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:18:33.886817 24308 tablet_service.cc:1558] Processing DeleteTablet for tablet 1541b2ab674f43ca8c6b46df9171c32d with delete_type TABLET_DATA_TOMBSTONED (TS c711faa13ead43ebbea0192cb74a4756 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44272
I20260709 12:18:33.889598 26019 tablet_replica.cc:333] T 1541b2ab674f43ca8c6b46df9171c32d P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:18:33.890749 26019 raft_consensus.cc:2243] T 1541b2ab674f43ca8c6b46df9171c32d P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:33.891631 26019 raft_consensus.cc:2272] T 1541b2ab674f43ca8c6b46df9171c32d P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.899915 24325 consensus_queue.cc:237] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:33.922072 24392 raft_consensus.cc:1275] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:33.925915 26019 ts_tablet_manager.cc:1916] T 1541b2ab674f43ca8c6b46df9171c32d P c711faa13ead43ebbea0192cb74a4756: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:33.929663 26041 consensus_queue.cc:1048] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:33.931005 25115 raft_consensus.cc:1275] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:33.932767 26041 consensus_queue.cc:1048] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:33.944448 25084 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:33.944733 25116 raft_consensus.cc:1275] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:33.945528 25815 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:33.946014 25815 raft_consensus.cc:697] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:33.946789 26019 ts_tablet_manager.cc:1929] T 1541b2ab674f43ca8c6b46df9171c32d P c711faa13ead43ebbea0192cb74a4756: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:33.947492 26019 log.cc:1199] T 1541b2ab674f43ca8c6b46df9171c32d P c711faa13ead43ebbea0192cb74a4756: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-0-root/wals/1541b2ab674f43ca8c6b46df9171c32d
I20260709 12:18:33.946888 25815 consensus_queue.cc:237] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:33.955942 25994 consensus_queue.cc:1048] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:18:33.968391 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 43550.9us
I20260709 12:18:33.970571 24392 raft_consensus.cc:1275] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:33.972623 26045 consensus_queue.cc:1048] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:33.984676 24217 catalog_manager.cc:5697] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 2 to 3, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 3 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:33.994143 24466 raft_consensus.cc:1275] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:34.003139 25994 consensus_queue.cc:1048] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:34.015081 24210 catalog_manager.cc:5028] TS c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): tablet 1541b2ab674f43ca8c6b46df9171c32d (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:34.024863 26041 raft_consensus.cc:2955] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:34.046270 24325 raft_consensus.cc:1275] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:34.052803 26027 consensus_queue.cc:1048] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:34.058568 24472 raft_consensus.cc:2955] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:34.065586 24219 catalog_manager.cc:5697] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 2 to 3, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 3 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:34.072934 24219 catalog_manager.cc:5697] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 2 to 3, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 3 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:34.092916 25117 raft_consensus.cc:2955] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:34.166939 24219 catalog_manager.cc:5697] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 3 to 4, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 4 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:34.172377 24220 catalog_manager.cc:5697] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index 4 to 5, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New cstate: current_term: 2 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:34.233590 24210 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 27d97e40dd274a2ea3734c2982741e3c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:35.173875 26041 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:35.174743 26041 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:35.185873 26041 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:35.366024 26041 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:35.366864 26041 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:35.526315 26041 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:35.619769 26041 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:35.620755 26041 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:35.623781 26041 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:35.664860 26041 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:35.665666 26041 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:35.668313 26041 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:35.701406 26041 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:35.702270 26041 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:35.704741 26041 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:35.911651 26062 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:35.912592 26060 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:35.912418 26062 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:35.914094 26060 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:35.916267 26062 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:35.916339 26060 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:35.918648 26064 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:35.918984 26060 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:35.919237 26064 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:35.919847 26060 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:35.921568 26064 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:35.921859 26061 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:35.922152 26064 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:35.922675 26064 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:35.923688 26065 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:35.925168 26065 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:35.926086 26063 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:35.927580 26063 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:35.928121 26065 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:35.925168 26064 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:35.926694 26062 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:35.929199 26064 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:35.929358 26062 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:35.922709 26059 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:35.931272 26059 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:35.922345 26060 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:35.923005 26061 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:35.934388 26059 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:35.930070 26064 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:35.935443 26062 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:35.934556 26061 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:35.937453 26064 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:35.937532 26063 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:35.939646 26062 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:35.939810 26064 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:35.940284 26062 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:35.940474 26064 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:35.942587 26062 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:35.942691 26064 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:35.943207 26062 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:35.943912 26062 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:35.943889 26065 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:35.943284 26064 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.945171 26065 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:35.945408 26064 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:35.946363 26062 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:35.947237 26065 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:35.948348 26064 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:35.963464 26059 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:35.964879 26059 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:35.967833 26059 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:35.969761 26068 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:35.970328 26068 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:35.972591 26068 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:35.972785 26059 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:35.973356 26059 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:35.974555 26069 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:35.975159 26069 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:35.976490 24323 raft_consensus.cc:1275] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:18:35.977205 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:35.977843 24318 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:35.977716 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:35.978132 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:35.978582 24324 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:35.978456 26065 consensus_queue.cc:1048] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:35.975539 26059 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:35.979646 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:35.980304 25084 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:35.980332 24323 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 1.
I20260709 12:18:35.981781 26059 raft_consensus.cc:2804] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:35.982286 26059 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:35.982321 26069 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:35.984081 25084 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:35.982846 26059 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:35.985817 25084 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:35.987435 26066 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:35.987919 26066 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:35.988281 26066 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:35.994508 26061 raft_consensus.cc:2804] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:36.001434 26061 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:36.001976 26061 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:36.022893 26072 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:36.023648 26072 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.026568 26072 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:36.019340 26066 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.034729 26078 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:36.035372 26078 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.037761 26078 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:36.038306 26078 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:36.038754 26078 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:36.026108 26059 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.039786 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:36.040602 24323 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:36.041723 26078 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:36.045328 26066 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:36.046317 26071 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:36.047312 26071 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:18:36.049587 26071 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:18:36.050125 26071 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:36.052157 26071 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.053488 26069 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:36.054767 26069 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.056190 26071 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:36.052205 26070 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:36.053136 26073 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:36.058358 26074 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:36.058259 26073 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:36.059114 26074 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:36.066242 26069 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:36.076035 26074 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:36.057758 26070 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:36.078550 24323 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:18:36.080668 25084 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:36.082877 26068 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:36.083657 26068 raft_consensus.cc:697] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 3 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:36.098662 26074 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.099449 26074 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:36.102387 26074 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:36.084889 26078 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:36.104383 26074 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:36.116514 26079 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:36.117161 26079 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:36.119608 26079 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:36.094542 26072 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:36.087627 26069 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:36.087909 26071 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:36.121800 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:36.124955 24317 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:36.123061 26072 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.121088 26074 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.087769 26075 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:36.086313 26077 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:36.127140 26069 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.128060 26080 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:36.114445 26078 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.123948 26059 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:36.139070 26081 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:36.132552 26073 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:36.133080 26068 consensus_queue.cc:237] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.134024 26071 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.126792 26079 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:18:36.142951 24393 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.029s	user 0.021s	sys 0.021s
I20260709 12:18:36.136193 26061 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.114135 26070 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:36.143375 26078 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:36.136991 26075 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.138459 26077 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:36.146379 24393 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.032s	user 0.022s	sys 0.021s
I20260709 12:18:36.147449 24317 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:18:36.150363 26069 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:36.150942 26072 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:36.148475 26079 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.151507 26075 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:36.157240 25084 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:36.139698 26081 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.160730 26061 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:36.163043 26071 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:36.169085 26059 raft_consensus.cc:2804] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:36.166107 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:36.148723 26076 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:36.169653 26059 raft_consensus.cc:697] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 3 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:36.164234 26077 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:36.161180 26074 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:36.170699 26059 consensus_queue.cc:237] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.171098 24317 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:36.170248 26076 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.183394 26081 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:36.183558 24317 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:36.187069 25084 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:36.189635 26083 raft_consensus.cc:2804] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:36.188620 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:36.193395 26083 raft_consensus.cc:697] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:36.193514 24317 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 1.
I20260709 12:18:36.195312 25084 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:36.141314 26080 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:36.197641 26061 raft_consensus.cc:2804] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:36.198175 26061 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:36.200016 26061 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:36.205525 26076 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:36.206286 26080 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:36.220383 26074 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:36.217372 26076 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:36.225760 26073 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:36.227385 26082 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:36.225039 26074 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.228539 26071 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:36.229030 26075 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:36.218567 26079 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:36.194446 26083 consensus_queue.cc:237] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.226428 26080 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:36.233736 26072 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:36.251880 26072 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:36.237771 26076 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:36.243486 26071 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.254397 26072 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:36.233989 26069 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:36.255038 26076 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:36.255172 26069 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.251960 26080 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.236090 26073 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:36.235369 26082 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:36.256026 26071 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:36.241698 26075 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.263155 26077 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:18:36.315023 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 101162us
I20260709 12:18:36.577919 26085 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:36.625216 26067 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:36.633033 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:36.585382 26066 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:36.636967 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:36.646206 26066 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.648072 26073 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:36.649170 26080 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:36.650141 26062 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:36.580101 26077 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.578827 26085 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.676856 26089 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:36.681885 26089 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.682237 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:36.654906 26059 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:36.654731 26067 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:36.687444 26095 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:36.688118 26069 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:36.666164 26061 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.691890 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:36.692607 25117 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:18:36.693197 26077 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:36.682673 26066 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:36.674723 26062 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:36.704054 26075 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:36.701809 26063 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:36.709568 26082 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:36.712857 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:36.715438 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:36.716303 25115 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:18:36.716910 26067 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:36.717727 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:36.717859 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:36.718372 25115 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:36.718611 26062 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:36.719745 26094 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:36.719847 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:36.721344 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:36.715663 26085 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:36.722306 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:36.695786 26065 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:36.702091 26066 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:36.694913 26059 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.720414 26094 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:36.725970 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:36.726646 25116 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:18:36.723778 24220 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54244 (request call id 268) took 2552 ms. Trace:
I20260709 12:18:36.729519 25115 raft_consensus.cc:1240] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 3 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:36.727543 26090 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:36.705176 26063 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:36.731403 25117 raft_consensus.cc:2468] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:18:36.731485 26068 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:36.726266 26065 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.738920 25115 raft_consensus.cc:1240] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 3 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:36.733685 26062 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:36.730440 26066 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.742256 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:36.705505 26095 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.748036 25116 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:18:36.739198 26067 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:36.757711 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:36.758517 24325 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:18:36.760124 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:36.760426 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:36.760828 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:36.761278 24472 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:18:36.764354 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:36.764494 26063 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:36.765144 24468 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:36.765803 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:36.766700 24470 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:36.746675 26062 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:36.728154 24220 rpcz_store.cc:276] 0709 12:18:34.169125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.169281 (+   156us) service_pool.cc:224] Handling call
0709 12:18:36.721089 (+2551808us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:34.179418 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:34.179990 (+   572us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:34.180032 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:18:34.180053 (+    21us) tablet.cc:662] Decoding operations
0709 12:18:34.180410 (+   357us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:34.180462 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:34.180492 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:18:34.180739 (+   247us) tablet.cc:701] Row locks acquired
0709 12:18:34.180758 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:18:34.180898 (+   140us) write_op.cc:270] Start()
0709 12:18:34.181029 (+   131us) write_op.cc:276] Timestamp: P: 1783599514180849 usec, L: 0
0709 12:18:34.181067 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:18:34.181750 (+   683us) log.cc:844] Serialized 539 byte log entry
0709 12:18:34.197078 (+ 15328us) op_driver.cc:464] REPLICATION: finished
0709 12:18:34.199576 (+  2498us) write_op.cc:301] APPLY: starting
0709 12:18:34.199684 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:34.199875 (+   191us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:34.200027 (+   152us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:34.200349 (+   322us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:34.200524 (+   175us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:18:34.200619 (+    95us) write_op.cc:312] APPLY: finished
0709 12:18:34.201194 (+   575us) log.cc:844] Serialized 23 byte log entry
0709 12:18:34.201412 (+   218us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:34.201513 (+   101us) write_op.cc:454] Released schema lock
0709 12:18:34.201559 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:34.201911 (+   352us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:34.201942 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":2191,"apply.run_cpu_time_us":2061,"apply.run_wall_time_us":2324,"num_ops":1,"prepare.queue_time_us":135,"prepare.run_cpu_time_us":2614,"prepare.run_wall_time_us":2614,"replication_time_us":15826}]]}
I20260709 12:18:36.772953 26066 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:36.752097 26064 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:36.795693 24469 raft_consensus.cc:1275] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:36.796973 25970 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:36.741494 26068 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.808952 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:36.802748 26067 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:36.809825 24470 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:18:36.736696 26090 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:36.806900 26064 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:36.877152 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:36.917855 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:36.811064 25973 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.921094 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:36.807374 25970 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:36.813138 26093 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:36.927182 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:36.909236 26061 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:36.905603 26097 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:36.935077 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:36.930673 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:36.936942 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:36.937203 24317 raft_consensus.cc:1240] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:36.941355 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:36.935889 24396 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:36.907780 25955 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:36.906561 26096 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:36.942340 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:36.939553 24471 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 1.
I20260709 12:18:37.081414 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:36.943205 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:37.084391 24318 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:37.004307 26090 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.085632 25083 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:37.010754 26097 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:37.086644 26081 raft_consensus.cc:2804] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:37.087055 26081 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:36.829337 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:37.087448 26081 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:37.088323 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.089699 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:37.090356 24471 raft_consensus.cc:2468] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 1.
I20260709 12:18:37.090512 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.091514 25083 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:37.092480 26066 raft_consensus.cc:2804] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:37.093044 26066 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:37.093567 26066 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:37.094285 26097 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.096009 26067 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:36.935735 26098 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:37.011641 26059 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.003728 26101 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:37.036743 26065 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.011567 24219 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35986 (request call id 179) took 2848 ms. Trace:
I20260709 12:18:36.935684 26094 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:36.924315 26074 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:36.939356 25963 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:36.985154 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.082204 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.101606 25963 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:37.102860 24319 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:18:37.099558 24219 rpcz_store.cc:276] 0709 12:18:34.163558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.163723 (+   165us) service_pool.cc:224] Handling call
0709 12:18:37.011507 (+2847784us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:34.182240 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:34.182796 (+   556us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:34.182827 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:18:34.182845 (+    18us) tablet.cc:662] Decoding operations
0709 12:18:34.183181 (+   336us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:34.183230 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:34.183255 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:18:34.183460 (+   205us) tablet.cc:701] Row locks acquired
0709 12:18:34.183479 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:18:34.183630 (+   151us) write_op.cc:270] Start()
0709 12:18:34.183726 (+    96us) write_op.cc:276] Timestamp: P: 1783599514183566 usec, L: 0
0709 12:18:34.183749 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:18:34.195272 (+ 11523us) log.cc:844] Serialized 539 byte log entry
0709 12:18:35.109688 (+914416us) op_driver.cc:464] REPLICATION: finished
0709 12:18:35.116326 (+  6638us) write_op.cc:301] APPLY: starting
0709 12:18:35.116432 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:35.116545 (+   113us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:35.116738 (+   193us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:35.117044 (+   306us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:35.117236 (+   192us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:18:35.117284 (+    48us) write_op.cc:312] APPLY: finished
0709 12:18:35.117523 (+   239us) log.cc:844] Serialized 23 byte log entry
0709 12:18:35.118286 (+   763us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:35.118380 (+    94us) write_op.cc:454] Released schema lock
0709 12:18:35.118615 (+   235us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:35.118976 (+   361us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:35.118992 (+    16us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":481336,"reported_tablets":1,"spinlock_wait_cycles":3456,"child_traces":[["op",{"apply.queue_time_us":6265,"apply.run_cpu_time_us":1956,"apply.run_wall_time_us":2689,"num_ops":1,"prepare.queue_time_us":1644,"prepare.run_cpu_time_us":2509,"prepare.run_wall_time_us":21829,"replication_time_us":925759,"thread_start_us":5805,"threads_started":1}]]}
I20260709 12:18:36.985325 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.009704 26089 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:36.924314 25973 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:37.105736 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:37.107015 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:37.107263 25973 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:36.937500 24473 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 1.
I20260709 12:18:37.108112 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:37.098256 24318 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:36.942377 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:37.116197 25115 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:37.109609 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.080073 26095 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.005951 26062 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.111327 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:37.005160 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.108949 25083 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:37.097164 25955 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:36.942423 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.121189 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:18:36.985090 25140 debug-util.cc:398] Leaking SignalData structure 0x7b0800271300 after lost signal to thread 23154
I20260709 12:18:37.008854 26064 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.122720 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 1955) took 3006 ms. Trace:
I20260709 12:18:36.966547 26091 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:36.985397 26032 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:37.120159 26095 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:37.036032 25970 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.128566 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:36.966060 26093 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:37.129040 24393 rpcz_store.cc:276] 0709 12:18:34.113127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.113262 (+   135us) service_pool.cc:224] Handling call
0709 12:18:34.113550 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:34.113749 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:18:36.152334 (+2038585us) log.cc:844] Serialized 14 byte log entry
0709 12:18:37.119334 (+967000us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:37.119409 (+    75us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:37.119490 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.119646 (+   156us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:37.119803 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":629681,"prepare.queue_time_us":60285,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":728288,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"thread_start_us":2374956,"threads_started":3,"wal-append.queue_time_us":36179}
I20260709 12:18:37.116515 25963 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:37.143859 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.149595 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.150483 24393 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:37.138266 26095 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:37.120177 26096 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:37.199918 26096 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.173915 26102 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:37.096690 26098 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:37.192037 25886 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:37.191774 26032 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:37.249485 25886 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:37.191883 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.252279 26093 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.194170 25955 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:37.173082 26095 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:37.099213 26101 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:37.206223 26102 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:37.252787 24397 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:18:37.283776 25985 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:37.292963 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.294441 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.298925 25970 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:37.280361 26106 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.310477 24319 raft_consensus.cc:1240] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:37.252364 25886 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.137085 26091 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:18:37.315481 25955 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:37.323585 24394 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 1.
I20260709 12:18:37.322430 25985 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:37.435359 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.386782 24320 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:37.437460 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.440613 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.444878 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:37.445694 24471 raft_consensus.cc:3055] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:37.446947 24471 raft_consensus.cc:740] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:37.447888 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.449383 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.325549 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.450539 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.451375 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.451704 25985 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:37.452167 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.453521 24321 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:18:37.458961 24468 raft_consensus.cc:3055] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:37.384974 25963 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:37.376362 26104 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:37.366282 26102 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:37.458240 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:37.462780 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:18:37.452175 26087 log.cc:927] Time spent T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.886s	user 0.004s	sys 0.000s
I20260709 12:18:37.461982 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.323551 26081 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:37.459424 24468 raft_consensus.cc:740] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:37.459781 24471 consensus_queue.cc:260] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:37.465571 25886 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:37.478624 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:37.466988 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.480155 24471 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:37.459365 26032 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:37.447599 25970 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:37.468262 25985 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:37.466161 24398 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:37.468797 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.469453 26101 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.469933 26112 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:37.471378 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:37.489467 26112 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:37.380653 26066 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:37.491547 24471 raft_consensus.cc:1275] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:37.473119 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:37.474150 26102 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:37.474260 26108 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:37.474781 25973 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:37.376150 26095 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:37.475601 25956 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:37.457392 26098 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.498093 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.465350 26110 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:18:37.462759 24289 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.512s (SENT) [suppressed 7 similar messages]
I20260709 12:18:37.443480 25955 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:37.478591 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.443732 26106 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:37.486086 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.486855 25985 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:37.487345 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.510424 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.481618 25886 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:37.491760 26112 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:18:37.461362 25140 debug-util.cc:398] Leaking SignalData structure 0x7b0800270da0 after lost signal to thread 24257
I20260709 12:18:37.477151 26091 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:37.483896 24468 consensus_queue.cc:260] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:37.479190 26104 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:37.494310 26102 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:37.464911 25963 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:37.498783 24323 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:18:37.526116 24291 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:37.507721 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:37.527158 25116 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:37.510715 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.528158 24322 raft_consensus.cc:2468] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:37.527459 24468 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:37.516126 24325 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:37.529568 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.530606 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.531571 24325 raft_consensus.cc:1240] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:37.506596 25084 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:18:37.532861 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 70146.7us
I20260709 12:18:37.534668 26100 raft_consensus.cc:2804] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:37.535185 26100 raft_consensus.cc:697] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:37.536829 26114 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:37.537772 26114 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:37.539646 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.540753 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.544423 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.545333 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.545547 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:37.546576 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.547261 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:37.553640 26066 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.554030 25985 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.555650 26095 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.542498 26110 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:37.516337 26101 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:37.500864 25973 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:37.504591 25956 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:37.505398 26108 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:37.552484 24399 raft_consensus.cc:1275] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:18:37.560760 25886 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.522503 26112 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:37.564093 24322 raft_consensus.cc:1240] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:37.568934 24321 raft_consensus.cc:1275] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:37.546083 26091 raft_consensus.cc:2804] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:18:37.565418 25140 debug-util.cc:398] Leaking SignalData structure 0x7b080037dd80 after lost signal to thread 24349
I20260709 12:18:37.578224 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.584080 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.585019 26068 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.585189 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.576933 25963 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.570174 26110 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:37.586282 25956 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.586676 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.587826 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.588619 25973 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:37.536048 26100 consensus_queue.cc:237] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:37.591758 25119 raft_consensus.cc:1240] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:37.594036 25117 raft_consensus.cc:1240] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:37.578526 26101 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:37.595162 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:37.577598 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:37.598860 25116 raft_consensus.cc:2393] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 2: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:18:37.580776 25970 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:37.583024 26112 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:37.582305 26108 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.623747 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.623351 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:37.626164 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:37.627135 25113 raft_consensus.cc:1240] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:37.628182 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:37.626384 24383 tablet_service.cc:1558] Processing DeleteTablet for tablet 27d97e40dd274a2ea3734c2982741e3c with delete_type TABLET_DATA_TOMBSTONED (TS c855242ec9d34a5397741ef20db9de8a not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:51466
I20260709 12:18:37.627007 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:37.629422 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.630620 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:37.631124 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.631438 24474 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:37.631991 24397 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:37.634397 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:37.635331 24467 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:37.637930 26101 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.597676 26095 consensus_queue.cc:1048] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:18:37.643246 26081 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.644145 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.645954 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.647089 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.647270 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.649469 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:37.584533 26104 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.579815 26091 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:37.685774 24468 raft_consensus.cc:1275] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:37.679436 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:37.705731 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.637966 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:37.707675 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.708454 24399 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:18:37.688975 26091 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:37.714663 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.715837 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.716862 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.718634 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:37.720227 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:37.721014 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:37.721686 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:37.722054 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.722756 25118 raft_consensus.cc:2393] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 2: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:18:37.720314 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:37.724666 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.725500 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.727622 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.728225 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.729238 24321 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
I20260709 12:18:37.728456 24399 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:18:37.730345 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:37.726481 24397 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
I20260709 12:18:37.732766 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.734238 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.742264 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.745122 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.746220 24399 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:37.747565 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.748535 24397 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:18:37.753219 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.753444 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.718616 26102 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.756026 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.756449 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.756771 24399 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:37.757244 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.757356 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.757579 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.758104 24397 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:18:37.759047 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.713322 24467 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:37.760317 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.761617 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.764861 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:37.767493 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.768031 24323 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:37.769586 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.771418 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.777488 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:37.760252 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:37.760407 25955 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.779986 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.780956 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.781095 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:18:37.781932 25140 debug-util.cc:398] Leaking SignalData structure 0x7b080031a8e0 after lost signal to thread 24424
I20260709 12:18:37.782191 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.782554 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:18:37.783430 25140 debug-util.cc:398] Leaking SignalData structure 0x7b08002c3d20 after lost signal to thread 24498
W20260709 12:18:37.783812 25140 debug-util.cc:398] Leaking SignalData structure 0x7b0800323900 after lost signal to thread 24499
W20260709 12:18:37.784667 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.784749 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.786055 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.786161 24438 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:37.788745 26079 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:37.789163 26079 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:37.789574 26079 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:37.783309 24467 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:37.789933 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:37.790136 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:37.783445 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.790737 24322 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
I20260709 12:18:37.791033 24391 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:37.791936 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.793040 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:37.793751 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.794384 24391 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:18:37.795248 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.795799 24391 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:37.796660 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.797190 24391 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:18:37.797978 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.798499 24391 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:18:37.799176 26119 tablet_replica.cc:333] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:18:37.799345 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.800485 26119 raft_consensus.cc:2243] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:37.801367 26119 raft_consensus.cc:2272] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:37.802439 26115 log.cc:927] Time spent T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:18:37.802847 24398 raft_consensus.cc:1275] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:37.805069 24290 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:18:37.806277 24290 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:18:37.807396 24290 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
W20260709 12:18:37.808192 24440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.792294 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:37.758875 26101 consensus_queue.cc:1059] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:18:37.816476 26107 consensus_queue.cc:1048] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:37.817515 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:37.818042 26101 raft_consensus.cc:3055] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:37.818466 26101 raft_consensus.cc:740] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:37.818686 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.819080 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:18:37.820082 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.820436 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:37.819579 26101 consensus_queue.cc:260] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:37.821776 26101 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:37.821847 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:37.810380 24440 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:18:37.821628 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 697735us
I20260709 12:18:37.824370 24440 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:37.809237 24290 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:18:37.816007 26098 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:37.816466 26112 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.816533 26064 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:37.831772 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:37.832175 26064 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:18:37.832440 26120 log.cc:927] Time spent T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:18:37.832669 26064 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:37.816370 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:37.834110 26082 raft_consensus.cc:2804] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:37.834321 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:37.834597 26082 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:37.835067 26082 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:37.808830 26041 raft_consensus.cc:2804] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:37.840852 26041 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:37.841372 26041 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:37.842049 26064 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:37.843798 26064 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:37.837131 25083 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:37.844846 26095 raft_consensus.cc:2749] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:37.830646 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:37.830735 24440 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:37.759660 25970 consensus_queue.cc:1059] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:18:37.777359 26106 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:37.831573 26111 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:37.836251 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.837376 24290 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:18:37.846576 26074 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:37.836615 26098 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:18:37.892261 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 45352.4us
I20260709 12:18:37.854174 24290 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:18:37.907049 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 76390.7us
W20260709 12:18:37.907090 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 52991.5us
I20260709 12:18:37.908887 26123 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:37.909997 24217 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54254 (request call id 261) took 1860 ms. Trace:
I20260709 12:18:37.915107 26091 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:37.854921 25970 raft_consensus.cc:3055] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:37.956357 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.934895 24217 rpcz_store.cc:276] 0709 12:18:36.049305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.050135 (+   830us) service_pool.cc:224] Handling call
0709 12:18:37.909845 (+1859710us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90440,"reported_tablets":1}
W20260709 12:18:37.916980 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 103688us
I20260709 12:18:37.920133 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:37.853061 26074 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:37.963618 25116 raft_consensus.cc:1240] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:37.924265 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:37.924604 25082 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:37.925561 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.966773 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:37.926685 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.927371 26082 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:37.855433 25140 debug-util.cc:398] Leaking SignalData structure 0x7b080036e060 after lost signal to thread 25143
I20260709 12:18:37.970309 24366 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:37.933117 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:37.852352 26111 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:37.930442 24438 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:37.853644 26098 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:37.848403 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:37.959198 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:37.979673 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:37.962843 26122 raft_consensus.cc:2749] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:37.923383 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.906770 26064 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:18:37.969460 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 210804us
I20260709 12:18:37.987641 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:18:37.988696 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 59745us
I20260709 12:18:37.856873 24324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44278 (request call id 1925) took 1085 ms. Trace:
I20260709 12:18:37.916268 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:37.974835 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:37.973752 24366 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:37.971350 24473 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:37.924187 26079 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:37.954794 26123 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:37.995563 26123 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:37.971953 25140 debug-util.cc:398] Leaking SignalData structure 0x7b0800317760 after lost signal to thread 25144
I20260709 12:18:37.964489 25970 raft_consensus.cc:740] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:37.927958 26114 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:37.954810 26068 consensus_queue.cc:1048] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:18:37.954813 26031 consensus_queue.cc:1059] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:18:37.986546 26064 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:37.989840 24440 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:37.969978 26074 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:37.977710 26093 raft_consensus.cc:2804] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:37.989332 24324 rpcz_store.cc:276] 0709 12:18:36.819157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.819718 (+   561us) service_pool.cc:224] Handling call
0709 12:18:36.844733 (+ 25015us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:36.913116 (+ 68383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:36.913147 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:36.913186 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:36.913218 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.856519 (+943301us) spinlock_profiling.cc:243] Waited 48.5 ms on lock 0x7b54000a8554. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:37.856581 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:37.856792 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111460096}
I20260709 12:18:37.977269 26111 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:38.037685 24319 raft_consensus.cc:1240] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:38.007445 26032 raft_consensus.cc:2749] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:37.971590 26106 consensus_queue.cc:1059] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
W20260709 12:18:38.009406 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 79072.4us
I20260709 12:18:38.020907 24466 raft_consensus.cc:1240] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 2. Current term is 3. Ops: []
W20260709 12:18:38.039868 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 106065us
I20260709 12:18:38.042527 24322 raft_consensus.cc:1240] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 1. Current term is 2. Ops: []
W20260709 12:18:38.042737 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 55319.6us
I20260709 12:18:38.036768 24366 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:38.010599 26091 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:18:38.024264 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 63624.6us
I20260709 12:18:38.037302 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:37.976766 25973 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:38.041738 24290 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:38.053998 24438 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:38.054885 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:37.981724 25955 consensus_queue.cc:1059] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:18:38.055912 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:38.026322 26064 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:38.055192 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:18:38.065238 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 75477.8us
I20260709 12:18:38.065111 25082 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:38.035516 26093 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:38.068787 24440 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:38.050806 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:38.072686 24366 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:38.051126 26130 raft_consensus.cc:2804] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:38.083480 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:38.066543 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:38.086903 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:38.070770 26093 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:38.083855 24366 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:38.151784 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 86751us
W20260709 12:18:38.152073 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 68298us
W20260709 12:18:38.148367 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 81964.1us
I20260709 12:18:38.152788 25082 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:38.153005 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:38.088150 26068 consensus_queue.cc:1048] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:18:38.074988 25985 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:38.124785 26132 raft_consensus.cc:2804] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:38.126824 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:38.078903 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:38.080547 26032 raft_consensus.cc:2804] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:18:38.143976 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 90036.7us
I20260709 12:18:38.085428 26130 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:38.077003 26106 consensus_queue.cc:1243] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer d99d5d772cfe4a96afcab3d3b009a281 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:18:38.158254 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:38.158439 25082 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:38.067233 26129 raft_consensus.cc:2764] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:18:38.153228 26082 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:38.155738 25973 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:38.162715 24366 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:38.161630 26126 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:38.167708 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 257) took 1325 ms. Trace:
I20260709 12:18:38.167236 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:38.171597 26122 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.177536 24438 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:38.178570 24316 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
mode: GRACEFUL
new_leader_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:42226
I20260709 12:18:38.162972 26095 raft_consensus.cc:2749] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:38.180676 26032 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:38.181348 26130 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:38.150547 26081 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:38.188699 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:38.186168 24466 rpcz_store.cc:276] 0709 12:18:36.839844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.840049 (+   205us) service_pool.cc:224] Handling call
0709 12:18:37.822096 (+982047us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b58001c3e98. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c325fc0 00007f4a9c310929 00007f4a9c3103d2 00007f4a95887bd4
0709 12:18:37.822267 (+   171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:38.038934 (+216667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.164801 (+125867us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b5400033ed4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:38.164973 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":464849920}
I20260709 12:18:38.179838 26074 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:38.190176 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:18:38.194396 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 125709us
I20260709 12:18:38.196233 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:38.169236 26132 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:38.190990 26068 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:38.194828 26106 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:38.186396 26126 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:38.189661 26135 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:38.195590 26122 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:38.200976 24393 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:38.211587 24289 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:38.240576 26122 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:38.241650 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:38.242302 25116 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:38.236943 26126 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:38.237816 24366 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:38.211156 26119 ts_tablet_manager.cc:1916] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:38.220961 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:38.222664 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:38.228566 26136 consensus_queue.cc:1048] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:38.198189 26079 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:18:38.224618 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.225952 24365 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:38.226236 26041 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:38.231316 26132 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:38.187736 25973 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:38.199841 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:38.268467 24319 raft_consensus.cc:1240] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:38.268304 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:38.199735 24316 raft_consensus.cc:606] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Received request to transfer leadership to TS c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:38.230074 26101 consensus_queue.cc:1059] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:18:38.231678 26106 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:38.253582 24392 raft_consensus.cc:1275] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:38.275914 25985 raft_consensus.cc:3055] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:38.276109 26106 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:38.276381 25985 raft_consensus.cc:740] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:38.235085 26131 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:38.246722 24474 raft_consensus.cc:1240] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:38.243782 25970 consensus_queue.cc:260] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:38.250511 24289 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:38.219515 24440 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:38.249697 25956 raft_consensus.cc:3055] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:38.223462 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:38.212486 26081 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:18:38.255030 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 65005.1us
W20260709 12:18:38.250788 24366 raft_consensus.cc:2686] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:18:38.258605 26134 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:38.259519 25112 raft_consensus.cc:1240] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:38.228554 26111 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:38.199404 26138 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:38.207931 26064 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:38.262077 24365 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:38.295753 26108 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:38.295856 24365 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:38.296192 26108 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:38.264613 26041 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:38.296581 26108 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:38.297694 26101 raft_consensus.cc:2749] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:38.265146 26031 raft_consensus.cc:3055] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:38.298758 26031 raft_consensus.cc:740] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:38.299677 26031 consensus_queue.cc:260] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:38.301087 26031 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:38.265753 26104 raft_consensus.cc:2749] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:38.202776 26032 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:38.305178 26108 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:38.270943 25973 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:38.309345 26108 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:38.244154 26135 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:38.280696 24289 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:38.313025 26135 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:38.314023 24289 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:38.315639 26107 raft_consensus.cc:2804] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:38.315737 24289 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:38.316236 26107 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
W20260709 12:18:38.281244 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 61855.3us
I20260709 12:18:38.316723 26141 raft_consensus.cc:2804] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:38.253732 26089 consensus_queue.cc:1059] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:18:38.317405 26141 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:38.283422 25970 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:38.284066 26082 raft_consensus.cc:2804] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:38.316928 26041 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:38.318079 24440 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:38.318900 26041 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:38.319361 26041 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:38.318004 26141 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:38.318006 26089 raft_consensus.cc:3055] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:38.321801 26089 raft_consensus.cc:740] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:38.322932 26089 consensus_queue.cc:260] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:38.329865 24365 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:38.331166 24289 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:38.332192 26104 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:38.332597 26104 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:38.332978 26104 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:38.333117 26091 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:38.288009 25116 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:38.288587 26129 raft_consensus.cc:2749] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:38.280478 26098 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:38.280133 26131 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:38.250471 26093 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:38.290764 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 53049.3us
I20260709 12:18:38.316720 26107 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:38.283605 25985 consensus_queue.cc:260] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:38.318583 26082 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:38.282150 25956 raft_consensus.cc:740] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:38.333129 24289 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:38.336055 24291 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:38.343175 24366 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:38.351867 26093 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:38.291441 26081 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:38.354642 24289 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:38.360162 24321 raft_consensus.cc:1240] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:38.355897 25118 raft_consensus.cc:1240] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:38.360678 24289 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:38.357587 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:38.363867 24289 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:38.327551 26041 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:38.366837 24289 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:38.367659 24289 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:38.346168 26082 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:38.373064 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 81136.8us
I20260709 12:18:38.374848 24289 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:38.359161 26129 raft_consensus.cc:2804] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:38.379024 24473 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
mode: GRACEFUL
new_leader_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:42866
I20260709 12:18:38.379947 24473 raft_consensus.cc:606] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Received request to transfer leadership to TS c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:38.380544 26141 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:38.383984 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.384589 24322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ae0187acc6343ef874010bc79580048"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:42226
I20260709 12:18:38.385228 24322 raft_consensus.cc:606] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:38.386751 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:38.341298 26138 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:38.393265 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:38.394929 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:38.397500 25083 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:38.399225 26068 raft_consensus.cc:2749] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:38.402560 25083 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:38.405124 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:38.407334 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:38.369349 26134 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:38.363317 26091 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:38.392356 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:38.391378 26127 raft_consensus.cc:2804] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:38.404326 26068 raft_consensus.cc:2749] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:18:38.419512 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 101516us
I20260709 12:18:38.417122 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
W20260709 12:18:38.423149 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 48950.3us
I20260709 12:18:38.410751 25083 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:38.411136 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 60907.7us
I20260709 12:18:38.373364 25985 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:38.426788 24440 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:38.429520 24440 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:38.375579 26122 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:38.433194 25083 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:38.433779 24440 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:38.434659 24365 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:38.430682 26150 raft_consensus.cc:2804] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:38.377908 26079 raft_consensus.cc:2749] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:38.435395 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:38.438942 24365 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:38.442199 26150 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:38.410606 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:38.409619 26138 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:38.421775 26134 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:38.422706 26091 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
W20260709 12:18:38.463518 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 78145.6us
I20260709 12:18:38.436695 26095 raft_consensus.cc:2749] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:38.465723 24440 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:38.467305 24365 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:38.436345 26122 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:38.391414 26130 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:38.446872 26100 raft_consensus.cc:2749] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:38.445792 26074 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:38.444876 26127 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:38.466454 26134 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:38.475747 26155 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:38.477159 26101 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:38.494253 26127 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:38.483189 26122 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:38.481016 25083 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:38.447975 26112 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:38.459525 26079 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:38.452445 26150 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:38.482319 25955 raft_consensus.cc:2749] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:38.478142 26091 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:38.465996 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:38.480392 24365 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:38.493424 26148 consensus_queue.cc:1059] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:18:38.498536 26098 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:38.513794 24365 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:38.500769 26112 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:38.516700 25083 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:38.518819 26147 raft_consensus.cc:2804] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:18:38.521962 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 46300.6us
I20260709 12:18:38.514189 26066 raft_consensus.cc:2749] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:38.530289 24365 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:38.513005 26114 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:38.514539 26108 raft_consensus.cc:2749] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:38.544272 24365 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:38.570159 24365 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:38.520321 26112 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:38.571887 24365 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:38.515893 26124 raft_consensus.cc:2749] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:38.531503 26111 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:38.519254 26147 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:38.515789 26149 raft_consensus.cc:2749] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:38.530575 26136 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:38.575083 24365 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:38.582542 25083 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:38.543507 26064 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:38.543170 26101 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:38.610212 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 250569us
I20260709 12:18:38.530762 26139 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:38.573304 25985 raft_consensus.cc:2749] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:38.530879 25955 raft_consensus.cc:2749] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:18:38.632828 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 167188us
I20260709 12:18:38.610451 26131 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:38.641526 24440 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:38.628779 26108 raft_consensus.cc:2749] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:38.645668 24440 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:38.609402 26147 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:38.635676 26093 raft_consensus.cc:2749] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:38.654377 26164 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:38.629822 26159 raft_consensus.cc:2749] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:38.644284 26139 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:38.651926 26111 raft_consensus.cc:3055] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:38.670320 26157 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:38.656973 26074 raft_consensus.cc:2749] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:38.663949 26142 log.cc:927] Time spent T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:18:38.665999 26139 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:38.668061 26123 consensus_meta.cc:287] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.672s	user 0.010s	sys 0.005s
I20260709 12:18:38.687232 25973 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:38.691573 25973 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:38.693856 26141 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:38.667902 26111 raft_consensus.cc:740] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:38.674844 26130 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:38.671217 26164 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:38.707700 26164 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:38.710678 26111 consensus_queue.cc:260] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:38.719533 26107 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:38.722527 26041 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:38.684712 26123 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:38.738744 26151 log.cc:927] Time spent T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 12:18:38.700117 26091 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:38.749277 24471 raft_consensus.cc:1240] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:38.746614 26107 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:38.751479 26032 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:38.758306 26160 raft_consensus.cc:2749] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:38.729498 26106 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:38.733407 26126 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:38.735888 26138 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:38.741671 26081 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:38.772368 26104 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:38.778973 25114 raft_consensus.cc:1240] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:38.780148 26081 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:38.780659 26104 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:38.798595 26123 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:38.760406 25956 consensus_queue.cc:260] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:38.806774 26106 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:18:38.813288 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.865468 26082 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:38.866731 24468 raft_consensus.cc:2393] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 3: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:38.867388 26157 raft_consensus.cc:2749] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:38.869923 26138 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:38.870766 26031 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:38.871616 26126 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:38.871501 26031 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:38.872821 26150 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:38.874099 26032 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:38.876220 25083 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:38.877291 24471 raft_consensus.cc:1240] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:38.878355 26068 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:38.875337 26150 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:18:38.863456 26135 consensus_meta.cc:287] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.550s	user 0.012s	sys 0.000s
I20260709 12:18:38.833902 25956 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:38.884145 26091 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:18:38.879487 25970 consensus_meta.cc:287] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.545s	user 0.011s	sys 0.000s
I20260709 12:18:38.889320 26135 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:38.897982 24398 raft_consensus.cc:1275] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:38.887625 26095 consensus_queue.cc:1059] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:18:38.905697 26031 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:38.910357 26137 raft_consensus.cc:3055] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:38.910813 26137 raft_consensus.cc:740] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:38.910924 26082 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:38.911753 26137 consensus_queue.cc:260] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:38.919862 26111 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:38.946326 26122 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:38.963804 24289 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.000s	sys 0.020s
W20260709 12:18:38.967115 24289 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.000s	sys 0.021s
W20260709 12:18:38.969151 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 594315us
I20260709 12:18:38.970041 24289 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:38.971737 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:38.975328 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 400320us
I20260709 12:18:38.976828 24365 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:18:38.975208 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 326660us
I20260709 12:18:38.976027 24289 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:38.908594 26147 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:38.972361 26135 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:18:38.978223 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.972561 26155 raft_consensus.cc:2749] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:18:38.977885 26129 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.015s	sys 0.017s
W20260709 12:18:38.983914 26129 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.016s	sys 0.017s
I20260709 12:18:38.991530 26129 raft_consensus.cc:697] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:38.984505 26147 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:18:38.972375 26132 consensus_meta.cc:287] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.694s	user 0.004s	sys 0.008s
I20260709 12:18:38.981153 26172 raft_consensus.cc:2804] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:38.998342 26172 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:38.998817 26172 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:38.985639 24440 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:39.006964 24365 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:39.010605 24365 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:39.012382 26171 raft_consensus.cc:2804] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:39.018472 24398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 214) took 1091 ms. Trace:
I20260709 12:18:39.015792 24440 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:39.023233 24289 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:39.023303 24398 rpcz_store.cc:276] 0709 12:18:37.927121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.970457 (+ 43336us) service_pool.cc:224] Handling call
0709 12:18:37.970892 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:38.898441 (+927549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.018148 (+119707us) spinlock_profiling.cc:243] Waited 927 ms on lock 0x7b54001b9754. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:39.018384 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2131331456}
I20260709 12:18:39.009169 25970 raft_consensus.cc:2749] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:39.008852 26166 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:39.010062 26147 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:18:39.064047 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 53504.2us
W20260709 12:18:39.063522 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 52549.1us
W20260709 12:18:39.065761 24288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.040s	sys 0.032s
I20260709 12:18:39.012972 26171 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:39.013497 26031 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:39.004128 26132 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:39.084936 26114 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:39.015862 26122 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:39.087548 24440 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:39.088476 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 65321.7us
I20260709 12:18:39.092692 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:39.098268 26171 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:39.059031 26082 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:39.094878 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:39.095711 25117 raft_consensus.cc:1240] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 1. Current term is 2. Ops: []
W20260709 12:18:39.096333 24288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.040s	sys 0.032s
I20260709 12:18:39.103021 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:39.029533 26091 consensus_queue.cc:1048] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 12:18:39.107621 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:18:39.110467 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.992710 26129 consensus_queue.cc:237] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:39.058801 26041 consensus_queue.cc:1059] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:18:39.104987 26170 consensus_queue.cc:1059] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:18:39.071561 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:18:39.114779 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 84353.6us
I20260709 12:18:39.127409 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:39.127650 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:39.087401 26147 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:39.133900 26147 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:39.116524 24440 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:39.129513 26136 consensus_queue.cc:1048] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:18:39.130578 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:39.114086 26163 raft_consensus.cc:2749] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:39.164855 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:39.141649 26112 consensus_meta.cc:287] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.552s	user 0.013s	sys 0.000s
I20260709 12:18:39.136186 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:39.131908 24398 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 1.
I20260709 12:18:39.195286 24465 raft_consensus.cc:1240] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:39.114650 25970 consensus_queue.cc:1059] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
W20260709 12:18:39.274893 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 133796us
I20260709 12:18:39.296797 24440 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:39.298133 24440 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:39.127224 26164 consensus_queue.cc:1059] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:18:39.233834 26167 consensus_queue.cc:1059] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.124s
I20260709 12:18:39.314725 24324 raft_consensus.cc:1275] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:39.277489 24322 raft_consensus.cc:1275] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:39.279493 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:39.316147 24323 raft_consensus.cc:1240] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 2. Current term is 3. Ops: []
W20260709 12:18:39.316692 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.130978 26095 consensus_queue.cc:1048] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 12:18:39.292104 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:39.290091 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:39.292533 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:39.294253 24399 raft_consensus.cc:1240] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:39.274601 26082 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:39.233022 26169 raft_consensus.cc:2804] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:39.302110 24467 raft_consensus.cc:2393] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 3: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:39.297401 26108 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:39.350065 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:39.350633 26145 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:39.351724 26169 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:39.352224 26169 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:39.303982 26139 consensus_meta.cc:287] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.614s	user 0.011s	sys 0.008s
I20260709 12:18:39.111399 26166 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:39.313825 26098 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.309419 24393 raft_consensus.cc:1240] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 2. Current term is 3. Ops: []
W20260709 12:18:39.288901 26127 consensus_meta.cc:287] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.791s	user 0.006s	sys 0.013s
I20260709 12:18:39.316424 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:18:39.289952 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 152331us
I20260709 12:18:39.330641 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:39.369254 24395 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:39.338620 24394 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:39.345981 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:39.370923 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:39.346897 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:39.349843 26108 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:39.302762 25985 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:39.352072 26167 raft_consensus.cc:3055] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:39.306347 24440 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:39.287241 26112 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:39.347134 26134 consensus_meta.cc:287] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.838s	user 0.014s	sys 0.000s
I20260709 12:18:39.334386 26174 raft_consensus.cc:2749] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:39.376477 24322 raft_consensus.cc:1240] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:39.365406 26104 consensus_queue.cc:1059] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:18:39.372038 24320 raft_consensus.cc:2393] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 2: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:18:39.382211 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 75975.4us
I20260709 12:18:39.388907 24440 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:39.391474 26082 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:39.391954 26082 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:39.383359 25985 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:39.392468 26082 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:39.390132 24440 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:39.394219 25985 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:39.371641 26132 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:39.397558 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:39.381575 26167 raft_consensus.cc:740] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:39.376933 26127 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:39.381239 26093 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:39.363005 26139 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:39.330406 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:39.391876 26134 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:39.413436 24440 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:39.414754 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:39.415225 24317 raft_consensus.cc:2393] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 4: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:18:39.368337 26131 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:39.417091 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:39.402321 24325 raft_consensus.cc:2393] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 2: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:18:39.382324 25082 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:39.386119 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:18:39.386371 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.410784 24219 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54244 (request call id 269) took 1473 ms. Trace:
I20260709 12:18:39.419775 24219 rpcz_store.cc:276] 0709 12:18:37.937100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.937280 (+   180us) service_pool.cc:224] Handling call
0709 12:18:38.205479 (+268199us) spinlock_profiling.cc:243] Waited 6.11 ms on lock 0x7b54000902a8. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d53e331 00007f4a9d5393fc 00007f4a9d10ae84 00007f4a9d20904e 00007f4a9b6ca2a4 00007f4a9b6ca232 00007f4a9b6ca161 00007f4a9b6ca0dc 00007f4a9b6c9392 00007f4a9568748c 00007f4a956868c6
0709 12:18:39.410718 (+1205239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135047,"reported_tablets":3,"spinlock_wait_cycles":14056192}
I20260709 12:18:39.386708 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:39.421587 25117 raft_consensus.cc:2393] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 2: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:18:39.406497 24217 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54252 (request call id 251) took 1121 ms. Trace:
I20260709 12:18:39.423357 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:39.427106 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:39.428310 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:18:39.398211 24271 auto_rebalancer.cc:629] Failed to schedule move for tablet 66cf199780b748b28ae5a775abb95cbe: Illegal state: Replica c855242ec9d34a5397741ef20db9de8a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:18:39.422361 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:39.432221 24399 raft_consensus.cc:2393] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 4: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:39.386868 26123 raft_consensus.cc:2749] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:39.400106 26161 raft_consensus.cc:993] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756: : Instructing follower c855242ec9d34a5397741ef20db9de8a to start an election
I20260709 12:18:39.433998 24440 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:39.401482 26127 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:39.402012 26093 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:39.437683 26089 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:39.443006 24395 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:39.442858 24217 rpcz_store.cc:276] 0709 12:18:38.284950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:38.285126 (+   176us) service_pool.cc:224] Handling call
0709 12:18:39.406429 (+1121303us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":877072,"reported_tablets":4}
I20260709 12:18:39.440490 26170 raft_consensus.cc:3055] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:39.430195 24400 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:39.454741 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:39.398322 26174 raft_consensus.cc:2804] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:39.456259 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:39.446115 24440 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:39.407557 26068 consensus_meta.cc:287] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.001s
I20260709 12:18:39.440577 26153 raft_consensus.cc:2804] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:39.470651 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:39.448223 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:39.448457 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:39.371922 26098 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:39.452268 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:39.473340 24395 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:39.472378 24289 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:39.457090 24399 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:39.410102 26139 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:39.452831 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:39.452903 25985 consensus_queue.cc:1059] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:18:39.449530 26081 consensus_queue.cc:1048] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:18:39.459206 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:39.494951 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:39.449541 26150 raft_consensus.cc:2749] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:39.496291 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:39.497951 24324 raft_consensus.cc:1275] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:39.454093 26170 raft_consensus.cc:740] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:39.506137 24399 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:39.507640 24289 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:39.508316 24395 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:18:39.456339 26174 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:39.450371 24366 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:18:39.514101 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.510174 24289 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:39.514930 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 64624.9us
I20260709 12:18:39.469622 26153 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:39.476188 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:39.485677 26127 raft_consensus.cc:2804] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:39.479835 24400 raft_consensus.cc:2393] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 2: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:39.481757 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:39.453274 26161 raft_consensus.cc:1081] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Signalling peer c855242ec9d34a5397741ef20db9de8a to start an election
I20260709 12:18:39.478018 26108 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:39.453024 26162 consensus_queue.cc:1048] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:18:39.399320 26167 consensus_queue.cc:260] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:39.490105 26107 raft_consensus.cc:3055] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:39.550582 26107 raft_consensus.cc:740] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:39.552060 26107 consensus_queue.cc:260] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:39.491621 26112 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:39.493271 26137 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:39.496482 26098 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:39.465339 24440 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:39.412956 24394 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:18:39.473023 26123 raft_consensus.cc:2749] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:39.432344 26131 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:39.493362 25985 raft_consensus.cc:3055] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:39.477582 26068 raft_consensus.cc:2749] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:39.447359 26149 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:39.517591 24397 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:39.479427 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:39.519052 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:39.572955 25985 raft_consensus.cc:740] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:39.533960 26032 raft_consensus.cc:3055] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:39.590131 26032 raft_consensus.cc:740] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:39.591080 26032 consensus_queue.cc:260] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:39.592118 26032 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:39.535060 26101 raft_consensus.cc:3055] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:39.535106 24467 consensus_queue.cc:237] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:39.592806 26101 raft_consensus.cc:740] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:39.575546 26170 consensus_queue.cc:260] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:39.520996 26153 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:39.546167 26166 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:39.516755 25956 raft_consensus.cc:2749] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:39.515726 26174 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:39.571954 26145 raft_consensus.cc:2749] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:39.542022 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:18:39.536113 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 93892.8us
I20260709 12:18:39.492357 26147 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:39.597865 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.513813 26139 raft_consensus.cc:2804] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:39.615094 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:39.593858 26170 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:39.569478 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 104230us
I20260709 12:18:39.479413 26172 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:39.553671 26124 raft_consensus.cc:3055] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:39.538100 26141 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:39.568276 26132 raft_consensus.cc:993] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3: : Instructing follower c855242ec9d34a5397741ef20db9de8a to start an election
I20260709 12:18:39.578807 24394 raft_consensus.cc:1240] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:18:39.579799 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:39.633960 24469 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:39.536106 26146 consensus_queue.cc:1059] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:18:39.575330 26149 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:39.580065 25985 consensus_queue.cc:260] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:39.544752 26134 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:39.581372 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:39.647131 24466 raft_consensus.cc:2393] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 4: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:39.581933 26131 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:39.583990 26171 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:39.651499 26169 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:39.558097 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:39.557289 26160 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:39.537914 26127 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:39.536741 26104 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.544453 26093 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:39.555114 24438 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:39.666175 26144 raft_consensus.cc:2804] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:39.646739 26152 raft_consensus.cc:1081] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Signalling peer c855242ec9d34a5397741ef20db9de8a to start an election
I20260709 12:18:39.666783 26144 raft_consensus.cc:697] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:39.608441 24397 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:39.574404 26107 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:39.558218 26150 consensus_queue.cc:1059] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:18:39.615427 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:39.645358 26149 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:39.559795 24366 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:39.565903 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:39.676332 24471 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 1.
I20260709 12:18:39.628027 24400 raft_consensus.cc:1240] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 1. Current term is 2. Ops: []
W20260709 12:18:39.676710 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 116963us
I20260709 12:18:39.678426 24400 raft_consensus.cc:1240] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:39.631012 24440 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:39.635044 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:39.680207 24398 raft_consensus.cc:1240] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:39.680565 24395 raft_consensus.cc:2393] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 4: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:39.636536 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:39.681560 24396 raft_consensus.cc:2393] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 2: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:39.637125 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:39.593762 26101 consensus_queue.cc:260] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:39.653168 26171 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:39.657644 24392 raft_consensus.cc:1240] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4. Ops: []
W20260709 12:18:39.658464 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 87785.5us
I20260709 12:18:39.632045 26139 raft_consensus.cc:697] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:39.632683 26124 raft_consensus.cc:740] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:39.669193 25084 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:39.687268 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:39.669481 24397 raft_consensus.cc:1240] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:39.705515 24365 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:18:39.664093 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 109062us
I20260709 12:18:39.706288 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:39.670491 24391 raft_consensus.cc:1240] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:39.707114 24397 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 1.
I20260709 12:18:39.616026 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:39.657294 26160 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:39.685751 25082 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:39.710413 25082 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:39.711151 26066 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:39.711705 26066 raft_consensus.cc:697] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:39.712733 26066 consensus_queue.cc:237] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:39.687381 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:39.669631 26127 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:39.718981 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 49882.9us
I20260709 12:18:39.676479 26141 raft_consensus.cc:697] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 4 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:39.691227 24320 raft_consensus.cc:1240] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:39.692384 24400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:51478
I20260709 12:18:39.684499 24289 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:39.729584 24400 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:18:39.729969 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 45564us
I20260709 12:18:39.671327 25985 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:39.740942 26173 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:39.741614 26173 raft_consensus.cc:697] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:39.671232 24473 raft_consensus.cc:1240] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 1. Current term is 2. Ops: []
W20260709 12:18:39.704691 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 95778.1us
I20260709 12:18:39.717314 26160 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:39.748988 24291 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:39.718129 26167 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:39.682725 26031 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:39.689174 24323 raft_consensus.cc:1240] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:39.725208 26139 consensus_queue.cc:237] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:39.667815 26144 consensus_queue.cc:237] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:39.730018 24400 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:39.731427 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:39.665882 26104 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:39.767990 24321 raft_consensus.cc:2393] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 2: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:18:39.769029 26184 log.cc:927] Time spent T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:18:39.732172 26128 raft_consensus.cc:2804] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:39.744570 26068 raft_consensus.cc:2749] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:39.746840 25118 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:39.748072 24366 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:39.717490 24365 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:39.701278 26132 raft_consensus.cc:2749] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:39.757578 25083 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:39.717378 26188 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:39.697721 26134 consensus_queue.cc:1059] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
W20260709 12:18:39.778882 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 61486.6us
I20260709 12:18:39.781934 26114 raft_consensus.cc:2749] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:39.781967 26141 consensus_queue.cc:237] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:39.783912 26082 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:39.754366 26162 consensus_queue.cc:1048] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:18:39.784709 26160 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:39.769958 26111 consensus_queue.cc:1059] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:18:39.758565 26148 raft_consensus.cc:2749] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:39.787688 24365 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:18:39.790176 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 159296us
I20260709 12:18:39.755072 26169 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:39.742695 26173 consensus_queue.cc:237] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:39.793555 26172 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:39.833649 24440 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:39.798610 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:39.850296 24392 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:39.792963 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:39.838581 24365 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:18:39.838955 24290 leader_election.cc:336] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.527s (SENT)
I20260709 12:18:39.774039 26128 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:39.795410 26119 ts_tablet_manager.cc:1929] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:18:39.849694 26132 raft_consensus.cc:2804] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:39.798935 26131 raft_consensus.cc:2804] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:39.855460 24290 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:39.855922 24365 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:39.852667 26148 raft_consensus.cc:3055] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:39.857129 24440 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:39.845618 26166 raft_consensus.cc:2749] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:39.865921 24365 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:39.868461 24471 raft_consensus.cc:1240] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:39.859211 26131 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:39.855885 26128 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:39.858526 26119 log.cc:1199] T 27d97e40dd274a2ea3734c2982741e3c P c855242ec9d34a5397741ef20db9de8a: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-1-root/wals/27d97e40dd274a2ea3734c2982741e3c
I20260709 12:18:39.856542 25970 raft_consensus.cc:2749] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:39.857221 26132 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:39.857681 26147 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:39.877739 26123 consensus_queue.cc:1059] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:39.869001 25956 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:39.875671 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:39.853114 26188 consensus_queue.cc:1059] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:18:39.859826 26148 raft_consensus.cc:740] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:39.865644 26152 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:39.869680 26106 raft_consensus.cc:2749] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:39.915864 26152 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:39.916306 26152 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:39.920086 24392 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:39.872414 26131 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:39.910364 26194 consensus_queue.cc:1059] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:18:39.884426 26132 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:39.913478 26127 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:39.913780 26188 raft_consensus.cc:3055] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:39.914839 26148 consensus_queue.cc:260] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:39.934062 26082 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:39.934793 26148 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:39.923759 24400 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:39.937461 26145 raft_consensus.cc:3055] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:39.937920 26145 raft_consensus.cc:740] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:39.938120 24400 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:39.939019 26144 consensus_queue.cc:1059] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:39.907610 25956 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:39.940253 25956 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:39.933521 26188 raft_consensus.cc:740] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:39.942888 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:39.951886 26153 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:39.889747 26171 consensus_queue.cc:1059] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
W20260709 12:18:39.973927 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 83701us
I20260709 12:18:39.975800 25117 raft_consensus.cc:3055] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:39.976182 25117 raft_consensus.cc:740] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:39.977201 25117 consensus_queue.cc:260] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:39.981611 25117 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:39.958555 26119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51466 (request call id 76) took 2319 ms. Trace:
I20260709 12:18:39.985114 26119 rpcz_store.cc:276] 0709 12:18:37.622325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.623509 (+  1184us) service_pool.cc:224] Handling call
0709 12:18:37.798736 (+175227us) ts_tablet_manager.cc:1151] Deleting tablet 27d97e40dd274a2ea3734c2982741e3c
0709 12:18:37.798813 (+    77us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:18:39.287898 (+1489085us) tablet_metadata.cc:665] Metadata flushed
0709 12:18:39.773941 (+486043us) tablet_metadata.cc:665] Metadata flushed
0709 12:18:39.932748 (+158807us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":169354,"thread_start_us":126111,"threads_started":1}
I20260709 12:18:39.990545 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:39.991523 25117 raft_consensus.cc:2410] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:18:39.993888 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:18:39.982597 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 89198us
W20260709 12:18:39.997059 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 158149us
I20260709 12:18:39.997330 25116 raft_consensus.cc:1240] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:39.947576 26123 raft_consensus.cc:3055] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:39.980985 26082 raft_consensus.cc:3055] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:39.995523 26031 raft_consensus.cc:2749] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:40.003598 26123 raft_consensus.cc:740] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:40.005976 26134 raft_consensus.cc:2749] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:40.017195 26106 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:40.051115 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.015885 26082 raft_consensus.cc:740] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:39.938827 26145 consensus_queue.cc:260] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:40.026660 26202 raft_consensus.cc:3055] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:40.007946 26129 consensus_queue.cc:1059] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 12:18:40.078933 26189 log.cc:927] Time spent T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:18:40.062536 26174 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:40.113696 26196 raft_consensus.cc:3055] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:40.114288 26196 raft_consensus.cc:740] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:40.101708 26101 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:40.029199 26106 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:40.123834 26106 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:40.129504 26106 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.129216 25956 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:40.130400 26106 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:40.135398 26195 log.cc:927] Time spent T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:18:40.139477 26127 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:40.131950 25956 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:40.142939 24467 raft_consensus.cc:1240] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:40.032313 26152 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:39.982826 26188 consensus_queue.cc:260] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:40.149410 26106 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:40.082147 26202 raft_consensus.cc:740] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:40.156540 26152 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:40.160219 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:40.160915 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:40.161509 24397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:51474
I20260709 12:18:40.167462 24397 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:40.167838 24397 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:40.168452 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.162712 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:40.163942 24208 catalog_manager.cc:5028] TS c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): tablet 27d97e40dd274a2ea3734c2982741e3c (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
I20260709 12:18:40.164201 24393 raft_consensus.cc:1240] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:40.165285 24394 raft_consensus.cc:1275] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:18:40.170277 24365 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:40.110860 26145 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:40.151772 26170 consensus_meta.cc:287] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.509s	user 0.004s	sys 0.007s
I20260709 12:18:40.179890 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:40.194712 24466 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
W20260709 12:18:40.184561 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.186558 24400 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:40.180101 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:40.189906 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35194 (request call id 328) took 1097 ms. Trace:
I20260709 12:18:40.197532 25118 rpcz_store.cc:276] 0709 12:18:39.092071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.092365 (+   294us) service_pool.cc:224] Handling call
0709 12:18:40.189699 (+1097334us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54005ff354. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:40.189809 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1404867328}
W20260709 12:18:40.198068 26200 log.cc:927] Time spent T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:18:40.189088 26174 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:40.202505 24366 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:40.196938 24469 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:40.193854 24395 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:40.208868 26112 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:40.209457 26112 raft_consensus.cc:697] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:40.209816 26081 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:40.173769 26106 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:40.210456 26081 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:40.194885 24397 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:40.210373 26112 consensus_queue.cc:237] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:40.185956 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:40.169198 26149 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:40.151994 26132 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:18:40.214823 24471 raft_consensus.cc:1240] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:40.218112 26132 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:18:40.216465 24365 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:40.226257 24397 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:18:40.230923 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.260360 25985 raft_consensus.cc:2804] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:40.265290 24468 raft_consensus.cc:1240] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:40.166356 26202 consensus_queue.cc:260] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:40.266826 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:40.267184 25985 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:40.267699 24466 raft_consensus.cc:3055] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:40.268204 24466 raft_consensus.cc:740] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:40.267676 25985 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:40.268925 26149 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:40.269129 24466 consensus_queue.cc:260] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:40.272330 24466 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:40.266826 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:40.261277 25956 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.225838 24465 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:40.264317 26153 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:40.183797 26128 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:40.279938 26068 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.280719 26081 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:40.275921 26114 consensus_queue.cc:1059] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:18:40.195442 26082 consensus_queue.cc:260] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:40.287858 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:40.293658 24469 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:40.318399 26128 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:40.320873 26098 raft_consensus.cc:3055] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:40.321365 26098 raft_consensus.cc:740] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:40.322214 26098 consensus_queue.cc:260] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:40.323045 26082 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:40.323282 26098 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:40.325477 24470 raft_consensus.cc:2393] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 3: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:40.288472 25956 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:40.309353 26068 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:40.343120 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:40.344151 24397 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:40.345613 26108 raft_consensus.cc:3055] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:40.346700 26108 raft_consensus.cc:740] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:40.346946 26131 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:40.349383 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:40.350121 24473 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:40.351257 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:40.351886 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:40.347826 26108 consensus_queue.cc:260] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:40.353322 26108 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:40.347438 25956 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:40.352506 24470 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:40.340068 26124 consensus_queue.cc:260] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:40.294503 24466 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
W20260709 12:18:40.364059 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.367220 26131 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:40.368350 26124 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:40.371528 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:40.372318 24470 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:40.342581 26068 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:40.383301 25985 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:40.385491 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:40.385821 26161 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.385890 26106 raft_consensus.cc:2749] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:40.387542 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:40.388443 25118 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:40.389834 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:40.390678 25117 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:40.386358 26161 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:40.396863 24366 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:40.395078 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:40.380295 26104 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:40.401912 24324 raft_consensus.cc:1240] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:40.402611 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:40.403246 24321 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:18:40.399010 24325 raft_consensus.cc:2393] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 2: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:18:40.395481 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:40.400218 24366 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:40.404692 25118 raft_consensus.cc:1240] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:40.400053 25082 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:40.398154 26196 consensus_queue.cc:260] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:40.405745 24366 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:40.410391 25118 raft_consensus.cc:1240] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:40.408404 24470 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
W20260709 12:18:40.410121 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.425185 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:40.425920 25118 raft_consensus.cc:2468] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:40.426994 24291 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:40.410742 25112 raft_consensus.cc:1240] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 5. Ops: []
I20260709 12:18:40.410051 25956 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:40.411628 26196 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:40.404750 26106 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:40.413790 26136 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:40.413275 26161 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:40.429195 26104 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:40.430809 26127 raft_consensus.cc:2804] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:40.458289 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:40.460577 24470 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:40.412053 26122 consensus_queue.cc:1059] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:18:40.463996 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:40.458700 24398 raft_consensus.cc:1240] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:40.462152 24397 raft_consensus.cc:1240] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:40.449198 25956 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:40.468029 25985 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:40.470077 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:40.470849 25112 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:40.455884 26136 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:40.468294 24397 raft_consensus.cc:1275] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:40.474468 25083 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:40.458252 26104 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:40.474526 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:40.475457 24365 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:40.461549 26127 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:40.481930 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.491204 24365 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:40.493345 24470 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:40.495414 24438 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:40.496763 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:40.472527 25956 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:40.503919 26146 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:40.428808 26163 consensus_queue.cc:1059] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:18:40.496716 24365 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:40.500999 26032 consensus_queue.cc:1059] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 12:18:40.526513 24290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.016s	sys 0.008s
I20260709 12:18:40.475234 26136 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:40.492878 25985 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:40.483359 26104 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:40.536912 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:40.526917 24290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.016s	sys 0.008s
I20260709 12:18:40.492718 26127 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:40.529933 24438 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:40.531729 24289 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.010s	sys 0.011s
W20260709 12:18:40.556898 24289 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.011s	sys 0.011s
I20260709 12:18:40.493499 26131 raft_consensus.cc:2804] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:40.526072 26160 raft_consensus.cc:2804] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:18:40.520473 26162 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.003s	sys 0.022s
I20260709 12:18:40.518945 26132 raft_consensus.cc:2804] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:18:40.557256 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 556642us
I20260709 12:18:40.570363 24289 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:40.532102 26146 raft_consensus.cc:697] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:40.526921 26174 consensus_queue.cc:1059] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:18:40.504967 26101 consensus_queue.cc:1059] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:18:40.568415 24392 raft_consensus.cc:1240] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 1. Current term is 2. Ops: []
W20260709 12:18:40.565766 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.575835 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:40.526654 26171 consensus_queue.cc:1048] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:18:40.605222 24398 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:40.580113 24393 raft_consensus.cc:1240] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 2. Current term is 3. Ops: []
W20260709 12:18:40.577699 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.581302 24391 raft_consensus.cc:1240] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:18:40.574689 25116 raft_consensus.cc:1275] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:18:40.599022 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.516209 26147 consensus_queue.cc:1059] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:18:40.546295 25985 raft_consensus.cc:697] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:40.505734 26149 consensus_queue.cc:1048] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:18:40.565186 26145 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:18:40.615140 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:40.592172 26162 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.006s	sys 0.022s
I20260709 12:18:40.595625 26163 raft_consensus.cc:2804] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:40.596447 26131 raft_consensus.cc:697] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:40.596927 26160 raft_consensus.cc:697] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:18:40.711707 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:40.712744 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:40.717510 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 86121.5us
I20260709 12:18:40.600998 26146 consensus_queue.cc:237] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:40.725306 24398 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
W20260709 12:18:40.729571 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.614892 26132 raft_consensus.cc:697] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
W20260709 12:18:40.644657 26141 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.036s	sys 0.064s
I20260709 12:18:40.616479 26134 consensus_queue.cc:1048] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.119s
I20260709 12:18:40.732722 26145 raft_consensus.cc:697] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
W20260709 12:18:40.760759 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 218657us
I20260709 12:18:40.740301 26147 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:40.720491 26206 consensus_queue.cc:1059] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:18:40.746791 26165 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.828984 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:18:40.829452 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 234766us
I20260709 12:18:40.742020 26163 raft_consensus.cc:697] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:40.765499 26188 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:40.766489 26141 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.038s	sys 0.064s
W20260709 12:18:40.877024 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:40.875626 24440 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.044s	sys 0.058s
W20260709 12:18:40.893378 24440 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.049s	sys 0.058s
W20260709 12:18:40.893749 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 898569us
W20260709 12:18:40.895682 24290 leader_election.cc:336] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.580s (SENT)
I20260709 12:18:40.905341 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:40.909186 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:40.870653 26171 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:40.825769 26147 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:40.875069 26181 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:40.917219 24319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "125e800842274e17a2c01df7bb749005"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:42226
I20260709 12:18:40.917855 24319 raft_consensus.cc:606] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:40.767050 25985 consensus_queue.cc:237] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:40.919534 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:40.919777 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:18:40.900561 26108 consensus_meta.cc:287] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.547s	user 0.014s	sys 0.000s
I20260709 12:18:40.921746 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:40.922523 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:40.923240 25118 raft_consensus.cc:2393] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 3: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:40.924981 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:40.927542 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:40.929389 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:40.931102 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:40.933167 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:40.933728 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:40.938154 25117 raft_consensus.cc:1240] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:40.944661 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:40.852721 26160 consensus_queue.cc:237] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:40.860654 26165 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:40.954101 24289 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:40.939968 26112 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.045s	sys 0.045s
I20260709 12:18:40.960618 24397 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
I20260709 12:18:40.961719 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:18:40.944481 26082 consensus_meta.cc:287] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.621s	user 0.011s	sys 0.001s
I20260709 12:18:40.969079 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:40.961036 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:40.978461 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:40.962421 24470 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:40.970712 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:40.971786 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:40.984530 24469 raft_consensus.cc:2393] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 3: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:40.978498 24474 raft_consensus.cc:2393] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 3: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:40.977311 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:40.967533 24471 raft_consensus.cc:1240] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:40.970837 26161 raft_consensus.cc:3055] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:40.990015 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:40.990669 24468 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:40.993552 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:40.994362 24471 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:18:40.995321 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:40.995134 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:40.997444 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:18:40.977308 26196 consensus_meta.cc:287] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.521s	user 0.007s	sys 0.004s
I20260709 12:18:40.978076 25113 raft_consensus.cc:2393] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 2: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
W20260709 12:18:40.979259 26215 log.cc:927] Time spent T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:18:40.918857 26171 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:41.024991 24398 raft_consensus.cc:1275] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:40.991590 26161 raft_consensus.cc:740] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:40.901361 26131 consensus_queue.cc:237] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:40.909425 26132 consensus_queue.cc:237] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:40.978173 26210 log.cc:927] Time spent T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 12:18:40.940194 26181 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:40.967468 26112 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.045s	sys 0.046s
I20260709 12:18:41.005852 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:41.056703 24391 raft_consensus.cc:1275] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:41.058105 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:41.059568 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:41.008033 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:40.979153 24467 raft_consensus.cc:1240] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:18:40.977165 26164 raft_consensus.cc:2804] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:40.969748 26098 consensus_queue.cc:1059] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:18:41.034644 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:40.940675 26145 consensus_queue.cc:237] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:41.007184 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:40.943915 26163 consensus_queue.cc:237] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:40.999580 26223 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.058410 26222 consensus_queue.cc:1048] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:18:41.104763 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 98428.7us
W20260709 12:18:41.109740 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.108959 25118 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
W20260709 12:18:41.079948 26124 consensus_meta.cc:287] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.711s	user 0.006s	sys 0.006s
I20260709 12:18:41.085949 26224 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:41.087129 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:18:41.096100 24290 leader_election.cc:336] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.012s (SENT)
I20260709 12:18:41.109333 25114 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
I20260709 12:18:41.101750 24470 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:18:41.101895 26221 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.102700 26168 consensus_queue.cc:1048] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:18:41.105299 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:41.128815 24320 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:41.120502 24468 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:41.131031 24472 raft_consensus.cc:2393] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 2: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:41.131968 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:41.133070 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:41.134415 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:41.072023 26139 raft_consensus.cc:3055] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:18:41.135259 24290 leader_election.cc:336] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.103s (SENT)
I20260709 12:18:41.122057 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:41.076843 26165 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:41.137709 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:41.138047 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:40.993266 25084 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:41.105643 26098 raft_consensus.cc:3055] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:18:41.137125 26208 log.cc:927] Time spent T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.513s	user 0.003s	sys 0.003s
I20260709 12:18:41.139196 26139 raft_consensus.cc:740] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:41.140355 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:41.144860 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:41.187438 24472 raft_consensus.cc:2393] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 2: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:41.146661 24320 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
W20260709 12:18:41.162631 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.164135 24323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82c31a779e7949a590cf168eef01e405"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:42226
I20260709 12:18:41.142860 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:18:41.189039 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.141680 26098 raft_consensus.cc:740] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:18:41.185391 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 192151us
I20260709 12:18:41.190795 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:41.187590 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:41.192077 24468 raft_consensus.cc:2393] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 3: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:41.191365 25084 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:41.194015 24472 raft_consensus.cc:1240] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:41.188674 24323 raft_consensus.cc:606] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:41.114722 26164 raft_consensus.cc:697] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:41.208866 26228 raft_consensus.cc:2749] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:41.216818 24468 raft_consensus.cc:3055] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:41.219197 24468 raft_consensus.cc:740] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:41.219841 24472 raft_consensus.cc:1240] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:41.222206 24470 raft_consensus.cc:1240] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:41.224646 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:41.229111 24468 consensus_queue.cc:260] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:41.235965 24468 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:41.242112 24473 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:18:41.215854 26227 consensus_queue.cc:1059] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 12:18:41.216153 26106 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:41.112498 26223 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:41.248721 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 57449.2us
I20260709 12:18:41.251171 25084 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:41.254447 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:41.255512 24473 raft_consensus.cc:2468] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:41.260914 24472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
mode: GRACEFUL
new_leader_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:42866
I20260709 12:18:41.234861 26165 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:41.229490 26108 consensus_queue.cc:1059] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:18:41.145969 26221 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:41.270076 24400 raft_consensus.cc:1240] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 2. Current term is 3. Ops: []
W20260709 12:18:41.275621 26229 log.cc:927] Time spent T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
W20260709 12:18:41.277009 25112 consensus_meta.cc:287] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.806s	user 0.010s	sys 0.005s
I20260709 12:18:41.277494 25112 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
W20260709 12:18:41.278754 26217 log.cc:927] Time spent T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 12:18:41.275867 25956 consensus_meta.cc:287] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.730s	user 0.008s	sys 0.001s
I20260709 12:18:41.245751 26147 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:41.254328 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:41.213382 26161 consensus_queue.cc:260] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:41.267081 26214 log.cc:927] Time spent T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 12:18:41.276188 26209 raft_consensus.cc:3055] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:41.185932 26224 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:41.283176 26171 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:41.259361 26106 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:41.303171 26223 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:41.303997 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:41.315717 24323 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:41.309084 26221 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:18:41.311869 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.287884 25956 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:41.250519 26139 consensus_queue.cc:260] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:41.331509 26127 consensus_meta.cc:287] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.776s	user 0.007s	sys 0.005s
I20260709 12:18:41.332207 26139 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:41.332463 24466 raft_consensus.cc:1240] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:41.333832 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:41.334388 24466 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:41.280830 26239 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:41.287809 26228 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:41.280483 26165 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:41.295684 26209 raft_consensus.cc:740] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:41.339234 24366 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:41.331333 26136 consensus_meta.cc:287] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.788s	user 0.003s	sys 0.006s
W20260709 12:18:41.334233 24290 leader_election.cc:336] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.024s (SENT)
I20260709 12:18:41.340384 24320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 1498) took 1350 ms. Trace:
I20260709 12:18:41.337404 26221 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.332120 26127 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:41.335979 26161 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:41.343683 26108 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:41.348320 26108 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.345695 26221 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:41.348819 26108 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:41.292333 26164 consensus_queue.cc:237] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:41.338567 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:41.360078 24468 raft_consensus.cc:1275] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:41.363731 24290 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:41.364683 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:41.366654 26147 consensus_queue.cc:1059] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:41.368669 25112 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:41.373802 24394 raft_consensus.cc:1240] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:41.349893 24466 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
W20260709 12:18:41.350298 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 135391us
I20260709 12:18:41.341662 24320 rpcz_store.cc:276] 0709 12:18:39.990068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.990205 (+   137us) service_pool.cc:224] Handling call
0709 12:18:41.340134 (+1349929us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400339854. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:41.340283 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2615815424}
W20260709 12:18:41.354187 26234 log.cc:927] Time spent T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:18:41.355223 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:41.346772 26170 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:41.396921 24398 raft_consensus.cc:1240] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:41.403343 24323 raft_consensus.cc:2393] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 4: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:18:41.362974 26104 consensus_meta.cc:287] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.816s	user 0.012s	sys 0.000s
I20260709 12:18:41.400509 24365 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:41.373790 24366 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:41.407938 24468 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:41.409214 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:41.410468 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:41.411103 24466 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:41.409922 24468 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
W20260709 12:18:41.411895 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.414202 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:41.414446 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:41.415534 24320 raft_consensus.cc:2410] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:18:41.416553 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:41.417333 24318 raft_consensus.cc:2368] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 2. Current term is 3.
I20260709 12:18:41.418262 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:41.418972 24318 raft_consensus.cc:2393] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 2: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:18:41.419662 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:41.420588 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:41.425694 24316 raft_consensus.cc:1240] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:41.427428 24325 raft_consensus.cc:1240] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:41.428586 24440 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:18:41.428984 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 43494us
I20260709 12:18:41.345309 26136 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:41.431598 26136 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:41.432196 24325 raft_consensus.cc:1240] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:41.436371 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:41.437131 24316 raft_consensus.cc:2393] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 2: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:18:41.438687 24395 raft_consensus.cc:1240] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:41.437294 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:41.441555 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:41.443024 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:41.444278 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:41.437875 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:18:41.448944 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 85311.2us
I20260709 12:18:41.447773 26160 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:41.451417 24322 raft_consensus.cc:1240] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:41.450009 24290 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:41.451234 24316 raft_consensus.cc:2393] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 3: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:18:41.454053 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:41.451247 24440 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:41.450930 26134 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.457561 24320 raft_consensus.cc:1240] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:41.450680 26160 raft_consensus.cc:697] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:41.422204 26223 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:41.456454 26221 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:41.460193 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:18:41.436122 26188 consensus_meta.cc:287] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.562s	user 0.006s	sys 0.006s
I20260709 12:18:41.461354 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:41.461424 24290 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:41.464531 24440 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:41.471477 24398 raft_consensus.cc:1240] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:41.453562 26111 raft_consensus.cc:2749] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:41.450891 26196 raft_consensus.cc:2749] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:41.407709 26170 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:41.459138 24465 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:41.507105 24472 raft_consensus.cc:606] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Received request to transfer leadership to TS c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:41.465850 26209 consensus_queue.cc:260] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:41.425750 26224 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:41.463475 26134 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:41.477828 26106 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:41.480569 26228 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:41.482949 26129 raft_consensus.cc:3055] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:18:41.536223 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 248928us
I20260709 12:18:41.491259 26241 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:41.492411 26160 consensus_queue.cc:237] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:41.470961 26206 raft_consensus.cc:2749] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:41.462184 26222 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:41.411263 26104 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:41.499917 24396 raft_consensus.cc:1240] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:41.554190 25115 raft_consensus.cc:1240] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:41.498106 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:41.503894 24440 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:41.507445 24290 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:41.507506 24472 raft_consensus.cc:614] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:41.555574 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 48232.7us
I20260709 12:18:41.509285 24325 raft_consensus.cc:1240] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:41.510353 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:41.517872 24323 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:41.519381 24318 raft_consensus.cc:1240] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:41.520263 26221 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:41.522603 26245 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.524180 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:41.473224 26146 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.474123 26172 raft_consensus.cc:2749] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:41.447577 26123 consensus_queue.cc:260] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:41.489980 25956 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:41.504557 26169 raft_consensus.cc:2749] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:41.507735 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:41.550202 26228 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.463315 26223 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.495961 26171 consensus_queue.cc:1059] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
W20260709 12:18:41.508365 26082 consensus_queue.cc:1175] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c855242ec9d34a5397741ef20db9de8a" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:41.534996 26032 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.677925 25115 raft_consensus.cc:1275] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:18:41.697021 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 193152us
W20260709 12:18:41.593874 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:41.576033 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:41.700418 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.694612 24393 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:41.569103 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:41.702265 24324 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:41.572474 26127 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:41.565313 26111 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:41.706537 26181 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:41.557910 26206 raft_consensus.cc:2749] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:41.536721 26129 raft_consensus.cc:740] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:41.559262 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:18:41.706910 24440 consensus_peers.cc:597] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4fb70b6bc9ed40a793fb93839c889578. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:41.712683 26221 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:41.797147 25119 raft_consensus.cc:1240] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:41.800345 26221 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:41.807379 24324 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:18:41.786921 25115 raft_consensus.cc:1240] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:41.725626 25116 raft_consensus.cc:1240] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:41.619179 26218 raft_consensus.cc:3055] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:41.801438 24465 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:41.617646 26114 raft_consensus.cc:3055] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:41.630455 26106 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.690424 26226 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.701838 26223 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:41.777182 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:41.818991 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 120809us
I20260709 12:18:41.831775 24440 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:41.806876 26129 consensus_queue.cc:260] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:41.674918 25985 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.725138 26181 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.571208 26224 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.784403 26104 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:41.815951 26221 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.703382 26165 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:41.757769 25956 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:41.564875 26168 consensus_queue.cc:1059] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.250s
I20260709 12:18:41.592660 26241 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:41.849216 26108 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:41.712568 25114 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
I20260709 12:18:41.817817 26218 raft_consensus.cc:740] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:41.845465 26224 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:41.727175 26141 consensus_queue.cc:1059] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 12:18:41.821503 26114 raft_consensus.cc:740] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:41.843658 26169 raft_consensus.cc:2804] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:41.866047 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:41.706809 26032 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:41.716333 26146 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:41.843479 26129 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:41.878530 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:41.879230 25119 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:41.864521 26227 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.034s	sys 0.048s
I20260709 12:18:41.709196 26245 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:41.888335 26241 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:41.716441 26228 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:41.837226 26106 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:41.860188 26170 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:41.848784 25985 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:41.889737 26227 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.034s	sys 0.049s
I20260709 12:18:41.858835 26221 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:41.858858 26181 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:41.874784 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:41.928188 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:41.908887 26141 consensus_queue.cc:1059] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:18:41.859974 25956 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:41.890502 26169 raft_consensus.cc:697] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:41.955089 26108 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:41.955788 26221 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:41.957041 26098 consensus_queue.cc:260] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:41.957701 24465 raft_consensus.cc:2393] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 3: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:41.958742 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:41.959079 26132 raft_consensus.cc:3055] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:41.959393 24465 raft_consensus.cc:2376] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3. Re-sending same reply.
I20260709 12:18:41.959653 26132 raft_consensus.cc:740] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:41.960397 25119 raft_consensus.cc:2468] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:41.853940 26226 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:41.960410 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:42.045653 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:42.049852 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:42.050536 24468 raft_consensus.cc:2376] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4. Re-sending same reply.
I20260709 12:18:41.947748 26114 consensus_queue.cc:260] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:42.051558 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:42.051749 26114 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:42.052284 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:42.052893 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:42.054075 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:42.053160 25112 raft_consensus.cc:2393] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 3: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
W20260709 12:18:42.014882 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.942770 26134 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:18:42.044129 24397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2027) took 1545 ms (client timeout 1526 ms). Trace:
I20260709 12:18:41.892350 26168 consensus_queue.cc:1059] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 12:18:42.054682 24468 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:42.092413 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:18:42.098016 26173 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.026s	sys 0.040s
I20260709 12:18:42.102734 26228 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:18:42.102854 26173 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.027s	sys 0.040s
I20260709 12:18:41.989080 26245 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:41.944833 26218 consensus_queue.cc:260] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:18:41.966825 26132 consensus_queue.cc:260] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:41.961357 26169 consensus_queue.cc:237] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:42.121186 26235 log.cc:927] Time spent T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.875s	user 0.000s	sys 0.005s
W20260709 12:18:42.127681 26161 consensus_meta.cc:287] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.769s	user 0.011s	sys 0.001s
I20260709 12:18:42.115226 26202 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:42.130735 26224 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:18:42.137042 26222 consensus_meta.cc:287] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.582s	user 0.007s	sys 0.004s
I20260709 12:18:42.151824 26218 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:42.164494 26222 raft_consensus.cc:2749] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:42.167832 26211 raft_consensus.cc:3055] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:42.176359 26211 raft_consensus.cc:740] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:42.177472 26211 consensus_queue.cc:260] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:42.178784 26211 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:42.181007 26226 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:18:42.182621 26243 log.cc:927] Time spent T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:18:42.207190 26223 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:42.211009 26223 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:42.300405 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:42.302809 24316 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:18:42.311266 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:42.312703 24323 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
W20260709 12:18:42.321700 24363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.000s	sys 0.035s
W20260709 12:18:42.322378 24363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.000s	sys 0.035s
W20260709 12:18:42.081143 24397 rpcz_store.cc:269] 0709 12:18:40.496263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:40.496427 (+   164us) service_pool.cc:224] Handling call
0709 12:18:42.041344 (+1544917us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b540027ef54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:42.041519 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1011016576}
W20260709 12:18:42.324980 24395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.018s	sys 0.021s
W20260709 12:18:42.325696 24395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.018s	sys 0.021s
W20260709 12:18:42.321702 24365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.007s	sys 0.001s
W20260709 12:18:42.327586 24365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.008s	sys 0.001s
W20260709 12:18:42.321702 24364 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.031s	sys 0.054s
W20260709 12:18:42.329175 24364 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.031s	sys 0.054s
W20260709 12:18:42.325124 24391 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.002s	sys 0.001s
W20260709 12:18:42.333069 24391 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.003s	sys 0.001s
W20260709 12:18:42.340085 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.343978 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:42.345228 24391 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
W20260709 12:18:42.367584 24438 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.018s	sys 0.023s
W20260709 12:18:42.368279 24438 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.018s	sys 0.023s
I20260709 12:18:42.368072 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:42.374923 24468 raft_consensus.cc:2393] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 3: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:42.378571 25110 raft_consensus.cc:1240] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 1. Current term is 2. Ops: []
W20260709 12:18:42.382028 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:42.382858 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:42.383575 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:42.384650 25082 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.016s	sys 0.061s
W20260709 12:18:42.385138 25082 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.016s	sys 0.061s
W20260709 12:18:42.386477 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.390035 24438 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:42.397116 24365 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:42.409391 24392 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:18:42.417627 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:18:42.418810 24467 consensus_meta.cc:287] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 1.121s	user 0.010s	sys 0.014s
I20260709 12:18:42.419996 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:42.417692 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:42.431691 25084 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:42.432806 24392 raft_consensus.cc:1240] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:42.513085 25956 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:18:42.518133 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.524466 26170 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:42.525166 25117 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.003s	sys 0.018s
I20260709 12:18:42.525683 26256 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:42.526615 26258 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.526999 26161 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.528174 26221 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.517277 26188 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:42.522935 26206 consensus_queue.cc:1059] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:42.485318 24467 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:18:42.543955 26144 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:42.545224 26144 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:42.549909 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:42.550971 24468 raft_consensus.cc:2376] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4. Re-sending same reply.
I20260709 12:18:42.509896 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:18:42.551851 25117 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.004s	sys 0.018s
I20260709 12:18:42.565703 24400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1544) took 1992 ms. Trace:
I20260709 12:18:42.566293 24400 rpcz_store.cc:276] 0709 12:18:40.573191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:40.574194 (+  1003us) service_pool.cc:224] Handling call
0709 12:18:40.619911 (+ 45717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:41.273749 (+653838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.522032 (+1248283us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b54000e47d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:42.565462 (+ 43430us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1494557440}
I20260709 12:18:42.568835 26223 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:42.569970 25118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 309) took 1640 ms (client timeout 2132 ms). Trace:
I20260709 12:18:42.569730 26223 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:42.570219 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:18:42.570567 25118 rpcz_store.cc:269] 0709 12:18:40.929094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:40.929210 (+   116us) service_pool.cc:224] Handling call
0709 12:18:42.569371 (+1640161us) spinlock_profiling.cc:243] Waited 71.1 ms on lock 0x7b5400630e54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:42.569657 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163591040}
W20260709 12:18:42.571271 24474 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 1467) took 1579 ms (client timeout 2024 ms). Trace:
W20260709 12:18:42.571700 24474 rpcz_store.cc:269] 0709 12:18:41.001788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.002923 (+  1135us) service_pool.cc:224] Handling call
0709 12:18:42.569767 (+1566844us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b58001c3e98. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c3120a0 00007f4a9c311984 00007f4a9588c6d4 00007f4a9588c662
0709 12:18:42.571181 (+  1414us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9591168}
I20260709 12:18:42.534655 26256 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:42.532740 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 143103us
I20260709 12:18:42.578466 26032 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:18:42.580078 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 187754us
W20260709 12:18:42.581276 24366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.858s	user 0.029s	sys 0.040s
I20260709 12:18:42.581532 26123 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:42.582268 26194 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:42.582994 26265 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:42.548420 26144 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:18:42.588994 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.589422 26170 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:42.590050 26206 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:42.590575 24467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 1475) took 1516 ms. Trace:
I20260709 12:18:42.590764 25985 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:42.591639 26258 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:42.596901 26221 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:42.599438 26263 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:42.600591 26132 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:42.600886 26161 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:42.603395 26253 raft_consensus.cc:3055] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:42.596452 26188 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:42.605264 24471 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:42.611374 26164 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:42.613399 24289 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:42.614568 26213 log.cc:927] Time spent T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 1.715s	user 0.008s	sys 0.011s
I20260709 12:18:42.617769 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:18:42.620337 24366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.030s	sys 0.041s
I20260709 12:18:42.613399 26108 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:42.581419 26093 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:42.630645 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:18:42.634023 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.586748 26256 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:42.683009 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:42.627877 26122 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:42.680413 26265 raft_consensus.cc:697] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:42.684876 26150 consensus_queue.cc:1059] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:42.685416 26164 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:42.687638 26211 consensus_queue.cc:1048] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:18:42.704797 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.688381 26188 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:42.648676 24465 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:42.713017 26122 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:42.722054 26164 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:42.689214 26264 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:42.723176 26264 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:42.726015 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 112923us
I20260709 12:18:42.679493 26093 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.726516 24317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 175) took 2727 ms. Trace:
I20260709 12:18:42.727286 24289 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:42.693234 24397 raft_consensus.cc:1275] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:42.691962 26108 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:42.701411 24391 raft_consensus.cc:1275] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:42.682783 25084 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:42.726557 26164 raft_consensus.cc:2804] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:42.725327 26206 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:42.726781 26093 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:42.678249 26263 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:42.691371 26252 log.cc:927] Time spent T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.517s	user 0.000s	sys 0.005s
I20260709 12:18:42.729929 26122 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:42.730417 26230 raft_consensus.cc:2804] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:42.628448 24467 rpcz_store.cc:276] 0709 12:18:41.074458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.188793 (+114335us) service_pool.cc:224] Handling call
0709 12:18:42.586632 (+1397839us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:42.729737 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 106228us
I20260709 12:18:42.682315 26223 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:42.730160 26031 raft_consensus.cc:3055] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:42.738229 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:42.727347 24317 rpcz_store.cc:276] 0709 12:18:39.998826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:40.001589 (+  2763us) service_pool.cc:224] Handling call
0709 12:18:40.001924 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:40.012877 (+ 10953us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:40.012915 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:40.013512 (+   597us) log.cc:844] Serialized 26 byte log entry
0709 12:18:40.541782 (+528270us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:40.541827 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:40.541907 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:42.613227 (+2071320us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:18:42.725710 (+112483us) raft_consensus.cc:1685] finished
0709 12:18:42.725746 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:42.726146 (+   400us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10518,"raft.queue_time_us":13007,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":5323,"spinlock_wait_cycles":4939136,"thread_start_us":468611,"threads_started":1,"wal-append.queue_time_us":713027}
I20260709 12:18:42.767359 26148 raft_consensus.cc:3055] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:42.768785 26150 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:42.769750 26170 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:18:42.770748 26111 consensus_meta.cc:287] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.060s	user 0.003s	sys 0.019s
I20260709 12:18:42.771687 26146 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:42.771420 26256 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:42.774765 25116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 744) took 2013 ms. Trace:
I20260709 12:18:42.733913 26164 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.638854 26181 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:42.640991 26253 raft_consensus.cc:740] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:42.746039 26230 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.815659 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:42.806555 24473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1484) took 1537 ms. Trace:
I20260709 12:18:42.807422 26148 raft_consensus.cc:740] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:42.807899 26150 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:42.808977 26144 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.840476 26108 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:42.808619 26194 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:42.769814 24472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:42866 (request call id 20) took 1509 ms. Trace:
I20260709 12:18:42.815966 25116 rpcz_store.cc:276] 0709 12:18:40.761541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:40.761691 (+   150us) service_pool.cc:224] Handling call
0709 12:18:40.761980 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:41.811754 (+1049774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.774195 (+962441us) spinlock_profiling.cc:243] Waited 963 ms on lock 0x7b54006bb554. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:42.774535 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2215556480}
I20260709 12:18:42.805050 26031 raft_consensus.cc:740] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:42.832679 26164 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:42.872233 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:42.873241 26267 raft_consensus.cc:3055] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:42.873760 26267 raft_consensus.cc:740] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:42.874509 26224 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.874946 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:42.875185 26224 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:42.877538 26224 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:42.877332 26031 consensus_queue.cc:260] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:42.878585 26031 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:42.880064 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:42.837882 26256 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:42.846105 24473 rpcz_store.cc:276] 0709 12:18:41.269226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.269387 (+   161us) service_pool.cc:224] Handling call
0709 12:18:41.508343 (+238956us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:41.555842 (+ 47499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:41.555868 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:41.555903 (+    35us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:41.555932 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.775499 (+1219567us) spinlock_profiling.cc:243] Waited 47.2 ms on lock 0x7b540010f254. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:42.775564 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:42.806009 (+ 30445us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b540010f250. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:42.806272 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":499,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":56406,"spinlock_wait_cycles":607211648}
I20260709 12:18:42.866897 26161 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:42.868808 26181 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:42.768870 26259 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:42.872488 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:42.875383 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:42.853418 24474 raft_consensus.cc:1240] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:42.847803 26230 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:42.839785 26129 consensus_meta.cc:287] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.963s	user 0.014s	sys 0.003s
I20260709 12:18:42.861563 24472 rpcz_store.cc:276] 0709 12:18:41.260486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.260724 (+   238us) service_pool.cc:224] Handling call
0709 12:18:42.769336 (+1508612us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b540010f254. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a97346853 00007f4a9c31460a 00007f4a9589a7d4 00007f4a9589a762 00007f4a9589a691 00007f4a9589a60c 00007f4a958998c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:42.769565 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":564006784}
I20260709 12:18:42.894304 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1585) took 1566 ms. Trace:
I20260709 12:18:42.881383 26265 consensus_queue.cc:237] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:42.897725 26148 consensus_queue.cc:260] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:42.886547 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 159375us
I20260709 12:18:42.869935 26253 consensus_queue.cc:260] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:42.874956 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:18:42.889703 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.861083 26111 raft_consensus.cc:2749] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:42.894629 24474 rpcz_store.cc:276] 0709 12:18:41.324523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.805856 (+1481333us) service_pool.cc:224] Handling call
0709 12:18:42.806440 (+   584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:42.890621 (+ 84181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.890767 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:42.982057 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:43.047108 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:18:43.107200 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.889469 26181 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:43.441287 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 265694us
I20260709 12:18:42.979791 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:43.026502 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:42.980185 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:42.974716 24466 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:18:42.898443 24316 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:42.899017 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:43.110586 24399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2030) took 1739 ms. Trace:
W20260709 12:18:43.448122 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.978935 24395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1561) took 1481 ms. Trace:
W20260709 12:18:42.956061 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:43.457043 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:43.457957 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.982750 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:43.053390 24321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 182) took 2201 ms. Trace:
I20260709 12:18:42.899417 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:43.061944 24325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44278 (request call id 1974) took 1629 ms. Trace:
W20260709 12:18:43.034618 24366 connection.cc:256] RPC call timeout handler was delayed by -1.1882058629998937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
W20260709 12:18:43.059258 24471 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 1464) took 2078 ms (client timeout 2012 ms). Trace:
I20260709 12:18:43.452832 24320 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
W20260709 12:18:43.425868 24465 consensus_meta.cc:287] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.713s	user 0.010s	sys 0.003s
W20260709 12:18:43.384785 26164 consensus_meta.cc:287] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.514s	user 0.013s	sys 0.000s
I20260709 12:18:43.453320 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:42.890095 26144 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:43.456060 24399 rpcz_store.cc:276] 0709 12:18:41.371083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.372743 (+  1660us) service_pool.cc:224] Handling call
0709 12:18:41.373112 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:41.538078 (+164966us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:41.538126 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:41.538196 (+    70us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:41.538250 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.110009 (+1571759us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54000cdd54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:43.110096 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:43.110380 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":378737408}
I20260709 12:18:43.487910 24474 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:42.899333 24467 raft_consensus.cc:1275] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:43.481619 26269 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:43.359246 26068 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:43.501631 25116 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:18:43.482764 24324 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:43.465611 24325 rpcz_store.cc:276] 0709 12:18:41.431942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.458734 (+ 26792us) service_pool.cc:224] Handling call
0709 12:18:41.459051 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:41.556378 (+ 97327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.061341 (+1504963us) spinlock_profiling.cc:243] Waited 50.1 ms on lock 0x7b540019f854. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:43.061689 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115138304}
I20260709 12:18:43.483338 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:18:42.974114 26258 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:43.335578 25113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 344) took 1826 ms. Trace:
I20260709 12:18:43.091145 26150 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:43.484746 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:43.316233 26146 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:43.358924 26238 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:42.897987 26206 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:43.190973 25082 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:43.492484 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:43.487056 26164 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:43.010360 26264 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:18:42.898972 26139 consensus_meta.cc:287] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.566s	user 0.011s	sys 0.007s
W20260709 12:18:43.493355 24366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:43.540320 24366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.539876 26238 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:43.541926 24319 raft_consensus.cc:1275] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:18:43.542348 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.065382 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:43.483886 26202 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:43.466969 24471 rpcz_store.cc:269] 0709 12:18:40.980904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:40.995089 (+ 14185us) service_pool.cc:224] Handling call
0709 12:18:43.058953 (+2063864us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b5400200dd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:43.059171 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3699779328}
I20260709 12:18:43.204337 26128 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:43.070206 26251 log.cc:927] Time spent T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.907s	user 0.002s	sys 0.000s
I20260709 12:18:43.104650 26171 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.556409 24317 raft_consensus.cc:2393] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 3: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:18:43.459712 26181 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:42.979924 26262 log.cc:927] Time spent T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.805s	user 0.004s	sys 0.000s
I20260709 12:18:43.507071 26254 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:42.933832 26114 consensus_meta.cc:287] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.798s	user 0.013s	sys 0.006s
I20260709 12:18:43.508574 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:42.977712 26232 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:42.979094 26221 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:43.328446 26153 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.569036 26153 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:43.570119 26239 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:43.570538 26239 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:43.570941 26239 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:43.571771 26153 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:43.185437 26188 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:43.310364 26170 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:43.094537 26106 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:43.090394 26212 raft_consensus.cc:3055] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:43.507189 26068 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:43.513890 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:43.514804 24472 raft_consensus.cc:2393] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 3: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:43.515219 26169 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:43.579406 26232 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:43.579746 26169 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:43.581476 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:43.582029 26232 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:43.582178 24472 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:43.582547 26169 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:43.515875 26269 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:43.583112 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:43.583878 24472 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:43.583959 24394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1559) took 2086 ms. Trace:
I20260709 12:18:43.333680 26108 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:43.572613 26188 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:43.585393 26269 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:43.011092 26132 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:43.586539 26132 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:43.586912 26068 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:43.100425 26256 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:43.588651 25119 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
I20260709 12:18:43.589030 26256 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:43.590612 25115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 749) took 1774 ms. Trace:
W20260709 12:18:43.591017 26230 consensus_meta.cc:287] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.657s	user 0.011s	sys 0.001s
I20260709 12:18:43.591343 26256 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:18:43.531116 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.977481 26259 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:43.592550 24466 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:43.591615 26230 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:43.593434 26098 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:43.593647 26123 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.593974 26259 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:43.531528 26263 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:43.594170 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:43.594465 26123 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:43.594872 24392 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:43.531714 24473 raft_consensus.cc:2393] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 2: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:43.051947 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:43.067453 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:43.532181 26146 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:43.533511 26265 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.534096 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:43.535010 24467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1486) took 2195 ms. Trace:
I20260709 12:18:43.602492 24316 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:18:43.602720 24467 rpcz_store.cc:276] 0709 12:18:41.335063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.847720 (+1512657us) service_pool.cc:224] Handling call
0709 12:18:42.898677 (+ 50957us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:43.495059 (+596382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.530447 (+ 35388us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:43.603693 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:43.604056 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:43.217885 26093 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:43.479014 24465 raft_consensus.cc:2468] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
W20260709 12:18:43.606433 24465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 1502) took 1518 ms (client timeout 1946 ms). Trace:
I20260709 12:18:43.606336 26265 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:43.063287 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:18:43.537406 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:43.578339 26261 log.cc:927] Time spent T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 1.083s	user 0.009s	sys 0.010s
I20260709 12:18:43.457070 24395 rpcz_store.cc:276] 0709 12:18:41.497943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.499359 (+  1416us) service_pool.cc:224] Handling call
0709 12:18:41.499805 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:41.500179 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:41.500209 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:41.511147 (+ 10938us) log.cc:844] Serialized 26 byte log entry
0709 12:18:42.326569 (+815422us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:42.326741 (+   172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.326921 (+   180us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:42.690292 (+363371us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:18:42.978505 (+288213us) raft_consensus.cc:1685] finished
0709 12:18:42.978531 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:42.978853 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":505,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":24583,"spinlock_wait_cycles":718723712,"thread_start_us":768058,"threads_started":1,"wal-append.queue_time_us":636978}
I20260709 12:18:42.897814 26267 consensus_queue.cc:260] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:43.546331 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:43.546970 26266 consensus_queue.cc:1048] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:18:43.546098 24400 raft_consensus.cc:2955] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:43.548389 25083 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:43.549125 26264 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:43.549230 26150 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.629451 25117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 746) took 2074 ms. Trace:
I20260709 12:18:43.629716 26150 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:43.546345 26238 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:43.550940 26206 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.631057 26206 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:43.632153 26150 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:43.632541 26093 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:43.632754 26269 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.633210 26206 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:43.518267 26144 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:43.057739 26194 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:43.633389 26269 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:43.636193 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 88166.4us
W20260709 12:18:43.557971 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 407996us
I20260709 12:18:43.558557 24324 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:18:43.560684 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:43.555446 26258 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.558845 24393 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:43.597167 26212 raft_consensus.cc:740] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:43.562592 26202 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:43.565310 24440 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:43.565874 26128 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:43.567173 26221 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:43.648974 26194 raft_consensus.cc:2749] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:43.649155 26230 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:43.648368 26093 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:43.561578 24323 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:43.651237 24323 raft_consensus.cc:1240] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:43.651652 26202 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:43.554950 26164 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:43.653580 24396 raft_consensus.cc:1240] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:43.653270 26082 raft_consensus.cc:2955] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:43.557575 26253 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:43.656841 24323 raft_consensus.cc:1275] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:43.575508 26170 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:43.661465 24472 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:18:43.662637 26170 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:43.576434 26254 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:18:43.572763 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:43.664739 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:43.517100 26137 raft_consensus.cc:3055] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:43.669011 25116 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:18:43.589601 26209 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:43.669874 25118 raft_consensus.cc:2393] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 2: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:18:43.507602 25113 rpcz_store.cc:276] 0709 12:18:41.502843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.504497 (+  1654us) service_pool.cc:224] Handling call
0709 12:18:42.808206 (+1303709us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b5800004598. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c325fc0 00007f4a9c310929 00007f4a9c3103d2 00007f4a95887bd4
0709 12:18:42.838262 (+ 30056us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:42.838750 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:42.838802 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:42.839624 (+   822us) log.cc:844] Serialized 26 byte log entry
0709 12:18:43.050196 (+210572us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:43.093791 (+ 43595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.094173 (+   382us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:43.286752 (+192579us) raft_consensus.cc:1685] finished
0709 12:18:43.286784 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:43.321776 (+ 34992us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7316608,"thread_start_us":188257,"threads_started":1,"wal-append.queue_time_us":363499}
W20260709 12:18:43.592662 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 54687.7us
I20260709 12:18:43.672621 26031 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:43.673882 24290 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:43.673774 26031 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:43.596235 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:43.676010 24473 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:43.669234 26137 raft_consensus.cc:740] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:43.677484 26137 consensus_queue.cc:260] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:43.666664 26093 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:43.681217 26093 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:43.681308 26254 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:18:43.689881 26128 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:43.590971 25115 rpcz_store.cc:276] 0709 12:18:41.816153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.816415 (+   262us) service_pool.cc:224] Handling call
0709 12:18:41.819381 (+  2966us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:41.873465 (+ 54084us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:41.873514 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:41.873581 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:41.873643 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.590185 (+1716542us) spinlock_profiling.cc:243] Waited 53.7 ms on lock 0x7b540048ce54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:43.590248 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:43.590430 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123510016}
I20260709 12:18:43.573225 26171 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:43.602226 24318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44278 (request call id 1963) took 2185 ms. Trace:
I20260709 12:18:43.699627 24318 rpcz_store.cc:276] 0709 12:18:41.416812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.436561 (+ 19749us) service_pool.cc:224] Handling call
0709 12:18:41.436880 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:41.693869 (+256989us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.601769 (+1907900us) spinlock_profiling.cc:243] Waited 82.3 ms on lock 0x7b540001d454. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:43.602049 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189227392}
I20260709 12:18:43.602099 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:18:43.696833 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.544202 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:18:43.620247 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.463430 24321 rpcz_store.cc:276] 0709 12:18:40.852802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:40.852940 (+   138us) service_pool.cc:224] Handling call
0709 12:18:40.853368 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:40.948925 (+ 95557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:40.948965 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:40.949006 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:40.949034 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.052783 (+2103749us) spinlock_profiling.cc:243] Waited 95.3 ms on lock 0x7b5400167454. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:43.052904 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:43.053185 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219270528}
I20260709 12:18:43.694389 24468 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:43.613188 24365 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:43.607000 24465 rpcz_store.cc:269] 0709 12:18:42.087699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.454858 (+367159us) service_pool.cc:224] Handling call
0709 12:18:43.606370 (+1151512us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:43.622642 24397 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:18:43.584374 24394 rpcz_store.cc:276] 0709 12:18:41.497291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.500142 (+  2851us) service_pool.cc:224] Handling call
0709 12:18:41.527344 (+ 27202us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:41.527824 (+   480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:41.527866 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:41.528495 (+   629us) log.cc:844] Serialized 26 byte log entry
0709 12:18:41.867892 (+339397us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:41.867940 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:41.868018 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:43.069229 (+1201211us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:18:43.583457 (+514228us) raft_consensus.cc:1685] finished
0709 12:18:43.583486 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:43.583764 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1334,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":11404,"spinlock_wait_cycles":721558784,"thread_start_us":338804,"threads_started":1,"wal-append.queue_time_us":603621}
I20260709 12:18:43.617305 26263 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.625305 26267 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:43.597348 26132 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:43.625573 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:43.626644 25112 raft_consensus.cc:2393] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 3: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:18:43.709997 26254 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:43.633560 25110 raft_consensus.cc:2393] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 6: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:18:43.554670 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:43.629969 25117 rpcz_store.cc:276] 0709 12:18:41.700382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.700648 (+   266us) service_pool.cc:224] Handling call
0709 12:18:41.701050 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:41.701802 (+   752us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:41.701834 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:41.702712 (+   878us) log.cc:844] Serialized 26 byte log entry
0709 12:18:42.579150 (+876438us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:42.579317 (+   167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.579518 (+   201us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:43.518056 (+938538us) spinlock_profiling.cc:243] Waited 5.89 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:18:43.626751 (+108695us) raft_consensus.cc:1685] finished
0709 12:18:43.626771 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:43.629369 (+  2598us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18846,"raft.queue_time_us":4978,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":32087,"spinlock_wait_cycles":13548416,"thread_start_us":747833,"threads_started":1,"wal-append.queue_time_us":769632}
I20260709 12:18:43.602751 26188 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:43.555524 26148 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:43.638865 26124 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.640302 25083 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:43.608899 26106 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.642580 24319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 193) took 1724 ms. Trace:
I20260709 12:18:43.643249 26258 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:43.613308 26146 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:43.614500 26265 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:43.614238 26123 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:43.649518 26221 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:43.651762 26212 consensus_queue.cc:260] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:43.653201 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:43.568153 26101 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:43.584856 26108 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:43.649180 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 162261us
I20260709 12:18:43.662673 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:43.573123 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:43.671285 26264 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:43.681892 26111 raft_consensus.cc:2764] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:18:43.616545 24474 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:18:43.705958 24473 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:18:43.705958 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:43.702139 24325 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
W20260709 12:18:43.707860 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 97354.5us
I20260709 12:18:43.745023 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:43.682786 26031 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:43.616608 24289 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:43.712114 26278 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:43.713476 26139 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:18:43.714087 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.705888 26169 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.713884 26263 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:43.717226 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:18:43.755296 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 138761us
I20260709 12:18:43.718250 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:43.718333 24290 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:43.709631 26269 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:43.724436 26164 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.724427 24319 rpcz_store.cc:276] 0709 12:18:41.917913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.927342 (+  9429us) service_pool.cc:224] Handling call
0709 12:18:41.927712 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:43.542452 (+1614740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.642254 (+ 99802us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b5400103954. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:43.642514 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3710820736}
I20260709 12:18:43.720368 26254 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:43.765969 26171 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:43.769938 26272 raft_consensus.cc:2804] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:43.729403 24392 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:43.772228 24324 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:43.737339 24440 leader_election.cc:400] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 2. Current term is 3.
I20260709 12:18:43.733253 24471 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:43.773497 24440 leader_election.cc:403] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:18:43.739117 26108 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:43.727522 26106 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:43.739534 26101 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:43.774713 26164 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:43.784411 26101 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:43.729357 26124 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:43.785439 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 1503) took 1413 ms. Trace:
I20260709 12:18:43.738523 24472 raft_consensus.cc:2393] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 2: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:43.738013 26221 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:43.729562 26211 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.732255 26212 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:43.729025 26222 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.746897 24438 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:43.728399 26128 raft_consensus.cc:2749] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:43.756461 24466 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:43.758148 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 117955us
I20260709 12:18:43.759992 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:43.761021 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:43.761224 26264 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:43.762080 26258 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:43.810894 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:43.812409 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:43.813094 24472 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:43.814266 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:43.814911 24472 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:18:43.815898 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:43.762759 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:43.763132 24469 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:43.763657 26173 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.763360 26278 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:43.765969 26263 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:18:43.768886 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.768759 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:43.770305 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:43.775370 26272 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:43.774938 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2042) took 1157 ms. Trace:
I20260709 12:18:43.771864 26254 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:43.780100 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:43.780474 24467 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:43.781214 26106 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:43.782171 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:43.786994 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:43.787629 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:43.798060 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:43.785909 24468 rpcz_store.cc:276] 0709 12:18:42.372326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.732954 (+360628us) service_pool.cc:224] Handling call
0709 12:18:43.785259 (+1052305us) spinlock_profiling.cc:243] Waited 832 ms on lock 0x7b54002bb1d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:43.785375 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1913575680}
I20260709 12:18:43.821448 24319 raft_consensus.cc:1275] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:43.831453 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:43.810680 26111 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:43.767524 26169 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:43.817391 24322 raft_consensus.cc:1240] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:43.817521 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:18:43.817596 24469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 1459) took 2842 ms (client timeout 1693 ms). Trace:
I20260709 12:18:43.818265 24470 raft_consensus.cc:1275] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:43.822366 24399 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
W20260709 12:18:43.822410 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 75619.8us
I20260709 12:18:43.822073 24473 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:43.837148 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:43.837857 24473 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:18:43.839324 26093 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:43.840524 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:43.845927 24473 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:18:43.845988 26181 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:43.853083 26124 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:43.853430 24397 raft_consensus.cc:2410] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:18:43.854650 24324 raft_consensus.cc:1275] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:43.855770 24470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1485) took 2558 ms. Trace:
I20260709 12:18:43.858441 26082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:33182 (request call id 11) took 4378 ms. Trace:
I20260709 12:18:43.858886 26169 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:43.833086 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:43.833024 24474 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:43.838783 24291 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:43.861374 24396 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:43.839965 24318 raft_consensus.cc:1240] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:43.822230 24393 raft_consensus.cc:2393] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 3: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:43.809028 26253 raft_consensus.cc:2749] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 2. Current term is 3.
I20260709 12:18:43.842396 26264 raft_consensus.cc:2804] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:43.868781 24474 raft_consensus.cc:1240] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:43.869309 26093 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:43.869472 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1590) took 2346 ms. Trace:
I20260709 12:18:43.869881 26264 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:43.840859 24471 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:43.820770 26211 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:43.826152 26272 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:43.795974 26139 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:43.835899 24469 rpcz_store.cc:269] 0709 12:18:40.974963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:40.987854 (+ 12891us) service_pool.cc:224] Handling call
0709 12:18:43.817330 (+2829476us) spinlock_profiling.cc:243] Waited 2.62 s on lock 0x7b54002bc0d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:43.817465 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6022457216}
I20260709 12:18:43.817852 26173 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:43.847198 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:43.820428 26278 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:43.848310 26106 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:43.848722 24465 raft_consensus.cc:2393] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 2: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:43.848557 26137 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:43.849352 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.849866 25083 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:43.822716 24391 rpcz_store.cc:276] 0709 12:18:42.617945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.618125 (+   180us) service_pool.cc:224] Handling call
0709 12:18:42.618616 (+   491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:42.729055 (+110439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.774700 (+1045645us) spinlock_profiling.cc:243] Waited 79.8 ms on lock 0x7b54002085d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:43.774882 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183577984}
I20260709 12:18:43.821233 26222 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:43.861276 24468 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:43.816519 24472 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:18:43.860991 26164 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:43.866206 24322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44278 (request call id 1976) took 2428 ms. Trace:
I20260709 12:18:43.866493 26068 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.867224 24319 raft_consensus.cc:1240] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:43.856171 24470 rpcz_store.cc:276] 0709 12:18:41.299436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.299884 (+   448us) service_pool.cc:224] Handling call
0709 12:18:43.817749 (+2517865us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:43.836011 (+ 18262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.855549 (+ 19538us) spinlock_profiling.cc:243] Waited 2.52 s on lock 0x7b54002bc0d0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:43.855688 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5789321984}
I20260709 12:18:43.880255 24392 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:43.880909 24466 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:43.889925 24471 raft_consensus.cc:1240] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:43.883133 24473 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:43.870654 26264 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:43.889358 24291 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:43.993881 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:43.994078 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:18:43.990859 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 141087us
W20260709 12:18:43.836820 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 69399.9us
W20260709 12:18:43.991679 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.890069 24316 raft_consensus.cc:2393] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 5: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:18:43.901666 24320 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:43.869974 24474 rpcz_store.cc:276] 0709 12:18:41.523087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.868143 (+2345056us) service_pool.cc:224] Handling call
0709 12:18:43.868553 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:43.869190 (+   637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.869379 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:43.994153 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1488) took 2161 ms. Trace:
I20260709 12:18:43.998541 24471 rpcz_store.cc:276] 0709 12:18:41.833196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.889337 (+2056141us) service_pool.cc:224] Handling call
0709 12:18:43.889737 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:43.993886 (+104149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.994095 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:43.985911 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.995278 24469 raft_consensus.cc:1240] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 1. Current term is 2. Ops: []
W20260709 12:18:43.916770 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:43.999010 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 261404us
I20260709 12:18:43.994758 25119 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:44.000114 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1591) took 2368 ms. Trace:
I20260709 12:18:44.001209 26231 raft_consensus.cc:2804] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:44.001453 26169 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.001796 26231 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.002331 26231 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:44.002060 26169 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:43.891619 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:18:44.004045 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.000499 24469 rpcz_store.cc:276] 0709 12:18:41.631627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.877493 (+2245866us) service_pool.cc:224] Handling call
0709 12:18:43.995111 (+117618us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:43.999849 (+  4738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.000054 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:44.006163 25118 raft_consensus.cc:2393] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 3: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
W20260709 12:18:44.000921 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.949700 26124 raft_consensus.cc:2804] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:44.006076 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:43.990213 24322 rpcz_store.cc:276] 0709 12:18:41.432765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.677098 (+2244333us) service_pool.cc:224] Handling call
0709 12:18:43.677553 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:43.837325 (+159772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.860779 (+ 23454us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54000a8554. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:43.860976 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320697088}
I20260709 12:18:44.010332 24472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 327) took 1141 ms. Trace:
I20260709 12:18:43.966514 26139 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:43.891561 26181 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:43.891726 26211 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:43.893352 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:43.947479 26239 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:44.322547 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.015327 24473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 325) took 1147 ms. Trace:
W20260709 12:18:44.405874 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:44.611534 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.897573 24217 catalog_manager.cc:5697] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 2 to 3, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 3 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:44.021390 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 332) took 1150 ms. Trace:
I20260709 12:18:44.011916 24472 rpcz_store.cc:276] 0709 12:18:42.868816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.996477 (+1127661us) service_pool.cc:224] Handling call
0709 12:18:44.008426 (+ 11949us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:44.009965 (+  1539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:44.009993 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:44.010041 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:44.010076 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.010141 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:44.010245 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:44.067461 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:44.088508 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:18:44.110579 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 62812.8us
I20260709 12:18:44.528115 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:18:44.608695 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 890346us
W20260709 12:18:44.611574 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.613853 24393 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:44.016175 24321 raft_consensus.cc:1275] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:44.615175 24400 raft_consensus.cc:2393] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 3: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:18:44.610882 24473 rpcz_store.cc:276] 0709 12:18:42.867781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.996411 (+1128630us) service_pool.cc:224] Handling call
0709 12:18:43.996745 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:44.014980 (+ 18235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:44.015011 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:44.015067 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:44.015105 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.015163 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:44.015267 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:44.077839 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.014087 24469 raft_consensus.cc:1275] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:44.015324 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:44.613237 24474 rpcz_store.cc:276] 0709 12:18:42.870880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.999158 (+1128278us) service_pool.cc:224] Handling call
0709 12:18:44.012789 (+ 13631us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:44.020950 (+  8161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:44.020992 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:44.021060 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:44.021109 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.021188 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:44.021320 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:44.017335 24470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 331) took 1146 ms. Trace:
I20260709 12:18:44.388813 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:44.017897 25115 raft_consensus.cc:2393] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 3: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:18:44.038388 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 333) took 1167 ms. Trace:
W20260709 12:18:44.618919 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:44.055501 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 166324us
W20260709 12:18:44.617303 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.246344 24316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 1524) took 1150 ms. Trace:
I20260709 12:18:44.618816 24471 rpcz_store.cc:276] 0709 12:18:42.871267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.999584 (+1128317us) service_pool.cc:224] Handling call
0709 12:18:44.011688 (+ 12104us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:44.016334 (+  4646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:44.016382 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:44.037878 (+ 21496us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:44.037952 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.038060 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:44.038258 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:44.614306 24289 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:44.092738 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.617651 24470 rpcz_store.cc:276] 0709 12:18:42.870477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.999129 (+1128652us) service_pool.cc:224] Handling call
0709 12:18:44.011109 (+ 11980us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:44.016921 (+  5812us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:44.016954 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:44.017009 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:44.017058 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.017115 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:44.017262 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:44.621088 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:44.619941 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.610008 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:44.618898 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 334) took 1747 ms. Trace:
I20260709 12:18:44.622390 24399 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 1.
I20260709 12:18:43.858911 26082 rpcz_store.cc:276] 0709 12:18:39.480439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.485282 (+  4843us) service_pool.cc:224] Handling call
0709 12:18:39.620776 (+135494us) log.cc:844] Serialized 513 byte log entry
0709 12:18:43.835574 (+4214798us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2816,"raft.queue_time_us":5631,"raft.run_cpu_time_us":1651,"raft.run_wall_time_us":1650,"thread_start_us":23134,"threads_started":1,"wal-append.queue_time_us":23433,"wal-append.run_cpu_time_us":2132,"wal-append.run_wall_time_us":1087683}
I20260709 12:18:44.622676 24469 rpcz_store.cc:276] 0709 12:18:42.883464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.006948 (+1123484us) service_pool.cc:224] Handling call
0709 12:18:44.012974 (+  6026us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:44.618609 (+605635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.618838 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:44.092435 25082 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.686s (SENT) [suppressed 32 similar messages]
I20260709 12:18:44.629755 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:18:44.197726 26282 log.cc:927] Time spent T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 12:18:44.638368 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:44.640867 24472 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:44.640259 24468 raft_consensus.cc:1275] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:44.641870 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1594) took 1397 ms. Trace:
I20260709 12:18:44.642192 24468 rpcz_store.cc:276] 0709 12:18:43.293355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.069876 (+776521us) service_pool.cc:224] Handling call
0709 12:18:44.630038 (+560162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:44.641603 (+ 11565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.641814 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:44.068769 26242 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.322913 24467 raft_consensus.cc:1240] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:44.643224 24392 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:18:44.014633 26164 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:44.620615 24316 rpcz_store.cc:276] 0709 12:18:43.095671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.625187 (+529516us) service_pool.cc:224] Handling call
0709 12:18:44.246031 (+620844us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54002dbc54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:44.246257 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":382461184}
I20260709 12:18:44.644433 24290 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:44.097154 26173 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:44.645658 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:44.646728 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:44.648351 25114 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:44.648552 26227 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:44.663489 24398 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 1.
I20260709 12:18:44.629040 26139 raft_consensus.cc:2804] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:18:44.654911 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.372306 26224 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:44.644168 24394 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:44.644953 24217 catalog_manager.cc:5697] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 2 to 3, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 3 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:44.597116 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 335) took 1592 ms. Trace:
I20260709 12:18:44.660867 24469 raft_consensus.cc:1275] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:44.011987 26068 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:44.629225 25110 raft_consensus.cc:2468] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:44.661242 24472 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:18:44.239588 26124 raft_consensus.cc:697] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:18:44.662680 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 612140us
I20260709 12:18:44.663641 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:44.666134 24470 raft_consensus.cc:1275] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:44.666415 24289 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:44.667513 24473 raft_consensus.cc:1240] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:44.629001 26137 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.667646 24474 raft_consensus.cc:1275] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:44.689111 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1595) took 1324 ms. Trace:
I20260709 12:18:44.689467 24474 rpcz_store.cc:276] 0709 12:18:43.365030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.656684 (+1291654us) service_pool.cc:224] Handling call
0709 12:18:44.665188 (+  8504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:44.688843 (+ 23655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.689055 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:44.690634 24395 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:18:44.674242 26212 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:44.674409 26242 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:44.686614 26173 raft_consensus.cc:2804] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:44.694015 26169 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:44.668424 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 337) took 1117 ms. Trace:
I20260709 12:18:44.039953 26106 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:44.691991 26212 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:44.698211 26106 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:44.698505 26212 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:44.698834 26106 consensus_queue.cc:1048] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:44.702582 25114 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:44.183144 26254 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:44.665066 26227 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:44.670768 24217 catalog_manager.cc:5697] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 2 to 3, leader changed from d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 3 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:44.685269 24290 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:44.685705 26093 consensus_queue.cc:1048] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:44.696029 24471 rpcz_store.cc:276] 0709 12:18:43.550888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.641980 (+1091092us) service_pool.cc:224] Handling call
0709 12:18:44.664298 (+ 22318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:44.664445 (+   147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:44.664460 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:44.668159 (+  3699us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:44.668206 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.668265 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:44.668371 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:44.678872 24470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1612) took 1137 ms. Trace:
I20260709 12:18:44.683976 26222 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:44.691882 26137 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:44.670886 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1602) took 1303 ms. Trace:
I20260709 12:18:44.707613 24440 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:44.708307 24469 rpcz_store.cc:276] 0709 12:18:43.367802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.654616 (+1286814us) service_pool.cc:224] Handling call
0709 12:18:44.656817 (+  2201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:44.670626 (+ 13809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.670828 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:44.702934 24365 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:44.687803 24473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 336) took 1137 ms. Trace:
I20260709 12:18:44.709451 24473 rpcz_store.cc:276] 0709 12:18:43.550505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.641924 (+1091419us) service_pool.cc:224] Handling call
0709 12:18:44.642218 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:44.687523 (+ 45305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.687734 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:44.705694 24470 rpcz_store.cc:276] 0709 12:18:43.540903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.641421 (+1100518us) service_pool.cc:224] Handling call
0709 12:18:44.665832 (+ 24411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:44.678282 (+ 12450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.678492 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:44.705962 24217 catalog_manager.cc:5697] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 1 to 2, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 2 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:44.678369 24467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1489) took 2841 ms. Trace:
I20260709 12:18:44.667619 26139 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:44.711817 26272 consensus_meta.cc:287] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.815s	user 0.008s	sys 0.004s
W20260709 12:18:44.714157 26264 consensus_meta.cc:287] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.707s	user 0.011s	sys 0.000s
I20260709 12:18:44.715819 26254 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:44.718608 26239 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:44.672247 26224 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:44.750489 25114 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35194 (request call id 355) took 1688 ms (client timeout 2131 ms). Trace:
I20260709 12:18:44.725831 24365 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:44.727289 24217 catalog_manager.cc:5697] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 1 to 2, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 2 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:44.725935 24467 rpcz_store.cc:276] 0709 12:18:41.833531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.993659 (+2160128us) service_pool.cc:224] Handling call
0709 12:18:44.231384 (+237725us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:44.662233 (+430849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.675048 (+ 12815us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:44.729828 24440 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:44.730269 26137 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:44.732847 26082 raft_consensus.cc:2749] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:44.670143 24465 rpcz_store.cc:276] 0709 12:18:42.966778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.022495 (+1055717us) service_pool.cc:224] Handling call
0709 12:18:44.321553 (+299058us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:44.372659 (+ 51106us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:44.387593 (+ 14934us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:44.425762 (+ 38169us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:44.449630 (+ 23868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.463608 (+ 13978us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:44.498803 (+ 35195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:44.736569 26212 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:44.737443 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:44.759686 24397 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:44.759770 24395 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:18:44.757377 24217 catalog_manager.cc:5697] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 1 to 2, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:18:44.737598 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:44.760725 24391 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:44.737913 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:18:44.727555 26231 consensus_meta.cc:287] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.725s	user 0.010s	sys 0.003s
I20260709 12:18:44.738140 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:44.737470 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:44.761596 26231 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:44.739144 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:44.761741 24393 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:44.746129 26222 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.767184 25112 raft_consensus.cc:1240] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 2. Current term is 4. Ops: []
I20260709 12:18:44.767464 26222 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:44.751323 26224 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:44.769619 26222 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:44.769632 26212 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:44.771168 24440 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:44.772236 26267 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:44.772984 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:44.748287 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:44.774184 26068 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:44.774597 24394 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 1.
I20260709 12:18:44.673954 26124 consensus_queue.cc:237] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:44.775324 26082 consensus_queue.cc:1059] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:44.776825 26253 raft_consensus.cc:3055] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:44.777303 26253 raft_consensus.cc:740] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:44.778496 26253 consensus_queue.cc:260] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:44.779584 24391 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:18:44.747514 26181 raft_consensus.cc:2749] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:44.746825 26227 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:44.769958 26224 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:44.764721 24217 catalog_manager.cc:5697] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 1 to 2, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 2 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:44.766700 26231 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:44.773097 26267 raft_consensus.cc:2749] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:18:44.750928 25114 rpcz_store.cc:269] 0709 12:18:43.061810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.062684 (+   874us) service_pool.cc:224] Handling call
0709 12:18:44.750296 (+1687612us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540072f454. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:44.750426 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2353377664}
I20260709 12:18:44.764767 24395 raft_consensus.cc:1275] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:44.726481 26139 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:44.772902 26242 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:44.790688 26224 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.751761 26272 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:44.755717 26264 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:44.802759 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 92809us
I20260709 12:18:44.799046 26254 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:44.806146 24365 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:44.802536 26224 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:44.809649 24466 raft_consensus.cc:1240] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 2. Current term is 3. Ops: []
W20260709 12:18:44.809686 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 124585us
I20260709 12:18:44.813818 26253 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:44.817515 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.818202 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 330) took 1948 ms. Trace:
I20260709 12:18:44.818559 24466 rpcz_store.cc:276] 0709 12:18:42.870118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.997687 (+1127569us) service_pool.cc:224] Handling call
0709 12:18:43.997899 (+   212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:44.810302 (+812403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.817952 (+  7650us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b5400150ed4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:44.818133 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1866457856}
I20260709 12:18:44.820039 24365 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:44.822328 24290 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:44.811723 26254 raft_consensus.cc:697] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:44.823232 26291 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:18:44.828486 24271 auto_rebalancer.cc:629] Failed to schedule move for tablet f3d18ca89df84c1ba95edb6284f7a8fb: Illegal state: Replica 99b8650fa8324ac2ac5f75eee9b1a1e3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:18:44.830893 26272 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:44.833601 24440 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:44.835016 24440 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:44.835662 24290 connection.cc:256] RPC call timeout handler was delayed by -1.4248828839999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18810000000000002s for a response
W20260709 12:18:44.836573 24290 connection.cc:256] RPC call timeout handler was delayed by -1.3663828839999042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
W20260709 12:18:44.836891 24290 connection.cc:256] RPC call timeout handler was delayed by -1.3259217109998644s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
W20260709 12:18:44.837460 24290 connection.cc:256] RPC call timeout handler was delayed by -1.3168828840000515s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2001s for a response
W20260709 12:18:44.837792 24290 connection.cc:256] RPC call timeout handler was delayed by -1.306082884000034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2013s for a response
I20260709 12:18:44.838778 26267 raft_consensus.cc:2749] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:18:44.838491 24290 connection.cc:256] RPC call timeout handler was delayed by -1.2547828839999511s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
W20260709 12:18:44.840116 24290 connection.cc:256] RPC call timeout handler was delayed by -1.2475828839999394s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20779999999999998s for a response
W20260709 12:18:44.840657 24290 connection.cc:256] RPC call timeout handler was delayed by -1.1692828840000402s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21650000000000003s for a response
W20260709 12:18:44.841195 24290 connection.cc:256] RPC call timeout handler was delayed by -1.1053828839999369s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22360000000000002s for a response
I20260709 12:18:44.839709 26272 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:18:44.875988 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:44.879635 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 787129us
I20260709 12:18:44.881417 26296 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:18:44.882004 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 237954us
I20260709 12:18:44.837939 26288 raft_consensus.cc:2749] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:44.890631 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1613) took 1304 ms. Trace:
I20260709 12:18:44.836349 26124 raft_consensus.cc:2749] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:44.894943 24366 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:44.891083 24468 rpcz_store.cc:276] 0709 12:18:43.578891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.642754 (+1063863us) service_pool.cc:224] Handling call
0709 12:18:44.668504 (+ 25750us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:44.880561 (+212057us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:44.880604 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:44.881945 (+  1341us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:44.882007 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.883316 (+  1309us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:44.883486 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22004,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":117,"thread_start_us":207572,"threads_started":1}
W20260709 12:18:44.892830 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:44.900898 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:44.902330 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 67461.2us
W20260709 12:18:44.904642 24396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.000s	sys 0.012s
W20260709 12:18:44.926605 24396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.000s	sys 0.013s
W20260709 12:18:44.901396 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.898394 26296 raft_consensus.cc:697] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:44.899026 26272 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:44.933283 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 235779us
I20260709 12:18:44.904937 26291 raft_consensus.cc:697] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:44.936731 26294 raft_consensus.cc:2749] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:44.937044 26291 consensus_queue.cc:237] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:44.938750 26232 consensus_queue.cc:1048] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:44.941498 25083 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:44.941885 26124 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:44.942561 26232 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:44.943364 26232 raft_consensus.cc:697] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:44.944751 26232 consensus_queue.cc:237] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:44.901641 26242 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.901984 26264 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:44.959149 26239 consensus_queue.cc:1059] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:44.961076 26137 raft_consensus.cc:3055] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:44.961686 26137 raft_consensus.cc:740] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:44.963027 26137 consensus_queue.cc:260] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:44.966684 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:44.967767 24468 raft_consensus.cc:2368] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 2. Current term is 3.
I20260709 12:18:44.972050 26137 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:44.959769 26293 log.cc:927] Time spent T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:18:44.977030 25083 leader_election.cc:400] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Vote denied by peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453) with higher term. Message: Invalid argument: T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 2. Current term is 3.
I20260709 12:18:44.977624 25083 leader_election.cc:403] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:18:44.930107 26173 raft_consensus.cc:697] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:44.975128 24440 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:44.974797 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 164966us
I20260709 12:18:44.984570 24365 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:44.987059 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:44.987943 24320 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
W20260709 12:18:44.997457 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.934957 26289 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:45.000272 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 105392us
I20260709 12:18:45.000964 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:45.003403 24365 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:45.004181 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:45.004953 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:45.005373 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:45.005775 24466 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:45.006783 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:45.008960 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:45.009650 24467 raft_consensus.cc:2468] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:18:45.012791 24396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2057) took 1176 ms. Trace:
W20260709 12:18:45.013001 24290 leader_election.cc:336] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.841s (SENT)
I20260709 12:18:44.997843 26106 raft_consensus.cc:2804] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:45.014186 26106 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:45.014566 26106 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:44.900743 26254 consensus_queue.cc:237] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:45.020932 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.023798 25083 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:45.028767 26289 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:18:45.037717 24365 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:45.038753 26294 raft_consensus.cc:2804] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:45.039184 26294 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:45.039561 26294 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:45.041002 26173 consensus_queue.cc:237] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:44.942624 26124 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:45.044497 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 90264us
I20260709 12:18:45.046643 24466 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
W20260709 12:18:45.047636 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 48257.9us
I20260709 12:18:45.013206 24396 rpcz_store.cc:276] 0709 12:18:43.863974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.876803 (+ 12829us) service_pool.cc:224] Handling call
0709 12:18:43.889229 (+ 12426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:43.889716 (+   487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:43.889746 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:44.009136 (+119390us) log.cc:844] Serialized 26 byte log entry
0709 12:18:44.927062 (+917926us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:44.927098 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.927166 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:45.012572 (+ 85406us) raft_consensus.cc:1685] finished
0709 12:18:45.012589 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:45.012732 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18842,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":31443,"thread_start_us":635610,"threads_started":1,"wal-append.queue_time_us":942639}
I20260709 12:18:45.048946 24291 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:45.051923 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:45.001879 26232 raft_consensus.cc:2749] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453) with higher term. Message: Invalid argument: T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 2. Current term is 3.
I20260709 12:18:45.055166 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:45.056026 24316 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:45.058403 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:45.060380 24365 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:45.060907 25083 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:45.031617 26264 raft_consensus.cc:2749] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:45.070039 24365 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:45.050519 26227 raft_consensus.cc:2804] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:45.050987 26305 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:45.089520 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:45.005261 26242 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:45.051348 26303 raft_consensus.cc:2804] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:45.105362 24318 raft_consensus.cc:1240] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:45.108002 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:18:45.102195 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 50753.6us
I20260709 12:18:45.115648 24289 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:45.111629 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.104619 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:45.051844 26224 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:45.152707 24325 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:45.118667 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:45.089574 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 59616.9us
W20260709 12:18:45.153317 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.085115 26227 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:45.124274 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.069257 26231 raft_consensus.cc:2804] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:45.155339 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:45.155725 24289 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:45.106235 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:45.087725 26305 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:45.114352 26291 raft_consensus.cc:2764] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:18:45.186620 24323 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:45.188205 26305 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:45.167694 24318 raft_consensus.cc:1240] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:45.161381 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:45.238524 24395 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:45.237828 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 48530.3us
I20260709 12:18:45.159541 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:45.161315 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:45.239678 24324 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
W20260709 12:18:45.162251 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.180137 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:45.240824 24394 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
W20260709 12:18:45.240936 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.164623 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:45.077055 26307 raft_consensus.cc:2804] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:18:45.158861 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 91995.6us
I20260709 12:18:45.195643 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:45.185451 26124 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:45.187808 26272 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:45.199836 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:45.157351 26302 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:45.210707 26253 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.102485 26296 consensus_queue.cc:237] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:45.155057 25110 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:45.180778 26264 consensus_queue.cc:1059] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:18:45.188360 24440 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:45.162174 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:45.115522 26303 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:18:45.220706 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 65031.3us
I20260709 12:18:45.159926 26227 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:45.223721 24325 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:18:45.224537 24366 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:45.223464 26231 raft_consensus.cc:697] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
W20260709 12:18:45.187093 24290 leader_election.cc:336] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.001s (SENT)
W20260709 12:18:45.241967 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.241986 24365 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:45.239418 25084 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:45.250622 24316 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:18:45.290967 24289 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:45.223598 26181 raft_consensus.cc:2804] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:45.255692 26302 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.280299 24395 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:45.286864 24392 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:45.247622 26106 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:45.289799 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.244606 26307 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:45.292577 24290 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:45.256179 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:45.297866 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 58538.8us
I20260709 12:18:45.237349 26139 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:45.303733 26139 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:45.304765 24321 raft_consensus.cc:2393] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 3: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:18:45.305503 24291 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:45.284866 24320 consensus_queue.cc:237] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
W20260709 12:18:45.318641 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 136936us
I20260709 12:18:45.322263 24289 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:45.322562 26173 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:45.323457 26173 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:45.324476 24289 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:45.324797 26301 raft_consensus.cc:2804] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:45.325292 26301 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:45.325680 26301 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:45.326373 26211 raft_consensus.cc:2804] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:45.326947 26211 raft_consensus.cc:697] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:45.326845 26068 consensus_queue.cc:1059] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:45.295696 26181 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.292433 26303 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:45.298466 26300 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:45.300449 26302 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:45.335084 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 93165.1us
I20260709 12:18:45.335567 26323 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:45.336757 25084 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:45.300673 26288 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:45.284499 26253 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:45.306281 26239 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:45.341713 24365 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:45.305567 26307 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:45.299978 26272 consensus_queue.cc:1048] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:18:45.329955 26291 raft_consensus.cc:2804] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:45.333336 26181 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:45.328099 26211 consensus_queue.cc:237] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:45.349290 26323 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.385370 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:18:45.387025 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.395234 24396 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:18:45.403247 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 224046us
I20260709 12:18:45.358901 26300 raft_consensus.cc:697] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:45.378782 26242 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:45.365473 26291 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:45.381399 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:45.425199 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:45.429507 24470 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
W20260709 12:18:45.430522 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.397964 26323 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:45.400558 26224 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:18:45.413621 26308 log.cc:927] Time spent T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:18:45.411566 26319 raft_consensus.cc:2804] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:45.444446 25083 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:18:45.445174 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 103532us
I20260709 12:18:45.446879 24365 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:45.447206 24290 leader_election.cc:336] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.013s (SENT)
I20260709 12:18:45.426421 26291 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:45.447875 24290 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:45.381006 26231 consensus_queue.cc:237] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:45.462558 24365 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:45.468564 24289 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:45.468791 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 102322us
I20260709 12:18:45.469794 25084 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:45.443955 26319 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.461607 26164 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:18:45.482178 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.479079 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:18:45.466188 26309 log.cc:927] Time spent T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.237s	user 0.000s	sys 0.002s
I20260709 12:18:45.433247 26242 consensus_queue.cc:1059] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:18:45.483650 24395 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:45.456161 26315 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
W20260709 12:18:45.494589 26318 log.cc:927] Time spent T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:18:45.481573 26319 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:45.446491 26294 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:45.491573 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 49957.2us
I20260709 12:18:45.491724 24289 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:45.493029 25084 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:45.485538 24365 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:45.499662 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.462173 26082 consensus_queue.cc:1048] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:18:45.505120 26331 raft_consensus.cc:2804] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:45.505934 26331 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.506296 26331 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:45.508616 26136 raft_consensus.cc:2804] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:45.509073 26136 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.509394 26136 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:45.489099 26106 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:45.512825 26137 raft_consensus.cc:2804] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:45.513365 26137 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.513701 26137 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:45.513824 26311 log.cc:927] Time spent T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 12:18:45.457965 26264 consensus_queue.cc:1048] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
W20260709 12:18:45.579105 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 86103.9us
W20260709 12:18:45.578722 24319 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.000s	sys 0.014s
W20260709 12:18:45.582916 24319 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.000s	sys 0.014s
W20260709 12:18:45.583847 24290 leader_election.cc:336] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.070s (SENT)
W20260709 12:18:45.581425 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 356900us
I20260709 12:18:45.584779 24290 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:45.589416 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 362098us
I20260709 12:18:45.590245 24366 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:45.504205 26315 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:45.495396 26300 consensus_queue.cc:237] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:45.588711 26068 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:45.694998 26093 raft_consensus.cc:3055] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:45.695158 26068 raft_consensus.cc:697] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:45.695531 26093 raft_consensus.cc:740] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:45.695791 26136 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:45.688831 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:45.583829 26224 raft_consensus.cc:2804] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:18:45.619870 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:45.653467 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 171959us
W20260709 12:18:45.658655 26326 log.cc:927] Time spent T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:18:45.745913 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.689015 26253 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:45.713573 26239 raft_consensus.cc:2749] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:45.664449 26295 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.669378 26299 raft_consensus.cc:3055] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:45.713768 26264 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.714764 26224 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:45.747007 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 156848us
I20260709 12:18:45.632258 26341 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:45.602903 26082 consensus_queue.cc:1048] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.162s
I20260709 12:18:45.753994 26288 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:45.778004 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.763893 26339 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:45.696343 26068 consensus_queue.cc:237] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:45.788259 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:45.696555 26093 consensus_queue.cc:260] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:45.792160 26093 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:45.793293 26253 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.793977 26253 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:45.794584 26301 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:45.796208 26253 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:45.733821 26331 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:18:45.775020 26299 raft_consensus.cc:740] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:45.801789 26315 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:45.782302 26341 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.802532 26341 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:45.802199 26307 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:45.802784 26299 consensus_queue.cc:260] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:45.803930 26299 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:45.788210 26136 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:45.796847 26288 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:45.806097 26331 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:18:45.806285 26319 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:45.807583 26288 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:45.808275 26339 raft_consensus.cc:697] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:45.809340 26339 consensus_queue.cc:237] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:45.809921 26137 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:45.782464 26264 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:45.812753 26323 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:45.814365 26264 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:45.782588 26224 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:45.815069 26323 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:45.776103 26295 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:45.807682 26305 consensus_meta.cc:287] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.524s	user 0.005s	sys 0.003s
I20260709 12:18:45.786664 26294 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:18:45.819798 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 237863us
I20260709 12:18:45.850965 24396 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
W20260709 12:18:45.877624 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:45.882716 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.804522 26307 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:45.907817 26341 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:45.822214 26305 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:45.912109 24393 raft_consensus.cc:1240] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 4. Current term is 5. Ops: []
W20260709 12:18:45.925796 26181 consensus_meta.cc:287] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.525s	user 0.005s	sys 0.006s
I20260709 12:18:45.936902 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:46.086139 24470 raft_consensus.cc:1275] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:18:45.977403 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.095405 26354 ts_tablet_manager.cc:933] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:45.969732 26301 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:46.101462 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:46.101697 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:46.102349 25110 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:46.102424 24468 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:46.260830 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:18:46.247613 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.259403 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:46.260512 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:46.203474 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1595) took 1051 ms. Trace:
W20260709 12:18:46.099400 26303 consensus_meta.cc:287] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.738s	user 0.017s	sys 0.004s
W20260709 12:18:46.159785 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.992137 26253 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.993819 26181 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:46.142232 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:46.356724 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:46.220481 24440 connection.cc:256] RPC call timeout handler was delayed by -2.7790570439999556s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
I20260709 12:18:46.251971 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:18:46.385565 24366 connection.cc:256] RPC call timeout handler was delayed by -2.8480710920000547s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
I20260709 12:18:46.323866 24217 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35986 (request call id 180) took 2581 ms. Trace:
W20260709 12:18:46.311481 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.330973 24319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 209) took 1271 ms. Trace:
I20260709 12:18:46.398538 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:18:46.196722 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:46.417609 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 925892us
W20260709 12:18:46.457418 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.026263 26319 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:18:46.333309 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:46.232517 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 516323us
I20260709 12:18:46.452409 25118 raft_consensus.cc:2393] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 4: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:18:46.453593 24393 rpcz_store.cc:276] 0709 12:18:45.152116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.152280 (+   164us) service_pool.cc:224] Handling call
0709 12:18:45.161716 (+  9436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:45.914276 (+752560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:46.203154 (+288878us) spinlock_profiling.cc:243] Waited 744 ms on lock 0x7b5400208fd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:46.203398 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1711945984}
W20260709 12:18:46.460140 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.192480 24468 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:18:46.467633 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:18:46.440838 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:46.207085 26291 consensus_meta.cc:287] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.731s	user 0.010s	sys 0.010s
I20260709 12:18:46.322088 24219 catalog_manager.cc:5697] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 1 to 2, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 2 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:46.141674 26227 consensus_meta.cc:287] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.834s	user 0.015s	sys 0.009s
I20260709 12:18:46.467633 25083 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:46.468439 24325 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:46.481542 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.404835 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:18:46.197541 26302 consensus_meta.cc:287] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.838s	user 0.007s	sys 0.014s
I20260709 12:18:46.204252 26329 raft_consensus.cc:3055] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:46.513923 26329 raft_consensus.cc:740] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:46.514577 26299 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.460080 24217 rpcz_store.cc:276] 0709 12:18:43.742540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.742855 (+   315us) service_pool.cc:224] Handling call
0709 12:18:46.323739 (+2580884us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:45.016741 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:45.025876 (+  9135us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:45.025931 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:18:45.025965 (+    34us) tablet.cc:662] Decoding operations
0709 12:18:45.026866 (+   901us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:45.026942 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:45.026967 (+    25us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:18:45.027729 (+   762us) tablet.cc:701] Row locks acquired
0709 12:18:45.027784 (+    55us) write_op.cc:260] PREPARE: finished
0709 12:18:45.027949 (+   165us) write_op.cc:270] Start()
0709 12:18:45.028095 (+   146us) write_op.cc:276] Timestamp: P: 1783599525027882 usec, L: 0
0709 12:18:45.028130 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:18:45.058521 (+ 30391us) log.cc:844] Serialized 2856 byte log entry
0709 12:18:45.461407 (+402886us) op_driver.cc:464] REPLICATION: finished
0709 12:18:45.630310 (+168903us) write_op.cc:301] APPLY: starting
0709 12:18:45.630466 (+   156us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:45.630683 (+   217us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:45.689857 (+ 59174us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:45.789406 (+ 99549us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:45.789778 (+   372us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:18:45.789840 (+    62us) write_op.cc:312] APPLY: finished
0709 12:18:45.790220 (+   380us) log.cc:844] Serialized 59 byte log entry
0709 12:18:45.790423 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:45.790545 (+   122us) write_op.cc:454] Released schema lock
0709 12:18:45.790616 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:45.791046 (+   430us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:45.791077 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1151,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":168561,"apply.run_cpu_time_us":4406,"apply.run_wall_time_us":160728,"num_ops":7,"prepare.queue_time_us":181595,"prepare.run_cpu_time_us":12558,"prepare.run_wall_time_us":135013,"raft.queue_time_us":213578,"raft.run_cpu_time_us":58325,"raft.run_wall_time_us":129335,"replication_time_us":433099,"thread_start_us":380816,"threads_started":4,"wal-append.queue_time_us":129034}]]}
I20260709 12:18:46.117686 26341 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:46.472424 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.515053 26299 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:46.516319 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.517549 26299 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:46.472708 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.318454 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:46.544184 25082 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:46.473464 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.545502 24324 raft_consensus.cc:2368] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 2. Current term is 3.
I20260709 12:18:46.473585 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.483438 26148 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.474732 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:46.476948 24317 raft_consensus.cc:1275] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:46.477505 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.259851 26137 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:46.258423 26289 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:18:46.479075 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.331636 26098 raft_consensus.cc:2804] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:46.394248 26106 raft_consensus.cc:2804] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:46.483212 26353 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.149501 26305 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:46.333194 26272 raft_consensus.cc:2749] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:46.482932 25115 raft_consensus.cc:2410] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:18:46.506888 26351 raft_consensus.cc:2804] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:46.245850 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:46.508834 24365 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:46.420475 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:46.456310 24319 rpcz_store.cc:276] 0709 12:18:45.059206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.064763 (+  5557us) service_pool.cc:224] Handling call
0709 12:18:45.068010 (+  3247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:45.068265 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:45.068606 (+   341us) log.cc:844] Serialized 14 byte log entry
0709 12:18:46.330581 (+1261975us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:46.330638 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:46.330680 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:46.330763 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:46.330897 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":746163,"prepare.queue_time_us":8721,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":748522,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":514307,"threads_started":1,"wal-append.queue_time_us":601723}
I20260709 12:18:46.555071 26300 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.218873 26093 consensus_queue.cc:1048] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.294s
I20260709 12:18:46.513985 26327 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.317301 25114 raft_consensus.cc:1240] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:46.455511 25119 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
I20260709 12:18:46.472488 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:46.582522 25118 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:46.517731 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.478657 26291 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:46.520673 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.493609 24219 catalog_manager.cc:5697] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 2 to 3, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 3 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:46.618986 24325 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
I20260709 12:18:46.620009 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.619575 24219 catalog_manager.cc:5697] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:46.220805 26352 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.512511 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:46.625365 25117 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 1.
I20260709 12:18:46.193037 25110 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:46.621095 24219 catalog_manager.cc:5697] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 2 to 3, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 3 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:18:46.546573 24316 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:46.474112 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:46.154156 26224 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:46.553537 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.548035 26299 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.626784 24219 catalog_manager.cc:5697] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 1 to 2, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:18:46.627736 26299 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:46.628367 25110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35188 (request call id 770) took 1318 ms. Trace:
I20260709 12:18:46.628183 24219 catalog_manager.cc:5697] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 3 to 4, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 4 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:18:46.230522 26295 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:46.552886 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.555133 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.630064 24321 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
I20260709 12:18:46.629662 24219 catalog_manager.cc:5697] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 1 to 2, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 2 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:18:46.556362 24440 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:46.464485 26303 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:46.557891 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:46.662936 24320 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:46.560487 24289 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:46.552042 26239 raft_consensus.cc:2749] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:18:46.573163 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:46.664527 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 104150us
I20260709 12:18:46.458554 26253 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
W20260709 12:18:46.573027 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 64368.5us
I20260709 12:18:46.333536 26124 raft_consensus.cc:2804] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:46.572665 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.547103 24465 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:18:46.555323 26098 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:46.526739 26227 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:46.580566 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 996674us
I20260709 12:18:46.678193 24322 raft_consensus.cc:1240] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:46.585148 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:46.698360 25119 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:18:46.585278 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.586212 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.584560 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:46.585182 26106 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:46.514966 26329 consensus_queue.cc:260] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:46.616416 25112 raft_consensus.cc:2368] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 2. Current term is 3.
I20260709 12:18:46.547158 26148 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:46.616223 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:46.577209 26341 raft_consensus.cc:2804] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:46.621114 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.723719 24325 raft_consensus.cc:2410] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:18:46.724094 24290 leader_election.cc:336] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.078s (SENT)
I20260709 12:18:46.724575 24290 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:46.724756 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:46.618220 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:46.434907 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:46.578970 25082 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:46.522950 26302 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:46.628834 25110 rpcz_store.cc:276] 0709 12:18:45.309974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.330268 (+ 20294us) service_pool.cc:224] Handling call
0709 12:18:46.100486 (+770218us) spinlock_profiling.cc:243] Waited 9.34 ms on lock 0x7b5800004598. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c3120a0 00007f4a9c311984 00007f4a9588c6d4 00007f4a9588c662
0709 12:18:46.628290 (+527804us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21492096}
I20260709 12:18:46.583042 26300 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:46.635255 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.573611 26353 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:46.640014 26352 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:46.626248 26305 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.636026 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.643932 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.660046 24392 raft_consensus.cc:1240] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:46.470956 26354 tablet_copy_client.cc:323] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.195:44453
I20260709 12:18:46.631110 24219 catalog_manager.cc:5697] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:46.674201 26364 raft_consensus.cc:2804] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:46.583928 26327 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:46.662045 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:46.684793 24317 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:46.702296 24319 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:46.686162 26289 consensus_queue.cc:1059] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:18:46.702920 24318 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:46.741494 26148 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:46.721616 25116 raft_consensus.cc:1240] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:46.727272 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:46.685396 26098 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:46.746142 24396 raft_consensus.cc:1275] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:18:46.677268 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 213962us
I20260709 12:18:46.684351 26253 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:46.737504 25115 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:46.743376 24393 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:18:46.752934 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:46.753856 24395 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:46.756019 26289 raft_consensus.cc:3055] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:46.756486 26289 raft_consensus.cc:740] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:46.722697 26351 raft_consensus.cc:697] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:46.757544 26289 consensus_queue.cc:260] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:46.758862 26289 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:46.743577 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 164697us
I20260709 12:18:46.727922 24323 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:46.760257 24324 raft_consensus.cc:2368] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 3. Current term is 4.
W20260709 12:18:46.745481 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 78880.2us
I20260709 12:18:46.758335 26351 consensus_queue.cc:237] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:46.764065 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 103527us
I20260709 12:18:46.721582 26341 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:46.726138 26106 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:46.747156 24366 connection.cc:256] RPC call timeout handler was delayed by -2.5464047460000074s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
I20260709 12:18:46.722947 26367 raft_consensus.cc:2764] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:18:46.768887 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.765648 24320 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:18:46.769338 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.745438 26239 raft_consensus.cc:2764] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:18:46.745157 26227 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:46.783063 24319 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:46.790148 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.780169 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:18:46.767325 24366 connection.cc:256] RPC call timeout handler was delayed by -1.5416352540000844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
I20260709 12:18:46.756402 26164 raft_consensus.cc:2749] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:46.768579 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.766631 26181 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:46.757544 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:46.768700 26211 consensus_queue.cc:1048] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:18:46.783195 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:18:46.788440 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 242350us
I20260709 12:18:46.788620 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:18:46.791532 24366 connection.cc:256] RPC call timeout handler was delayed by -1.4831352539999898s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15960000000000002s for a response
W20260709 12:18:46.802103 24366 connection.cc:256] RPC call timeout handler was delayed by -1.3355352539999785s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17600000000000002s for a response
W20260709 12:18:46.802438 24366 connection.cc:256] RPC call timeout handler was delayed by -1.1663352539999323s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1948s for a response
W20260709 12:18:46.802822 24366 connection.cc:256] RPC call timeout handler was delayed by -1.0844352540000273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20390000000000003s for a response
W20260709 12:18:46.802922 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 101454us
W20260709 12:18:46.803114 24366 connection.cc:256] RPC call timeout handler was delayed by -1.0583352539999851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2068s for a response
I20260709 12:18:46.747010 26305 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:46.806777 24440 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:46.795348 24322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 208) took 1741 ms. Trace:
I20260709 12:18:46.792428 25083 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:46.760408 26364 raft_consensus.cc:697] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:46.796868 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.812249 24323 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:46.791016 25118 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
I20260709 12:18:46.813333 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.813875 25084 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:46.763605 26253 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.788733 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:46.766556 26341 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:46.801668 24320 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:18:46.766865 26299 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:46.794376 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:46.805191 24321 raft_consensus.cc:2393] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 4: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:18:46.808072 24322 rpcz_store.cc:276] 0709 12:18:45.054106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.054298 (+   192us) service_pool.cc:224] Handling call
0709 12:18:45.068843 (+ 14545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:46.700658 (+1631815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:46.795128 (+ 94470us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b54000a8f54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:46.795281 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3700459904}
I20260709 12:18:46.841409 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.809744 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.810673 26371 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.808257 24289 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:46.828416 25118 raft_consensus.cc:1275] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:46.841434 24466 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:46.821369 26164 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.823380 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:46.824587 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:46.826092 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:46.826413 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:46.833360 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:18:46.850968 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.815316 24366 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:46.842576 24317 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:46.845439 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:46.850968 24324 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:46.852174 24323 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:46.822448 26239 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:18:46.864209 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.811976 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:46.823149 26367 raft_consensus.cc:2749] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:46.835515 24290 leader_election.cc:336] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.165s (SENT)
I20260709 12:18:46.851429 24320 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:46.845177 25113 raft_consensus.cc:1275] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:18:46.857817 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 49695.9us
I20260709 12:18:46.829272 26372 consensus_queue.cc:1048] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:18:46.865177 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:46.865653 24393 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:46.867775 24466 raft_consensus.cc:2468] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:18:46.898551 24323 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:18:46.897850 25083 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:46.848126 26329 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:46.871320 26361 consensus_queue.cc:1059] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:18:46.875370 24484 tablet_copy_service.cc:140] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Received BeginTabletCopySession request for tablet 4fb70b6bc9ed40a793fb93839c889578 from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:33198)
I20260709 12:18:46.877032 24316 raft_consensus.cc:2393] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 3: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:18:46.887809 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 122415us
I20260709 12:18:46.893612 24290 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:46.828835 26093 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.906764 24323 raft_consensus.cc:1275] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:46.908337 24289 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:46.861730 26319 raft_consensus.cc:2804] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:18:46.926083 24291 consensus_peers.cc:597] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 97dd30b21cc14958a91b2da522e4bbe9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:46.835251 26368 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:46.909444 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:46.932780 24317 raft_consensus.cc:1240] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:46.910931 24393 raft_consensus.cc:1275] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:18:46.911689 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 149236us
I20260709 12:18:46.863588 26173 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:46.894984 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:46.923828 24323 raft_consensus.cc:1275] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:18:46.925136 25082 leader_election.cc:336] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.686s (SENT)
I20260709 12:18:46.828619 26253 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:46.930652 24320 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:46.933516 25117 raft_consensus.cc:2393] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 3: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:18:46.951349 25082 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:46.908684 26299 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.926450 26093 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:46.956060 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 47809.1us
I20260709 12:18:46.923633 26346 raft_consensus.cc:2804] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:18:46.956651 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.965138 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:46.970854 24392 raft_consensus.cc:2393] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 4: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:46.892218 26164 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:46.973150 26352 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:46.974754 26164 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:18:46.975826 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 140346us
I20260709 12:18:46.913300 26363 consensus_queue.cc:1048] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:18:46.977015 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:46.978140 26353 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:46.979538 26364 consensus_queue.cc:237] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:46.909063 26301 consensus_queue.cc:1059] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:18:46.980808 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:46.981464 26232 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:46.956501 26319 raft_consensus.cc:697] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:46.983116 26302 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:46.960041 26367 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:46.970386 26362 raft_consensus.cc:2804] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:46.892696 26371 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:46.984596 26367 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:46.892081 26239 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:46.985940 26289 raft_consensus.cc:2749] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:46.974844 26327 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:46.986737 25114 raft_consensus.cc:1275] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:46.988111 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:46.988770 24466 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:18:46.988986 26300 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:46.990955 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:46.984006 26181 raft_consensus.cc:3055] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:46.925711 26224 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:46.983517 26319 consensus_queue.cc:237] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:46.992056 25119 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:46.981530 26301 raft_consensus.cc:3055] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:18:46.993673 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 178432us
I20260709 12:18:46.995427 24318 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
W20260709 12:18:46.996441 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 189747us
I20260709 12:18:47.022750 24440 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:46.924425 26303 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:46.926314 26124 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:46.933189 26368 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:46.936131 26173 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:46.933358 26291 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:18:46.976508 24290 leader_election.cc:336] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.231s (SENT)
I20260709 12:18:47.056944 24290 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:47.058012 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 81533.8us
W20260709 12:18:47.058619 24290 leader_election.cc:336] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.236s (SENT)
I20260709 12:18:47.058998 24290 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:47.060487 26367 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:18:47.062738 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.063341 26378 consensus_queue.cc:1059] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:47.063930 25111 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:47.064234 26378 raft_consensus.cc:3055] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:47.064714 26378 raft_consensus.cc:740] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:47.064927 26349 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.065460 26349 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:47.065878 24366 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:47.055991 26173 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:47.055560 26148 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.067863 26349 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:47.068188 26148 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:46.998198 26181 raft_consensus.cc:740] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:47.060514 26295 consensus_queue.cc:1048] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:18:47.071653 24398 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:47.072045 26305 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:47.072253 26289 raft_consensus.cc:2749] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:47.000903 25083 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:18:47.073701 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:47.074767 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 76703.2us
I20260709 12:18:47.014752 26093 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:47.035450 24440 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:47.053894 25115 raft_consensus.cc:2468] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:46.936049 24484 tablet_copy_service.cc:161] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Beginning new tablet copy session on tablet 4fb70b6bc9ed40a793fb93839c889578 from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:33198: session id = d99d5d772cfe4a96afcab3d3b009a281-4fb70b6bc9ed40a793fb93839c889578
I20260709 12:18:47.020327 26301 raft_consensus.cc:740] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:46.999215 26353 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.052170 26352 raft_consensus.cc:2749] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:47.070179 26181 consensus_queue.cc:260] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:47.025326 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 91262.3us
I20260709 12:18:46.998679 26362 raft_consensus.cc:697] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:18:47.026439 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 108547us
I20260709 12:18:47.056223 26124 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:47.093876 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 58513.9us
I20260709 12:18:47.015763 26346 raft_consensus.cc:697] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:47.021032 26098 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:18:47.072041 26300 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:47.101843 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:47.114208 26371 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:47.055760 26368 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:47.080818 26232 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:47.115916 26239 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:47.079777 26380 consensus_queue.cc:1048] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:18:47.116671 24484 tablet_copy_source_session.cc:215] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:47.053393 26374 consensus_queue.cc:1048] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 12:18:47.117334 26301 consensus_queue.cc:260] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:47.118291 26376 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:47.084905 26305 raft_consensus.cc:2749] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:47.123383 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:47.124579 26353 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:47.126503 26181 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:47.027781 26372 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:47.137676 26224 consensus_queue.cc:1048] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:47.142901 24473 raft_consensus.cc:1240] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:46.970678 26299 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:47.169713 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:47.173318 26341 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:47.175946 26362 consensus_queue.cc:237] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:47.192353 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:47.257157 24366 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:47.278519 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:47.242347 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:47.222425 24470 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:18:47.277832 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:18:47.234197 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.283042 24473 raft_consensus.cc:2393] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 3: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:47.283222 24392 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
W20260709 12:18:47.284072 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.273388 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:47.128271 26106 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:47.274566 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:47.192101 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.202754 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:47.282341 24398 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
W20260709 12:18:47.321681 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 64660.2us
I20260709 12:18:47.321857 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:47.323547 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:47.324316 24466 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:47.325688 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:47.326371 24466 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:47.327299 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:47.329047 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:47.329871 24466 raft_consensus.cc:2393] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 2: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
W20260709 12:18:47.282281 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 152431us
I20260709 12:18:47.285972 26232 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:47.273200 26363 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.348845 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:47.358912 24395 raft_consensus.cc:1240] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4. Ops: []
W20260709 12:18:47.365098 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.350409 24366 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:47.351428 25083 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:47.353717 24472 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:18:47.321653 24471 raft_consensus.cc:2376] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4. Re-sending same reply.
I20260709 12:18:47.355985 24325 raft_consensus.cc:2393] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 3: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:18:47.357924 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:47.341193 24467 raft_consensus.cc:2468] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:18:47.263952 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:18:47.384712 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.309116 26376 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:47.275084 26303 consensus_queue.cc:1048] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 12:18:47.176494 26173 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:47.349632 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:47.423530 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:18:47.509290 24438 leader_election.cc:336] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.605s (SENT)
I20260709 12:18:47.509459 24466 raft_consensus.cc:2368] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4.
I20260709 12:18:47.389968 25119 raft_consensus.cc:1240] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:47.388165 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:47.352803 26305 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:47.514925 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 224488us
W20260709 12:18:47.448153 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.509895 24438 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:47.510968 24470 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:47.354998 26371 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:47.547114 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 195757us
I20260709 12:18:47.357754 26232 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:47.552964 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:18:47.551017 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.538493 26367 raft_consensus.cc:2749] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:47.391300 26148 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:47.559381 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:47.563838 24469 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:47.476003 26253 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:47.517370 26305 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:47.537431 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:47.476922 26301 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:47.557930 26367 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.569219 26353 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:47.538537 26370 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.570365 26098 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:47.517774 26106 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:47.573194 26374 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:47.574575 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:47.636984 26374 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:47.637233 24470 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:47.637524 26374 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:47.638399 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:47.638993 24470 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:18:47.560947 24291 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:47.509668 26376 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:47.641585 26299 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:47.574817 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:47.584455 24466 raft_consensus.cc:2393] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 2: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:47.585801 24398 raft_consensus.cc:1275] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:47.587074 24392 raft_consensus.cc:1240] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 2. Current term is 3. Ops: []
W20260709 12:18:47.620087 24438 leader_election.cc:336] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.713s (SENT)
I20260709 12:18:47.558089 26227 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:47.605886 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:18:47.605938 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 255660us
I20260709 12:18:47.394825 26211 consensus_queue.cc:1048] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.179s
I20260709 12:18:47.613214 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:47.621060 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:47.622334 26124 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:47.623142 26148 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.623670 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:47.624886 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:47.625602 26173 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:47.630578 24391 raft_consensus.cc:1275] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:18:47.631569 26387 log.cc:927] Time spent T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:18:47.633150 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:47.635545 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:47.636137 26354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fb70b6bc9ed40a793fb93839c889578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:47.395552 26363 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:47.248466 26378 consensus_queue.cc:260] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:47.646409 24438 leader_election.cc:336] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.714s (SENT)
I20260709 12:18:47.582964 26305 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:47.654654 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:47.567400 26371 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:18:47.588935 26346 consensus_queue.cc:237] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:47.655323 24318 raft_consensus.cc:2468] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:18:47.881089 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:47.881929 24466 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:18:47.882833 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:18:47.851358 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:47.658072 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 139847us
I20260709 12:18:47.884407 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:47.887166 24392 raft_consensus.cc:2368] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 3. Current term is 4.
I20260709 12:18:47.686721 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:18:47.887857 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.888118 24398 raft_consensus.cc:2393] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 5: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:47.887977 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:47.888727 24392 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:47.889660 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:18:47.885838 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 239466us
W20260709 12:18:47.844156 25082 leader_election.cc:336] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.594s (SENT)
I20260709 12:18:47.885607 24397 raft_consensus.cc:2393] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 3: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:47.891112 24394 raft_consensus.cc:2393] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 3: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
W20260709 12:18:47.890748 24438 leader_election.cc:336] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.766s (SENT)
I20260709 12:18:47.891728 24469 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:47.816781 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:47.892660 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:18:47.892781 24438 leader_election.cc:336] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.597s (SENT)
I20260709 12:18:47.890810 25082 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:47.773463 24470 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:18:47.893077 24471 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:47.894032 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:47.894222 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:47.894476 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:47.815112 24325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 1546) took 1172 ms. Trace:
I20260709 12:18:47.895067 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:47.896219 24391 raft_consensus.cc:2393] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 3: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:47.895800 24325 rpcz_store.cc:276] 0709 12:18:46.642373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:46.724412 (+ 82039us) service_pool.cc:224] Handling call
0709 12:18:47.814812 (+1090400us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b540001ca54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:47.815027 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1449206016}
I20260709 12:18:47.897149 24396 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
W20260709 12:18:47.664050 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.898741 24400 raft_consensus.cc:2393] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 3: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:47.675789 24289 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:47.883841 26124 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:47.901077 24471 raft_consensus.cc:2393] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 4: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:18:47.906535 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:18:47.902328 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:47.903154 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 59046.7us
I20260709 12:18:47.889995 25083 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:47.845894 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:47.905403 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:47.908978 24472 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:47.910288 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:18:47.906222 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 230679us
I20260709 12:18:47.908610 24395 raft_consensus.cc:2393] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 3: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:47.911885 24469 raft_consensus.cc:2393] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 3: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:47.911623 24289 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:47.901219 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.905589 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:47.914801 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:47.915613 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:47.916718 24323 raft_consensus.cc:2393] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 5: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:47.920413 26374 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:47.921968 24399 raft_consensus.cc:1240] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:47.922848 26382 consensus_queue.cc:1048] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:47.923777 26374 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:47.924754 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:47.925127 24366 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:47.910591 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:18:47.927450 24319 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.017s	sys 0.008s
W20260709 12:18:47.749737 26329 consensus_meta.cc:287] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.827s	user 0.010s	sys 0.000s
W20260709 12:18:47.927830 25082 leader_election.cc:336] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.631s (SENT)
W20260709 12:18:47.698005 26394 log.cc:927] Time spent T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 12:18:47.930979 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.932044 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:18:47.695798 26396 log.cc:927] Time spent T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:18:47.932070 24392 raft_consensus.cc:2393] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 5: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:47.936967 24473 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:47.937139 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:47.654824 26227 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:47.701591 26341 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:47.901338 24325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:42226
I20260709 12:18:47.644497 26370 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:47.617244 26367 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:47.654349 26353 consensus_queue.cc:1048] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.332s
I20260709 12:18:47.937575 24321 raft_consensus.cc:1240] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 2. Current term is 3. Ops: []
W20260709 12:18:48.302227 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 370998us
I20260709 12:18:48.304962 24289 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:47.885279 26361 raft_consensus.cc:2804] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:47.911290 24465 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:48.027724 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:47.969909 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:48.305310 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:47.969614 24316 raft_consensus.cc:1275] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:48.300980 25115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 778) took 1012 ms. Trace:
I20260709 12:18:48.305163 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:18:48.279059 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:48.302155 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 336235us
I20260709 12:18:48.312901 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:18:48.138695 24438 leader_election.cc:336] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.763s (SENT)
I20260709 12:18:48.355901 24438 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:47.945933 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:48.329632 24470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1512) took 1140 ms. Trace:
W20260709 12:18:48.226877 26232 consensus_meta.cc:287] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.583s	user 0.008s	sys 0.000s
W20260709 12:18:48.348194 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 420368us
I20260709 12:18:47.968973 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:48.349649 24325 raft_consensus.cc:606] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
W20260709 12:18:48.348582 24319 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.078s	user 0.017s	sys 0.015s
W20260709 12:18:48.163626 26376 consensus_meta.cc:287] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.001s
I20260709 12:18:48.359848 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:48.379801 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:48.067613 26181 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:48.350582 26319 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.926353 26301 raft_consensus.cc:2804] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:48.072288 25110 raft_consensus.cc:1240] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:18:48.372037 24466 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:48.352284 24320 raft_consensus.cc:2393] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 4: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:18:48.186887 26368 consensus_meta.cc:287] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.921s	user 0.008s	sys 0.001s
W20260709 12:18:48.373251 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 448192us
W20260709 12:18:48.348759 26372 consensus_meta.cc:287] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.999s	user 0.013s	sys 0.001s
I20260709 12:18:48.374181 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:48.417759 24321 raft_consensus.cc:2410] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 3 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:18:48.419045 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:48.374316 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:48.375124 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:47.933163 26068 raft_consensus.cc:2804] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:48.357080 24470 rpcz_store.cc:276] 0709 12:18:47.189371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:47.930156 (+740785us) service_pool.cc:224] Handling call
0709 12:18:48.302763 (+372607us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:48.329147 (+ 26384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:48.329189 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:48.329253 (+    64us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:48.329302 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:48.329383 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:48.329552 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:48.377082 24319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 221) took 1825 ms. Trace:
W20260709 12:18:48.377033 25082 leader_election.cc:336] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.139s (SENT)
I20260709 12:18:48.376487 24325 raft_consensus.cc:614] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:48.489560 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 112617us
I20260709 12:18:48.395457 26173 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:48.353698 26227 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:48.353165 25115 rpcz_store.cc:276] 0709 12:18:47.288193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:47.289281 (+  1088us) service_pool.cc:224] Handling call
0709 12:18:47.352388 (+ 63107us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:47.394001 (+ 41613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:47.394043 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:47.481421 (+ 87378us) log.cc:844] Serialized 26 byte log entry
0709 12:18:47.612346 (+130925us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:47.612421 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:47.612529 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:47.964179 (+351650us) raft_consensus.cc:1685] finished
0709 12:18:47.964201 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:48.300876 (+336675us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43302,"raft.queue_time_us":41781,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":58916,"thread_start_us":45488,"threads_started":1,"wal-append.queue_time_us":419126}
I20260709 12:18:47.970009 26333 raft_consensus.cc:2749] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:48.380476 24400 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
I20260709 12:18:48.380467 24392 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 3: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:48.529126 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:48.530133 25117 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:48.317410 26253 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.026849 24467 raft_consensus.cc:2393] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 3: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:47.905975 26148 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:48.539232 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 183576us
I20260709 12:18:47.964488 26371 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:18:48.181927 26363 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:48.385517 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:18:48.387156 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 82329.4us
I20260709 12:18:48.347424 26211 consensus_queue.cc:1059] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:18:48.375175 26380 raft_consensus.cc:2764] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:18:48.402354 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:48.414516 24366 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:48.375159 26352 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:48.477775 24321 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:18:48.477679 24398 raft_consensus.cc:2393] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 3: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:48.477722 24365 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:48.491659 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:48.379354 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:48.489009 24319 rpcz_store.cc:276] 0709 12:18:46.552081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:46.873793 (+321712us) service_pool.cc:224] Handling call
0709 12:18:46.874093 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:46.874312 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:46.924233 (+ 49921us) log.cc:844] Serialized 14 byte log entry
0709 12:18:48.376745 (+1452512us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:48.376798 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:48.376841 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:48.376911 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:48.377030 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35351,"prepare.queue_time_us":108191,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":31352,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":35295,"thread_start_us":1473333,"threads_started":3,"wal-append.queue_time_us":549983}
W20260709 12:18:48.494025 25082 leader_election.cc:336] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.909s (SENT)
I20260709 12:18:48.396126 26341 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.498700 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1612) took 1535 ms. Trace:
I20260709 12:18:48.507679 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:48.683298 24472 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:48.384999 26376 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:48.448294 26372 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:48.529134 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:48.509869 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:48.384056 26232 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:48.491282 26353 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.707569 24470 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:48.531019 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 211802us
I20260709 12:18:48.392357 26319 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:48.488473 26068 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:48.500769 26173 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:48.530536 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:48.732555 26173 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:48.490437 26301 raft_consensus.cc:697] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:48.735074 26301 consensus_queue.cc:237] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:48.383131 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:48.708003 26382 raft_consensus.cc:2749] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:48.737078 24469 raft_consensus.cc:2393] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 3: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:48.541523 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:48.737283 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:48.737633 24471 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:48.738724 26354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:48252 (request call id 317) took 2984 ms. Trace:
I20260709 12:18:48.417384 26368 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:48.508893 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:48.545552 24394 raft_consensus.cc:2393] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 3: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:48.546584 24440 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:48.496209 26124 consensus_queue.cc:1048] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
W20260709 12:18:48.673022 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 179015us
I20260709 12:18:48.683530 24323 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:18:48.670683 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:48.768388 24398 raft_consensus.cc:2393] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 3: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:48.684563 24473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 1527) took 1288 ms. Trace:
I20260709 12:18:48.683065 24393 rpcz_store.cc:276] 0709 12:18:46.963751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:46.963965 (+   214us) service_pool.cc:224] Handling call
0709 12:18:46.964352 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:47.075732 (+111380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:47.075770 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:47.083502 (+  7732us) log.cc:844] Serialized 26 byte log entry
0709 12:18:47.604015 (+520513us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:47.604081 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:47.604190 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:47.695070 (+ 90880us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:18:48.490754 (+795684us) raft_consensus.cc:1685] finished
0709 12:18:48.490777 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:48.498611 (+  7834us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26661,"raft.queue_time_us":108795,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":26172,"spinlock_wait_cycles":43158784,"thread_start_us":422510,"threads_started":2,"wal-append.queue_time_us":367145}
W20260709 12:18:48.690825 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 552135us
I20260709 12:18:48.768963 24473 rpcz_store.cc:276] 0709 12:18:47.395876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:47.516351 (+120475us) service_pool.cc:224] Handling call
0709 12:18:48.684358 (+1168007us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b54000fd2d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:48.684496 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":881379072}
W20260709 12:18:48.769438 24438 leader_election.cc:336] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.922s (SENT)
W20260709 12:18:48.556700 26389 log.cc:927] Time spent T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.999s	user 0.009s	sys 0.006s
I20260709 12:18:48.530701 26406 raft_consensus.cc:2749] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:48.710320 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:18:48.718251 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 303787us
I20260709 12:18:48.777952 24366 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:48.556207 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:48.702703 26361 raft_consensus.cc:697] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:48.726807 26376 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:48.727234 26408 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:48.785633 26408 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:48.785753 26361 consensus_queue.cc:237] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:48.788172 26408 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:48.539852 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:48.736521 26319 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:48.706115 26341 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:48.760046 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 213670us
I20260709 12:18:48.797605 24440 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:48.763253 24472 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:18:48.537952 26253 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:48.770910 24470 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:48.774300 26370 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:48.740432 26068 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:48.705840 26352 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:48.782754 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:48.722867 26353 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:48.812755 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:48.814877 24471 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:18:48.816526 24471 raft_consensus.cc:1240] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:48.817148 24472 raft_consensus.cc:1275] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:48.795084 26367 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:18:48.685175 26305 consensus_meta.cc:287] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.741s	user 0.010s	sys 0.001s
W20260709 12:18:48.784732 26404 log.cc:927] Time spent T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 12:18:48.729128 26232 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:48.742810 26372 raft_consensus.cc:2804] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:18:48.842002 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 62941.2us
I20260709 12:18:48.842799 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:48.817391 26376 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:48.794389 24473 raft_consensus.cc:1275] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:48.845672 24473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1517) took 1655 ms. Trace:
I20260709 12:18:48.846177 24473 rpcz_store.cc:276] 0709 12:18:47.190612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.770107 (+1579495us) service_pool.cc:224] Handling call
0709 12:18:48.789421 (+ 19314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:48.845376 (+ 55955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:48.845606 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:48.772734 26371 raft_consensus.cc:2749] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:48.801584 24470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 384) took 1447 ms. Trace:
I20260709 12:18:48.806602 24440 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:48.851882 24322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 234) took 1269 ms. Trace:
W20260709 12:18:48.852574 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 46060.7us
I20260709 12:18:48.795712 26402 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:48.807590 24397 raft_consensus.cc:2393] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 5: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:18:48.807392 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 262281us
I20260709 12:18:48.739161 26354 rpcz_store.cc:276] 0709 12:18:45.763035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.763493 (+   458us) service_pool.cc:224] Handling call
0709 12:18:46.095810 (+332317us) ts_tablet_manager.cc:934] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
0709 12:18:47.552487 (+1456677us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:18:48.150390 (+597903us) tablet_metadata.cc:665] Metadata flushed
0709 12:18:48.150572 (+   182us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:18:48.334882 (+184310us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:18:48.373890 (+ 39008us) tablet_replica.cc:206] Creating consensus instance
0709 12:18:48.738560 (+364670us) ts_tablet_manager.cc:989] Replica registered.
0709 12:18:48.738626 (+    66us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":77347,"tablet-copy.queue_time_us":311306,"thread_start_us":452547,"threads_started":2}
I20260709 12:18:48.817608 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1526) took 1461 ms. Trace:
I20260709 12:18:48.783865 24366 leader_election.cc:400] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 2. Current term is 3.
I20260709 12:18:48.863557 24366 leader_election.cc:403] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:48.784317 25116 raft_consensus.cc:1240] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:48.741966 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 1532) took 1116 ms. Trace:
I20260709 12:18:48.864619 24471 rpcz_store.cc:276] 0709 12:18:47.358540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.815876 (+1457336us) service_pool.cc:224] Handling call
0709 12:18:48.816301 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:48.817321 (+  1020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:48.817541 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:48.800612 26410 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:48.840658 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:48.866791 24396 raft_consensus.cc:2393] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 3: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:48.793690 24395 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:18:48.819169 26412 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.841615 26253 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:48.853410 24440 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:48.853875 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:48.851830 24470 rpcz_store.cc:276] 0709 12:18:47.353647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.800574 (+1446927us) service_pool.cc:224] Handling call
0709 12:18:48.800927 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:48.801158 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:48.801197 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:48.801256 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:48.801306 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:48.801377 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:48.801512 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:48.833370 26416 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.845285 26376 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:18:48.821967 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 344285us
I20260709 12:18:48.869534 24290 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:48.873399 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 106040us
I20260709 12:18:48.851439 26352 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:48.817276 26409 consensus_queue.cc:1048] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 12:18:48.833467 26305 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:48.842247 26372 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:48.864588 24466 rpcz_store.cc:276] 0709 12:18:47.625662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:47.882615 (+256953us) service_pool.cc:224] Handling call
0709 12:18:48.741807 (+859192us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b5400243454. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:48.741906 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1119524608}
W20260709 12:18:48.881208 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 97513.4us
I20260709 12:18:48.882375 24440 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:48.861341 26402 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:48.906447 26402 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:48.852309 24322 rpcz_store.cc:276] 0709 12:18:47.582086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:47.582250 (+   164us) service_pool.cc:224] Handling call
0709 12:18:47.625219 (+ 42969us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:47.625813 (+   594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:47.625855 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:47.626772 (+   917us) log.cc:844] Serialized 52 byte log entry
0709 12:18:48.040123 (+413351us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:48.040189 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:48.040306 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:48.851645 (+811339us) raft_consensus.cc:1685] finished
0709 12:18:48.851665 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:48.851821 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10759,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":138,"thread_start_us":412696,"threads_started":1,"wal-append.queue_time_us":849162}
I20260709 12:18:48.880565 26412 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:48.909792 26386 log.cc:927] Time spent T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 1.353s	user 0.000s	sys 0.038s
I20260709 12:18:48.911677 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 373) took 2118 ms. Trace:
I20260709 12:18:48.912431 26305 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:48.913705 26353 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:18:48.914073 26407 log.cc:927] Time spent T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.358s	user 0.000s	sys 0.001s
I20260709 12:18:48.915012 24318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44278 (request call id 2000) took 1001 ms. Trace:
I20260709 12:18:48.915426 24467 raft_consensus.cc:1275] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:18:48.855892 26411 consensus_queue.cc:1059] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 12:18:48.916589 24467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1529) took 1377 ms. Trace:
I20260709 12:18:48.890106 26148 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:48.885339 26418 raft_consensus.cc:2749] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 2. Current term is 3.
I20260709 12:18:48.917384 24467 rpcz_store.cc:276] 0709 12:18:47.539562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.874972 (+1335410us) service_pool.cc:224] Handling call
0709 12:18:48.914899 (+ 39927us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:48.916252 (+  1353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:48.916518 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:48.919395 24467 raft_consensus.cc:1275] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:48.921509 26341 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:48.881265 26410 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:48.880282 26354 tablet_copy_client.cc:806] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:48.884325 24365 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:48.874717 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:48.915383 24318 rpcz_store.cc:276] 0709 12:18:47.913473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:47.914379 (+   906us) service_pool.cc:224] Handling call
0709 12:18:48.120716 (+206337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:48.376477 (+255761us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:48.376517 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:48.391888 (+ 15371us) log.cc:844] Serialized 26 byte log entry
0709 12:18:48.779597 (+387709us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:48.779632 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:48.779691 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:48.914789 (+135098us) raft_consensus.cc:1685] finished
0709 12:18:48.914808 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:48.914942 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":252528,"raft.queue_time_us":265374,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":91340,"thread_start_us":284051,"threads_started":1,"wal-append.queue_time_us":368361}
I20260709 12:18:48.861897 26367 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:48.887355 26416 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:48.891440 24470 raft_consensus.cc:1275] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:18:48.887594 25082 leader_election.cc:336] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.160s (SENT)
I20260709 12:18:48.912206 24468 rpcz_store.cc:276] 0709 12:18:46.792781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:46.793625 (+   844us) service_pool.cc:224] Handling call
0709 12:18:46.793949 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:46.902466 (+108517us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:46.902497 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:46.902996 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 12:18:47.092685 (+189689us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:47.092749 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:47.189228 (+ 96479us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b540029d454. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:47.189296 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:48.908781 (+1719485us) spinlock_profiling.cc:243] Waited 5.99 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:18:48.911413 (+  2632us) raft_consensus.cc:1685] finished
0709 12:18:48.911434 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:48.911588 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":731,"raft.queue_time_us":52607,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":28093,"spinlock_wait_cycles":51007232,"thread_start_us":252914,"threads_started":2,"wal-append.queue_time_us":613247}
I20260709 12:18:48.874987 26173 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:48.886852 26376 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:48.950380 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 69187.2us
I20260709 12:18:49.155375 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 389) took 1268 ms. Trace:
I20260709 12:18:49.073127 25083 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:49.142545 24472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1518) took 1951 ms. Trace:
W20260709 12:18:48.930611 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 156094us
I20260709 12:18:49.145588 25116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 369) took 2634 ms. Trace:
W20260709 12:18:48.997789 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 102323us
W20260709 12:18:49.189563 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.099701 24399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2065) took 1509 ms. Trace:
I20260709 12:18:49.188858 25082 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:49.173152 24320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2012) took 1240 ms. Trace:
W20260709 12:18:49.172293 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 302828us
W20260709 12:18:49.031121 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 148861us
I20260709 12:18:49.024309 24324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44278 (request call id 2003) took 1109 ms. Trace:
I20260709 12:18:48.929353 24466 raft_consensus.cc:1275] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:18:49.191395 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 307168us
I20260709 12:18:48.889554 26253 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:48.897722 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:49.192047 24470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 390) took 1304 ms. Trace:
I20260709 12:18:49.323975 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1626) took 1434 ms. Trace:
I20260709 12:18:49.241910 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:49.324993 24466 rpcz_store.cc:276] 0709 12:18:47.889485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.898701 (+1009216us) service_pool.cc:224] Handling call
0709 12:18:48.905592 (+  6891us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:49.323637 (+418045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:49.323904 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:49.326002 24290 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:49.322575 24399 rpcz_store.cc:276] 0709 12:18:47.590527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:47.590678 (+   151us) service_pool.cc:224] Handling call
0709 12:18:47.621446 (+ 30768us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:47.922472 (+301026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:49.099390 (+1176918us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b54000cdd54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:49.099618 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":690555136}
I20260709 12:18:49.278303 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1513) took 2088 ms. Trace:
I20260709 12:18:49.195618 24471 rpcz_store.cc:276] 0709 12:18:47.887018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.874310 (+987292us) service_pool.cc:224] Handling call
0709 12:18:48.874592 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:48.930683 (+ 56091us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:48.930735 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:48.930802 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:48.930850 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:49.154984 (+224134us) spinlock_profiling.cc:243] Waited 55.8 ms on lock 0x7b54001437d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:49.155049 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:49.155293 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128321792}
I20260709 12:18:49.327328 24469 rpcz_store.cc:276] 0709 12:18:47.189610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.738217 (+1548607us) service_pool.cc:224] Handling call
0709 12:18:48.738566 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:48.738950 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:48.738977 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:48.739462 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 12:18:48.847814 (+108352us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:48.847872 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:48.847965 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:49.278068 (+430103us) raft_consensus.cc:1685] finished
0709 12:18:49.278089 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:49.278237 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":133,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":107,"thread_start_us":107883,"threads_started":1,"wal-append.queue_time_us":519791}
I20260709 12:18:49.187063 24366 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:49.329622 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:49.329825 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:18:49.330169 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 143202us
I20260709 12:18:49.330286 24471 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:18:49.331303 24366 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
W20260709 12:18:49.255692 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:49.331969 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 444374us
W20260709 12:18:49.223315 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:49.333225 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:49.257566 25084 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.155.193:36951 timed out after 2.198s (SENT) [suppressed 32 similar messages]
I20260709 12:18:49.321835 24470 rpcz_store.cc:276] 0709 12:18:47.887260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.878852 (+991592us) service_pool.cc:224] Handling call
0709 12:18:48.890967 (+ 12115us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:49.191556 (+300589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:49.191813 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:49.325112 24440 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:18:49.335289 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 77774.5us
W20260709 12:18:49.235047 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 162060us
I20260709 12:18:49.323592 25116 rpcz_store.cc:276] 0709 12:18:46.511046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:46.877206 (+366160us) service_pool.cc:224] Handling call
0709 12:18:46.908109 (+ 30903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:48.864295 (+1956186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:49.145259 (+280964us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b54004e3754. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:49.145477 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4305848704}
I20260709 12:18:49.321802 24320 rpcz_store.cc:276] 0709 12:18:47.932326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.401992 (+469666us) service_pool.cc:224] Handling call
0709 12:18:49.166405 (+764413us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b54000a8f54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:49.173055 (+  6650us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":998943488}
I20260709 12:18:49.327195 24324 rpcz_store.cc:276] 0709 12:18:47.914752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:47.914884 (+   132us) service_pool.cc:224] Handling call
0709 12:18:47.969333 (+ 54449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:48.386683 (+417350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:48.388027 (+  1344us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:48.413552 (+ 25525us) log.cc:844] Serialized 26 byte log entry
0709 12:18:48.681686 (+268134us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:48.892160 (+210474us) log.cc:844] Serialized 14 byte log entry
0709 12:18:49.023970 (+131810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:49.024053 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:49.024098 (+    45us) raft_consensus.cc:1685] finished
0709 12:18:49.024110 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:49.024251 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":520293,"prepare.queue_time_us":573796,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":545521,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":209,"thread_start_us":331441,"threads_started":2,"wal-append.queue_time_us":292326}
I20260709 12:18:48.905207 26372 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:49.075336 26391 log.cc:927] Time spent T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928: Append to log took a long time: real 1.518s	user 0.019s	sys 0.009s
W20260709 12:18:49.038125 24465 consensus_meta.cc:287] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.663s	user 0.013s	sys 0.012s
I20260709 12:18:49.223932 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:18:49.338984 25082 leader_election.cc:336] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.971s (SENT)
I20260709 12:18:49.197912 24472 rpcz_store.cc:276] 0709 12:18:47.190843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.799282 (+1608439us) service_pool.cc:224] Handling call
0709 12:18:48.799683 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:48.817608 (+ 17925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:49.142215 (+324607us) spinlock_profiling.cc:243] Waited 9.19 ms on lock 0x7b54002bbbd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:49.142459 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21126912}
I20260709 12:18:49.375973 24468 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:49.162441 26408 raft_consensus.cc:3055] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:49.330331 24469 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:18:49.368486 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:49.388896 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:49.389968 24469 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:49.388993 24397 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:49.154474 26349 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.341081 26361 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:48.947247 26371 raft_consensus.cc:2749] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:49.344040 24290 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:49.194275 26367 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:49.198868 26227 consensus_meta.cc:287] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.667s	user 0.007s	sys 0.004s
I20260709 12:18:49.089356 26410 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:49.140698 26417 raft_consensus.cc:2749] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:49.061815 26346 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:49.233036 26354 tablet_copy_client.cc:670] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:49.195894 26418 raft_consensus.cc:2804] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:18:49.373100 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.296415 26378 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:48.990626 26368 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:49.240996 26093 raft_consensus.cc:2804] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:49.374094 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:49.256546 25114 raft_consensus.cc:1275] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:49.374840 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:49.444945 24470 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:49.342167 24438 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:49.446676 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 104587us
I20260709 12:18:49.344586 24440 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:18:49.449535 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 105051us
I20260709 12:18:49.450457 24440 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:49.379163 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:49.379683 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:49.452770 24391 raft_consensus.cc:2393] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 5: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:49.381157 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:49.383010 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:49.453950 24393 raft_consensus.cc:2393] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 3: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:49.383859 26435 raft_consensus.cc:2804] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:49.383051 24365 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:49.465128 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 82209us
I20260709 12:18:49.413157 26367 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:49.234968 25110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 366) took 2723 ms. Trace:
I20260709 12:18:49.258067 26173 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:18:49.385404 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 54139.6us
I20260709 12:18:49.067407 26181 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:49.391512 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:49.396150 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:49.036882 26341 consensus_queue.cc:1048] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.331s
I20260709 12:18:49.337364 26232 raft_consensus.cc:2749] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:49.341382 26305 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:18:49.402083 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.406672 24468 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:18:48.992841 26124 consensus_queue.cc:1059] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.386s
I20260709 12:18:49.345438 26364 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:49.407806 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 68840.4us
I20260709 12:18:49.364878 26409 raft_consensus.cc:2749] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:49.036664 26423 consensus_queue.cc:1048] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.391s
I20260709 12:18:49.410429 24396 raft_consensus.cc:1275] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:48.976972 26414 consensus_queue.cc:1059] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.413s
I20260709 12:18:49.367654 26363 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:49.426280 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 89325.7us
I20260709 12:18:49.387892 26408 raft_consensus.cc:740] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:49.232106 26068 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:49.431994 24466 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:49.434554 24469 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:49.473119 26362 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.633997 24469 raft_consensus.cc:1240] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:18:49.635737 24469 raft_consensus.cc:1240] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:18:49.388353 24465 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:49.638255 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 1622) took 2086 ms. Trace:
I20260709 12:18:49.638710 24465 rpcz_store.cc:276] 0709 12:18:47.551782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:47.635262 (+ 83480us) service_pool.cc:224] Handling call
0709 12:18:49.638171 (+2002909us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:49.640424 24471 raft_consensus.cc:1275] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:49.456928 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:49.641454 24395 raft_consensus.cc:2410] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:18:49.398326 26361 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.642231 26361 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:49.458673 24438 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:18:49.645452 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 186863us
I20260709 12:18:49.460332 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:49.463387 24440 leader_election.cc:400] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 3. Current term is 4.
I20260709 12:18:49.463622 24394 raft_consensus.cc:2393] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 3: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:49.037604 26412 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:49.471074 24365 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:49.424774 26427 log.cc:927] Time spent T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:18:49.472441 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:49.424178 26418 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:49.424975 26301 raft_consensus.cc:2749] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:49.409737 26349 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:49.468403 26435 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:49.489820 24470 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:18:49.518507 24472 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:18:49.518254 24399 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:49.491325 24366 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
W20260709 12:18:49.554723 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 227576us
I20260709 12:18:49.616299 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:49.468489 26410 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:49.689430 24290 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:49.691859 24290 leader_election.cc:400] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Vote denied by peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453) with higher term. Message: Invalid argument: T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4.
I20260709 12:18:49.473646 26291 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:49.431547 26093 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:49.425246 26227 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:49.622570 25082 leader_election.cc:336] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.592s (SENT)
I20260709 12:18:49.469772 26403 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.471848 26299 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:18:49.628589 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 251665us
I20260709 12:18:49.553556 26181 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:49.474828 26371 raft_consensus.cc:2804] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:49.636734 26363 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:49.648335 24440 leader_election.cc:403] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:49.696188 26435 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:49.665004 24393 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:18:49.662082 26124 raft_consensus.cc:3055] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:49.681844 26412 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.730986 26412 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:49.733731 26412 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:49.455368 26346 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:49.661615 26402 consensus_meta.cc:287] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.755s	user 0.013s	sys 0.000s
I20260709 12:18:49.735311 26402 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:49.736894 24466 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:18:49.737740 26402 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:49.738525 26402 raft_consensus.cc:2804] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:49.738948 26402 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:49.739352 26402 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:49.739444 26068 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:18:49.713013 26426 log.cc:927] Time spent T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.413s	user 0.000s	sys 0.001s
I20260709 12:18:49.693742 24290 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:49.717972 25113 raft_consensus.cc:2393] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 4: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
W20260709 12:18:49.695983 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 70265us
I20260709 12:18:49.646869 26397 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:49.742007 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 290187us
I20260709 12:18:49.742481 26397 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:49.743682 26124 raft_consensus.cc:740] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:49.647279 26419 raft_consensus.cc:3055] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:18:49.704303 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 233069us
I20260709 12:18:49.744876 26419 raft_consensus.cc:740] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:18:49.745404 26431 log.cc:927] Time spent T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:18:49.670809 26418 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:49.745813 26419 consensus_queue.cc:260] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:49.747206 26419 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:49.701269 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 78763.4us
W20260709 12:18:49.748462 26429 log.cc:927] Time spent T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.363s	user 0.000s	sys 0.000s
I20260709 12:18:49.748914 26412 raft_consensus.cc:2749] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:49.749039 25082 leader_election.cc:336] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.664s (SENT)
I20260709 12:18:49.749576 25082 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:49.709589 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:49.750840 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.646860 24392 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:18:49.695845 26410 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.752942 26410 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:49.617070 26416 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:49.700177 26093 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:49.697973 26291 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:49.718922 25118 raft_consensus.cc:2393] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 4: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:18:49.698644 26414 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:49.704298 26299 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:49.654597 26362 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:49.742962 24440 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:49.745325 24365 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:49.748205 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 55598.6us
I20260709 12:18:49.629644 26364 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:49.473886 25110 rpcz_store.cc:276] 0709 12:18:46.510255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:46.846843 (+336588us) service_pool.cc:224] Handling call
0709 12:18:46.847245 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:48.416008 (+1568763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:49.159995 (+743987us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400709254. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:49.233560 (+ 73565us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2483400960}
W20260709 12:18:49.776674 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.782763 24399 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:49.711802 26371 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.737730 26349 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:18:49.805429 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 56428.3us
W20260709 12:18:49.819873 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 74630.6us
I20260709 12:18:49.820654 24365 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:49.793159 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 146896us
W20260709 12:18:49.806988 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 64950.4us
I20260709 12:18:49.755348 26341 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:49.822278 24323 raft_consensus.cc:1240] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:49.822672 24438 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:49.821201 25082 leader_election.cc:336] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.733s (SENT)
I20260709 12:18:49.783505 26441 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.828421 24393 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:18:49.793130 26291 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:49.829293 26371 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:49.795085 26299 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:49.836469 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:49.875852 24320 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:18:49.839206 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 335) took 1347 ms. Trace:
I20260709 12:18:49.839455 24318 raft_consensus.cc:1275] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:49.710073 26408 consensus_queue.cc:260] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:49.931753 24289 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:18:49.937443 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 115021us
I20260709 12:18:49.908113 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:49.941767 24393 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:49.712430 26403 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:49.844280 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 133419us
I20260709 12:18:49.877343 25118 rpcz_store.cc:276] 0709 12:18:48.491520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.492443 (+   923us) service_pool.cc:224] Handling call
0709 12:18:49.838956 (+1346513us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540072f454. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:49.839139 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2326153984}
I20260709 12:18:49.839828 26443 raft_consensus.cc:2749] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:49.970461 26445 raft_consensus.cc:2804] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:50.020301 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:18:49.920413 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 90736.2us
I20260709 12:18:49.908841 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:18:49.950526 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.794857 26434 consensus_queue.cc:1048] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
W20260709 12:18:50.020349 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 529140us
W20260709 12:18:50.029419 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 201812us
I20260709 12:18:50.020205 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:50.029114 24366 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:50.023263 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 91576.1us
I20260709 12:18:50.024763 24394 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:50.032609 24289 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:49.861888 24365 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:50.029105 24397 consensus_meta.cc:287] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.632s	user 0.006s	sys 0.005s
I20260709 12:18:50.034387 24397 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:18:50.036005 24399 raft_consensus.cc:1275] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:18:50.040385 24290 connection.cc:256] RPC call timeout handler was delayed by -2.30537507300005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2973s for a response
W20260709 12:18:50.040859 24290 connection.cc:256] RPC call timeout handler was delayed by -1.937266357999988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2614s for a response
I20260709 12:18:49.868093 26181 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:50.041666 26412 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:50.042178 26412 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:50.043552 26181 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:50.044231 26412 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:50.044847 26412 raft_consensus.cc:2804] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:50.044952 24289 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:50.045708 26414 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:50.045866 24289 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:50.046648 26423 raft_consensus.cc:2804] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:50.046746 24289 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:50.047106 26423 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.047477 26423 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:50.047559 24289 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:50.048424 26437 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:18:50.048939 24290 connection.cc:256] RPC call timeout handler was delayed by -1.3441485539999576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
I20260709 12:18:50.049289 26437 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.049984 26437 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:50.052274 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:50.052822 26414 raft_consensus.cc:697] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 4 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:18:50.049407 24290 connection.cc:256] RPC call timeout handler was delayed by -1.2901485539998703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
I20260709 12:18:50.053054 24394 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:50.053493 24290 connection.cc:256] RPC call timeout handler was delayed by -1.0012485539998579s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
I20260709 12:18:50.053992 26414 consensus_queue.cc:237] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:50.048842 26211 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:50.057459 26211 raft_consensus.cc:697] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 4 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:50.058665 26211 consensus_queue.cc:237] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:50.059222 26437 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:50.063838 26437 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:50.064344 26412 raft_consensus.cc:697] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:50.069550 26412 consensus_queue.cc:237] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:50.065124 24394 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:18:50.067503 24322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
mode: GRACEFUL
new_leader_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:42226
I20260709 12:18:50.077082 24322 raft_consensus.cc:606] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Received request to transfer leadership to TS c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:49.841836 26441 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:49.978188 26416 consensus_queue.cc:1048] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:18:49.978021 26418 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:50.117702 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 92532.6us
I20260709 12:18:50.005275 26450 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:50.019948 26305 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:50.029181 26408 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:50.490792 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:18:50.227941 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 248257us
W20260709 12:18:50.314697 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:50.304682 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:50.627797 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:50.485153 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:18:50.118414 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 257670us
W20260709 12:18:50.523798 25083 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.007s	sys 0.011s
W20260709 12:18:50.647294 25083 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.010s	sys 0.014s
W20260709 12:18:50.647782 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 679577us
W20260709 12:18:50.339562 26361 consensus_meta.cc:287] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.697s	user 0.010s	sys 0.002s
I20260709 12:18:50.648706 26470 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.649114 26361 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:50.649483 26470 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:50.651834 26470 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:50.269134 26363 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:50.608973 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:18:50.213305 26376 consensus_meta.cc:287] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.981s	user 0.010s	sys 0.003s
I20260709 12:18:50.653795 26376 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:50.654310 26473 consensus_queue.cc:1059] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:18:50.654932 24473 raft_consensus.cc:1240] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:50.642675 24397 raft_consensus.cc:1240] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 2. Current term is 3. Ops: []
W20260709 12:18:50.596858 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:50.018774 26448 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:18:50.143371 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 114460us
W20260709 12:18:50.594167 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 851240us
W20260709 12:18:50.628733 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:50.629069 25084 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:50.548131 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1631) took 1088 ms. Trace:
I20260709 12:18:50.488704 24396 raft_consensus.cc:1240] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4. Ops: []
W20260709 12:18:50.594779 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:50.666452 24366 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:18:50.662603 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 62893.2us
I20260709 12:18:50.279521 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:50.667474 24394 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:50.666361 24391 rpcz_store.cc:276] 0709 12:18:49.459905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.462711 (+  2806us) service_pool.cc:224] Handling call
0709 12:18:49.463023 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:49.463258 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:49.808481 (+345223us) log.cc:844] Serialized 14 byte log entry
0709 12:18:50.547387 (+738906us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b1800303700. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a96ef44bc 00007f4a9424248b 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425ec02 00007f4a96ee620b 00007f4a96eebd23 00007f4a96eec23a
0709 12:18:50.547645 (+   258us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:50.547720 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:50.547783 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:50.547876 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:50.548051 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":506660,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":56693,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":56,"spinlock_wait_cycles":25900928,"thread_start_us":477800,"threads_started":2,"wal-append.queue_time_us":407594}
W20260709 12:18:50.416276 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:50.630075 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:18:50.666913 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:50.670650 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:18:50.355176 26444 log.cc:927] Time spent T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.378s	user 0.002s	sys 0.000s
W20260709 12:18:50.498911 26410 consensus_meta.cc:287] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.692s	user 0.008s	sys 0.004s
W20260709 12:18:50.420957 24465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.001s	sys 0.010s
W20260709 12:18:50.666055 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:50.376572 26439 log.cc:927] Time spent T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.520s	user 0.000s	sys 0.001s
I20260709 12:18:50.368584 26403 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:50.656052 26460 raft_consensus.cc:3055] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:18:50.656613 26445 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.005s	sys 0.007s
I20260709 12:18:50.596699 26441 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:50.630118 24365 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:50.355341 26402 consensus_meta.cc:287] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.615s	user 0.009s	sys 0.000s
I20260709 12:18:50.673237 24289 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:50.359241 26367 consensus_meta.cc:287] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.803s	user 0.006s	sys 0.003s
W20260709 12:18:50.447587 26458 log.cc:927] Time spent T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 12:18:50.350108 26093 consensus_meta.cc:287] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.000s
W20260709 12:18:50.491922 26372 consensus_meta.cc:287] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 1.094s	user 0.008s	sys 0.004s
W20260709 12:18:50.419377 26378 consensus_meta.cc:287] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.986s	user 0.008s	sys 0.003s
W20260709 12:18:50.359241 26419 consensus_meta.cc:287] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.612s	user 0.002s	sys 0.007s
I20260709 12:18:50.152552 26227 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:50.325459 26455 raft_consensus.cc:2804] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:50.689273 24473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 385) took 3331 ms. Trace:
I20260709 12:18:50.495066 26346 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:50.599678 26305 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:50.340921 26364 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:50.216032 26456 raft_consensus.cc:2749] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:50.492739 26397 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:50.369978 26409 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:50.324810 26461 raft_consensus.cc:2804] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:50.665360 24440 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
W20260709 12:18:50.373047 25113 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 336) took 1881 ms (client timeout 2218 ms). Trace:
I20260709 12:18:50.121723 26341 raft_consensus.cc:697] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:50.596240 26462 raft_consensus.cc:2804] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:18:50.351193 26435 consensus_meta.cc:287] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.556s	user 0.004s	sys 0.003s
I20260709 12:18:50.703316 24394 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:18:50.675753 26362 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:18:50.686026 24465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.003s	sys 0.011s
I20260709 12:18:50.680707 26473 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:50.664559 26450 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:18:50.711364 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 148566us
I20260709 12:18:50.809764 24400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2098) took 1427 ms. Trace:
W20260709 12:18:50.810005 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 141922us
W20260709 12:18:50.811278 24438 leader_election.cc:336] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.860s (SENT)
W20260709 12:18:50.811930 24438 leader_election.cc:336] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.863s (SENT)
I20260709 12:18:50.810297 24400 rpcz_store.cc:276] 0709 12:18:49.382017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.382169 (+   152us) service_pool.cc:224] Handling call
0709 12:18:49.412980 (+ 30811us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:49.808964 (+395984us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:49.808996 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:49.819898 (+ 10902us) log.cc:844] Serialized 26 byte log entry
0709 12:18:49.988466 (+168568us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:49.988526 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:50.272960 (+284434us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54002085d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:50.273026 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:50.761894 (+488868us) raft_consensus.cc:1685] finished
0709 12:18:50.761916 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:50.809702 (+ 47786us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90517,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":5787,"spinlock_wait_cycles":463498624,"thread_start_us":251208,"threads_started":2,"wal-append.queue_time_us":467977}
W20260709 12:18:50.680925 26442 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.001s	sys 0.018s
I20260709 12:18:50.852283 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:50.852308 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:18:50.715130 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 66640.2us
I20260709 12:18:50.854295 25083 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:50.855448 25083 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:50.685647 26301 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:50.142828 26446 raft_consensus.cc:2749] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 3. Current term is 4.
I20260709 12:18:50.365428 26371 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:50.356703 26299 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:50.705665 26445 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.005s	sys 0.007s
I20260709 12:18:50.680326 26437 consensus_queue.cc:1048] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:18:50.315227 26463 consensus_queue.cc:1048] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.403s
I20260709 12:18:50.724547 26372 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:50.727240 24474 raft_consensus.cc:1240] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 2. Current term is 4. Ops: []
I20260709 12:18:50.727798 24473 rpcz_store.cc:276] 0709 12:18:47.358306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.847202 (+1488896us) service_pool.cc:224] Handling call
0709 12:18:48.849430 (+  2228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:50.655389 (+1805959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:50.688975 (+ 33586us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b54001509d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:50.689191 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4151831424}
I20260709 12:18:50.731102 25119 raft_consensus.cc:1240] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:50.265913 26451 consensus_queue.cc:1048] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.463s
I20260709 12:18:50.685498 26068 consensus_queue.cc:1048] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:18:50.210608 26423 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:50.685734 26410 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:50.713302 26361 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:50.911065 26423 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:50.366214 26124 consensus_queue.cc:260] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:50.912081 26124 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:50.672647 26464 consensus_queue.cc:1059] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
W20260709 12:18:50.746892 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 81624.6us
I20260709 12:18:50.912915 26451 raft_consensus.cc:2764] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:18:50.913352 24440 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:50.913525 26181 consensus_queue.cc:1175] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c855242ec9d34a5397741ef20db9de8a" responder_term: 4 status { last_received { term: 3 index: 3 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:50.896036 26406 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.914630 24440 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:50.915381 26397 raft_consensus.cc:2749] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:50.915036 26406 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:50.915715 24440 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:50.747126 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 117081us
W20260709 12:18:50.903517 26468 log.cc:927] Time spent T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:18:50.758117 26459 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.758997 26435 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:50.759740 26409 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:50.744382 26376 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:50.757975 26469 raft_consensus.cc:2749] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:50.718357 26367 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:50.744069 26291 consensus_meta.cc:287] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.664s	user 0.007s	sys 0.004s
I20260709 12:18:50.749039 26461 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.762980 26418 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:18:50.797152 26465 log.cc:927] Time spent T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.201s	user 0.002s	sys 0.001s
I20260709 12:18:50.764539 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:50.956066 26418 consensus_queue.cc:1048] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:50.957267 26484 consensus_queue.cc:1059] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:50.757982 26399 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:50.804149 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:50.963165 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:50.964001 24394 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:50.827505 24438 leader_election.cc:336] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.931s (SENT)
W20260709 12:18:50.964985 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 137506us
I20260709 12:18:50.723384 26093 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:50.856478 25083 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:50.863906 24317 raft_consensus.cc:1275] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:18:50.890631 26445 raft_consensus.cc:697] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:50.969835 24317 pending_rounds.cc:85] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756: Aborting all ops after (but not including) 4
I20260709 12:18:50.970175 24317 pending_rounds.cc:107] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:18:50.697134 26460 raft_consensus.cc:740] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:50.970469 24317 raft_consensus.cc:2889] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:50.971339 26460 consensus_queue.cc:260] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:50.893864 24398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1623) took 1555 ms. Trace:
I20260709 12:18:50.957923 26291 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:50.864519 26443 consensus_queue.cc:1048] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 12:18:50.809410 26473 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:50.858771 26442 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.002s	sys 0.018s
I20260709 12:18:50.809156 26232 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:50.904220 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:50.907476 26362 consensus_queue.cc:1059] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:50.889151 26441 raft_consensus.cc:2804] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:18:50.908394 26477 log.cc:927] Time spent T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:18:50.908603 26371 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:18:50.909407 26479 log.cc:927] Time spent T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:18:50.909847 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:50.712981 26402 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:50.727733 26455 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:51.020439 26455 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:51.006507 24467 raft_consensus.cc:1240] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:18:50.859066 25114 raft_consensus.cc:1275] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:50.917380 24365 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:50.826089 26450 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:50.924484 24391 raft_consensus.cc:2393] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 3: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:50.859066 26448 raft_consensus.cc:697] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:18:50.748652 25113 rpcz_store.cc:269] 0709 12:18:48.491809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.495412 (+  3603us) service_pool.cc:224] Handling call
0709 12:18:50.372814 (+1877402us) spinlock_profiling.cc:243] Waited 899 ms on lock 0x7b540075fdd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:50.372974 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2068106112}
I20260709 12:18:50.892975 26447 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:50.927078 24440 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:50.941505 24324 raft_consensus.cc:1240] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:50.916122 26397 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:50.951851 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1508) took 3763 ms. Trace:
I20260709 12:18:50.887071 26301 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:51.029837 26397 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:51.030596 26397 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:51.031948 26301 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:50.953615 24471 raft_consensus.cc:1275] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:18:50.954455 26461 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:51.032663 24471 pending_rounds.cc:85] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 5
I20260709 12:18:51.032966 24471 pending_rounds.cc:107] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:18:51.033210 24471 raft_consensus.cc:2889] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:51.029912 24474 rpcz_store.cc:276] 0709 12:18:47.188225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:47.188590 (+   365us) service_pool.cc:224] Handling call
0709 12:18:47.195772 (+  7182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:50.893280 (+3697508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:50.951518 (+ 58238us) spinlock_profiling.cc:243] Waited 3.53 s on lock 0x7b540010f754. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:50.951780 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8120802688}
I20260709 12:18:50.926761 26456 raft_consensus.cc:2764] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:18:50.812412 26378 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:51.037271 26378 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.974555 25118 raft_consensus.cc:1240] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 2. Current term is 3. Ops: []
W20260709 12:18:50.975397 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 118993us
W20260709 12:18:51.038069 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 120759us
I20260709 12:18:51.038769 24365 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:50.972541 24398 rpcz_store.cc:276] 0709 12:18:49.338042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.338176 (+   134us) service_pool.cc:224] Handling call
0709 12:18:49.338526 (+   350us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:49.338921 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:49.338953 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:49.346688 (+  7735us) log.cc:844] Serialized 52 byte log entry
0709 12:18:49.663160 (+316472us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:49.663199 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:49.663265 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:50.858672 (+1195407us) raft_consensus.cc:1685] finished
0709 12:18:50.858693 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:50.893806 (+ 35113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":294,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":42552,"thread_start_us":240079,"threads_started":1,"wal-append.queue_time_us":310315}
I20260709 12:18:51.042397 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:51.043529 24398 raft_consensus.cc:2393] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 3: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:51.049263 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:51.050428 24469 raft_consensus.cc:2393] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 3: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:51.051576 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:51.052291 24469 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:51.053727 24468 raft_consensus.cc:1240] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:18:50.986651 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 92294.2us
I20260709 12:18:50.986927 24396 raft_consensus.cc:1240] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:50.950456 26423 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:50.954501 26481 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.924540 26403 consensus_queue.cc:1048] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:18:50.962334 26462 raft_consensus.cc:697] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:50.983458 26463 raft_consensus.cc:3055] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:50.958580 26484 raft_consensus.cc:3055] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:50.929067 26470 consensus_queue.cc:1048] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:18:51.003736 26362 raft_consensus.cc:3055] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:51.004913 26372 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:50.929279 26459 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:50.985603 26460 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:51.014317 24394 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:18:50.994663 26441 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.986388 26227 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:50.990979 26399 raft_consensus.cc:697] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:51.006280 26299 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:51.065320 26447 raft_consensus.cc:697] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:50.970484 26445 consensus_queue.cc:237] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:51.017988 26409 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:51.019102 26410 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:50.987990 26473 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:51.027156 26291 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:18:51.028090 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 101090us
I20260709 12:18:51.028649 26446 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:51.028301 26448 consensus_queue.cc:237] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:51.058207 24366 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:51.059747 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:51.060091 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:18:51.064536 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.060770 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:51.073704 26397 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:51.061159 26378 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:51.082267 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 115892us
W20260709 12:18:51.085098 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.086496 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:50.997895 26232 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:51.075225 26463 raft_consensus.cc:740] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:50.939970 26341 consensus_queue.cc:237] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:51.592258 24400 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.022s	sys 0.081s
W20260709 12:18:51.373426 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.644038 24398 raft_consensus.cc:2393] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 4: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:18:51.644064 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:51.409161 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:18:51.336520 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.646600 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:51.646729 24468 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:51.648037 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.081398 26368 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.406422 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:51.662086 24396 raft_consensus.cc:2393] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 4: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:18:51.648154 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:51.114224 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:51.644076 24400 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.025s	sys 0.082s
I20260709 12:18:51.031484 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:51.084033 26484 raft_consensus.cc:740] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:51.472585 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:51.649056 24473 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:51.413115 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 325207us
I20260709 12:18:51.096067 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:51.739741 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1643) took 2392 ms. Trace:
I20260709 12:18:51.370524 26462 consensus_queue.cc:237] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:51.789569 24465 rpcz_store.cc:276] 0709 12:18:49.338003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.639452 (+301449us) service_pool.cc:224] Handling call
0709 12:18:49.639782 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:49.640031 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:49.640059 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:49.640518 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 12:18:50.857864 (+1217346us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:50.985942 (+128078us) log.cc:844] Serialized 14 byte log entry
0709 12:18:51.603538 (+617596us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b5400373aa0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a972c7733 00007f4a9734cdbf 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c
0709 12:18:51.612810 (+  9272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:51.629975 (+ 17165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:51.637647 (+  7672us) raft_consensus.cc:1685] finished
0709 12:18:51.657360 (+ 19713us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:51.729929 (+ 72569us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":142053,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":4282,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":10411,"spinlock_wait_cycles":5163264,"thread_start_us":1160564,"threads_started":2,"wal-append.queue_time_us":1048246}
I20260709 12:18:51.791910 26354 tablet_copy_client.cc:538] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:51.792003 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:51.655439 24391 raft_consensus.cc:2393] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 3: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:51.234874 26305 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:51.793638 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:51.794731 24391 raft_consensus.cc:2393] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 4: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:18:51.739101 26399 consensus_queue.cc:237] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:51.795728 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:51.669675 26464 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:51.656406 26470 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:18:51.650076 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 591606us
I20260709 12:18:51.677140 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1638) took 1800 ms. Trace:
I20260709 12:18:51.688428 24219 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54252 (request call id 252) took 7792 ms. Trace:
W20260709 12:18:51.689939 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:51.824468 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.088986 26362 raft_consensus.cc:740] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:51.825995 26362 consensus_queue.cc:260] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:51.827432 26362 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:51.647280 24474 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:18:51.481741 24220 catalog_manager.cc:5697] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 2 to 3, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 3 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:51.195643 26468 log.cc:927] Time spent T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:18:51.669323 26418 raft_consensus.cc:2749] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:51.236389 26488 raft_consensus.cc:2804] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:51.175196 26301 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.472501 26459 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:51.738499 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:51.231794 26402 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:51.738972 26437 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:51.107041 26441 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:51.832702 26364 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:18:51.858785 24470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.013s	sys 0.032s
I20260709 12:18:51.569073 24467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1637) took 3395 ms. Trace:
I20260709 12:18:51.094307 26443 consensus_queue.cc:1059] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.644s
I20260709 12:18:51.868103 26443 raft_consensus.cc:3055] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:51.862838 24467 rpcz_store.cc:276] 0709 12:18:48.174947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.920380 (+745433us) service_pool.cc:224] Handling call
0709 12:18:49.089416 (+169036us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:51.021195 (+1931779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:51.568732 (+547537us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b540029ed54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:51.568988 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4356159872}
I20260709 12:18:51.868804 26443 raft_consensus.cc:740] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:51.869814 24467 raft_consensus.cc:1240] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:51.869748 26443 consensus_queue.cc:260] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:51.638700 26093 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:51.094909 26406 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:51.649880 26367 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:51.085579 26423 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:51.919914 26093 consensus_queue.cc:1048] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:51.767339 26499 consensus_queue.cc:1059] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:51.411283 26483 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:51.670138 26461 consensus_meta.cc:287] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.625s	user 0.007s	sys 0.004s
W20260709 12:18:51.738453 26492 log.cc:927] Time spent T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 12:18:51.789259 24394 raft_consensus.cc:2393] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 3: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:51.953392 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:51.954442 24394 raft_consensus.cc:2393] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 3: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:18:51.955478 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:51.956346 24394 raft_consensus.cc:2368] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 6. Current term is 7.
I20260709 12:18:51.261124 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 397) took 1888 ms. Trace:
I20260709 12:18:51.801018 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:51.956826 24471 rpcz_store.cc:276] 0709 12:18:49.372320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.641137 (+268817us) service_pool.cc:224] Handling call
0709 12:18:50.953237 (+1312100us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:51.033668 (+ 80431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:51.260777 (+227109us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b540010f750. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:51.261027 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3016944000}
I20260709 12:18:51.957625 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:51.796518 24391 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:18:51.958071 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:18:51.659029 24469 consensus_meta.cc:287] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.606s	user 0.006s	sys 0.003s
I20260709 12:18:51.081671 26481 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:51.820899 24393 rpcz_store.cc:276] 0709 12:18:49.876515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.946801 (+ 70286us) service_pool.cc:224] Handling call
0709 12:18:50.375002 (+428201us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b58001c9e98. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c325fc0 00007f4a9c310929 00007f4a9c3103d2 00007f4a95887bd4
0709 12:18:50.375204 (+   202us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:50.375587 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:50.375612 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:50.376065 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 12:18:50.695464 (+319399us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:50.730614 (+ 35150us) log.cc:844] Serialized 14 byte log entry
0709 12:18:51.449457 (+718843us) spinlock_profiling.cc:243] Waited 9.75 ms on lock 0x7b18002fbe40. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a94241e07 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425c455 00007f4a97344060 00007f4a97356716 00007f4a97367287 00007f4a97367208
0709 12:18:51.676840 (+227383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:51.676911 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:51.676952 (+    41us) raft_consensus.cc:1685] finished
0709 12:18:51.676964 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:51.677086 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1590,"prepare.queue_time_us":198232,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":405040,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":164,"spinlock_wait_cycles":50384128,"thread_start_us":556949,"threads_started":3,"wal-append.queue_time_us":356625}
I20260709 12:18:51.841157 24289 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:51.821156 26464 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:51.851222 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:51.850946 24440 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:51.852787 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.699312 26368 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:51.829809 24220 catalog_manager.cc:5697] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 2 to 3, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 3 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:51.525319 26435 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:51.857069 25117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35188 (request call id 797) took 1128 ms. Trace:
I20260709 12:18:51.629545 26253 raft_consensus.cc:2749] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:51.860345 24470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.013s	sys 0.032s
I20260709 12:18:51.857123 26299 consensus_queue.cc:1059] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:18:51.865229 26232 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:51.853168 26412 consensus_queue.cc:1059] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
W20260709 12:18:51.866961 26408 consensus_meta.cc:287] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.195s	user 0.008s	sys 0.015s
I20260709 12:18:51.735620 24472 raft_consensus.cc:1240] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:51.842826 26488 raft_consensus.cc:697] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:51.871165 26364 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:51.836524 26470 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:51.878713 26484 consensus_queue.cc:260] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:51.879253 26397 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:51.879649 25083 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:51.880955 24400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1649) took 1285 ms. Trace:
I20260709 12:18:51.881814 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:51.872931 26446 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.884465 26447 consensus_queue.cc:237] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:51.887614 26460 consensus_meta.cc:287] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.790s	user 0.014s	sys 0.005s
I20260709 12:18:51.851743 26414 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:18:51.853278 26419 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.854897 26301 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:51.893131 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:51.861624 26437 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:51.895210 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:51.897521 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:18:51.898048 26455 consensus_meta.cc:287] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.877s	user 0.010s	sys 0.001s
I20260709 12:18:51.854430 26361 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.921271 26423 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:51.209486 26227 raft_consensus.cc:697] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:51.892836 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:51.943928 24468 raft_consensus.cc:2468] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:18:51.931311 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:51.951273 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:51.958823 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:52.489512 24396 raft_consensus.cc:2368] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 2. Current term is 3.
I20260709 12:18:52.489998 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:52.490528 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:52.490846 24469 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
W20260709 12:18:52.236470 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:52.115940 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 470235us
I20260709 12:18:52.182464 24320 raft_consensus.cc:1240] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:52.494148 24322 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:52.494274 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33198 (request call id 399) took 1446 ms. Trace:
I20260709 12:18:52.490720 24319 raft_consensus.cc:2368] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4.
W20260709 12:18:52.056280 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:52.494845 24468 rpcz_store.cc:276] 0709 12:18:51.048296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.059740 (+ 11444us) service_pool.cc:224] Handling call
0709 12:18:52.494205 (+1434465us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:52.491650 24469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 1655) took 1444 ms (client timeout 1697 ms). Trace:
W20260709 12:18:52.178854 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:52.190315 24473 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
W20260709 12:18:52.495906 24469 rpcz_store.cc:269] 0709 12:18:51.047685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.051294 (+  3609us) service_pool.cc:224] Handling call
0709 12:18:52.491593 (+1440299us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:52.496707 24473 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 1649) took 1451 ms (client timeout 1629 ms). Trace:
I20260709 12:18:52.497254 24470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1653) took 1450 ms. Trace:
W20260709 12:18:52.252681 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 437593us
I20260709 12:18:52.490742 24393 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:18:52.493770 24398 raft_consensus.cc:2393] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 3: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:18:52.017457 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:52.498732 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:52.498620 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 405) took 1270 ms. Trace:
I20260709 12:18:52.499989 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:18:52.123713 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 449686us
I20260709 12:18:51.967482 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:18:52.109205 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 412705us
W20260709 12:18:52.230079 24395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 1643) took 1746 ms (client timeout 1944 ms). Trace:
I20260709 12:18:51.821409 24219 rpcz_store.cc:276] 0709 12:18:43.866193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.866426 (+   233us) service_pool.cc:224] Handling call
0709 12:18:51.658833 (+7792407us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:47.100780 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:47.108707 (+  7927us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:47.108750 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:18:47.108768 (+    18us) tablet.cc:662] Decoding operations
0709 12:18:47.248869 (+140101us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:47.248926 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:47.248953 (+    27us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:18:47.249596 (+   643us) tablet.cc:701] Row locks acquired
0709 12:18:47.249614 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:18:47.249780 (+   166us) write_op.cc:270] Start()
0709 12:18:47.249919 (+   139us) write_op.cc:276] Timestamp: P: 1783599527249722 usec, L: 0
0709 12:18:47.249942 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:18:47.263873 (+ 13931us) log.cc:844] Serialized 3272 byte log entry
0709 12:18:48.480945 (+1217072us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:18:49.075153 (+594208us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b20000a5d78. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a96efab91 00007f4a96f1ca19 00007f4a96ee78c3 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169 00007f4a96ef0131 00007f4a96eef42d 0000000000388634
0709 12:18:49.840158 (+765005us) op_driver.cc:464] REPLICATION: finished
0709 12:18:50.758073 (+917915us) write_op.cc:301] APPLY: starting
0709 12:18:50.791541 (+ 33468us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:50.791773 (+   232us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:50.791811 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:50.913185 (+121374us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:50.913408 (+   223us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:18:50.913456 (+    48us) write_op.cc:312] APPLY: finished
0709 12:18:50.913787 (+   331us) log.cc:844] Serialized 65 byte log entry
0709 12:18:50.982649 (+ 68862us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:50.985393 (+  2744us) write_op.cc:454] Released schema lock
0709 12:18:50.987597 (+  2204us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:51.024046 (+ 36449us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:51.024118 (+    72us) write_op.cc:454] Released schema lock
0709 12:18:51.465747 (+441629us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b180028a1a0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9422d2a6 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9425f3f3 00007f4a942617c1
0709 12:18:51.467581 (+  1834us) spinlock_profiling.cc:243] Waited 4.38 ms on lock 0x7b180028a1a0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9425f3f3 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd 0000000000388634 0000000000388479 00007f4a9424283a
Metrics: {"mutex_wait_us":7491,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":867177,"apply.run_cpu_time_us":30662,"apply.run_wall_time_us":276200,"num_ops":8,"prepare.queue_time_us":250189,"prepare.run_cpu_time_us":58300,"prepare.run_wall_time_us":426255,"raft.queue_time_us":234389,"raft.run_cpu_time_us":30786,"raft.run_wall_time_us":1269455,"replication_time_us":2542440,"spinlock_wait_cycles":32948992,"thread_start_us":1488739,"threads_started":5,"wal-append.queue_time_us":366272,"wal-append.run_cpu_time_us":96944,"wal-append.run_wall_time_us":3157311}]]}
W20260709 12:18:52.491953 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 650863us
W20260709 12:18:52.492302 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:52.505074 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 406) took 1190 ms. Trace:
I20260709 12:18:52.501566 26093 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:52.500846 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:52.493700 24220 catalog_manager.cc:5697] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index -1 to 4, term changed from 3 to 4, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to <none>, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:52.505911 24398 raft_consensus.cc:2393] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 3: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:52.503515 25116 raft_consensus.cc:1275] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:52.508435 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:52.509074 24393 raft_consensus.cc:2376] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4. Re-sending same reply.
I20260709 12:18:52.508733 24220 catalog_manager.cc:5697] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 1 to 2, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 2 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:52.495435 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 644516us
I20260709 12:18:52.510496 25116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 799) took 1764 ms. Trace:
I20260709 12:18:52.510181 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:52.510859 25116 rpcz_store.cc:276] 0709 12:18:50.745952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:50.746075 (+   123us) service_pool.cc:224] Handling call
0709 12:18:51.568168 (+822093us) spinlock_profiling.cc:243] Waited 6.45 ms on lock 0x7b5800004598. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c325fc0 00007f4a9c310929 00007f4a9c3103d2 00007f4a95887bd4
0709 12:18:51.568423 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:52.508443 (+940020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:52.510257 (+  1814us) spinlock_profiling.cc:243] Waited 935 ms on lock 0x7b5400050854. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:52.510436 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2164612736}
I20260709 12:18:52.511344 24440 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:52.497144 24473 rpcz_store.cc:269] 0709 12:18:51.045527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.056584 (+ 11057us) service_pool.cc:224] Handling call
0709 12:18:52.496646 (+1440062us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:52.507671 26093 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:52.512550 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:52.513772 24393 raft_consensus.cc:2368] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 6. Current term is 7.
I20260709 12:18:52.492769 25117 rpcz_store.cc:276] 0709 12:18:50.729160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:50.729865 (+   705us) service_pool.cc:224] Handling call
0709 12:18:51.472394 (+742529us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b5800004598. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c3120a0 00007f4a9c311984 00007f4a9588c6d4 00007f4a9588c662
0709 12:18:51.856984 (+384590us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5835136}
I20260709 12:18:52.514204 26093 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:52.508853 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:52.516860 24399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 1644) took 2032 ms. Trace:
I20260709 12:18:52.517287 24399 rpcz_store.cc:276] 0709 12:18:50.484607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:50.484783 (+   176us) service_pool.cc:224] Handling call
0709 12:18:52.516579 (+2031796us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b54001b8854. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:52.516787 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4277390080}
W20260709 12:18:52.503612 25082 leader_election.cc:336] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.050s (SENT)
I20260709 12:18:52.518982 24472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1652) took 1472 ms. Trace:
W20260709 12:18:52.519495 25082 leader_election.cc:336] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.907s (SENT)
I20260709 12:18:52.520120 24320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 251) took 1618 ms. Trace:
I20260709 12:18:52.029085 24321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 254) took 1108 ms. Trace:
W20260709 12:18:52.507227 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:52.492134 24400 rpcz_store.cc:276] 0709 12:18:50.595803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:50.864241 (+268438us) service_pool.cc:224] Handling call
0709 12:18:50.903595 (+ 39354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:51.036534 (+132939us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:51.036578 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:51.037261 (+   683us) log.cc:844] Serialized 26 byte log entry
0709 12:18:51.663831 (+626570us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:51.663872 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:51.663953 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:51.880719 (+216766us) raft_consensus.cc:1685] finished
0709 12:18:51.880742 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:51.880889 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45657,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":32119,"thread_start_us":747931,"threads_started":2,"wal-append.queue_time_us":797985}
I20260709 12:18:52.520716 24320 rpcz_store.cc:276] 0709 12:18:50.901730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:50.901866 (+   136us) service_pool.cc:224] Handling call
0709 12:18:50.902161 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:52.493665 (+1591504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:52.519890 (+ 26225us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400339854. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:52.520054 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2943773568}
I20260709 12:18:52.500276 24469 rpcz_store.cc:276] 0709 12:18:51.228434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:52.497555 (+1269121us) service_pool.cc:224] Handling call
0709 12:18:52.497964 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:52.498314 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:52.498340 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:52.498393 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:52.498425 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:52.498473 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:52.498569 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:52.502727 24394 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:18:52.519371 24472 rpcz_store.cc:276] 0709 12:18:51.046569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.056360 (+  9791us) service_pool.cc:224] Handling call
0709 12:18:51.080978 (+ 24618us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:52.490134 (+1409156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:52.518764 (+ 28630us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b5400143cd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:52.518924 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1504890112}
W20260709 12:18:52.520246 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 640642us
I20260709 12:18:52.524020 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:52.499858 24471 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:52.507397 24468 rpcz_store.cc:276] 0709 12:18:51.314539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:52.503822 (+1189283us) service_pool.cc:224] Handling call
0709 12:18:52.504133 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:52.504297 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:52.504320 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:52.504360 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:52.504833 (+   473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:52.504902 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:52.505017 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:52.525321 24394 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 1.
W20260709 12:18:52.521296 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:52.528093 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:18:52.504812 24290 leader_election.cc:336] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.540s (SENT)
I20260709 12:18:52.529172 24394 raft_consensus.cc:2393] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 3: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:18:52.529781 24323 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
W20260709 12:18:52.504492 24395 rpcz_store.cc:269] 0709 12:18:50.484108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:50.608663 (+124555us) service_pool.cc:224] Handling call
0709 12:18:52.228807 (+1620144us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b5400208fd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:52.229971 (+  1164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3532585856}
I20260709 12:18:52.482331 26354 tablet_bootstrap.cc:492] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
W20260709 12:18:52.001058 26450 consensus_meta.cc:287] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.964s	user 0.009s	sys 0.004s
I20260709 12:18:51.933907 26483 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:52.532244 25083 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
W20260709 12:18:52.416607 26445 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.017s	sys 0.000s
I20260709 12:18:52.532874 24319 raft_consensus.cc:1240] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:18:52.626443 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:52.497758 24470 rpcz_store.cc:276] 0709 12:18:51.046916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.056449 (+  9533us) service_pool.cc:224] Handling call
0709 12:18:51.081155 (+ 24706us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:51.081605 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:51.081659 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:51.094058 (+ 12399us) log.cc:844] Serialized 26 byte log entry
0709 12:18:52.496918 (+1402860us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:52.496957 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:52.497021 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:52.497059 (+    38us) raft_consensus.cc:1685] finished
0709 12:18:52.497075 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:52.497199 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3860,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":133,"thread_start_us":1247855,"threads_started":1,"wal-append.queue_time_us":894837}
I20260709 12:18:52.528012 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:52.535557 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:52.515090 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:52.629642 24391 raft_consensus.cc:2410] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:18:52.520884 24321 rpcz_store.cc:276] 0709 12:18:50.920751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:50.921284 (+   533us) service_pool.cc:224] Handling call
0709 12:18:50.921764 (+   480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:50.929880 (+  8116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:50.929928 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:50.930599 (+   671us) log.cc:844] Serialized 26 byte log entry
0709 12:18:51.001477 (+ 70878us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:51.001537 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:51.001642 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:52.028722 (+1027080us) raft_consensus.cc:1685] finished
0709 12:18:52.028753 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:52.028997 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7754,"raft.queue_time_us":8647,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":16461,"thread_start_us":44425,"threads_started":1,"wal-append.queue_time_us":335933}
I20260709 12:18:52.629830 24393 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:18:52.516342 26367 raft_consensus.cc:2749] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:52.630419 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:52.538295 24220 catalog_manager.cc:5697] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 1 to 2, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 2 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.631767 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:52.529763 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:51.933511 26173 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.056557 26378 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:52.538848 26424 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.620081 26488 consensus_queue.cc:237] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:52.624221 24469 raft_consensus.cc:1275] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:18:52.075945 26305 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:52.646381 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:52.649276 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:52.668300 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:52.630967 24321 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:52.649912 24320 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:52.547202 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:52.655742 24318 raft_consensus.cc:1275] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:52.660351 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:52.663590 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:52.692090 24399 raft_consensus.cc:2393] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 3: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:18:52.693162 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:52.235443 26487 raft_consensus.cc:3055] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:52.677430 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:52.215232 26454 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:18:52.625248 26445 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.021s	sys 0.000s
I20260709 12:18:52.516608 26399 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:52.720556 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:52.525235 26443 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:52.700876 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:52.539640 26093 raft_consensus.cc:2804] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:18:52.702242 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:52.744300 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:52.703840 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:52.709177 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:52.746585 24394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2110) took 1094 ms. Trace:
I20260709 12:18:52.747108 24394 rpcz_store.cc:276] 0709 12:18:51.652404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:52.680254 (+1027850us) service_pool.cc:224] Handling call
0709 12:18:52.746473 (+ 66219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:52.749020 24466 raft_consensus.cc:1240] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:18:52.722637 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1651) took 1913 ms. Trace:
W20260709 12:18:52.698959 24323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57702 (request call id 243) took 2859 ms (client timeout 2443 ms). Trace:
I20260709 12:18:52.612004 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:18:52.771289 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 266013us
I20260709 12:18:52.625116 26460 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.294600 26441 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:52.779906 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 275130us
I20260709 12:18:52.090484 26473 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:52.659415 26362 consensus_meta.cc:287] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.831s	user 0.015s	sys 0.000s
I20260709 12:18:52.613984 26301 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:52.517311 26361 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:52.623775 26408 consensus_queue.cc:1059] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.203s
W20260709 12:18:52.755851 25082 leader_election.cc:336] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.401s (SENT)
I20260709 12:18:52.822101 25082 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:52.822359 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 290170us
I20260709 12:18:52.616915 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:52.616997 26437 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:18:52.750942 24323 rpcz_store.cc:269] 0709 12:18:49.839731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.839878 (+   147us) service_pool.cc:224] Handling call
0709 12:18:52.698771 (+2858893us) spinlock_profiling.cc:243] Waited 2.5 s on lock 0x7b5400167954. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:52.698883 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5748224640}
I20260709 12:18:52.543694 26484 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:52.777225 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 265946us
I20260709 12:18:52.839112 24440 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:52.839613 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:52.840387 24468 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:18:52.840727 24440 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:52.777343 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 122614us
W20260709 12:18:52.841882 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:52.780202 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:52.615443 26481 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:52.616891 26368 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:52.517964 26419 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:52.517598 26446 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:52.677325 26462 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.519598 26414 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:52.826807 26435 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.678864 26483 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:52.872900 26517 raft_consensus.cc:3055] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:52.517787 26455 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:52.526268 26423 consensus_queue.cc:1048] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.250s
I20260709 12:18:52.706261 26487 raft_consensus.cc:740] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:52.541646 26434 consensus_queue.cc:1059] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.239s
I20260709 12:18:52.694422 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:52.743971 26093 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.745886 26367 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:51.975450 26461 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:52.624605 26450 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:52.677870 26173 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:52.022620 26463 consensus_queue.cc:260] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:52.836172 24471 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:18:52.921443 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33198 (request call id 409) took 1042 ms. Trace:
I20260709 12:18:52.805081 26227 consensus_queue.cc:237] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:52.848402 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1650) took 1802 ms. Trace:
W20260709 12:18:52.825546 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 321935us
W20260709 12:18:53.039117 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 265610us
I20260709 12:18:52.869124 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:53.086939 24467 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:18:52.785820 24320 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:18:52.835955 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:53.053525 24324 raft_consensus.cc:1240] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:53.088208 26441 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:52.881114 24396 raft_consensus.cc:1240] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:18:52.844202 24440 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:53.062307 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:52.750751 24393 rpcz_store.cc:276] 0709 12:18:50.809543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:52.721908 (+1912365us) service_pool.cc:224] Handling call
0709 12:18:52.722176 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:52.722349 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:52.722372 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:52.722410 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:52.722445 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:52.722495 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:52.722586 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:52.809358 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:52.922374 24471 rpcz_store.cc:276] 0709 12:18:51.878710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:52.017087 (+138377us) service_pool.cc:224] Handling call
0709 12:18:52.921373 (+904286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:52.845106 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 403) took 1754 ms. Trace:
I20260709 12:18:52.813922 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:53.145641 24396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2104) took 2099 ms. Trace:
W20260709 12:18:52.924666 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 168858us
I20260709 12:18:53.153321 24318 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:53.154814 24392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 1647) took 2668 ms (client timeout 3028 ms). Trace:
W20260709 12:18:53.155401 24392 rpcz_store.cc:269] 0709 12:18:50.486348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:50.490472 (+  4124us) service_pool.cc:224] Handling call
0709 12:18:53.154228 (+2663756us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b54001112d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:53.154579 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4861707648}
W20260709 12:18:53.156075 25082 leader_election.cc:336] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.551s (SENT)
I20260709 12:18:52.917302 26093 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:52.939479 26173 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:52.575299 26232 consensus_queue.cc:1048] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.168s
I20260709 12:18:52.928323 26361 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:52.868820 26364 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:52.929678 26378 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:52.846869 26397 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:53.195410 26397 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.195941 26397 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:52.851514 26399 raft_consensus.cc:697] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 4 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:53.202134 26399 consensus_queue.cc:237] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:52.798080 26410 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.210153 26410 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:52.918793 26414 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:52.969924 26419 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:52.699573 26424 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:52.928040 26434 raft_consensus.cc:3055] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:53.214658 26434 raft_consensus.cc:740] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:52.887670 26435 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:53.219355 26435 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:52.994949 26446 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:52.965987 26450 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:52.810401 26448 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:53.223605 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.223410 26448 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:53.224403 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 68635.8us
W20260709 12:18:53.225458 24321 consensus_meta.cc:287] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.534s	user 0.011s	sys 0.003s
I20260709 12:18:53.225981 24321 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:53.227128 24316 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:52.743400 26454 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:53.231099 26454 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:53.228585 24316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 1553) took 1292 ms. Trace:
I20260709 12:18:53.233021 24316 rpcz_store.cc:276] 0709 12:18:51.935696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.957410 (+ 21714us) service_pool.cc:224] Handling call
0709 12:18:53.228329 (+1270919us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54000a8554. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:53.228502 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2480562560}
I20260709 12:18:52.998530 26455 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:52.809907 26460 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:53.237520 26460 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:52.880191 26462 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:52.929026 26463 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:53.240332 24400 raft_consensus.cc:1275] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:52.871925 26470 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:52.867233 26473 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:52.944161 26487 consensus_queue.cc:260] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:53.242368 24400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1652) took 2332 ms. Trace:
I20260709 12:18:53.242774 26487 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:52.865590 26513 log.cc:927] Time spent T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:18:52.881695 26517 raft_consensus.cc:740] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:52.845299 26519 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:52.852097 26523 raft_consensus.cc:2804] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:53.000039 26526 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.281245 26526 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:53.283093 26519 raft_consensus.cc:2749] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:53.283907 26526 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:18:52.820447 24366 connection.cc:256] RPC call timeout handler was delayed by -4.7246449930000836s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
W20260709 12:18:53.103783 24322 consensus_meta.cc:287] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.581s	user 0.009s	sys 0.005s
W20260709 12:18:53.099603 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:53.094724 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 251995us
W20260709 12:18:53.285079 24366 connection.cc:256] RPC call timeout handler was delayed by -4.6922449930000312s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1569s for a response
W20260709 12:18:53.285885 24366 connection.cc:256] RPC call timeout handler was delayed by -4.6274449930001538s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16410000000000002s for a response
W20260709 12:18:53.286346 24366 connection.cc:256] RPC call timeout handler was delayed by -4.5887449930000912s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
W20260709 12:18:53.286778 24366 connection.cc:256] RPC call timeout handler was delayed by -4.5374449930000083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17410000000000003s for a response
W20260709 12:18:53.287185 24366 connection.cc:256] RPC call timeout handler was delayed by -4.532944993000001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1746s for a response
W20260709 12:18:53.287611 24366 connection.cc:256] RPC call timeout handler was delayed by -4.4429449930000828s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
W20260709 12:18:53.288033 24366 connection.cc:256] RPC call timeout handler was delayed by -4.3925449930000013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1902s for a response
I20260709 12:18:53.062448 24466 rpcz_store.cc:276] 0709 12:18:51.045812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.045964 (+   152us) service_pool.cc:224] Handling call
0709 12:18:51.086103 (+ 40139us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:52.749576 (+1663473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:52.848074 (+ 98498us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b5400315e54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:52.848320 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3823474432}
I20260709 12:18:53.288534 25083 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:53.149513 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:52.851869 26068 raft_consensus.cc:2749] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:53.289999 24317 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:53.160332 24394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1654) took 2220 ms. Trace:
I20260709 12:18:53.290925 24394 rpcz_store.cc:276] 0709 12:18:50.939841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:52.748071 (+1808230us) service_pool.cc:224] Handling call
0709 12:18:52.760321 (+ 12250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:52.780838 (+ 20517us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:52.780970 (+   132us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:52.819070 (+ 38100us) log.cc:844] Serialized 26 byte log entry
0709 12:18:53.156201 (+337131us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:53.156403 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:53.157520 (+  1117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:53.157789 (+   269us) raft_consensus.cc:1685] finished
0709 12:18:53.157806 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:53.159533 (+  1727us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":51775,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":9066,"thread_start_us":271012,"threads_started":1,"wal-append.queue_time_us":305540}
I20260709 12:18:53.293526 26462 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:53.295410 26473 consensus_queue.cc:1048] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:53.132181 24365 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:53.296805 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 208516us
I20260709 12:18:53.297966 24365 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:53.298633 26368 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:53.299201 26455 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:53.166180 24323 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:53.299911 25083 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:53.301705 24324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 258) took 1482 ms. Trace:
I20260709 12:18:53.167258 26409 raft_consensus.cc:3055] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:53.302449 26409 raft_consensus.cc:740] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:53.302217 26305 consensus_queue.cc:1059] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:53.303319 26455 raft_consensus.cc:697] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:53.167490 24399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 312) took 1279 ms. Trace:
I20260709 12:18:53.168943 24289 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:53.304844 26455 consensus_queue.cc:237] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:53.306313 26305 raft_consensus.cc:3055] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:53.306964 26305 raft_consensus.cc:740] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:18:53.169193 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 386724us
I20260709 12:18:53.106389 26341 consensus_queue.cc:1059] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 12:18:53.309357 26341 raft_consensus.cc:3055] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:53.309842 26341 raft_consensus.cc:740] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:18:53.311663 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.172116 26464 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:53.172403 24395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1655) took 2172 ms. Trace:
I20260709 12:18:53.148725 24465 rpcz_store.cc:276] 0709 12:18:51.090298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.871029 (+780731us) service_pool.cc:224] Handling call
0709 12:18:51.897042 (+ 26013us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:51.897286 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:52.078002 (+180716us) log.cc:844] Serialized 14 byte log entry
0709 12:18:52.781511 (+703509us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:52.803803 (+ 22292us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:52.815016 (+ 11213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:52.823667 (+  8651us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:52.837685 (+ 14018us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11399,"prepare.queue_time_us":721885,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":98549,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":27866,"thread_start_us":675622,"threads_started":3,"wal-append.queue_time_us":693913}
I20260709 12:18:53.146390 24396 rpcz_store.cc:276] 0709 12:18:51.045494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:52.845779 (+1800285us) service_pool.cc:224] Handling call
0709 12:18:52.877547 (+ 31768us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:53.144611 (+267064us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:53.145277 (+   666us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:53.173839 24325 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:18:53.186828 26502 raft_consensus.cc:2764] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:18:53.222481 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.238021 24318 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:53.304844 24399 rpcz_store.cc:276] 0709 12:18:51.888220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:52.694180 (+805960us) service_pool.cc:224] Handling call
0709 12:18:53.167203 (+473023us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:53.302269 24324 rpcz_store.cc:276] 0709 12:18:51.819389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.819588 (+   199us) service_pool.cc:224] Handling call
0709 12:18:51.820002 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:53.105523 (+1285521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:53.301198 (+195675us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400167454. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:53.301553 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2834945920}
I20260709 12:18:53.246451 26517 consensus_queue.cc:260] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:53.249233 25110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 800) took 1320 ms. Trace:
I20260709 12:18:53.242827 24400 rpcz_store.cc:276] 0709 12:18:50.909550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:52.730759 (+1821209us) service_pool.cc:224] Handling call
0709 12:18:52.815525 (+ 84766us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:53.240694 (+425169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:53.242002 (+  1308us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b54002a4754. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:53.242299 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":975405824}
I20260709 12:18:53.269136 26523 raft_consensus.cc:697] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:53.274575 26093 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:53.275406 24397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2101) took 2206 ms (client timeout 2227 ms). Trace:
I20260709 12:18:53.277034 26448 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:53.278239 26461 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:53.285079 24322 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:53.161581 24473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 407) took 1466 ms. Trace:
I20260709 12:18:53.162810 24393 raft_consensus.cc:1240] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:53.299321 26368 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.164408 26301 raft_consensus.cc:3055] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:53.300257 26488 raft_consensus.cc:2804] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:18:53.166281 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 321964us
W20260709 12:18:53.305449 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 136711us
I20260709 12:18:53.170586 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:18:53.288417 24366 connection.cc:256] RPC call timeout handler was delayed by -4.3889449929999955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
I20260709 12:18:53.301754 25083 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:18:53.328261 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:53.329228 24397 rpcz_store.cc:269] 0709 12:18:51.044306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.674195 (+629889us) service_pool.cc:224] Handling call
0709 12:18:53.222602 (+1548407us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400208ad4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:53.250587 (+ 27985us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3122254720}
I20260709 12:18:53.312705 24395 rpcz_store.cc:276] 0709 12:18:50.999822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:52.781157 (+1781335us) service_pool.cc:224] Handling call
0709 12:18:52.781507 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:52.781722 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:52.781750 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:52.817964 (+ 36214us) log.cc:844] Serialized 26 byte log entry
0709 12:18:53.087409 (+269445us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:53.087562 (+   153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:53.087765 (+   203us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:53.146437 (+ 58672us) raft_consensus.cc:1685] finished
0709 12:18:53.146464 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:53.172135 (+ 25671us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":239038,"threads_started":1,"wal-append.queue_time_us":293009}
I20260709 12:18:53.316416 26414 raft_consensus.cc:2804] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:53.334161 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2105) took 2288 ms. Trace:
W20260709 12:18:53.334503 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.328224 26450 consensus_queue.cc:1048] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:18:53.334946 24396 raft_consensus.cc:1240] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 6. Current term is 7. Ops: []
W20260709 12:18:53.341833 24366 connection.cc:256] RPC call timeout handler was delayed by -4.3178449930001079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
W20260709 12:18:53.342263 24366 connection.cc:256] RPC call timeout handler was delayed by -4.3043449930000861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
I20260709 12:18:53.321398 25110 rpcz_store.cc:276] 0709 12:18:51.928322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.933183 (+  4861us) service_pool.cc:224] Handling call
0709 12:18:52.055156 (+121973us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:52.178909 (+123753us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:52.189411 (+ 10502us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:52.222691 (+ 33280us) log.cc:844] Serialized 26 byte log entry
0709 12:18:52.530871 (+308180us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:52.543236 (+ 12365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:52.631326 (+ 88090us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:53.246640 (+615314us) raft_consensus.cc:1685] finished
0709 12:18:53.248673 (+  2033us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:53.248952 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12503,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":42673,"thread_start_us":279531,"threads_started":1,"wal-append.queue_time_us":318531}
I20260709 12:18:53.343694 26523 consensus_queue.cc:237] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:53.346120 24322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 1550) took 1451 ms. Trace:
I20260709 12:18:53.339252 24393 rpcz_store.cc:276] 0709 12:18:51.045754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:53.161044 (+2115290us) service_pool.cc:224] Handling call
0709 12:18:53.162155 (+  1111us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:53.333822 (+171667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:53.334081 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:53.346683 24322 rpcz_store.cc:276] 0709 12:18:51.894726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.894873 (+   147us) service_pool.cc:224] Handling call
0709 12:18:53.339001 (+1444128us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:53.349593 24366 connection.cc:256] RPC call timeout handler was delayed by -4.2737449930000366s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2034s for a response
I20260709 12:18:53.349493 24396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 289) took 1466 ms. Trace:
I20260709 12:18:53.350342 24396 rpcz_store.cc:276] 0709 12:18:51.875987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:53.332319 (+1456332us) service_pool.cc:224] Handling call
0709 12:18:53.334625 (+  2306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:53.341985 (+  7360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:53.342283 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:53.335812 26368 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:53.353014 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.304186 26409 consensus_queue.cc:260] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:53.358207 24440 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:53.334949 26301 raft_consensus.cc:740] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:53.323779 26341 consensus_queue.cc:260] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:53.216475 26434 consensus_queue.cc:260] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:53.324064 26524 consensus_queue.cc:1059] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
W20260709 12:18:53.360613 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:53.373339 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 71762.2us
W20260709 12:18:53.362205 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.362875 24399 raft_consensus.cc:1240] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:53.362185 24395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 299) took 1479 ms. Trace:
I20260709 12:18:53.331297 24473 rpcz_store.cc:276] 0709 12:18:51.695269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:52.512726 (+817457us) service_pool.cc:224] Handling call
0709 12:18:52.513064 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:52.539607 (+ 26543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:52.539639 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:52.625815 (+ 86176us) log.cc:844] Serialized 26 byte log entry
0709 12:18:53.090966 (+465151us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:53.091097 (+   131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:53.091227 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:53.147067 (+ 55840us) raft_consensus.cc:1685] finished
0709 12:18:53.147090 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:53.161302 (+ 14212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43248,"raft.queue_time_us":112891,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":89601,"thread_start_us":345946,"threads_started":1,"wal-append.queue_time_us":457498}
W20260709 12:18:53.371716 24325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 1552) took 1436 ms (client timeout 1692 ms). Trace:
I20260709 12:18:53.375501 24395 rpcz_store.cc:276] 0709 12:18:51.883096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:53.361028 (+1477932us) service_pool.cc:224] Handling call
0709 12:18:53.361484 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:53.361832 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:53.361853 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:53.361906 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:53.361935 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:53.361986 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:53.362099 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:53.363301 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 49735.4us
I20260709 12:18:53.369913 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:53.370064 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 401) took 2304 ms. Trace:
I20260709 12:18:53.365643 24400 raft_consensus.cc:1240] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 2. Current term is 3. Ops: []
W20260709 12:18:53.375892 24325 rpcz_store.cc:269] 0709 12:18:51.934825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.935010 (+   185us) service_pool.cc:224] Handling call
0709 12:18:53.371415 (+1436405us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b540001d454. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:53.371629 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1298842368}
I20260709 12:18:53.345031 26488 raft_consensus.cc:697] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:53.348593 26410 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:53.362895 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:53.379451 24392 raft_consensus.cc:1275] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:53.308619 26305 consensus_queue.cc:260] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:53.369750 26341 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:53.327303 26483 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:53.389248 25117 raft_consensus.cc:2393] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:18:53.374953 24440 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
W20260709 12:18:53.404985 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.393595 24399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 290) took 1498 ms. Trace:
W20260709 12:18:53.393327 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.409812 26460 raft_consensus.cc:2804] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:53.410522 26460 raft_consensus.cc:697] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 3 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:53.410441 26361 consensus_queue.cc:1059] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:18:53.411980 26361 raft_consensus.cc:3055] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:53.413290 26517 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:53.413451 26305 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:53.415100 26409 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:53.416095 24438 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:53.417104 26367 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:53.417629 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 294) took 1536 ms. Trace:
I20260709 12:18:53.418041 24393 rpcz_store.cc:276] 0709 12:18:51.881667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:53.351941 (+1470274us) service_pool.cc:224] Handling call
0709 12:18:53.416891 (+ 64950us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:53.417251 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:53.417285 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:53.417348 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:53.417379 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:53.417442 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:53.417556 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:53.419461 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:53.420291 24393 raft_consensus.cc:2393] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 3: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:53.407963 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1657) took 1746 ms. Trace:
I20260709 12:18:53.375962 26414 raft_consensus.cc:697] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 4 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:53.407316 24397 raft_consensus.cc:1240] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:53.380887 26526 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.378571 24474 rpcz_store.cc:276] 0709 12:18:51.065520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.832198 (+766678us) service_pool.cc:224] Handling call
0709 12:18:51.832649 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:52.542563 (+709914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:52.542609 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:52.632545 (+ 89936us) log.cc:844] Serialized 26 byte log entry
0709 12:18:53.089738 (+457193us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:53.089892 (+   154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:53.340204 (+250312us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b540010e354. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:53.340251 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:53.345143 (+  4892us) raft_consensus.cc:1685] finished
0709 12:18:53.345160 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:53.369836 (+ 24676us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1631735040,"thread_start_us":361617,"threads_started":1,"wal-append.queue_time_us":476210}
I20260709 12:18:53.440836 24397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 293) took 1559 ms. Trace:
I20260709 12:18:53.441330 24397 rpcz_store.cc:276] 0709 12:18:51.881383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:53.348766 (+1467383us) service_pool.cc:224] Handling call
0709 12:18:53.389472 (+ 40706us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:53.423323 (+ 33851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:53.440756 (+ 17433us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:53.421396 24392 rpcz_store.cc:276] 0709 12:18:51.659002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:53.289404 (+1630402us) service_pool.cc:224] Handling call
0709 12:18:53.336298 (+ 46894us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:53.403581 (+ 67283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:53.405183 (+  1602us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:53.442703 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:53.409401 24399 rpcz_store.cc:276] 0709 12:18:51.880425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:53.337551 (+1457126us) service_pool.cc:224] Handling call
0709 12:18:53.362542 (+ 24991us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:53.379118 (+ 16576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:53.379236 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:53.445362 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:53.446127 24399 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:53.375952 26093 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:53.363554 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:53.367095 26424 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:53.420815 26524 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:53.424582 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.424860 24366 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:53.426493 24473 raft_consensus.cc:1240] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:18:53.426508 26068 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:53.427150 26443 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:53.428514 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:18:53.430620 26544 log.cc:927] Time spent T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.058s	user 0.000s	sys 0.002s
I20260709 12:18:53.431347 24467 raft_consensus.cc:1275] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:53.433899 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:53.434331 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:53.436022 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:53.436376 26435 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.369550 26502 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:53.366259 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:53.484122 26397 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:53.442592 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:53.486578 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:53.401108 24400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 291) took 1512 ms. Trace:
I20260709 12:18:53.441879 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:53.487743 24400 rpcz_store.cc:276] 0709 12:18:51.880785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:53.339109 (+1458324us) service_pool.cc:224] Handling call
0709 12:18:53.365328 (+ 26219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:53.378775 (+ 13447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:53.392839 (+ 14064us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:53.488392 24474 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:18:53.436033 24394 raft_consensus.cc:1275] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:53.489004 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:53.491231 24394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 283) took 1637 ms. Trace:
I20260709 12:18:53.491837 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:53.493115 25110 raft_consensus.cc:2393] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 3: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:18:53.492916 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:53.491685 24394 rpcz_store.cc:276] 0709 12:18:51.853956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:53.292974 (+1439018us) service_pool.cc:224] Handling call
0709 12:18:53.435136 (+142162us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b58001c9e98. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c325fc0 00007f4a9c310929 00007f4a9c3103d2 00007f4a95887bd4
0709 12:18:53.435450 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:53.490843 (+ 55393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:53.491151 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51886464}
I20260709 12:18:53.495146 24470 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:53.496899 26368 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:53.499192 26368 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:53.363762 26301 consensus_queue.cc:260] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:53.501338 26484 consensus_meta.cc:287] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.654s	user 0.009s	sys 0.008s
I20260709 12:18:53.501832 26301 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:53.502982 24391 raft_consensus.cc:2410] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:18:53.503525 26448 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.504034 26448 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:53.508854 24396 raft_consensus.cc:1240] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:53.479826 26443 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:53.509563 24396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 296) took 1627 ms. Trace:
I20260709 12:18:53.509886 24396 rpcz_store.cc:276] 0709 12:18:51.882246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:53.372747 (+1490501us) service_pool.cc:224] Handling call
0709 12:18:53.449903 (+ 77156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:53.509289 (+ 59386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:53.509488 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:53.511163 26488 consensus_queue.cc:237] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:53.513389 24472 raft_consensus.cc:1240] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:53.442611 24398 raft_consensus.cc:2410] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:18:53.449062 24468 raft_consensus.cc:1240] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:18:53.431224 24465 raft_consensus.cc:1240] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:18:53.444525 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:53.460405 24317 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
W20260709 12:18:53.450493 24290 leader_election.cc:336] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.600s (SENT)
I20260709 12:18:53.438144 26464 raft_consensus.cc:3055] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:53.412544 26361 raft_consensus.cc:740] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:53.478605 26526 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:53.482851 24469 raft_consensus.cc:2393] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 5: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:53.519835 24323 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:18:53.524844 24392 raft_consensus.cc:2393] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 4: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:18:53.529536 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 113671us
I20260709 12:18:53.531036 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:53.479681 26068 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:18:53.537037 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 87212.5us
W20260709 12:18:53.538601 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 114000us
I20260709 12:18:53.539579 24366 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:53.541716 26463 raft_consensus.cc:2764] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:18:53.542263 26367 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:18:53.542680 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 134234us
I20260709 12:18:53.542856 26463 raft_consensus.cc:2749] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:53.541853 26397 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:53.412071 26460 consensus_queue.cc:237] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:53.548458 24400 raft_consensus.cc:1240] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:53.483774 26414 consensus_queue.cc:237] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
W20260709 12:18:53.554585 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 194060us
I20260709 12:18:53.555806 24440 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:53.508589 26524 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:53.556839 26397 raft_consensus.cc:2749] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:53.548312 24323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 1560) took 1012 ms. Trace:
I20260709 12:18:53.521481 26464 raft_consensus.cc:740] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:53.560067 24323 rpcz_store.cc:276] 0709 12:18:52.535913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:52.835646 (+299733us) service_pool.cc:224] Handling call
0709 12:18:53.534229 (+698583us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:53.573060 26526 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:53.573876 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:53.575125 24471 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:18:53.576864 26397 consensus_queue.cc:1059] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:53.577966 26397 raft_consensus.cc:3055] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:53.577903 26410 consensus_queue.cc:1059] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:53.578590 26397 raft_consensus.cc:740] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:53.579190 26410 raft_consensus.cc:3055] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:53.579645 26410 raft_consensus.cc:740] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:53.580889 26364 consensus_queue.cc:1048] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:53.580845 26410 consensus_queue.cc:260] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:53.582762 26410 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:53.583123 26361 consensus_queue.cc:260] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:53.584663 26361 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:53.584832 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:53.546047 26068 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:53.542761 26367 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:18:53.587234 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.557664 26483 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:53.590301 24397 raft_consensus.cc:2393] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 4: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:18:53.591928 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 52557.7us
W20260709 12:18:53.593745 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 48248.7us
I20260709 12:18:53.556877 26461 raft_consensus.cc:2804] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:53.579792 26397 consensus_queue.cc:260] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:53.601152 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:53.607579 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:53.608300 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.608438 26524 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:53.593276 26367 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:53.610769 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 55128.3us
I20260709 12:18:53.611786 24440 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:53.614033 24440 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:53.602062 26461 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.614737 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:53.615181 26461 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:53.615561 24440 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:53.596930 26437 consensus_queue.cc:1048] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:18:53.615571 24473 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:53.533908 26435 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:53.564287 26443 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:53.625880 26464 consensus_queue.cc:260] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:53.627012 25113 raft_consensus.cc:1240] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 12:18:53.628866 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.642707 24399 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
W20260709 12:18:53.645109 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:53.640952 24290 connection.cc:256] RPC call timeout handler was delayed by -1.106281165999917s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19930000000000003s for a response
W20260709 12:18:53.647421 24290 connection.cc:256] RPC call timeout handler was delayed by -1.087558301999934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30150000000000005s for a response
I20260709 12:18:53.651382 26481 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:53.652181 26481 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:53.659442 26446 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.660143 26446 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:53.661194 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:18:53.662204 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.662168 24467 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:53.640178 26502 raft_consensus.cc:2749] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:53.639065 26526 raft_consensus.cc:2749] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:53.683779 24366 leader_election.cc:400] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 2. Current term is 3.
W20260709 12:18:53.686575 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.693158 26367 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:53.701098 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.679486 26464 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:53.712383 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:53.724004 24290 leader_election.cc:336] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.921s (SENT)
I20260709 12:18:53.735417 24290 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:53.709532 26519 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:53.727996 26397 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:53.750242 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:53.716892 26446 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:53.752238 24392 raft_consensus.cc:1275] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:18:53.757647 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 134626us
I20260709 12:18:53.758802 24466 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:53.751410 26232 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:53.773638 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:53.774221 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.780447 24366 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:53.774530 26305 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.760159 26520 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:53.779142 26232 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:53.792907 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 81684.5us
W20260709 12:18:53.793372 26552 log.cc:927] Time spent T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 12:18:53.793781 26551 log.cc:927] Time spent T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.188s	user 0.002s	sys 0.000s
I20260709 12:18:53.794406 24468 raft_consensus.cc:1275] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:18:53.800740 26550 log.cc:927] Time spent T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:18:53.801244 26528 raft_consensus.cc:2749] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:18:53.803236 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.794615 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:53.763705 26470 consensus_queue.cc:1059] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.143s
I20260709 12:18:53.828276 24394 raft_consensus.cc:2393] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 3: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:53.847002 24467 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:18:53.849036 24467 raft_consensus.cc:1240] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:18:53.851997 26448 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:18:53.854718 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.855230 24398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 280) took 2003 ms. Trace:
I20260709 12:18:53.855671 24398 rpcz_store.cc:276] 0709 12:18:51.851477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:52.646131 (+794654us) service_pool.cc:224] Handling call
0709 12:18:53.854972 (+1208841us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b54001a6654. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:53.855151 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1754333568}
I20260709 12:18:53.803023 26435 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:53.805972 26488 raft_consensus.cc:2804] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:53.866241 26367 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:53.867516 26434 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:53.872710 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 313) took 1984 ms. Trace:
I20260709 12:18:53.873379 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:53.874276 25111 raft_consensus.cc:2368] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 3. Current term is 4.
I20260709 12:18:53.874534 26232 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:53.811558 26481 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:18:53.877779 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.880573 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:53.873214 24391 rpcz_store.cc:276] 0709 12:18:51.888509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:52.700650 (+812141us) service_pool.cc:224] Handling call
0709 12:18:53.872367 (+1171717us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b54001b9254. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:53.872605 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1779420928}
W20260709 12:18:53.891847 24290 leader_election.cc:336] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.986s (SENT)
I20260709 12:18:53.892393 24290 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:53.902443 24466 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:18:53.909395 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:53.910336 24400 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:18:53.911023 24438 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:53.913585 26567 log.cc:927] Time spent T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:18:53.832216 26305 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:18:53.912328 24470 raft_consensus.cc:1275] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:18:53.921180 24471 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:18:53.927172 24393 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
W20260709 12:18:53.929380 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:53.929883 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:53.930271 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:53.933758 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.933856 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:53.934713 24465 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:53.935768 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:53.937793 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:18:53.938573 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.939074 24323 raft_consensus.cc:2410] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:18:53.865039 26488 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:53.938581 24466 raft_consensus.cc:1275] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:53.940129 26367 raft_consensus.cc:2804] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:53.953523 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:53.953941 26367 raft_consensus.cc:697] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:53.954160 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:53.954612 24317 raft_consensus.cc:2393] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 3: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:18:53.955156 26367 consensus_queue.cc:237] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:53.953280 26488 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:53.928915 26341 consensus_meta.cc:287] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.507s	user 0.008s	sys 0.005s
I20260709 12:18:53.878062 26520 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:53.958389 24474 raft_consensus.cc:1240] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:54.065543 24473 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
W20260709 12:18:53.963989 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:54.063408 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:54.075318 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 210674us
I20260709 12:18:53.936398 24465 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
W20260709 12:18:53.975896 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:54.007721 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.100414 24365 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:54.025803 24395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 301) took 2142 ms. Trace:
W20260709 12:18:53.973305 26559 log.cc:927] Time spent T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:18:54.024511 25116 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:54.068146 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:53.973868 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:18:54.077155 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.077775 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:54.079175 24473 raft_consensus.cc:1275] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:54.064055 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:54.082150 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:54.099318 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:18:54.005816 26557 log.cc:927] Time spent T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
W20260709 12:18:54.098097 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 329876us
I20260709 12:18:54.104498 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:18:54.103751 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:54.030512 26301 consensus_meta.cc:287] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.528s	user 0.013s	sys 0.000s
W20260709 12:18:54.034852 26546 log.cc:927] Time spent T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.506s	user 0.002s	sys 0.000s
I20260709 12:18:54.112054 24394 raft_consensus.cc:2393] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 3: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:54.111799 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:54.112811 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:54.114995 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:54.101637 24395 rpcz_store.cc:276] 0709 12:18:51.883709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:53.406479 (+1522770us) service_pool.cc:224] Handling call
0709 12:18:53.857044 (+450565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:53.881050 (+ 24006us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:18:53.881085 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:53.891409 (+ 10324us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:53.891466 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:53.891552 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:54.025587 (+134035us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b54001a6650. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:54.025713 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1936,"raft.queue_time_us":22670,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":12234,"spinlock_wait_cycles":1027509120}
I20260709 12:18:54.113458 24365 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:54.021428 26409 raft_consensus.cc:3055] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:18:54.119055 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.123445 24400 raft_consensus.cc:2393] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 3: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:54.006356 26305 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:18:54.039737 26481 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:18:54.119799 24290 leader_election.cc:336] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.244s (SENT)
I20260709 12:18:54.120407 24471 raft_consensus.cc:1275] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:18:54.128360 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.974962 26399 raft_consensus.cc:2749] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:54.121305 25083 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:18:54.120689 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.129992 24316 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:54.130141 24399 raft_consensus.cc:2393] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 4: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:53.992918 26473 consensus_queue.cc:1059] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.148s
I20260709 12:18:54.068420 26068 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:54.123471 26409 raft_consensus.cc:740] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:54.126276 26521 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:54.161324 26521 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:54.161931 26521 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:54.161552 26409 consensus_queue.cc:260] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:54.163142 26409 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:54.165380 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:54.166766 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:54.169834 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:54.146236 24366 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:54.082641 26460 consensus_queue.cc:1059] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:18:53.994153 26461 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:54.151904 24393 raft_consensus.cc:1240] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:54.153875 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 44507.9us
I20260709 12:18:54.155515 26481 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:54.132082 26443 consensus_queue.cc:1048] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:18:54.156992 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:54.140348 24465 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:18:54.173283 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:54.174276 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:54.137828 26305 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:54.178432 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:54.178731 24324 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:54.181789 26068 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:54.182586 26488 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:54.144111 26232 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:54.227663 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:54.229051 26473 consensus_queue.cc:1243] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer c711faa13ead43ebbea0192cb74a4756 log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:18:54.230103 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:54.230427 26481 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:54.230938 24317 raft_consensus.cc:2393] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 4: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:54.195993 24316 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
W20260709 12:18:54.223593 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 69932.8us
W20260709 12:18:54.224550 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 53162.4us
I20260709 12:18:54.225435 26520 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:18:54.234570 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:54.235183 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.239265 24323 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
W20260709 12:18:54.235801 25082 leader_election.cc:336] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 3.226s (SENT)
W20260709 12:18:54.242478 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 89265.3us
W20260709 12:18:54.248899 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:54.249631 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:54.251493 24290 leader_election.cc:336] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.614s (SENT)
I20260709 12:18:54.251703 26488 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:18:54.256798 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 44977.2us
I20260709 12:18:54.257464 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:54.257751 24365 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:54.258881 24469 raft_consensus.cc:2393] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 3: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:54.208442 26305 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:54.263031 26435 consensus_queue.cc:1048] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:54.263680 26461 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:54.273250 24365 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:54.272040 26305 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:54.275266 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:54.240214 26448 raft_consensus.cc:2749] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:54.281280 26232 raft_consensus.cc:697] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:54.282612 26232 consensus_queue.cc:237] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:54.284922 26461 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.285668 26461 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:54.288143 26461 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:18:54.264760 24290 leader_election.cc:336] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.973s (SENT)
I20260709 12:18:54.253297 26528 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.297000 24290 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:54.309012 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 63286.4us
I20260709 12:18:54.315110 24319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1559) took 1776 ms. Trace:
I20260709 12:18:54.315392 26528 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:54.336112 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 210010us
I20260709 12:18:54.315645 24319 rpcz_store.cc:276] 0709 12:18:52.535653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:53.192592 (+656939us) service_pool.cc:224] Handling call
0709 12:18:53.193376 (+   784us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:53.222241 (+ 28865us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:53.222284 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:53.241736 (+ 19452us) log.cc:844] Serialized 26 byte log entry
0709 12:18:53.329969 (+ 88233us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:53.330434 (+   465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:53.330541 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:54.034031 (+703490us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:18:54.305309 (+271278us) raft_consensus.cc:1685] finished
0709 12:18:54.305340 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:54.311855 (+  6515us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28013,"raft.queue_time_us":28497,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":215,"spinlock_wait_cycles":47065856,"thread_start_us":87569,"threads_started":1,"wal-append.queue_time_us":150806}
I20260709 12:18:54.338624 24366 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:54.338986 26528 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:18:54.319836 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 67168.8us
W20260709 12:18:54.339993 24290 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 3.015s (SENT) [suppressed 43 similar messages]
I20260709 12:18:54.303867 26520 raft_consensus.cc:2749] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:54.321592 24394 raft_consensus.cc:1275] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:18:54.326335 26443 raft_consensus.cc:3055] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:54.307313 26448 consensus_queue.cc:1059] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:18:54.297220 26462 consensus_queue.cc:1048] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:18:54.333230 26530 raft_consensus.cc:3055] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:54.278118 26341 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:54.340420 24366 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:18:54.403409 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:54.387423 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:54.411777 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:54.412976 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 263758us
I20260709 12:18:54.414866 24324 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
W20260709 12:18:54.341142 24290 leader_election.cc:336] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 3.061s (SENT)
W20260709 12:18:54.411412 25082 leader_election.cc:336] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 3.289s (SENT)
W20260709 12:18:54.363909 26519 consensus_meta.cc:287] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.602s	user 0.012s	sys 0.000s
W20260709 12:18:54.357867 26361 consensus_meta.cc:287] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.773s	user 0.009s	sys 0.004s
W20260709 12:18:54.421448 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 80341.7us
I20260709 12:18:54.419348 25083 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:54.350436 26435 raft_consensus.cc:2749] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:54.399912 26443 raft_consensus.cc:740] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:54.399544 26530 raft_consensus.cc:740] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
W20260709 12:18:54.441588 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:54.442225 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.419575 26488 raft_consensus.cc:2749] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:54.447419 25083 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:54.426411 26519 raft_consensus.cc:2749] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:54.466709 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 126462us
W20260709 12:18:54.467590 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 56304.2us
I20260709 12:18:54.380043 26521 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:54.470794 24289 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:54.472812 24291 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:54.459051 26464 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:54.475724 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:54.432169 26528 consensus_queue.cc:1048] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 12:18:54.481072 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 204345us
I20260709 12:18:54.484071 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:54.487596 24324 raft_consensus.cc:2368] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 4. Current term is 5.
W20260709 12:18:54.487752 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:54.487872 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.466650 26473 raft_consensus.cc:2804] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:18:54.491178 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.488373 24365 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:54.492790 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:54.486557 25083 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:18:54.499493 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.499931 26419 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:54.485339 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:54.500149 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:54.502242 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:54.502849 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:54.503270 26447 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:54.503816 26447 raft_consensus.cc:697] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:54.504861 26447 consensus_queue.cc:237] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:54.508592 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.508497 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:54.510998 24366 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:54.512101 25118 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
I20260709 12:18:54.516620 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:54.528963 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:54.529856 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:54.531337 24396 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:54.519976 26530 consensus_queue.cc:260] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:54.482988 26460 consensus_queue.cc:1059] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 12:18:54.538475 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 67794.9us
I20260709 12:18:54.538770 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:54.539777 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:54.541232 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:54.534960 24438 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:54.497788 26481 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:54.514170 26488 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:54.565781 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:18:54.567152 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.571165 24289 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:54.522281 26473 raft_consensus.cc:697] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:54.493952 26368 consensus_queue.cc:1048] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:18:54.573959 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:54.494710 26523 consensus_queue.cc:1048] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:18:54.528086 26462 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:54.579710 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:54.580222 24318 raft_consensus.cc:2393] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 3: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:54.578398 24469 raft_consensus.cc:1275] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:54.577252 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:54.575564 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:54.573406 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:54.569660 26481 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:54.608130 24470 raft_consensus.cc:1275] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:54.568336 26488 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:54.617239 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:54.538044 26341 raft_consensus.cc:697] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:18:54.617277 24290 leader_election.cc:336] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 3.308s (SENT)
W20260709 12:18:54.618696 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 47667.1us
I20260709 12:18:54.627463 24318 raft_consensus.cc:1240] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:54.605415 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:54.629878 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:54.581282 26461 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:54.514659 26443 consensus_queue.cc:260] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:54.630613 24394 raft_consensus.cc:2376] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3. Re-sending same reply.
W20260709 12:18:54.638975 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 142942us
I20260709 12:18:54.639061 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:54.581930 26520 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:54.641988 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:54.645854 24325 raft_consensus.cc:2410] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:18:54.642263 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.622095 26481 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:54.622233 26409 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:54.649744 26581 log.cc:927] Time spent T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:18:54.622591 26488 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:54.649121 24468 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
W20260709 12:18:54.653998 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 52403.5us
I20260709 12:18:54.634205 26530 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:54.660775 24319 raft_consensus.cc:1240] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:18:54.636722 26461 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:54.665316 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:54.673854 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.663830 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:54.617337 26585 consensus_queue.cc:1048] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:18:54.675710 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:54.693830 24394 raft_consensus.cc:1275] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:18:54.683264 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.677838 26461 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:54.663242 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:54.668167 24465 raft_consensus.cc:1275] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:18:54.711805 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:54.714764 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:54.702276 26414 consensus_queue.cc:1059] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:18:54.716025 24322 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 4: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:18:54.716411 26521 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:54.754174 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:54.758654 24321 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
W20260709 12:18:54.758920 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 62858.6us
I20260709 12:18:54.725965 26232 raft_consensus.cc:3055] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:54.730396 26461 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:54.733496 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:54.707713 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:54.754339 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:54.754115 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:54.751895 26341 consensus_queue.cc:237] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:54.762749 24325 raft_consensus.cc:2410] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:18:54.765719 25082 leader_election.cc:336] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.598s (SENT)
I20260709 12:18:54.768981 25082 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:54.770977 24317 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:54.771056 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:18:54.771667 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 94564.5us
I20260709 12:18:54.772239 24470 raft_consensus.cc:2393] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 4: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:54.772571 24366 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:54.772946 24323 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:18:54.774312 24366 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:54.782403 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:18:54.781667 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.828970 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:54.783171 24316 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:54.830258 24468 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:54.831194 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 344727us
I20260709 12:18:54.831790 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:54.669035 26409 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:54.767542 26443 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:54.844762 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:18:54.863713 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 102477us
I20260709 12:18:54.763420 26361 raft_consensus.cc:3055] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:54.761644 26232 raft_consensus.cc:740] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:54.868973 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:18:54.870389 26589 log.cc:927] Time spent T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
I20260709 12:18:54.877547 24473 raft_consensus.cc:1240] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:18:54.881233 24318 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:18:54.887507 24396 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
W20260709 12:18:54.893982 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.846046 26447 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:54.929013 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:54.928961 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:54.931816 24466 raft_consensus.cc:1275] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:54.932446 26367 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.971552 26367 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:54.936993 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:54.940789 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:54.974105 26588 log.cc:927] Time spent T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 12:18:54.974717 26585 raft_consensus.cc:2804] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:54.975440 26585 raft_consensus.cc:697] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:54.743788 26473 consensus_queue.cc:237] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:54.989636 26414 consensus_queue.cc:1048] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:18:54.992893 26591 log.cc:927] Time spent T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:18:54.782639 26305 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:54.999454 24393 raft_consensus.cc:1240] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:18:55.002696 26579 log.cc:927] Time spent T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.552s	user 0.000s	sys 0.006s
W20260709 12:18:55.058492 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.917685 26521 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:55.094861 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:55.097970 24472 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:55.065871 26598 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.150401 26598 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:55.154356 26409 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:18:55.155907 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.158402 26447 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:55.159159 26447 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:55.012123 26585 consensus_queue.cc:237] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:55.267684 26410 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:55.284163 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:55.301157 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 526950us
I20260709 12:18:54.874954 26361 raft_consensus.cc:740] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:55.264793 26409 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.311141 26410 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:55.344471 24289 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.004s	sys 0.006s
W20260709 12:18:55.362233 24289 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.005s	sys 0.006s
W20260709 12:18:55.362711 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 579239us
W20260709 12:18:55.363602 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.350615 26521 raft_consensus.cc:697] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:55.336606 26409 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:55.478801 24322 raft_consensus.cc:1275] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
W20260709 12:18:55.391010 24316 consensus_meta.cc:287] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.550s	user 0.007s	sys 0.001s
I20260709 12:18:55.479496 24316 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
W20260709 12:18:55.419945 24324 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.051s	sys 0.148s
W20260709 12:18:55.480927 24324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.052s	sys 0.156s
W20260709 12:18:55.380244 24317 consensus_meta.cc:287] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.608s	user 0.014s	sys 0.000s
I20260709 12:18:55.481534 24317 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6.
I20260709 12:18:55.479346 24322 pending_rounds.cc:85] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756: Aborting all ops after (but not including) 5
W20260709 12:18:55.486073 24290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.010s	sys 0.018s
W20260709 12:18:55.486581 24290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.010s	sys 0.018s
W20260709 12:18:55.489375 24365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.000s	sys 0.030s
W20260709 12:18:55.489951 24365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.000s	sys 0.030s
W20260709 12:18:55.490319 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 709699us
W20260709 12:18:55.492901 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 443919us
W20260709 12:18:55.493970 25082 leader_election.cc:336] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.862s (SENT)
I20260709 12:18:55.361059 26305 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:55.374785 26598 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:55.485918 24322 pending_rounds.cc:107] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756: Aborting uncommitted NO_OP operation due to leader change: 3.6
W20260709 12:18:55.483453 24467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.056s	sys 0.061s
W20260709 12:18:55.498860 24474 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.010s	sys 0.023s
W20260709 12:18:55.506261 24474 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.014s	sys 0.023s
W20260709 12:18:55.494736 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.503566 24322 raft_consensus.cc:2889] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:55.506562 24467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.057s	sys 0.062s
I20260709 12:18:55.502664 26367 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:55.515718 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:55.518092 24365 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:55.364701 26232 consensus_queue.cc:260] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:55.562288 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 68368us
W20260709 12:18:55.564406 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.569777 24366 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:55.568259 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:55.516270 26305 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:55.573849 26305 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:55.574239 26410 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:55.576171 26305 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:18:55.570469 25082 leader_election.cc:336] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.085s (SENT)
I20260709 12:18:55.583069 24396 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:18:55.485103 26361 consensus_queue.cc:260] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:55.591745 24468 consensus_meta.cc:287] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.743s	user 0.015s	sys 0.004s
I20260709 12:18:55.592424 24468 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:55.600600 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:55.627607 24468 raft_consensus.cc:2368] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4.
I20260709 12:18:55.589430 26410 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.636406 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:18:55.640374 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 121905us
W20260709 12:18:55.641191 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 70800.1us
W20260709 12:18:55.642011 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.566846 26607 consensus_queue.cc:1048] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.110s
W20260709 12:18:55.643914 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.592921 26447 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:55.590401 26305 consensus_queue.cc:1048] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:18:55.519553 26521 consensus_queue.cc:237] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:55.594810 26367 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:55.626093 26601 raft_consensus.cc:2749] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:55.596410 26602 raft_consensus.cc:2804] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:55.660188 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:55.638782 26361 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:55.672760 24470 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:55.690160 24468 raft_consensus.cc:2393] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 2: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
W20260709 12:18:55.710347 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 192321us
W20260709 12:18:55.712939 26354 log.cc:927] Time spent T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:18:55.713071 26601 consensus_queue.cc:1048] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:55.713902 26354 tablet_bootstrap.cc:492] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:55.715041 26354 tablet_bootstrap.cc:492] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:18:55.715864 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:55.715880 26354 ts_tablet_manager.cc:1403] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 3.234s	user 0.038s	sys 0.031s
I20260709 12:18:55.717085 24470 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:18:55.679586 26602 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:55.647704 26410 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:55.728003 25082 leader_election.cc:336] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.337s (SENT)
I20260709 12:18:55.710943 26613 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:55.815840 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:55.753141 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:55.814955 24472 consensus_meta.cc:287] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.678s	user 0.008s	sys 0.008s
I20260709 12:18:55.777275 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:55.837139 24472 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:18:55.810977 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:55.769093 25082 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:55.838048 24465 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:55.724014 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:55.840143 24468 raft_consensus.cc:2368] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 4. Current term is 5.
I20260709 12:18:55.786275 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:18:55.832434 26419 consensus_meta.cc:287] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.332s	user 0.013s	sys 0.009s
I20260709 12:18:55.776796 26409 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:18:55.769119 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.841670 26613 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:55.842609 24466 raft_consensus.cc:2393] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:55.843036 24470 raft_consensus.cc:2393] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 3: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:55.862147 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:55.863145 24470 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 4: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
W20260709 12:18:55.863512 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 267776us
W20260709 12:18:55.823913 26608 log.cc:927] Time spent T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:18:55.678256 26367 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:55.851686 25110 consensus_meta.cc:287] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 1.348s	user 0.012s	sys 0.009s
W20260709 12:18:55.846742 26530 consensus_meta.cc:287] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 1.183s	user 0.014s	sys 0.005s
I20260709 12:18:55.864917 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:55.854625 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:55.865121 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:55.875671 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:18:55.828241 26488 consensus_meta.cc:287] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 1.164s	user 0.014s	sys 0.005s
W20260709 12:18:55.822644 26603 log.cc:927] Time spent T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
W20260709 12:18:55.843482 26481 consensus_meta.cc:287] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.183s	user 0.009s	sys 0.012s
W20260709 12:18:55.823290 26600 log.cc:927] Time spent T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 12:18:55.809046 26602 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:55.876466 24468 raft_consensus.cc:2368] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6.
I20260709 12:18:55.876579 24472 raft_consensus.cc:2393] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 4: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:55.853765 26419 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:55.862881 26613 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:55.877584 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:55.878834 24396 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:18:55.850426 26093 consensus_queue.cc:1048] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:18:55.894867 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:55.883904 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:55.884687 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1681) took 1340 ms. Trace:
I20260709 12:18:55.878983 26488 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:55.885401 26609 log.cc:927] Time spent T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 12:18:55.888842 25119 raft_consensus.cc:1275] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:18:55.890246 26367 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:55.893997 26410 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:55.896198 24400 raft_consensus.cc:2376] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5. Re-sending same reply.
I20260709 12:18:55.894024 24466 raft_consensus.cc:2376] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3. Re-sending same reply.
I20260709 12:18:55.907421 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:55.925709 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:55.926498 24396 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
I20260709 12:18:55.908030 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:55.929623 24391 raft_consensus.cc:2410] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:18:55.910952 26488 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:55.896998 24474 rpcz_store.cc:276] 0709 12:18:54.544047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:54.544182 (+   135us) service_pool.cc:224] Handling call
0709 12:18:54.777564 (+233382us) spinlock_profiling.cc:243] Waited 9 ms on lock 0x7b58001c3e98. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c325fc0 00007f4a9c310929 00007f4a9c3103d2 00007f4a95887bd4
0709 12:18:54.777822 (+   258us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:54.778380 (+   558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:54.778420 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:54.779177 (+   757us) log.cc:844] Serialized 52 byte log entry
0709 12:18:55.506781 (+727604us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:55.696286 (+189505us) log.cc:844] Serialized 14 byte log entry
0709 12:18:55.709954 (+ 13668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:55.710082 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:55.884139 (+174057us) raft_consensus.cc:1685] finished
0709 12:18:55.884293 (+   154us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:55.884540 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":335027,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":974,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":8501,"spinlock_wait_cycles":20696960,"thread_start_us":861111,"threads_started":2,"wal-append.queue_time_us":793745}
I20260709 12:18:55.947513 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:55.948218 24474 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:18:55.949229 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:55.950563 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:55.882227 26447 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:55.951377 24474 raft_consensus.cc:2393] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 3: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:55.951930 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:18:55.916044 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:55.919224 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.953948 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:55.882038 26481 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:55.932583 26435 raft_consensus.cc:3055] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:55.963878 26617 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.964483 26617 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:55.965574 26607 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:18:55.966080 26443 consensus_meta.cc:287] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 1.105s	user 0.014s	sys 0.005s
I20260709 12:18:55.966250 26607 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:55.967301 24470 raft_consensus.cc:2393] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 3: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:55.967473 26617 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:55.968423 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:55.964524 24391 raft_consensus.cc:1240] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:55.969175 24470 raft_consensus.cc:2376] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3. Re-sending same reply.
I20260709 12:18:55.970227 26607 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:55.935338 26354 raft_consensus.cc:359] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:55.940528 24467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 436) took 1080 ms. Trace:
I20260709 12:18:55.944696 26613 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.952900 24466 raft_consensus.cc:2393] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 4: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:55.954427 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:55.954607 24468 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:55.952248 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:55.874678 25110 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:18:55.961958 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:55.970369 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:56.318264 24474 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:56.318589 24470 raft_consensus.cc:2393] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 3: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:56.179905 24473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1538) took 1339 ms. Trace:
I20260709 12:18:56.320581 24473 rpcz_store.cc:276] 0709 12:18:54.840451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:54.840614 (+   163us) service_pool.cc:224] Handling call
0709 12:18:54.861189 (+ 20575us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:54.881307 (+ 20118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:56.179415 (+1298108us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b540010f254. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:56.179793 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36747520}
W20260709 12:18:56.134034 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:56.180032 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:56.254230 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:56.096966 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.217260 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:18:56.422366 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.339829 26461 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:18:56.185724 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 457756us
W20260709 12:18:56.184352 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 317388us
W20260709 12:18:56.432359 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.150660 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 818) took 1631 ms. Trace:
I20260709 12:18:56.095911 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:55.976250 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:56.341288 24220 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54254 (request call id 262) took 11060 ms. Trace:
W20260709 12:18:56.342054 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.024798 24398 raft_consensus.cc:1275] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:18:56.210621 24438 leader_election.cc:336] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.639s (SENT)
W20260709 12:18:56.437680 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 227126us
I20260709 12:18:56.321600 24467 rpcz_store.cc:276] 0709 12:18:54.860311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:54.868168 (+  7857us) service_pool.cc:224] Handling call
0709 12:18:54.870747 (+  2579us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:54.927052 (+ 56305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:54.927100 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:54.927814 (+   714us) log.cc:844] Serialized 26 byte log entry
0709 12:18:55.567783 (+639969us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:55.582032 (+ 14249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:55.587606 (+  5574us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:55.940246 (+352640us) raft_consensus.cc:1685] finished
0709 12:18:55.940278 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:55.940456 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6235,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":137,"thread_start_us":588793,"threads_started":1,"wal-append.queue_time_us":662789}
I20260709 12:18:56.348563 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:56.424657 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:56.349154 26447 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.352888 26068 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.353982 24324 raft_consensus.cc:1240] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:56.336699 26434 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:56.136253 26464 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:56.456825 26068 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:56.457172 26464 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:56.459707 26068 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:56.436478 24220 rpcz_store.cc:276] 0709 12:18:45.220982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.226569 (+  5587us) service_pool.cc:224] Handling call
0709 12:18:56.262214 (+11035645us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:53.514434 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:53.544465 (+ 30031us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:53.544525 (+    60us) write_op.cc:435] Acquired schema lock
0709 12:18:53.544557 (+    32us) tablet.cc:662] Decoding operations
0709 12:18:53.554250 (+  9693us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:53.554357 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:53.554402 (+    45us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:18:53.555405 (+  1003us) tablet.cc:701] Row locks acquired
0709 12:18:53.555463 (+    58us) write_op.cc:260] PREPARE: finished
0709 12:18:53.555693 (+   230us) write_op.cc:270] Start()
0709 12:18:53.555882 (+   189us) write_op.cc:276] Timestamp: P: 1783599533555607 usec, L: 0
0709 12:18:53.555927 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 12:18:53.604995 (+ 49068us) log.cc:844] Serialized 2129 byte log entry
0709 12:18:54.174827 (+569832us) op_driver.cc:464] REPLICATION: finished
0709 12:18:54.437790 (+262963us) write_op.cc:301] APPLY: starting
0709 12:18:54.443358 (+  5568us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:54.443650 (+   292us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:54.443837 (+   187us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:54.475653 (+ 31816us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:54.500894 (+ 25241us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:18:54.500946 (+    52us) write_op.cc:312] APPLY: finished
0709 12:18:54.501326 (+   380us) log.cc:844] Serialized 47 byte log entry
0709 12:18:54.501544 (+   218us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:54.501683 (+   139us) write_op.cc:454] Released schema lock
0709 12:18:54.501751 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:54.502195 (+   444us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:54.502222 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":251944,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":216793,"apply.run_cpu_time_us":3973,"apply.run_wall_time_us":84250,"num_ops":5,"prepare.queue_time_us":263664,"prepare.run_cpu_time_us":34860,"prepare.run_wall_time_us":308922,"raft.queue_time_us":336897,"raft.run_cpu_time_us":13620,"raft.run_wall_time_us":96221,"replication_time_us":616257,"thread_start_us":381352,"threads_started":4,"wal-append.queue_time_us":160414,"wal-append.run_cpu_time_us":92589,"wal-append.run_wall_time_us":1736306}]]}
I20260709 12:18:56.361389 26613 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:56.354964 26232 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:56.468948 26613 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:56.433748 26521 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.356418 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:56.471658 24474 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:18:56.349932 26621 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.357132 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1671) took 2132 ms. Trace:
W20260709 12:18:56.345258 25110 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 342) took 1857 ms (client timeout 1670 ms). Trace:
I20260709 12:18:56.358330 26443 consensus_queue.cc:1048] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:56.352941 24319 raft_consensus.cc:1275] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:18:56.358373 26597 log.cc:927] Time spent T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 1.389s	user 0.003s	sys 0.000s
I20260709 12:18:56.448973 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:56.042550 26437 consensus_queue.cc:1059] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.347s
I20260709 12:18:55.962503 26435 raft_consensus.cc:740] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:55.923039 26602 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:18:56.078145 26410 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:56.518746 26410 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:55.971764 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.332290 26354 raft_consensus.cc:740] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:18:56.142109 24465 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:18:56.521783 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 1549) took 1010 ms. Trace:
I20260709 12:18:56.522174 24465 rpcz_store.cc:276] 0709 12:18:55.511798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:55.810672 (+298874us) service_pool.cc:224] Handling call
0709 12:18:56.521702 (+711030us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:56.423693 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.424528 26599 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.524791 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:56.525204 26599 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:56.525739 26434 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:56.526062 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:56.526346 26434 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:56.526758 24465 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:56.527429 26599 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:56.425119 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:56.527657 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:56.528194 24469 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
W20260709 12:18:56.437877 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.529282 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:56.019701 24394 raft_consensus.cc:1240] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:56.530604 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:56.347918 24472 raft_consensus.cc:2393] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 3: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:56.531217 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:56.531754 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:56.532176 24466 raft_consensus.cc:2410] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:18:56.532518 24472 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 4: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:56.531778 26354 consensus_queue.cc:260] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:18:56.533376 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:56.534109 24472 raft_consensus.cc:2393] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 6: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:56.534835 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:56.535259 26354 ts_tablet_manager.cc:1434] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.738s	user 0.009s	sys 0.018s
W20260709 12:18:56.535651 26354 ts_tablet_manager.cc:1467] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281: Tablet startup took 816ms
W20260709 12:18:56.137634 26592 log.cc:927] Time spent T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 1.149s	user 0.002s	sys 0.001s
I20260709 12:18:56.432988 25119 rpcz_store.cc:276] 0709 12:18:54.519711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:54.525823 (+  6112us) service_pool.cc:224] Handling call
0709 12:18:54.526181 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:55.905073 (+1378892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:56.150292 (+245219us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54007d0354. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:56.150564 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3109225344}
I20260709 12:18:56.537106 26435 consensus_queue.cc:260] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:56.444957 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:56.446177 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:56.538913 24322 raft_consensus.cc:2376] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3. Re-sending same reply.
W20260709 12:18:56.450265 25082 leader_election.cc:336] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.521s (SENT)
I20260709 12:18:56.539498 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:56.539978 25082 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:56.540166 24466 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
W20260709 12:18:56.541042 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 90813.7us
I20260709 12:18:56.541126 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:56.541798 24466 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
W20260709 12:18:56.542448 24290 leader_election.cc:336] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.609s (SENT)
W20260709 12:18:56.542611 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.542896 24290 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:56.103210 26419 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:56.544207 26530 raft_consensus.cc:2749] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:56.544005 26419 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:56.544828 26613 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:56.445788 26519 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:56.545830 26519 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:56.546933 26419 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:56.547946 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:56.531219 24469 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:18:56.549109 26464 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:56.473250 24393 rpcz_store.cc:276] 0709 12:18:54.224352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:54.252426 (+ 28074us) service_pool.cc:224] Handling call
0709 12:18:54.252882 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:54.999975 (+747093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:56.356861 (+1356886us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b54002a4754. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:56.357048 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1716195200}
I20260709 12:18:56.550034 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:56.550186 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:56.550706 24469 raft_consensus.cc:2468] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:18:56.551046 25115 raft_consensus.cc:2393] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 3: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:18:56.550717 24399 raft_consensus.cc:1240] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:56.023876 26481 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:56.553074 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:56.554044 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:56.492309 24468 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:18:56.555032 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:56.555745 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:56.555874 24473 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:56.556660 24468 raft_consensus.cc:2410] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:18:56.557518 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:56.558076 24468 raft_consensus.cc:2376] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4. Re-sending same reply.
I20260709 12:18:56.558938 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:56.559453 24468 raft_consensus.cc:2376] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4. Re-sending same reply.
I20260709 12:18:56.559770 26434 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:56.542647 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:56.478073 26461 consensus_queue.cc:1048] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:18:56.483510 26621 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:56.479007 25110 rpcz_store.cc:269] 0709 12:18:54.488141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:54.489342 (+  1201us) service_pool.cc:224] Handling call
0709 12:18:56.336371 (+1847029us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:56.461513 26447 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:56.484154 26521 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:56.510737 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.512286 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:56.512775 25114 raft_consensus.cc:2393] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 3: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:56.518002 26602 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:18:56.515866 24467 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:18:56.579118 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:56.579695 26621 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:56.580018 24467 raft_consensus.cc:2393] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 3: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:56.580684 24323 raft_consensus.cc:1275] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:56.581215 26630 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:56.581604 26530 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.581817 26630 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:56.582165 26530 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:56.584084 26630 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:56.585644 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:56.586601 24470 raft_consensus.cc:2393] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:18:56.587551 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:56.588225 24470 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:18:56.528358 24465 raft_consensus.cc:2393] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 3: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
W20260709 12:18:56.123870 25116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 339) took 1627 ms (client timeout 1567 ms). Trace:
I20260709 12:18:56.535727 24472 raft_consensus.cc:2410] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:18:56.443092 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.554064 24218 catalog_manager.cc:5697] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:56.462255 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:56.551595 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:18:56.501636 26632 log.cc:927] Time spent T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:18:56.502429 26437 raft_consensus.cc:3055] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:56.489101 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:56.561589 24466 raft_consensus.cc:2376] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4. Re-sending same reply.
I20260709 12:18:56.560359 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:56.618355 24468 raft_consensus.cc:2376] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4. Re-sending same reply.
W20260709 12:18:56.563970 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 124111us
I20260709 12:18:56.594801 24398 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:56.595031 24469 raft_consensus.cc:2393] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 4: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:56.548450 26519 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:18:56.589949 25116 rpcz_store.cc:269] 0709 12:18:54.473609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:54.473784 (+   175us) service_pool.cc:224] Handling call
0709 12:18:56.097833 (+1624049us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b540075e754. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:56.100382 (+  2549us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":789159168}
I20260709 12:18:56.538493 26435 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:56.594857 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:56.629377 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1683) took 2062 ms. Trace:
W20260709 12:18:56.632709 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.566497 26464 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:56.540001 26410 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:56.619779 24438 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:56.629719 25084 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:56.633883 24468 raft_consensus.cc:1240] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:56.633862 24465 raft_consensus.cc:1240] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 1. Current term is 3. Ops: []
I20260709 12:18:56.634508 24319 raft_consensus.cc:1275] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:56.631592 24469 raft_consensus.cc:1275] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:56.634692 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:56.635747 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:56.706012 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:56.958284 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1543) took 1641 ms. Trace:
I20260709 12:18:56.730271 24470 raft_consensus.cc:1240] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:56.959291 24465 rpcz_store.cc:276] 0709 12:18:55.316844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:56.626973 (+1310129us) service_pool.cc:224] Handling call
0709 12:18:56.633672 (+  6699us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:56.957947 (+324275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:56.958216 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:56.630527 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 443) took 1285 ms. Trace:
I20260709 12:18:56.960855 24466 rpcz_store.cc:276] 0709 12:18:55.345175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:56.629776 (+1284601us) service_pool.cc:224] Handling call
0709 12:18:56.630061 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:56.630220 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:56.630246 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:56.630286 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:56.630320 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:56.630383 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:56.630476 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:56.961978 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1551) took 1403 ms. Trace:
W20260709 12:18:56.843727 24440 connection.cc:256] RPC call timeout handler was delayed by -1.0722772829999485s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
W20260709 12:18:56.963800 24440 connection.cc:256] RPC call timeout handler was delayed by -1.0281772829998772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
W20260709 12:18:56.964605 24440 connection.cc:256] RPC call timeout handler was delayed by -1.0281772829998772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
I20260709 12:18:56.722533 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:56.966645 24317 raft_consensus.cc:2393] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 5: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:56.629673 24474 raft_consensus.cc:1275] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:18:56.968511 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 444) took 1108 ms. Trace:
I20260709 12:18:56.969071 24474 rpcz_store.cc:276] 0709 12:18:55.860019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:56.629106 (+769087us) service_pool.cc:224] Handling call
0709 12:18:56.629383 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:56.968180 (+338797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:56.968425 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:56.645462 24325 raft_consensus.cc:1275] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:56.953069 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:56.963059 24473 raft_consensus.cc:2393] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 4: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:56.877583 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:56.962962 24469 rpcz_store.cc:276] 0709 12:18:55.558642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:56.630960 (+1072318us) service_pool.cc:224] Handling call
0709 12:18:56.631252 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:56.961682 (+330430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:56.961906 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:56.979884 24470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1544) took 1642 ms. Trace:
I20260709 12:18:56.756150 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:56.981472 25116 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
W20260709 12:18:56.636219 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 65798.7us
I20260709 12:18:56.982625 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1547) took 1501 ms. Trace:
W20260709 12:18:56.923713 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 379561us
W20260709 12:18:56.984851 24290 leader_election.cc:336] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.698s (SENT)
I20260709 12:18:56.985318 24290 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:56.922821 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:56.749804 25082 leader_election.cc:336] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 3.114s (SENT)
W20260709 12:18:56.623179 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.986665 25082 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:56.632491 24471 rpcz_store.cc:276] 0709 12:18:54.566944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:54.567093 (+   149us) service_pool.cc:224] Handling call
0709 12:18:55.937113 (+1370020us) spinlock_profiling.cc:243] Waited 7.65 ms on lock 0x7b58001c3e98. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c325fc0 00007f4a9c310929 00007f4a9c3103d2 00007f4a95887bd4
0709 12:18:55.937337 (+   224us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:55.937865 (+   528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:55.937899 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:55.938621 (+   722us) log.cc:844] Serialized 52 byte log entry
0709 12:18:56.524812 (+586191us) spinlock_profiling.cc:243] Waited 7.03 ms on lock 0x7b180028f300. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a96ef44bc 00007f4a9424248b 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425ec02 00007f4a96ee620b 00007f4a96eebd23 00007f4a96eec0d1
0709 12:18:56.525013 (+   201us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:56.525052 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:56.525126 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:56.629182 (+104056us) raft_consensus.cc:1685] finished
0709 12:18:56.629199 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:56.629322 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22806,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":17734,"spinlock_wait_cycles":33771136,"thread_start_us":53172,"threads_started":1,"wal-append.queue_time_us":451638}
I20260709 12:18:56.980389 24470 rpcz_store.cc:276] 0709 12:18:55.337583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:56.721704 (+1384121us) service_pool.cc:224] Handling call
0709 12:18:56.722194 (+   490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:56.979627 (+257433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:56.979825 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:56.987660 24440 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:56.876603 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:56.988866 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:56.817909 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.726969 26641 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.983129 24468 rpcz_store.cc:276] 0709 12:18:55.480947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:56.633440 (+1152493us) service_pool.cc:224] Handling call
0709 12:18:56.633704 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:56.982354 (+348650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:56.982564 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:56.994870 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 375143us
W20260709 12:18:56.900427 26643 log.cc:927] Time spent T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:18:56.995126 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:57.014389 26641 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:57.014878 24393 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:18:57.015537 24438 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:56.631059 26530 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:56.617805 26437 raft_consensus.cc:740] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:57.016855 26641 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:56.721215 26519 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:57.017891 26519 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:56.537662 26354 ts_tablet_manager.cc:1469] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281: Trace:
0709 12:18:45.763035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.763493 (+   458us) service_pool.cc:224] Handling call
0709 12:18:46.095810 (+332317us) ts_tablet_manager.cc:934] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
0709 12:18:47.552487 (+1456677us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:18:48.150390 (+597903us) tablet_metadata.cc:665] Metadata flushed
0709 12:18:48.150572 (+   182us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:18:48.334882 (+184310us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:18:48.373890 (+ 39008us) tablet_replica.cc:206] Creating consensus instance
0709 12:18:48.738560 (+364670us) ts_tablet_manager.cc:989] Replica registered.
0709 12:18:48.738626 (+    66us) inbound_call.cc:177] Queueing success response
0709 12:18:52.481633 (+3743007us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:18:55.811907 (+3330274us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:18:55.932103 (+120196us) tablet_replica.cc:261] Starting instrumentation
0709 12:18:55.932944 (+   841us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":77347,"raft.queue_time_us":2608,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":117,"tablet-copy.queue_time_us":311306,"tablet-download-pool.queue_time_us":127707,"tablet-download-pool.run_cpu_time_us":1658,"tablet-download-pool.run_wall_time_us":2235986,"thread_start_us":452547,"threads_started":2}
W20260709 12:18:57.019959 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 390292us
I20260709 12:18:57.020824 24470 raft_consensus.cc:1275] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:18:57.021962 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:57.022492 24470 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:56.751989 24218 catalog_manager.cc:5697] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 2 to 3, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 3 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:56.620455 26615 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.024003 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:18:57.027490 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.027624 24438 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:57.024296 24473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 448) took 1156 ms. Trace:
I20260709 12:18:56.628610 26447 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:57.026028 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:57.034109 24321 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:57.029032 24473 rpcz_store.cc:276] 0709 12:18:55.867831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:56.983081 (+1115250us) service_pool.cc:224] Handling call
0709 12:18:57.023796 (+ 40715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:57.023981 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:57.024008 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:57.024053 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:57.024087 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:57.024140 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:57.024245 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:56.628610 26434 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:57.027526 24397 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:18:57.030150 24469 raft_consensus.cc:1275] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:57.035646 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1565) took 1169 ms. Trace:
I20260709 12:18:57.035979 24469 rpcz_store.cc:276] 0709 12:18:55.865878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:56.979832 (+1113954us) service_pool.cc:224] Handling call
0709 12:18:57.026078 (+ 46246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:57.035397 (+  9319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:57.035590 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:57.024721 24218 catalog_manager.cc:5697] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 1 to 2, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:56.631383 26636 consensus_queue.cc:1059] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.385s
W20260709 12:18:57.038942 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 73155.5us
W20260709 12:18:57.040778 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 291042us
I20260709 12:18:57.020849 26473 raft_consensus.cc:2804] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:18:57.042610 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.019994 26617 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.631620 26593 consensus_queue.cc:1048] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.405s
I20260709 12:18:57.025302 25111 raft_consensus.cc:1240] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:57.046429 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:18:57.048866 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 64097.3us
I20260709 12:18:57.056957 24218 catalog_manager.cc:5697] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:57.057770 24290 leader_election.cc:336] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.949s (SENT)
I20260709 12:18:57.058197 24290 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:57.056460 24469 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:18:57.059902 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:57.060716 26481 raft_consensus.cc:2749] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:57.061000 26629 raft_consensus.cc:2749] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:18:57.061985 24290 leader_election.cc:336] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.967s (SENT)
I20260709 12:18:57.062464 25119 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:18:57.053256 24484 tablet_copy_service.cc:342] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-4fb70b6bc9ed40a793fb93839c889578 received from {username='slave'} at 127.0.0.1:33198
I20260709 12:18:57.063233 24484 tablet_copy_service.cc:434] P 99b8650fa8324ac2ac5f75eee9b1a1e3: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-4fb70b6bc9ed40a793fb93839c889578 on tablet 4fb70b6bc9ed40a793fb93839c889578 with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:57.063474 24365 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:57.055795 26647 log.cc:927] Time spent T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.071s	user 0.001s	sys 0.001s
I20260709 12:18:57.037042 26615 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:57.051338 26437 consensus_queue.cc:260] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:57.062621 24290 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:57.065861 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1688) took 1036 ms. Trace:
I20260709 12:18:57.065922 26464 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:57.066597 26481 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:57.066900 26615 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:57.029177 26410 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:57.067695 26410 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:57.067798 24290 leader_election.cc:336] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.115s (SENT)
I20260709 12:18:57.068090 26410 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:57.068487 24290 leader_election.cc:336] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.157s (SENT)
I20260709 12:18:57.066550 26464 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:57.038355 26461 raft_consensus.cc:2749] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:57.068910 24290 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:57.069738 26461 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.069880 26437 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:57.070295 26605 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:57.069500 24469 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:57.071110 26617 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:57.041568 26630 raft_consensus.cc:2749] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:57.066443 24392 rpcz_store.cc:276] 0709 12:18:56.029742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:56.218662 (+188920us) service_pool.cc:224] Handling call
0709 12:18:56.219172 (+   510us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:18:56.219760 (+   588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:56.219801 (+    41us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:18:56.503881 (+284080us) spinlock_profiling.cc:243] Waited 6.73 ms on lock 0x7b2c00000de8. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a95c45a11 00007f4a95c55372 00007f4a97387a01 00007f4a9734c43a 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2
0709 12:18:56.504566 (+   685us) log.cc:844] Serialized 78 byte log entry
0709 12:18:56.765171 (+260605us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:56.765227 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:56.765437 (+   210us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:57.055228 (+289791us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:18:57.065621 (+ 10393us) raft_consensus.cc:1685] finished
0709 12:18:57.065641 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:57.065801 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14766,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":15929,"spinlock_wait_cycles":73254144,"thread_start_us":260139,"threads_started":1,"wal-append.queue_time_us":480229}
W20260709 12:18:57.076654 26650 log.cc:927] Time spent T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 12:18:57.077003 24290 leader_election.cc:336] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.728s (SENT)
W20260709 12:18:57.081990 24290 leader_election.cc:336] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.911s (SENT)
I20260709 12:18:57.082482 24290 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:57.069118 26464 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:57.078195 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:57.079123 24440 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:57.083422 24473 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:57.080063 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:57.087648 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:18:57.044795 24291 consensus_peers.cc:597] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 97dd30b21cc14958a91b2da522e4bbe9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:57.089048 24398 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
W20260709 12:18:57.089367 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 67970.7us
I20260709 12:18:57.090534 24394 raft_consensus.cc:2393] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 3: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:57.031984 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:57.037557 26641 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:18:57.093051 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 46501.2us
I20260709 12:18:57.093161 24469 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:18:57.095707 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:57.099083 24321 raft_consensus.cc:2410] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:18:57.099608 24440 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:57.103394 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:57.104530 24317 raft_consensus.cc:2410] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:18:57.105388 24290 leader_election.cc:336] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.944s (SENT)
I20260709 12:18:57.105607 24440 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:57.106141 24290 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:57.107404 24466 raft_consensus.cc:1240] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:57.109177 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 446) took 1248 ms. Trace:
I20260709 12:18:57.109702 24466 rpcz_store.cc:276] 0709 12:18:55.860407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:56.962245 (+1101838us) service_pool.cc:224] Handling call
0709 12:18:57.106968 (+144723us) spinlock_profiling.cc:243] Waited 32.8 ms on lock 0x7b58001c3e98. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c325fc0 00007f4a9c310929 00007f4a9c3103d2 00007f4a95887bd4
0709 12:18:57.107196 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:57.108880 (+  1684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:57.109110 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75424128}
I20260709 12:18:57.112536 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:57.113673 24323 raft_consensus.cc:2393] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 3: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:18:57.116165 24318 raft_consensus.cc:1275] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:57.112036 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:57.119306 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:57.119415 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:57.119789 24466 raft_consensus.cc:2410] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:18:57.121106 24322 raft_consensus.cc:1275] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:18:57.121057 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:57.095108 26437 raft_consensus.cc:2749] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:57.097254 26641 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:57.134114 24473 raft_consensus.cc:2410] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:18:57.099421 24467 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:57.100602 26519 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:18:57.165050 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.168480 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:57.174291 24466 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:57.070441 26461 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:57.094321 26605 consensus_queue.cc:1048] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:18:57.178283 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:57.179046 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:57.179872 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:57.184093 24322 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:57.114519 26473 raft_consensus.cc:697] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:57.141755 26419 consensus_queue.cc:1059] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:18:57.101454 26481 consensus_queue.cc:1048] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 12:18:57.194161 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:57.192703 24324 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:18:57.166271 26641 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:57.198669 24366 connection.cc:256] RPC call timeout handler was delayed by -2.5242050449999169s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
W20260709 12:18:57.199136 24366 connection.cc:256] RPC call timeout handler was delayed by -2.480105045000073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
W20260709 12:18:57.199524 24366 connection.cc:256] RPC call timeout handler was delayed by -2.4675050450000526s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
W20260709 12:18:57.199888 24366 connection.cc:256] RPC call timeout handler was delayed by -2.4630050450000454s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
W20260709 12:18:57.200244 24366 connection.cc:256] RPC call timeout handler was delayed by -2.3298050450000574s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
W20260709 12:18:57.200609 24366 connection.cc:256] RPC call timeout handler was delayed by -2.3235050450000472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
W20260709 12:18:57.203059 24366 connection.cc:256] RPC call timeout handler was delayed by -2.3181050450000384s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18580000000000002s for a response
W20260709 12:18:57.203438 24366 connection.cc:256] RPC call timeout handler was delayed by -2.2632050449999497s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
W20260709 12:18:57.203796 24366 connection.cc:256] RPC call timeout handler was delayed by -2.2551050449999366s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
I20260709 12:18:57.165436 26646 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:57.194783 24318 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
W20260709 12:18:57.208089 26435 consensus_meta.cc:287] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.563s	user 0.007s	sys 0.003s
I20260709 12:18:57.209156 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:57.230855 24316 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
W20260709 12:18:57.210500 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.232411 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:57.212352 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:18:57.212759 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.213068 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:57.213544 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:57.234707 24466 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:18:57.234906 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:57.235806 24469 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:18:57.214569 24365 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:57.215430 26437 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.240504 24365 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:57.216801 24474 raft_consensus.cc:1275] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:57.220001 26617 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:57.210767 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:57.247709 24321 raft_consensus.cc:2410] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:18:57.233067 24324 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
W20260709 12:18:57.239326 24366 connection.cc:256] RPC call timeout handler was delayed by -2.2380050449999089s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
W20260709 12:18:57.248265 24366 connection.cc:256] RPC call timeout handler was delayed by -2.223605045000113s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
W20260709 12:18:57.248579 24366 connection.cc:256] RPC call timeout handler was delayed by -2.0283050450000246s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21800000000000003s for a response
W20260709 12:18:57.248879 24366 connection.cc:256] RPC call timeout handler was delayed by -1.651205045000097s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2599s for a response
W20260709 12:18:57.249147 24366 connection.cc:256] RPC call timeout handler was delayed by -1.438805044999981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28350000000000003s for a response
W20260709 12:18:57.249396 24366 connection.cc:256] RPC call timeout handler was delayed by -1.2381050450001112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3058s for a response
I20260709 12:18:57.251420 24316 raft_consensus.cc:1275] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:57.251591 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:57.252170 24468 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:57.252470 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:57.254475 26435 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:57.254936 26414 raft_consensus.cc:3055] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:57.255606 26414 raft_consensus.cc:740] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:57.256997 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:57.257953 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 445) took 1397 ms. Trace:
I20260709 12:18:57.258612 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:57.142769 26621 consensus_queue.cc:1059] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:18:57.259895 26437 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:57.244752 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:57.245126 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:57.245435 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 447) took 1384 ms. Trace:
I20260709 12:18:57.265650 24473 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:18:57.265841 24474 rpcz_store.cc:276] 0709 12:18:55.860785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:56.970082 (+1109297us) service_pool.cc:224] Handling call
0709 12:18:57.216088 (+246006us) spinlock_profiling.cc:243] Waited 7.07 ms on lock 0x7b58001c3e98. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c325fc0 00007f4a9c310929 00007f4a9c3103d2 00007f4a95887bd4
0709 12:18:57.216337 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:57.241318 (+ 24981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:57.245360 (+  4042us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16269568}
I20260709 12:18:57.190472 26519 raft_consensus.cc:2749] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:57.246304 24365 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:57.200978 26615 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:57.246515 26530 consensus_queue.cc:1048] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:18:57.260382 26521 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:57.260478 26621 raft_consensus.cc:3055] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:57.279076 26621 raft_consensus.cc:740] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:57.260772 26341 raft_consensus.cc:2804] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:57.144788 26593 consensus_queue.cc:1048] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:18:57.258610 24465 rpcz_store.cc:276] 0709 12:18:55.860233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:56.961119 (+1100886us) service_pool.cc:224] Handling call
0709 12:18:57.256966 (+295847us) spinlock_profiling.cc:243] Waited 8.52 ms on lock 0x7b58001c3e98. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c325fc0 00007f4a9c310929 00007f4a9c3103d2 00007f4a95887bd4
0709 12:18:57.257272 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:57.257510 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:57.257551 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:57.257612 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:57.257655 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:57.257722 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:57.257870 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19584896}
I20260709 12:18:57.285157 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:57.288297 24465 raft_consensus.cc:1275] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:18:57.263581 26645 log.cc:927] Time spent T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.278s	user 0.000s	sys 0.003s
I20260709 12:18:57.263227 26414 consensus_queue.cc:260] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:57.233572 24323 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:57.255040 26435 raft_consensus.cc:697] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:57.239913 24466 raft_consensus.cc:1275] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:18:57.270246 24318 raft_consensus.cc:1275] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:57.272367 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:57.303326 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1602) took 1167 ms. Trace:
I20260709 12:18:57.303650 24474 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:18:57.303706 24466 rpcz_store.cc:276] 0709 12:18:56.135787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:57.235476 (+1099689us) service_pool.cc:224] Handling call
0709 12:18:57.235760 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:57.303060 (+ 67300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:57.303271 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:57.305886 24365 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:57.307081 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 209028us
I20260709 12:18:57.274833 24322 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:18:57.275312 24468 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:18:57.186587 26630 consensus_queue.cc:1059] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:18:57.276196 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:57.224269 26464 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:57.339308 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:57.340495 24398 raft_consensus.cc:2393] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 4: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:57.231122 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:57.283289 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:57.215716 24317 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:18:57.246721 26646 raft_consensus.cc:697] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:57.293678 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:18:57.294818 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 267581us
I20260709 12:18:57.295732 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:57.284073 26617 raft_consensus.cc:2804] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:57.347226 24438 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:57.347609 26617 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:57.338384 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:57.349419 24394 raft_consensus.cc:2410] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:18:57.296382 26341 raft_consensus.cc:697] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:57.353933 24473 raft_consensus.cc:1240] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:57.343689 26602 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:57.351560 26617 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:57.372277 26646 consensus_queue.cc:237] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:57.284127 26473 consensus_queue.cc:237] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:57.374459 26594 consensus_queue.cc:1059] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:57.362619 26414 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:57.362023 26599 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:57.397363 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:57.368115 26602 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:57.403981 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:57.406666 26602 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:57.377504 26232 consensus_queue.cc:1059] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:18:57.413655 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:57.414824 24470 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:18:57.355888 26621 consensus_queue.cc:260] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:57.417619 24471 raft_consensus.cc:1240] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 4. Current term is 5. Ops: []
W20260709 12:18:57.418491 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:57.414451 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 308929us
W20260709 12:18:57.419765 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 312822us
I20260709 12:18:57.420671 24440 leader_election.cc:400] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 4. Current term is 5.
I20260709 12:18:57.421274 24440 leader_election.cc:403] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:57.407740 26464 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:57.411602 26461 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:57.444160 24289 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:57.454304 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 348934us
I20260709 12:18:57.466686 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:18:57.474277 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 127111us
I20260709 12:18:57.409137 26599 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:57.495990 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:57.422439 26642 raft_consensus.cc:2749] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:57.406483 26435 consensus_queue.cc:237] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:57.466368 26615 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:18:57.495146 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 377434us
W20260709 12:18:57.503522 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 83031.9us
I20260709 12:18:57.504240 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1568) took 1556 ms. Trace:
I20260709 12:18:57.506083 24471 rpcz_store.cc:276] 0709 12:18:55.947878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:57.021005 (+1073127us) service_pool.cc:224] Handling call
0709 12:18:57.417370 (+396365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:57.419494 (+  2124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:57.504051 (+ 84557us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b5400243450. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:57.504176 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":883751168}
I20260709 12:18:57.475842 26447 raft_consensus.cc:3055] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:57.472556 26437 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:57.513244 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:57.514498 24440 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:57.515985 25083 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:18:57.526214 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.524238 24438 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:57.532722 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:57.508838 26461 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:57.485496 26232 consensus_queue.cc:1059] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:18:57.510089 26615 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:57.476949 26657 consensus_queue.cc:1059] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:18:57.514685 26621 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:57.513859 26447 raft_consensus.cc:740] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:57.508306 24317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:42226
I20260709 12:18:57.543934 24440 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:57.445753 26341 consensus_queue.cc:237] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
W20260709 12:18:57.545214 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.549082 24317 raft_consensus.cc:606] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:57.573772 24317 raft_consensus.cc:614] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:57.553429 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:57.529114 26454 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:57.583845 24393 raft_consensus.cc:1240] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: []
W20260709 12:18:57.587064 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.588230 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:18:57.590610 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 62669.5us
W20260709 12:18:57.582002 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 114730us
I20260709 12:18:57.535998 26461 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:57.592886 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:57.594278 24289 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:18:57.596537 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 52705.1us
I20260709 12:18:57.597218 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:57.597913 24398 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
W20260709 12:18:57.601028 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.595528 24397 raft_consensus.cc:1275] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:18:57.602041 24397 pending_rounds.cc:85] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a: Aborting all ops after (but not including) 5
I20260709 12:18:57.602347 24397 pending_rounds.cc:107] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:18:57.602691 24397 raft_consensus.cc:2889] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:57.545608 26615 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:57.606103 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:57.606973 24393 raft_consensus.cc:2368] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5.
W20260709 12:18:57.614413 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 154909us
I20260709 12:18:57.532449 26530 consensus_queue.cc:1048] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:18:57.582808 26454 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:57.633486 24391 raft_consensus.cc:1240] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:57.633783 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:18:57.674084 26653 log.cc:927] Time spent T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
W20260709 12:18:57.674708 26654 log.cc:927] Time spent T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:18:57.676381 24472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 442) took 2362 ms. Trace:
I20260709 12:18:57.667352 26673 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:57.667886 26680 raft_consensus.cc:2749] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:57.602058 26461 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:57.668453 24438 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:18:57.666002 24440 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:57.597764 26599 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:18:57.630146 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 127898us
I20260709 12:18:57.677016 24472 rpcz_store.cc:276] 0709 12:18:55.314271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:56.721614 (+1407343us) service_pool.cc:224] Handling call
0709 12:18:56.990629 (+269015us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:57.030960 (+ 40331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:57.030994 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:57.037694 (+  6700us) log.cc:844] Serialized 26 byte log entry
0709 12:18:57.306209 (+268515us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:57.306266 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:57.306376 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:57.676060 (+369684us) raft_consensus.cc:1685] finished
0709 12:18:57.676087 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:57.676307 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8872,"raft.queue_time_us":47526,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":252716,"threads_started":1,"wal-append.queue_time_us":425680}
I20260709 12:18:57.659265 26454 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:57.635417 26666 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 4. Current term is 5.
I20260709 12:18:57.681162 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:57.683143 24393 raft_consensus.cc:3055] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:57.688141 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:57.694029 24393 raft_consensus.cc:740] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:18:57.685518 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.694929 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:57.684180 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:18:57.696369 24290 leader_election.cc:336] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.689s (SENT)
I20260709 12:18:57.701256 24290 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:57.702426 24399 raft_consensus.cc:2393] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 5: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:18:57.696355 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:57.703375 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:57.694998 24393 consensus_queue.cc:260] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:57.703941 24400 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:18:57.708292 24393 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:57.709599 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:57.711263 24400 raft_consensus.cc:2410] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:18:57.711081 24366 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:57.713732 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:18:57.712783 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 75982.7us
W20260709 12:18:57.713704 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 76268.3us
W20260709 12:18:57.716434 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.679912 26668 raft_consensus.cc:2749] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:57.717459 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 119883us
W20260709 12:18:57.733681 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 70145us
I20260709 12:18:57.733893 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:57.735253 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:57.683741 26662 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:57.693537 26673 raft_consensus.cc:697] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:57.741256 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:57.746483 24399 raft_consensus.cc:3055] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:57.746950 24399 raft_consensus.cc:740] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:57.747385 26666 consensus_queue.cc:1059] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:57.747874 24399 consensus_queue.cc:260] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:57.740903 26667 raft_consensus.cc:2749] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:57.749158 24399 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:57.716835 26599 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:57.753890 25083 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:57.758453 26354 ts_tablet_manager.cc:933] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
W20260709 12:18:57.762240 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.765637 24399 raft_consensus.cc:1275] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:18:57.766661 26675 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:57.767122 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:57.769520 26605 raft_consensus.cc:3055] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:57.789433 24472 raft_consensus.cc:1240] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:57.740051 26662 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:57.773022 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:57.775954 24399 pending_rounds.cc:85] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a: Aborting all ops after (but not including) 4
I20260709 12:18:57.781339 26672 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:57.789965 26605 raft_consensus.cc:740] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:18:57.808174 26602 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:57.811378 26602 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:57.807364 26605 consensus_queue.cc:260] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:57.813329 24472 raft_consensus.cc:1240] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:57.784997 26448 raft_consensus.cc:3055] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:57.817663 26672 raft_consensus.cc:697] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:57.819984 26448 raft_consensus.cc:740] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:57.821113 26434 raft_consensus.cc:3055] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:57.821566 26434 raft_consensus.cc:740] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
W20260709 12:18:57.788688 25082 leader_election.cc:336] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.726s (SENT)
I20260709 12:18:57.789376 24395 raft_consensus.cc:2410] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:18:57.721201 26660 raft_consensus.cc:2804] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:57.738822 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:57.717141 26678 consensus_queue.cc:1048] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 12:18:57.777602 24440 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:57.815409 24399 pending_rounds.cc:107] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:18:57.831035 24399 raft_consensus.cc:2889] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:57.816901 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:57.812952 26605 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:57.822340 25082 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:57.833664 26674 log.cc:927] Time spent T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.152s	user 0.000s	sys 0.004s
I20260709 12:18:57.782238 24470 raft_consensus.cc:1275] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:57.821126 26672 consensus_queue.cc:237] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:57.825742 26434 consensus_queue.cc:260] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:57.826928 26448 consensus_queue.cc:260] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:57.800222 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 92840.9us
W20260709 12:18:57.840793 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 52188.9us
W20260709 12:18:57.843223 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 65759.2us
I20260709 12:18:57.844236 24440 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:57.853900 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.819478 26662 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:57.836360 26410 consensus_meta.cc:287] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.760s	user 0.011s	sys 0.000s
I20260709 12:18:57.828523 26660 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:57.856695 24440 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:57.887511 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.839782 26663 raft_consensus.cc:2749] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:57.890084 24366 leader_election.cc:400] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4.
W20260709 12:18:57.896479 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 171017us
I20260709 12:18:57.858919 26434 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:57.899461 24366 leader_election.cc:403] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:18:57.899297 24440 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:57.902124 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.842902 26473 raft_consensus.cc:2749] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:18:57.919482 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 223153us
W20260709 12:18:57.920462 24290 leader_election.cc:336] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.993s (SENT)
I20260709 12:18:57.921003 24290 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:57.891399 26668 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:57.903764 26448 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:57.909919 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:57.889878 26660 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:57.926177 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 84506.2us
W20260709 12:18:57.909551 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.836438 25114 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
W20260709 12:18:57.940018 25082 leader_election.cc:336] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.965s (SENT)
W20260709 12:18:57.912317 26617 consensus_meta.cc:287] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.539s	user 0.012s	sys 0.001s
I20260709 12:18:57.940989 25082 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:57.936712 24399 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
W20260709 12:18:57.942768 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 52847.8us
I20260709 12:18:57.861806 26410 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:57.944525 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 45360.9us
W20260709 12:18:57.965569 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.951483 26354 tablet_copy_client.cc:323] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.193:36951
I20260709 12:18:57.948941 24440 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:57.976320 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 55901.5us
W20260709 12:18:57.977223 24290 leader_election.cc:336] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.179s (SENT)
I20260709 12:18:57.981703 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:18:57.981976 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.982405 24322 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:18:57.986795 24440 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:57.988247 24440 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:57.994449 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.952504 26666 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:57.998564 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:57.999825 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:58.000833 24317 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:18:58.008371 24318 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:18:57.940690 26652 consensus_queue.cc:1059] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
W20260709 12:18:58.012146 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.007380 24291 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:57.981758 26473 raft_consensus.cc:2749] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:58.014968 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 75042.3us
W20260709 12:18:58.020830 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 43656.2us
W20260709 12:18:58.043572 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 55450.2us
I20260709 12:18:57.949179 26617 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:58.070297 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 63005.8us
I20260709 12:18:57.998453 26668 raft_consensus.cc:2749] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:57.976136 26698 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:18:58.068050 24290 leader_election.cc:336] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.228s (SENT)
I20260709 12:18:58.070252 24440 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:57.991232 26646 raft_consensus.cc:2749] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:58.076155 24290 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:58.004514 26680 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:58.086122 26681 log.cc:927] Time spent T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
W20260709 12:18:58.087033 26685 log.cc:927] Time spent T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
W20260709 12:18:58.104700 24290 leader_election.cc:336] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.785s (SENT)
W20260709 12:18:58.111857 24290 leader_election.cc:336] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.834s (SENT)
I20260709 12:18:57.940235 26673 consensus_queue.cc:237] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:58.111889 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 44540.7us
I20260709 12:18:58.074793 26661 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:58.132529 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 62362.9us
I20260709 12:18:58.090197 26680 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:58.140450 24472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1704) took 1057 ms. Trace:
W20260709 12:18:58.145926 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.143216 24472 rpcz_store.cc:276] 0709 12:18:57.082967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:57.824988 (+742021us) service_pool.cc:224] Handling call
0709 12:18:57.833319 (+  8331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:57.833524 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:18:57.833834 (+   310us) log.cc:844] Serialized 14 byte log entry
0709 12:18:58.114945 (+281111us) log.cc:844] Serialized 14 byte log entry
0709 12:18:58.139991 (+ 25046us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:58.140063 (+    72us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:58.140124 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:58.140212 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:58.140368 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":130705,"prepare.queue_time_us":844,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":2487,"raft.queue_time_us":55765,"spinlock_wait_cycles":14776576,"thread_start_us":224789,"threads_started":1}
I20260709 12:18:58.154036 24440 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:58.161268 24440 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:58.124815 26661 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.169080 24440 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
W20260709 12:18:58.152102 26690 log.cc:927] Time spent T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 12:18:58.176805 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:58.179731 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.139554 26646 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:18:58.181501 24290 leader_election.cc:336] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 3.015s (SENT)
I20260709 12:18:58.149335 26680 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:58.183872 24366 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:58.185036 24440 leader_election.cc:400] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 3. Current term is 4.
I20260709 12:18:58.187362 24440 leader_election.cc:403] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:18:58.188488 24440 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:58.192246 24440 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:58.198246 24440 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:58.202170 26658 raft_consensus.cc:3055] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:58.202698 26658 raft_consensus.cc:740] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:58.202742 24440 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:58.203016 24472 raft_consensus.cc:1240] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:58.207214 24440 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:58.211054 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1685) took 1195 ms. Trace:
I20260709 12:18:58.211547 24465 rpcz_store.cc:276] 0709 12:18:57.015212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:57.306057 (+290845us) service_pool.cc:224] Handling call
0709 12:18:57.306427 (+   370us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:57.340865 (+ 34438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:57.340918 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:57.356572 (+ 15654us) log.cc:844] Serialized 52 byte log entry
0709 12:18:57.483926 (+127354us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:58.194622 (+710696us) spinlock_profiling.cc:243] Waited 4.14 ms on lock 0x7b1800279040. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a96ef44bc 00007f4a9424248b 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425c455 00007f4a9ad443c7 00007f4a973569a7 00007f4a973660bf
0709 12:18:58.194763 (+   141us) log.cc:844] Serialized 14 byte log entry
0709 12:18:58.210645 (+ 15882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:58.210727 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:58.210768 (+    41us) raft_consensus.cc:1685] finished
0709 12:18:58.210841 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:58.210982 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":771,"prepare.queue_time_us":196202,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":153532,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":19454,"spinlock_wait_cycles":9519872,"thread_start_us":312839,"threads_started":3,"wal-append.queue_time_us":192718}
I20260709 12:18:58.215770 24440 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:58.225107 26667 raft_consensus.cc:3055] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:58.225652 26667 raft_consensus.cc:740] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:58.203828 26658 consensus_queue.cc:260] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:58.226698 26667 consensus_queue.cc:260] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:58.228236 26658 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:58.231359 26667 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:58.234927 26666 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:58.235745 26666 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:58.236267 26666 raft_consensus.cc:697] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:58.232529 26663 raft_consensus.cc:2749] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 3. Current term is 4.
I20260709 12:18:58.232762 24440 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:58.237952 26663 raft_consensus.cc:2749] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:58.253515 25084 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:58.253854 26663 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:58.256286 26636 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:58.234021 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1699) took 1215 ms. Trace:
I20260709 12:18:58.256721 26636 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.257153 26636 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:58.256798 24474 rpcz_store.cc:276] 0709 12:18:57.018478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:57.785879 (+767401us) service_pool.cc:224] Handling call
0709 12:18:57.786187 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:57.786400 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:18:57.786736 (+   336us) log.cc:844] Serialized 14 byte log entry
0709 12:18:58.233505 (+446769us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b18002c6020. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a96ef44bc 00007f4a9424248b 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425c455 00007f4a97344060 00007f4a97356716 00007f4a97367287
0709 12:18:58.233615 (+   110us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:58.233668 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:58.233726 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:58.233803 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:58.233950 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":201,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":36282,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":10886,"spinlock_wait_cycles":5020928,"thread_start_us":167771,"threads_started":2,"wal-append.queue_time_us":203888}
I20260709 12:18:58.237910 26666 consensus_queue.cc:237] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:58.242344 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.266633 24440 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:58.268340 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:58.271411 24474 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:58.270861 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:58.273437 24472 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:58.278119 24323 raft_consensus.cc:1275] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:58.283831 24318 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:18:58.287140 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1690) took 1270 ms. Trace:
I20260709 12:18:58.287690 24466 rpcz_store.cc:276] 0709 12:18:57.016541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:57.351012 (+334471us) service_pool.cc:224] Handling call
0709 12:18:57.364004 (+ 12992us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:57.498929 (+134925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:57.498956 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:57.509667 (+ 10711us) log.cc:844] Serialized 26 byte log entry
0709 12:18:57.689300 (+179633us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:57.689343 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:57.689417 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:58.286832 (+597415us) raft_consensus.cc:1685] finished
0709 12:18:58.286861 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:58.287048 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":177048,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":20683,"thread_start_us":272607,"threads_started":2,"wal-append.queue_time_us":258791}
I20260709 12:18:58.291399 24440 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
W20260709 12:18:58.293292 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.176262 26661 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:58.180292 26668 raft_consensus.cc:2804] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:58.165185 26704 raft_consensus.cc:2749] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:58.151399 26615 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:58.329597 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 148111us
I20260709 12:18:58.326237 24472 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
W20260709 12:18:58.330391 24290 leader_election.cc:336] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 3.028s (SENT)
I20260709 12:18:58.349479 24366 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:58.292706 26437 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.291582 26642 raft_consensus.cc:2804] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:18:58.345512 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.348333 24290 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:58.291123 26481 raft_consensus.cc:2749] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:58.369758 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 78468us
I20260709 12:18:58.323935 26668 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:58.328275 26646 raft_consensus.cc:697] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
W20260709 12:18:58.400033 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.350426 26410 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:58.315100 26636 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:58.402318 26723 raft_consensus.cc:2749] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:58.411162 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 80809.7us
I20260709 12:18:58.291020 26694 consensus_queue.cc:1048] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.194s
W20260709 12:18:58.426987 24290 leader_election.cc:336] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 3.151s (SENT)
I20260709 12:18:58.427613 24290 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:58.428944 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 94848.8us
I20260709 12:18:58.395943 26599 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:58.443831 24366 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
W20260709 12:18:58.453886 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.363430 26232 consensus_queue.cc:1059] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:18:58.401364 26668 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:58.459726 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:58.370749 26437 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:58.439134 26688 log.cc:927] Time spent T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.444s	user 0.000s	sys 0.002s
I20260709 12:18:58.426047 26630 raft_consensus.cc:2749] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:58.494786 24323 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
W20260709 12:18:58.467350 26454 consensus_meta.cc:287] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.757s	user 0.007s	sys 0.004s
I20260709 12:18:58.503232 24318 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:42226
I20260709 12:18:58.511703 24318 raft_consensus.cc:606] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:58.419422 26719 raft_consensus.cc:2749] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:58.505439 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:18:58.513612 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:58.467581 24467 consensus_meta.cc:287] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 1.279s	user 0.014s	sys 0.001s
I20260709 12:18:58.520794 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:58.525094 24440 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:58.526314 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:58.547924 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:58.555763 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:18:58.560276 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.560983 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:58.562282 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:58.519910 26617 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:58.563144 24466 raft_consensus.cc:2393] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:58.453292 24335 tablet_copy_service.cc:140] P c711faa13ead43ebbea0192cb74a4756: Received BeginTabletCopySession request for tablet 97dd30b21cc14958a91b2da522e4bbe9 from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:57702)
I20260709 12:18:58.520442 24467 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:18:58.575541 26713 consensus_queue.cc:1048] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 12:18:58.583309 26725 raft_consensus.cc:2764] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:18:58.583877 26682 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:58.545432 26703 raft_consensus.cc:2749] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:58.563001 26722 raft_consensus.cc:2749] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:18:58.584760 26699 log.cc:927] Time spent T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.377s	user 0.001s	sys 0.000s
I20260709 12:18:58.585230 26727 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:58.587087 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.587572 26437 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:58.616973 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1689) took 1600 ms. Trace:
I20260709 12:18:58.623302 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:58.523921 26454 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:58.654939 26684 log.cc:927] Time spent T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.462s	user 0.000s	sys 0.001s
I20260709 12:18:58.596738 26519 raft_consensus.cc:2749] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:58.645998 24468 rpcz_store.cc:276] 0709 12:18:57.016356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:57.349221 (+332865us) service_pool.cc:224] Handling call
0709 12:18:57.349588 (+   367us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:57.461883 (+112295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:57.461919 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:57.462763 (+   844us) log.cc:844] Serialized 52 byte log entry
0709 12:18:57.845412 (+382649us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:57.932900 (+ 87488us) log.cc:844] Serialized 14 byte log entry
0709 12:18:57.933623 (+   723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:57.933846 (+   223us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:58.232203 (+298357us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b48001a01d8. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9c275aa1 00007f4a9c26cb37 00007f4a9c26c9ca 00007f4a9c36426f 00007f4a9c363f37 00007f4a9c37855c 00007f4a9c378508 00007f4a9c378488 00007f4a9c378443 00007f4a9c3776ec 00007f4a9b2a1a96
0709 12:18:58.616624 (+384421us) raft_consensus.cc:1685] finished
0709 12:18:58.616750 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:58.616902 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3807,"prepare.queue_time_us":72393,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":188589,"raft.run_cpu_time_us":2694,"raft.run_wall_time_us":303128,"spinlock_wait_cycles":7277952,"thread_start_us":434297,"threads_started":2,"wal-append.queue_time_us":410301}
W20260709 12:18:58.687738 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.689265 24474 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
W20260709 12:18:58.693048 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 168033us
W20260709 12:18:58.700589 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 47958.5us
W20260709 12:18:58.653460 26641 consensus_meta.cc:287] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 1.423s	user 0.013s	sys 0.004s
W20260709 12:18:58.709295 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.633193 26617 raft_consensus.cc:2804] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:18:58.714504 26716 log.cc:927] Time spent T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:18:58.714727 26720 raft_consensus.cc:2804] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:58.629542 26717 raft_consensus.cc:2749] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:58.633641 24467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 1684) took 2264 ms. Trace:
I20260709 12:18:58.715309 26705 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:58.777804 26705 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:58.782377 26447 consensus_queue.cc:260] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:58.734376 26636 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:18:58.735154 26710 log.cc:927] Time spent T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.352s	user 0.001s	sys 0.000s
I20260709 12:18:58.657263 26727 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:58.737941 26454 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:18:58.739957 26461 consensus_meta.cc:287] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 1.033s	user 0.004s	sys 0.009s
I20260709 12:18:58.789978 26461 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:58.745602 26662 consensus_meta.cc:287] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.854s	user 0.006s	sys 0.006s
I20260709 12:18:58.792938 26662 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:58.746233 26676 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:58.752099 24440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:58.760511 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.801760 24317 raft_consensus.cc:2393] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 5: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:18:58.770296 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:58.593080 26419 consensus_queue.cc:1048] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.127s
I20260709 12:18:58.772141 26720 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:58.842832 26720 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:58.797070 26676 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:58.847175 26676 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:58.768592 26629 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:58.710563 26615 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:18:58.838038 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 66640.6us
I20260709 12:18:58.874338 24290 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:58.839458 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:58.796205 26662 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:58.567095 26646 consensus_queue.cc:237] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:58.818100 26617 raft_consensus.cc:697] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:58.812546 26703 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:58.821792 26705 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:58.771741 24335 tablet_copy_service.cc:161] P c711faa13ead43ebbea0192cb74a4756: Beginning new tablet copy session on tablet 97dd30b21cc14958a91b2da522e4bbe9 from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:57702: session id = d99d5d772cfe4a96afcab3d3b009a281-97dd30b21cc14958a91b2da522e4bbe9
I20260709 12:18:58.803254 24467 rpcz_store.cc:276] 0709 12:18:56.341898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:56.620237 (+278339us) service_pool.cc:224] Handling call
0709 12:18:58.606027 (+1985790us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:58.913219 24473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1691) took 1896 ms. Trace:
I20260709 12:18:58.913652 24473 rpcz_store.cc:276] 0709 12:18:57.016807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:57.369143 (+352336us) service_pool.cc:224] Handling call
0709 12:18:57.392705 (+ 23562us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:57.599191 (+206486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:57.599237 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:57.644022 (+ 44785us) log.cc:844] Serialized 26 byte log entry
0709 12:18:57.775944 (+131922us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b48001a01d8. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9c275aa1 00007f4a9c26cb37 00007f4a9c26c9ca 00007f4a9c36426f 00007f4a9c363f37 00007f4a9c37855c 00007f4a9c378508 00007f4a9c378488 00007f4a9c378443 00007f4a9c3776ec 00007f4a9b2a1a96
0709 12:18:57.893453 (+117509us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:57.893534 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:57.893652 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:58.911413 (+1017761us) raft_consensus.cc:1685] finished
0709 12:18:58.911442 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:58.913150 (+  1708us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":185284,"raft.run_cpu_time_us":1722,"raft.run_wall_time_us":207225,"spinlock_wait_cycles":23406336,"thread_start_us":432731,"threads_started":2,"wal-append.queue_time_us":279036}
W20260709 12:18:58.918262 26709 log.cc:927] Time spent T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.545s	user 0.000s	sys 0.003s
W20260709 12:18:58.920892 26714 log.cc:927] Time spent T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.407s	user 0.002s	sys 0.000s
I20260709 12:18:58.925588 26642 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:58.926282 26642 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:58.931715 26712 log.cc:927] Time spent T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.377s	user 0.000s	sys 0.001s
W20260709 12:18:58.939013 26448 consensus_meta.cc:287] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.994s	user 0.005s	sys 0.005s
I20260709 12:18:58.910374 26703 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:58.941468 26683 log.cc:927] Time spent T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.724s	user 0.000s	sys 0.006s
I20260709 12:18:58.943392 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 449) took 2320 ms. Trace:
I20260709 12:18:58.944371 26434 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.881888 26629 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:58.944924 26434 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:58.946607 26629 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:58.946952 26434 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:58.943841 24469 rpcz_store.cc:276] 0709 12:18:56.623189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:57.236560 (+613371us) service_pool.cc:224] Handling call
0709 12:18:57.241998 (+  5438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:57.423006 (+181008us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:57.592836 (+169830us) log.cc:844] Serialized 14 byte log entry
0709 12:18:57.762501 (+169665us) spinlock_profiling.cc:243] Waited 7.59 ms on lock 0x7b48001a01d8. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9c275aa1 00007f4a9c26cb37 00007f4a9c26c9ca 00007f4a9c36426f 00007f4a9c363f37 00007f4a9c37855c 00007f4a9c378508 00007f4a9c378488 00007f4a9c378443 00007f4a9c3776ec 00007f4a9b2a1a96
0709 12:18:58.091608 (+329107us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:58.102927 (+ 11319us) log.cc:844] Serialized 26 byte log entry
0709 12:18:58.103134 (+   207us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:58.103180 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:58.103263 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:58.216760 (+113497us) spinlock_profiling.cc:243] Waited 5.65 ms on lock 0x7b18000350e0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9425f3f3 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd 0000000000388634 0000000000388479 00007f4a9424283a
0709 12:18:58.900208 (+683448us) spinlock_profiling.cc:243] Waited 67.6 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:18:58.943166 (+ 42958us) raft_consensus.cc:1685] finished
0709 12:18:58.943188 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:58.943329 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24985,"prepare.queue_time_us":222542,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":4599,"raft.queue_time_us":278133,"raft.run_cpu_time_us":3266,"raft.run_wall_time_us":294923,"spinlock_wait_cycles":186780288,"thread_start_us":686181,"threads_started":4,"wal-append.queue_time_us":292473}
I20260709 12:18:58.952102 24472 raft_consensus.cc:2393] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 3: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
W20260709 12:18:58.943454 26621 consensus_meta.cc:287] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.370s	user 0.008s	sys 0.003s
I20260709 12:18:58.953723 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:58.876533 24290 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:58.762243 26698 consensus_queue.cc:1048] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.140s
I20260709 12:18:58.958925 24324 raft_consensus.cc:2410] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:18:58.904783 26660 consensus_meta.cc:287] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.956s	user 0.013s	sys 0.001s
W20260709 12:18:58.962880 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 86421.2us
I20260709 12:18:58.964473 24290 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:58.960054 26659 raft_consensus.cc:2749] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:58.808987 26641 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:58.960928 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:58.959247 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:58.969488 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:58.971148 24469 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:18:58.971391 24473 raft_consensus.cc:2410] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:18:58.974634 24395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.042s	sys 0.122s
W20260709 12:18:58.978088 24395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.043s	sys 0.122s
W20260709 12:18:58.976610 24400 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.962s	user 0.013s	sys 0.023s
I20260709 12:18:58.752161 26680 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:58.981866 26602 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:58.976023 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:58.983304 24472 raft_consensus.cc:2368] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4.
I20260709 12:18:58.984045 26680 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:18:58.983842 26663 consensus_meta.cc:287] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.729s	user 0.009s	sys 0.000s
W20260709 12:18:58.984753 24400 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.014s	sys 0.023s
W20260709 12:18:58.984982 26414 consensus_meta.cc:287] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.587s	user 0.011s	sys 0.004s
I20260709 12:18:58.985745 26341 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4.
I20260709 12:18:58.984800 26663 raft_consensus.cc:2749] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:58.988410 26691 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.989452 26703 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:58.993394 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:59.012887 24473 raft_consensus.cc:2368] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 4. Current term is 5.
I20260709 12:18:58.996456 24290 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:58.969440 26621 raft_consensus.cc:2749] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:58.978253 26667 consensus_meta.cc:287] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.745s	user 0.012s	sys 0.000s
W20260709 12:18:59.042120 25082 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.039s	sys 0.102s
W20260709 12:18:59.042667 25082 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.039s	sys 0.102s
W20260709 12:18:59.045377 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:59.046195 25082 leader_election.cc:336] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.721s (SENT)
I20260709 12:18:59.046710 25082 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:59.048429 24365 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.941s	user 0.007s	sys 0.021s
W20260709 12:18:59.129837 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:59.034354 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
W20260709 12:18:59.129871 24365 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.022s	user 0.008s	sys 0.021s
W20260709 12:18:59.130755 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 1.05827e+06us
W20260709 12:18:59.132678 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:59.132953 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:59.134300 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:59.135119 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:59.135821 24473 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:18:59.136240 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:59.034771 24366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.000s	sys 0.024s
W20260709 12:18:59.136773 24366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.000s	sys 0.025s
W20260709 12:18:59.137411 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 693635us
W20260709 12:18:59.028990 26666 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.063s	sys 0.118s
I20260709 12:18:59.135878 26434 raft_consensus.cc:2749] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:59.015448 26659 raft_consensus.cc:2749] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:59.143489 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:59.191711 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:59.191905 24399 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:18:59.144477 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:18:59.151782 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:59.154421 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.973182 26660 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:59.035866 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:59.202473 24467 raft_consensus.cc:2410] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:18:59.203485 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:18:59.203889 24400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1701) took 1296 ms. Trace:
I20260709 12:18:59.204363 24400 rpcz_store.cc:276] 0709 12:18:57.907767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:57.908919 (+  1152us) service_pool.cc:224] Handling call
0709 12:18:57.909351 (+   432us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:57.920244 (+ 10893us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:57.920290 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:57.947765 (+ 27475us) log.cc:844] Serialized 539 byte log entry
0709 12:18:58.985520 (+1037755us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:58.985559 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:58.985641 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:59.203623 (+217982us) raft_consensus.cc:1685] finished
0709 12:18:59.203648 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:59.203798 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3469,"raft.queue_time_us":3615,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":4909,"thread_start_us":977416,"threads_started":1,"wal-append.queue_time_us":1223347}
I20260709 12:18:59.129684 26454 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:18:59.206820 26454 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:59.030193 26617 consensus_queue.cc:237] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:59.208482 26642 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:59.209201 26454 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:18:59.209717 26715 log.cc:927] Time spent T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.504s	user 0.001s	sys 0.000s
W20260709 12:18:59.139314 26666 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.063s	sys 0.118s
I20260709 12:18:59.212658 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 462) took 1010 ms. Trace:
I20260709 12:18:59.213060 24471 rpcz_store.cc:276] 0709 12:18:58.202218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:58.202341 (+   123us) service_pool.cc:224] Handling call
0709 12:18:58.202707 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:58.210854 (+  8147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:58.210900 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:58.211616 (+   716us) log.cc:844] Serialized 26 byte log entry
0709 12:18:58.639456 (+427840us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:58.639520 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:58.639646 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:59.212372 (+572726us) raft_consensus.cc:1685] finished
0709 12:18:59.212399 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:59.212571 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50626,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":88,"thread_start_us":434174,"threads_started":2,"wal-append.queue_time_us":817181}
I20260709 12:18:59.216295 24471 raft_consensus.cc:1275] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:18:59.217024 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 44806.9us
I20260709 12:18:59.217870 24366 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:59.219756 24366 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:59.222553 25113 raft_consensus.cc:1275] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:59.197628 25116 raft_consensus.cc:2393] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 4: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:18:59.197072 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:59.196856 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:59.201561 24396 raft_consensus.cc:1275] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:59.251062 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:59.251720 24469 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:18:59.225479 26696 raft_consensus.cc:2749] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:59.227268 26642 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:59.227610 24325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 293) took 1244 ms. Trace:
I20260709 12:18:59.230391 26448 raft_consensus.cc:2804] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:59.224748 26692 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:59.236305 26701 log.cc:927] Time spent T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.517s	user 0.000s	sys 0.001s
I20260709 12:18:59.236757 24472 raft_consensus.cc:1240] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:59.032395 26691 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:59.203408 26660 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:59.242975 26461 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:59.233317 26641 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:59.258625 24473 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:18:59.258219 24325 rpcz_store.cc:276] 0709 12:18:57.982939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:57.983277 (+   338us) service_pool.cc:224] Handling call
0709 12:18:57.983802 (+   525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:57.990934 (+  7132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:57.990976 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:58.013874 (+ 22898us) log.cc:844] Serialized 26 byte log entry
0709 12:18:58.147182 (+133308us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:58.147229 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:58.147306 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:59.227362 (+1080056us) raft_consensus.cc:1685] finished
0709 12:18:59.227386 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:59.227544 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11746,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":16730,"thread_start_us":40294,"threads_started":1,"wal-append.queue_time_us":490054}
W20260709 12:18:59.261881 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 63041.7us
I20260709 12:18:59.265830 26692 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:59.267046 26602 raft_consensus.cc:2749] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:59.268082 25082 leader_election.cc:336] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.239s (SENT)
I20260709 12:18:59.269732 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:59.270539 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:18:59.262735 26668 consensus_meta.cc:287] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.749s	user 0.011s	sys 0.000s
W20260709 12:18:59.263228 26675 consensus_meta.cc:287] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.448s	user 0.013s	sys 0.000s
I20260709 12:18:59.276580 26671 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.279322 24474 raft_consensus.cc:2410] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:18:59.262916 26661 consensus_meta.cc:287] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.936s	user 0.011s	sys 0.000s
W20260709 12:18:59.279168 25082 leader_election.cc:336] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.347s (SENT)
I20260709 12:18:59.279086 24396 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:18:59.283002 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:18:59.265185 26673 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.013s	sys 0.004s
W20260709 12:18:59.274454 26232 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.041s	sys 0.129s
W20260709 12:18:59.294095 26599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.005s	sys 0.015s
W20260709 12:18:59.297909 26655 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.013s	sys 0.012s
W20260709 12:18:59.298431 26599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.005s	sys 0.015s
W20260709 12:18:59.316227 25082 leader_election.cc:336] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.717s (SENT)
W20260709 12:18:59.294553 26232 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.042s	sys 0.130s
W20260709 12:18:59.293679 26673 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.013s	sys 0.004s
I20260709 12:18:59.280951 26720 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:59.293217 26675 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:59.360569 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 50402.9us
W20260709 12:18:59.365254 26655 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.015s	sys 0.012s
I20260709 12:18:59.377801 26727 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:59.311503 26671 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:59.295895 26661 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:59.310381 26599 raft_consensus.cc:697] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:59.373000 26232 consensus_queue.cc:1048] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:59.354840 26641 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.384325 24366 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:59.386631 26720 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:59.354496 26660 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.472730 26660 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:59.468257 26605 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.474149 26605 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:59.475064 26660 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:59.365207 26666 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:59.393146 24290 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:59.396234 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:59.396391 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:59.396505 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:59.396796 25114 raft_consensus.cc:1240] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:59.290050 26668 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:59.472301 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:59.381335 26739 consensus_queue.cc:1048] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:59.507493 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:59.410733 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:59.508745 24321 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:59.411689 26708 raft_consensus.cc:3055] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:59.449558 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:59.509924 24322 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:59.462735 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:59.510668 24318 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:59.403270 26696 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.512588 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:59.513082 26708 raft_consensus.cc:740] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:59.476384 26605 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:59.513411 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:18:59.514230 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 121211us
I20260709 12:18:59.514581 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:59.515174 24399 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:18:59.515743 26676 raft_consensus.cc:2749] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:59.518467 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:59.519496 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:59.519816 26675 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:59.520218 24316 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:59.520687 26676 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:18:59.521241 26676 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:59.522486 26605 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:59.523057 26738 log.cc:927] Time spent T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.139s	user 0.002s	sys 0.000s
I20260709 12:18:59.522991 26605 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:59.523448 26723 consensus_queue.cc:1048] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:59.525592 26692 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:18:59.503976 25119 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:18:59.492654 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:18:59.527529 24398 raft_consensus.cc:2368] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6.
I20260709 12:18:59.527580 24320 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:59.519502 24319 raft_consensus.cc:2393] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:18:59.498853 25082 leader_election.cc:336] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.889s (SENT)
I20260709 12:18:59.476471 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:18:59.477191 24324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 1585) took 2233 ms (client timeout 2004 ms). Trace:
W20260709 12:18:59.481714 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 97570.4us
I20260709 12:18:59.511219 24440 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:59.505347 24317 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:59.533066 24324 rpcz_store.cc:269] 0709 12:18:57.243756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:57.270644 (+ 26888us) service_pool.cc:224] Handling call
0709 12:18:59.476962 (+2206318us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b54002567d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:18:59.477094 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3716494720}
I20260709 12:18:59.515117 24290 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:59.489820 25115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 839) took 1424 ms. Trace:
I20260709 12:18:59.512820 26666 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:59.534365 25115 rpcz_store.cc:276] 0709 12:18:58.065969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:58.069560 (+  3591us) service_pool.cc:224] Handling call
0709 12:18:58.097144 (+ 27584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:59.269014 (+1171870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:59.269045 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:59.269098 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:59.269137 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:59.489597 (+220460us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400050854. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:18:59.489637 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:59.489760 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2694513536}
I20260709 12:18:59.535265 24440 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:59.501878 24335 tablet_copy_source_session.cc:215] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:59.548188 24440 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:59.548731 24322 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6.
I20260709 12:18:59.550994 24321 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:18:59.551940 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:18:59.558703 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 43664us
W20260709 12:18:59.559517 25082 leader_election.cc:336] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 4.999s (SENT)
I20260709 12:18:59.559677 24290 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:18:59.559599 24440 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:18:59.563066 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:18:59.563890 25119 raft_consensus.cc:2393] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 6: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:18:59.564949 24465 raft_consensus.cc:1240] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:59.567759 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:18:59.568104 26703 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:59.568750 26703 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:59.570873 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:18:59.479966 26661 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:59.488885 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:59.482039 26742 raft_consensus.cc:2804] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:59.568843 26232 consensus_queue.cc:1059] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:18:59.685082 24316 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
W20260709 12:18:59.689447 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:59.571679 24398 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:18:59.564244 25111 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.034s	user 0.019s	sys 0.031s
I20260709 12:18:59.581447 24366 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:18:59.642477 24290 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:18:59.563325 26727 raft_consensus.cc:2749] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:59.642630 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 98059us
I20260709 12:18:59.638258 26621 raft_consensus.cc:2749] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:59.698885 25111 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.179s	user 0.022s	sys 0.038s
I20260709 12:18:59.639883 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:59.546729 26720 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:59.637653 24335 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:57702 (request call id 298) took 1476 ms. Trace:
W20260709 12:18:59.674449 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 114907us
I20260709 12:18:59.675947 24324 raft_consensus.cc:1275] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:59.525592 26676 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:59.506989 26641 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:59.721046 26341 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:59.512703 26696 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:18:59.620343 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:59.770778 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:59.520336 26675 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:18:59.707921 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 65568us
I20260709 12:18:59.638005 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:59.582520 26703 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:59.712942 24317 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:18:59.774257 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:59.750753 26691 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:18:59.710682 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:59.785080 24469 raft_consensus.cc:2410] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:18:59.477146 26599 consensus_queue.cc:237] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:59.719498 24319 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:18:59.724354 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:59.731988 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:59.790359 24468 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:18:59.790681 24471 raft_consensus.cc:2393] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 4: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:59.732717 26660 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.732087 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:59.734174 24440 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:18:59.734798 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:59.794219 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:18:59.794770 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 60688.6us
I20260709 12:18:59.795095 24469 raft_consensus.cc:2393] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:18:59.795578 24440 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:18:59.749265 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:59.798808 24316 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
I20260709 12:18:59.710631 26692 raft_consensus.cc:2749] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:59.751206 24324 raft_consensus.cc:1240] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:59.752848 24466 raft_consensus.cc:1240] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: []
W20260709 12:18:59.753068 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 189246us
I20260709 12:18:59.514297 26708 consensus_queue.cc:260] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:18:59.757788 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:59.568989 26419 raft_consensus.cc:2749] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:59.764501 24365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.011s	sys 0.026s
W20260709 12:18:59.829584 24365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.011s	sys 0.026s
I20260709 12:18:59.723982 24335 rpcz_store.cc:276] 0709 12:18:58.082145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:58.147119 (+ 64974us) service_pool.cc:224] Handling call
0709 12:18:59.546345 (+1399226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:59.721387 26742 raft_consensus.cc:697] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:59.752689 26646 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.774550 24290 leader_election.cc:400] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453) with higher term. Message: Invalid argument: T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4.
I20260709 12:18:59.642261 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:18:59.851898 24290 leader_election.cc:403] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:59.852208 24322 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
W20260709 12:18:59.785879 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:59.660970 24318 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:18:59.799412 24440 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:18:59.805604 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:59.775947 26694 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:59.800187 26448 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.022s	sys 0.011s
I20260709 12:18:59.781670 26447 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:59.772236 26713 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.011s	sys 0.027s
I20260709 12:18:59.781370 26341 raft_consensus.cc:697] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:59.769524 26733 consensus_queue.cc:1059] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 12:18:59.830071 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 565728us
I20260709 12:18:59.846987 24366 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:18:59.856684 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 60103.1us
I20260709 12:18:59.856748 24468 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
W20260709 12:18:59.857911 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 83541.9us
I20260709 12:18:59.863299 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:18:59.812353 26678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.001s	sys 0.032s
I20260709 12:18:59.879779 24398 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:18:59.887852 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:18:59.888576 25118 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
W20260709 12:18:59.849092 26730 log.cc:927] Time spent T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:18:59.883430 24469 raft_consensus.cc:2368] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6.
I20260709 12:18:59.905440 24469 raft_consensus.cc:1240] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 2. Current term is 4. Ops: []
I20260709 12:18:59.883993 24290 leader_election.cc:400] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453) with higher term. Message: Invalid argument: T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 4. Current term is 5.
I20260709 12:18:59.843808 26727 raft_consensus.cc:2804] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:59.827728 26673 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:18:59.888011 26678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.002s	sys 0.033s
I20260709 12:18:59.898947 24468 raft_consensus.cc:1275] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:59.906984 24290 leader_election.cc:403] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:59.903257 24291 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:18:59.925336 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 78496us
I20260709 12:18:59.919044 24320 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:18:59.926146 24366 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:18:59.868584 26708 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:59.848577 26605 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:18:59.887069 26713 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.011s	sys 0.027s
W20260709 12:18:59.878829 26448 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.022s	sys 0.012s
I20260709 12:18:59.820333 26660 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:59.877408 26698 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:18:59.869611 26666 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:59.877988 26642 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:59.869973 26646 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:59.964386 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:18:59.943219 26602 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:18:59.892910 24467 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.027s	sys 0.057s
W20260709 12:18:59.965621 24467 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.027s	sys 0.057s
I20260709 12:18:59.917384 26668 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:59.966825 26646 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:59.969360 26692 raft_consensus.cc:2749] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453) with higher term. Message: Invalid argument: T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 4. Current term is 5.
I20260709 12:18:59.969683 26666 consensus_queue.cc:1059] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:59.969264 26341 consensus_queue.cc:237] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:59.970865 26736 consensus_queue.cc:1048] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:18:59.805444 26659 raft_consensus.cc:2955] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 4 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:18:59.943585 26742 consensus_queue.cc:237] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:59.944232 26414 raft_consensus.cc:2804] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:59.976002 26414 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:59.976398 26414 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:59.979218 26675 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:18:59.980369 26641 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:59.980755 26642 raft_consensus.cc:697] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:18:59.961498 26658 raft_consensus.cc:3055] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:59.981603 26658 raft_consensus.cc:740] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:18:59.948055 26448 raft_consensus.cc:697] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:18:59.980943 26641 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:18:59.982125 26642 consensus_queue.cc:237] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:59.982828 26641 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:59.983179 26448 consensus_queue.cc:237] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:18:59.939520 25110 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEARNER]: Advancing to term 5
I20260709 12:18:59.962296 26671 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:18:59.991717 24470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.057s	sys 0.053s
I20260709 12:18:59.991015 24471 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
W20260709 12:18:59.992343 24470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.058s	sys 0.053s
W20260709 12:18:59.994472 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 110686us
I20260709 12:18:59.995370 24290 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:18:59.999444 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:59.985080 26641 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:18:59.991585 26668 raft_consensus.cc:3055] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:59.991905 26602 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:00.025460 24290 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:00.024024 26691 raft_consensus.cc:2749] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:00.038153 26660 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:00.040736 24472 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.001s	sys 0.024s
W20260709 12:19:00.041126 24472 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.001s	sys 0.024s
W20260709 12:19:00.043735 24473 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.007s	sys 0.018s
W20260709 12:19:00.045892 24473 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.007s	sys 0.018s
W20260709 12:19:00.041096 26435 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.014s	sys 0.014s
I20260709 12:19:00.029760 26668 raft_consensus.cc:740] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
W20260709 12:19:00.041460 26461 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.011s	sys 0.012s
I20260709 12:19:00.027354 26696 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:00.062696 24323 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.014s	sys 0.039s
W20260709 12:19:00.063630 24323 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.014s	sys 0.039s
I20260709 12:19:00.050760 26691 raft_consensus.cc:2764] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 12:19:00.056916 26435 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.014s	sys 0.014s
I20260709 12:19:00.056268 26713 raft_consensus.cc:3055] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:19:00.069550 26461 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.012s	sys 0.013s
I20260709 12:19:00.064322 24323 raft_consensus.cc:2955] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:19:00.093967 26668 consensus_queue.cc:260] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:00.089912 26703 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:00.093103 26720 raft_consensus.cc:2749] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:00.094580 26713 raft_consensus.cc:740] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
W20260709 12:19:00.124820 26707 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.016s	sys 0.018s
W20260709 12:19:00.147253 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:00.161986 24289 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.000s	sys 0.032s
W20260709 12:19:00.162635 24289 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.000s	sys 0.032s
W20260709 12:19:00.163065 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 589127us
W20260709 12:19:00.165907 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:00.166872 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.181087 24289 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:00.134752 26707 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.016s	sys 0.018s
W20260709 12:19:00.184679 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.196254 25111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 842) took 1910 ms. Trace:
I20260709 12:19:00.196904 25111 rpcz_store.cc:276] 0709 12:18:58.286015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:58.290869 (+  4854us) service_pool.cc:224] Handling call
0709 12:18:58.344411 (+ 53542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:58.381300 (+ 36889us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:18:58.754951 (+373651us) spinlock_profiling.cc:243] Waited 7.15 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a942420ac 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425c455 00007f4a9ad443c7
0709 12:18:59.752299 (+997348us) log.cc:844] Serialized 14 byte log entry
0709 12:19:00.195677 (+443378us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:00.195766 (+    89us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:00.195837 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:00.195948 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:00.196154 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1239,"prepare.queue_time_us":463628,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":46,"raft.queue_time_us":13032,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":133,"spinlock_wait_cycles":16452352,"thread_start_us":1619493,"threads_started":2}
I20260709 12:19:00.202044 26696 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:00.202682 26696 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:00.203122 26696 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:00.235198 24289 leader_election.cc:400] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6.
I20260709 12:19:00.236052 24289 leader_election.cc:403] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 12:19:00.245133 26744 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.007s	sys 0.030s
W20260709 12:19:00.261196 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 310966us
W20260709 12:19:00.268998 26744 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.007s	sys 0.031s
I20260709 12:19:00.265141 26676 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:00.281431 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.274461 26720 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.287130 26720 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:00.287438 24467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 471) took 1099 ms. Trace:
I20260709 12:19:00.288182 26698 raft_consensus.cc:2749] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453) with higher term. Message: Invalid argument: T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4.
I20260709 12:19:00.289253 26720 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:00.270569 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 382086us
I20260709 12:19:00.291818 24440 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:00.280136 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 354041us
I20260709 12:19:00.273523 24289 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:00.290524 26764 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.305385 26764 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:00.307675 26764 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:00.271049 26673 raft_consensus.cc:697] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:00.314086 26673 consensus_queue.cc:237] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:00.314636 26658 consensus_queue.cc:260] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:00.317180 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 43780.9us
I20260709 12:19:00.290300 25110 raft_consensus.cc:1275] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEARNER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:19:00.387648 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:00.391918 24399 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:19:00.388199 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:00.393504 24398 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:00.258937 26713 consensus_queue.cc:260] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:00.285758 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:00.402160 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:00.312481 24366 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:00.403100 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:00.404068 24290 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:00.276266 26629 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.309953 26739 consensus_queue.cc:1048] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.090s
I20260709 12:19:00.390949 26703 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:00.397651 26750 log.cc:927] Time spent T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:19:00.390511 26727 raft_consensus.cc:697] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:00.316516 26658 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:00.380704 26761 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:00.412613 25084 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
W20260709 12:19:00.414328 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 101965us
I20260709 12:19:00.311277 26435 consensus_queue.cc:1048] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.108s
I20260709 12:19:00.312489 26764 raft_consensus.cc:2749] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:00.422389 25084 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:00.408093 26713 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:00.288060 24467 rpcz_store.cc:276] 0709 12:18:59.188396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:59.204570 (+ 16174us) service_pool.cc:224] Handling call
0709 12:18:59.245398 (+ 40828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:59.245698 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:59.966062 (+720364us) log.cc:844] Serialized 14 byte log entry
0709 12:19:00.286901 (+320839us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:00.286982 (+    81us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:00.287063 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:00.287170 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:00.287351 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2324,"prepare.queue_time_us":721572,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":62,"raft.queue_time_us":3692,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":131,"thread_start_us":1036388,"threads_started":2}
W20260709 12:19:00.420534 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 471426us
I20260709 12:19:00.426752 26707 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:00.457329 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:00.457545 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:00.467275 24365 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:00.468246 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:00.458220 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:00.469024 24467 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:19:00.469457 24469 raft_consensus.cc:2410] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:19:00.470108 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:00.473287 24440 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:00.454847 26707 raft_consensus.cc:697] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:00.474189 26770 consensus_queue.cc:1059] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:00.467047 26727 consensus_queue.cc:237] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:00.475116 26707 consensus_queue.cc:237] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:00.474620 26764 raft_consensus.cc:2804] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:00.418881 26629 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:00.477000 26764 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:00.477123 26758 log.cc:927] Time spent T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:19:00.477514 26764 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:00.481019 26599 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:19:00.481382 26756 log.cc:927] Time spent T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 12:19:00.482414 24365 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:00.483165 26659 consensus_meta.cc:287] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.000s
I20260709 12:19:00.458106 24471 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:00.433194 26530 raft_consensus.cc:2804] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:00.435962 26602 raft_consensus.cc:2804] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:00.484648 25084 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:00.474291 24440 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:00.459023 24472 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:00.492077 24440 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:00.427101 26232 consensus_queue.cc:1048] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:19:00.497416 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:00.495922 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 91957.4us
I20260709 12:19:00.498032 24470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 466) took 1339 ms. Trace:
I20260709 12:19:00.500573 24470 rpcz_store.cc:276] 0709 12:18:59.159037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:59.159230 (+   193us) service_pool.cc:224] Handling call
0709 12:18:59.159630 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:59.197900 (+ 38270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:59.197947 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:59.246348 (+ 48401us) log.cc:844] Serialized 26 byte log entry
0709 12:18:59.992867 (+746519us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:59.992943 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:59.993042 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:00.497756 (+504714us) raft_consensus.cc:1685] finished
0709 12:19:00.497781 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:00.497955 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29779,"raft.queue_time_us":38572,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":115,"thread_start_us":746080,"threads_started":1,"wal-append.queue_time_us":974316}
I20260709 12:19:00.485486 26481 raft_consensus.cc:2749] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:00.439363 26742 consensus_queue.cc:1048] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
W20260709 12:19:00.553318 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.504958 26703 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:00.493052 26530 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:00.504736 26658 raft_consensus.cc:2804] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:19:00.568696 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 76728.1us
W20260709 12:19:00.559442 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 124459us
W20260709 12:19:00.593497 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.567167 24290 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:00.509440 26602 raft_consensus.cc:697] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:00.585702 26769 raft_consensus.cc:2804] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:00.580185 26698 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.619411 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:00.620749 24322 raft_consensus.cc:2410] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:19:00.593156 26354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97dd30b21cc14958a91b2da522e4bbe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:00.596658 24289 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:00.608880 24290 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:00.609103 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:00.613444 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.598541 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:00.626034 25118 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:00.641230 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:00.642625 24317 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
W20260709 12:19:00.644191 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:00.644915 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 173260us
I20260709 12:19:00.649178 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:00.655736 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:00.594873 26530 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:00.593601 26658 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:00.659153 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:00.607388 26703 raft_consensus.cc:697] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:00.663522 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:00.682375 25115 raft_consensus.cc:2410] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:19:00.678930 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.669951 25116 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:19:00.565444 26768 consensus_queue.cc:1048] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.120s
I20260709 12:19:00.584273 26435 consensus_queue.cc:1048] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:19:00.725713 25118 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:19:00.726022 25117 raft_consensus.cc:1240] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:00.632145 26599 raft_consensus.cc:697] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:00.641640 26720 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:00.718365 26414 consensus_meta.cc:287] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.742s	user 0.009s	sys 0.003s
I20260709 12:19:00.682688 26658 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:00.617633 26770 consensus_queue.cc:1048] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.100s
I20260709 12:19:00.649226 26769 raft_consensus.cc:697] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:00.738092 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:00.735647 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 267007us
I20260709 12:19:00.735833 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:00.735311 24440 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:00.692152 26761 raft_consensus.cc:697] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 6 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:19:00.783288 26780 log.cc:927] Time spent T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:19:00.765411 26414 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:00.765704 26481 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:00.761698 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:00.762144 26675 raft_consensus.cc:2749] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:00.742735 26602 consensus_queue.cc:237] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:00.782908 26447 consensus_queue.cc:1048] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:00.724846 26766 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:00.642632 26698 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:00.651993 26696 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:00.792424 24318 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:00.807987 24440 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:00.821329 26642 raft_consensus.cc:2804] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:00.799230 26673 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:00.805598 26481 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:00.855625 24366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.810910 26786 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.807029 26692 raft_consensus.cc:2749] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:00.761679 26720 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:00.822082 26666 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:00.823552 26739 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:00.835772 26414 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:00.895948 24366 connection.cc:256] RPC call timeout handler was delayed by -3.1836540959998274s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1761s for a response
I20260709 12:19:00.835752 26642 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:19:00.919483 24366 connection.cc:256] RPC call timeout handler was delayed by -3.0783540959998845s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
I20260709 12:19:00.890861 25112 raft_consensus.cc:1240] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:00.858150 26481 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:00.920408 26776 log.cc:927] Time spent T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:19:00.930833 26789 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.931644 26789 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:00.933476 24319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44278 (request call id 2063) took 1178 ms. Trace:
I20260709 12:19:00.933951 24319 rpcz_store.cc:276] 0709 12:18:59.754610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:59.789875 (+ 35265us) service_pool.cc:224] Handling call
0709 12:18:59.843347 (+ 53472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:59.982068 (+138721us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:59.982098 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:59.982142 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:59.982178 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:00.933201 (+951023us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b540025ab54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:00.933248 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:00.933403 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1836,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"spinlock_wait_cycles":318172928}
I20260709 12:19:00.935847 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:00.936985 26742 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.937556 26742 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:00.939771 26742 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:00.941032 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1630) took 1214 ms. Trace:
I20260709 12:19:00.941524 24465 rpcz_store.cc:276] 0709 12:18:59.727110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:59.820367 (+ 93257us) service_pool.cc:224] Handling call
0709 12:18:59.973657 (+153290us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b58001c3e98. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c325fc0 00007f4a9c310929 00007f4a9c3103d2 00007f4a95887bd4
0709 12:18:59.973902 (+   245us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:59.985572 (+ 11670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:59.985607 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:59.991904 (+  6297us) log.cc:844] Serialized 539 byte log entry
0709 12:19:00.395611 (+403707us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:00.395651 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:00.395721 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:00.940494 (+544773us) raft_consensus.cc:1685] finished
0709 12:19:00.940517 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:00.940960 (+   443us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11027,"raft.queue_time_us":19895,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":2413,"spinlock_wait_cycles":4607232,"thread_start_us":368784,"threads_started":1,"wal-append.queue_time_us":729198}
W20260709 12:19:00.920670 26774 log.cc:927] Time spent T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:19:00.925010 24323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44278 (request call id 2058) took 1463 ms. Trace:
I20260709 12:19:00.949143 24323 rpcz_store.cc:276] 0709 12:18:59.461322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:59.461495 (+   173us) service_pool.cc:224] Handling call
0709 12:18:59.462171 (+   676us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:59.462775 (+   604us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:59.462817 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:59.473086 (+ 10269us) log.cc:844] Serialized 539 byte log entry
0709 12:19:00.064134 (+591048us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:00.243233 (+179099us) log.cc:844] Serialized 14 byte log entry
0709 12:19:00.243598 (+   365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:00.243734 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:00.922292 (+678558us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b18002ee940. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9425f3f3 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd 0000000000388634 0000000000388479 00007f4a9424283a
0709 12:19:00.924616 (+  2324us) raft_consensus.cc:1685] finished
0709 12:19:00.924761 (+   145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:00.924940 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3337,"raft.queue_time_us":1652,"raft.run_cpu_time_us":376,"raft.run_wall_time_us":19116,"spinlock_wait_cycles":7103744,"thread_start_us":590531,"threads_started":1,"wal-append.queue_time_us":785221}
I20260709 12:19:00.951910 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:00.953166 26772 log.cc:927] Time spent T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
W20260709 12:19:00.955412 24438 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.539s (SENT) [suppressed 36 similar messages]
I20260709 12:19:00.920485 26605 raft_consensus.cc:993] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756: : Instructing follower 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
I20260709 12:19:00.956430 26666 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:00.957358 26605 raft_consensus.cc:1081] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Signalling peer 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
I20260709 12:19:00.936478 24319 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:19:00.958895 26666 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:00.959956 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:00.961638 24319 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:19:00.895255 26694 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.842259 26703 consensus_queue.cc:237] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:00.954843 26764 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:00.967628 24440 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:00.891798 26673 raft_consensus.cc:697] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
W20260709 12:19:00.970346 24366 connection.cc:256] RPC call timeout handler was delayed by -3.0171540959997856s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
W20260709 12:19:00.970816 24366 connection.cc:256] RPC call timeout handler was delayed by -2.9847540959999606s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19820000000000002s for a response
W20260709 12:19:00.971123 24366 connection.cc:256] RPC call timeout handler was delayed by -2.9694540959999358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19990000000000002s for a response
W20260709 12:19:00.971469 24366 connection.cc:256] RPC call timeout handler was delayed by -2.9253540959998645s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
I20260709 12:19:00.954447 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:00.973680 24318 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
W20260709 12:19:00.984875 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.970538 26642 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:00.991956 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:00.993594 24366 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:01.013545 24366 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:01.015800 24366 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:01.011894 24319 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:19:01.017553 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:00.995960 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 258160us
I20260709 12:19:01.007931 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:00.991689 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 200044us
I20260709 12:19:01.018561 25119 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:19:01.018230 24393 raft_consensus.cc:2955] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:19:01.019061 24365 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
W20260709 12:19:01.006856 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 398005us
I20260709 12:19:01.020586 24290 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:01.027693 24323 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:19:01.013700 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:00.837930 26766 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:01.046984 24366 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:01.048563 24366 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:01.048138 24365 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:01.054692 24323 raft_consensus.cc:1275] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:19:01.056133 24323 raft_consensus.cc:1275] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:19:01.001096 26739 raft_consensus.cc:697] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:19:01.071333 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 50843.5us
I20260709 12:19:01.072271 24290 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:01.073438 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:01.060283 24319 raft_consensus.cc:1240] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:01.081007 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:01.081730 24398 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:00.964697 26694 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:01.086517 24290 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:00.863566 26599 consensus_queue.cc:237] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:01.045727 26753 raft_consensus.cc:2804] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:01.098733 24318 raft_consensus.cc:1275] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:19:01.009091 26434 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.101055 24398 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
I20260709 12:19:01.124498 26434 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:01.125065 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:01.126214 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:01.121027 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:01.127139 26434 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:01.127282 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:01.128424 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:01.129982 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:01.131359 26770 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:01.121850 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:01.123571 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:01.132072 26770 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:01.132666 24399 raft_consensus.cc:2393] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:01.134370 26770 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:01.135640 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 115993us
I20260709 12:19:01.132445 25119 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:19:01.141706 26788 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:19:01.159549 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 204010us
I20260709 12:19:01.164662 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:01.167029 25082 leader_election.cc:336] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.782s (SENT)
I20260709 12:19:01.142277 26621 raft_consensus.cc:2749] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:01.142434 26414 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:01.010274 26769 consensus_queue.cc:237] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:01.059160 26751 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:01.053375 26781 raft_consensus.cc:2749] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:01.069263 26435 raft_consensus.cc:2804] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:01.072580 26448 raft_consensus.cc:2749] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:01.148844 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:01.144119 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 57696.2us
I20260709 12:19:01.206359 24317 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
I20260709 12:19:01.206804 24290 leader_election.cc:400] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Vote denied by peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453) with higher term. Message: Invalid argument: T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6.
I20260709 12:19:01.207921 24290 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:00.969632 26673 consensus_queue.cc:237] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:01.128564 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:01.061968 26341 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:01.090894 26727 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:19:01.167081 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:01.167623 25082 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:01.141881 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:00.983747 26786 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:01.122520 26753 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:01.154632 26691 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:01.189723 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:01.183105 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:01.198866 24392 raft_consensus.cc:1240] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:01.002837 26761 consensus_queue.cc:237] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:01.150506 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:57686 (request call id 13) took 16006 ms. Trace:
I20260709 12:19:01.143231 26794 raft_consensus.cc:2764] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:19:01.154829 26733 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.169538 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:01.217376 24394 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:01.222597 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:01.429913 24322 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
W20260709 12:19:01.235272 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:01.229673 24398 raft_consensus.cc:2393] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:01.228960 24317 raft_consensus.cc:1240] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:19:01.225256 24290 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
W20260709 12:19:01.394222 26778 log.cc:927] Time spent T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.537s	user 0.002s	sys 0.001s
W20260709 12:19:01.432054 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 206881us
I20260709 12:19:01.432925 24290 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:01.434424 24290 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:01.435698 24290 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:01.436758 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:01.288370 24318 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:19:01.239785 26666 consensus_queue.cc:1048] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 12:19:01.240334 26676 consensus_meta.cc:287] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.949s	user 0.014s	sys 0.000s
I20260709 12:19:01.311448 25112 raft_consensus.cc:2368] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6.
W20260709 12:19:01.312847 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:01.385330 26698 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:01.314422 26434 raft_consensus.cc:2749] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:19:01.314666 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 147657us
W20260709 12:19:01.492107 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:01.273247 26435 raft_consensus.cc:697] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:01.283783 26341 raft_consensus.cc:697] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:19:01.316046 26783 log.cc:927] Time spent T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 12:19:01.218338 26739 consensus_queue.cc:237] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:01.317425 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:01.286900 26691 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:01.291465 26753 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:01.320889 26720 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:01.199100 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:01.242370 26414 raft_consensus.cc:2804] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:01.228256 26727 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:01.392805 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:01.249189 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:01.217813 26812 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.428220 24470 raft_consensus.cc:1240] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:01.190843 26789 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:01.438678 26621 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:01.171635 26788 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:01.439975 24290 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:01.440459 26775 log.cc:927] Time spent T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 12:19:01.443570 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:01.444207 26675 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:01.444797 26785 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:01.445393 26803 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:01.446355 24318 raft_consensus.cc:1240] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:19:01.447877 24396 raft_consensus.cc:1240] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:01.400945 24473 raft_consensus.cc:1275] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:01.471385 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:01.289211 26696 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:01.315160 26773 log.cc:927] Time spent T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.231s	user 0.000s	sys 0.000s
W20260709 12:19:01.479009 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:01.314239 26799 log.cc:927] Time spent T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:19:01.282933 26481 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:01.501415 24395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2147) took 2367 ms (client timeout 1910 ms). Trace:
I20260709 12:19:01.505460 26435 consensus_queue.cc:237] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:01.507308 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:01.507813 26341 consensus_queue.cc:237] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:01.447333 25113 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:01.514595 24400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 1720) took 1947 ms. Trace:
I20260709 12:19:01.469097 26784 raft_consensus.cc:2804] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:19:01.490945 26787 log.cc:927] Time spent T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.396s	user 0.000s	sys 0.003s
I20260709 12:19:01.457067 26764 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:01.489789 26676 raft_consensus.cc:2749] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6.
I20260709 12:19:01.534273 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1631) took 1806 ms. Trace:
W20260709 12:19:01.674942 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 53077.5us
W20260709 12:19:01.522475 25082 leader_election.cc:336] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.769s (SENT)
W20260709 12:19:01.615020 24366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.019s	sys 0.022s
W20260709 12:19:01.721675 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 199232us
I20260709 12:19:01.699591 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:01.488798 26733 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:01.721681 24399 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:01.724834 24465 raft_consensus.cc:2376] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5. Re-sending same reply.
W20260709 12:19:01.720451 24395 rpcz_store.cc:269] 0709 12:18:59.133628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:59.133834 (+   206us) service_pool.cc:224] Handling call
0709 12:19:01.501176 (+2367342us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54000cdd54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:01.501326 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3024347008}
I20260709 12:19:01.569867 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:01.561725 24316 raft_consensus.cc:1275] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:19:01.777185 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:01.737160 24321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 307) took 2177 ms. Trace:
I20260709 12:19:02.022444 24321 rpcz_store.cc:276] 0709 12:18:59.518730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:59.564436 (+ 45706us) service_pool.cc:224] Handling call
0709 12:18:59.564805 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:59.936491 (+371686us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:59.936524 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:59.972120 (+ 35596us) spinlock_profiling.cc:243] Waited 6.08 ms on lock 0x7b2c000dd788. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a95c45a11 00007f4a95c55372 00007f4a97387a01 00007f4a9734c43a 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2
0709 12:18:59.972578 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 12:19:00.895445 (+922867us) spinlock_profiling.cc:243] Waited 9.5 ms on lock 0x7b18003d1da0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a94241e07 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425ec02 00007f4a96ee620b 00007f4a96eebd23 00007f4a96eec0d1 00007f4a97307a0f
0709 12:19:01.079319 (+183874us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:01.079356 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:01.696273 (+616917us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b5400167954. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:01.696321 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:01.696437 (+   116us) raft_consensus.cc:1685] finished
0709 12:19:01.696451 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:01.696603 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19682,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":19651,"spinlock_wait_cycles":844236800,"thread_start_us":183682,"threads_started":1,"wal-append.queue_time_us":1586088}
I20260709 12:19:02.024094 26793 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:01.514375 26668 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:02.025017 26793 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:02.027797 26733 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:01.754658 24320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.021s	sys 0.027s
W20260709 12:19:02.028981 24320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.025s	sys 0.045s
W20260709 12:19:02.030367 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 288759us
W20260709 12:19:01.849843 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:01.763528 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:02.032925 24393 raft_consensus.cc:2410] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:19:01.922015 24325 raft_consensus.cc:2368] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6.
I20260709 12:19:01.946048 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:01.718989 24400 rpcz_store.cc:276] 0709 12:18:59.567254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:59.567437 (+   183us) service_pool.cc:224] Handling call
0709 12:19:01.503118 (+1935681us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b54000e38d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:01.514523 (+ 11405us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1981189888}
I20260709 12:19:02.034713 24391 raft_consensus.cc:2410] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:19:02.034456 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 594516us
W20260709 12:19:01.957762 24394 consensus_meta.cc:287] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.001s
I20260709 12:19:02.035593 24394 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
W20260709 12:19:01.745726 24440 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.009s	sys 0.023s
W20260709 12:19:02.037269 24440 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.058s	user 0.015s	sys 0.036s
W20260709 12:19:02.037648 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 1.07004e+06us
W20260709 12:19:02.020176 25082 leader_election.cc:336] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.947s (SENT)
I20260709 12:19:02.039058 25082 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:01.517743 26691 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:01.719481 24474 rpcz_store.cc:276] 0709 12:18:59.727389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:59.821555 (+ 94166us) service_pool.cc:224] Handling call
0709 12:18:59.862286 (+ 40731us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:00.103341 (+241055us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:00.103391 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:00.124462 (+ 21071us) log.cc:844] Serialized 26 byte log entry
0709 12:19:00.491344 (+366882us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:00.510829 (+ 19485us) log.cc:844] Serialized 14 byte log entry
0709 12:19:00.511058 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:00.511137 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:00.949803 (+438666us) spinlock_profiling.cc:243] Waited 6.04 ms on lock 0x7b1800402700. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9425f522 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd 0000000000388634 0000000000388479 00007f4a9424283a
0709 12:19:01.512040 (+562237us) raft_consensus.cc:1685] finished
0709 12:19:01.534022 (+ 21982us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:01.534199 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25282,"prepare.queue_time_us":19212,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":27447,"raft.queue_time_us":85082,"raft.run_cpu_time_us":510,"raft.run_wall_time_us":85709,"spinlock_wait_cycles":14617088,"thread_start_us":545594,"threads_started":2,"wal-append.queue_time_us":903894}
W20260709 12:19:02.064155 26658 consensus_meta.cc:287] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 1.263s	user 0.002s	sys 0.007s
I20260709 12:19:02.064698 24474 raft_consensus.cc:1240] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:01.873133 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:01.887966 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:01.832306 26803 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:01.676172 26816 log.cc:927] Time spent T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 12:19:01.753165 26785 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:01.563024 26766 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:01.736896 26727 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:01.983604 26642 consensus_meta.cc:287] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.922s	user 0.010s	sys 0.001s
W20260709 12:19:02.022500 26806 log.cc:927] Time spent T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.816s	user 0.001s	sys 0.000s
I20260709 12:19:02.099792 26668 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:02.045619 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:02.106562 24393 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
W20260709 12:19:02.107015 26713 consensus_meta.cc:287] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 1.670s	user 0.007s	sys 0.006s
I20260709 12:19:02.107753 26668 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:01.831557 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:01.533986 26661 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:19:01.722254 24366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.019s	sys 0.031s
I20260709 12:19:01.524502 26434 consensus_queue.cc:1048] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.538s
I20260709 12:19:02.066461 24398 raft_consensus.cc:2410] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:19:02.076511 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 56369.2us
I20260709 12:19:02.122623 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:02.123354 24396 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:01.679343 26530 consensus_meta.cc:287] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.954s	user 0.011s	sys 0.004s
I20260709 12:19:02.081290 26765 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:02.082330 26817 log.cc:927] Time spent T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:19:02.082159 26798 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:02.082893 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:01.830798 26812 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:01.737186 26414 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:01.557293 26786 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:02.084687 26785 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:01.549696 26802 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:02.096865 26642 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:02.098599 26766 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.099200 26666 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.099686 26815 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.112041 24440 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
W20260709 12:19:02.184755 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 72873.4us
I20260709 12:19:01.924283 26764 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:01.723066 26784 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:01.736825 26698 raft_consensus.cc:2749] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:02.115972 25114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48252 (request call id 362) took 2329 ms. Trace:
I20260709 12:19:02.081291 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:02.117540 24474 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:33272
I20260709 12:19:02.298004 24474 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:02.298596 24474 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:02.119859 26668 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:01.404922 26659 rpcz_store.cc:276] 0709 12:18:45.115109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.160353 (+ 45244us) service_pool.cc:224] Handling call
0709 12:18:45.380903 (+220550us) log.cc:844] Serialized 513 byte log entry
0709 12:18:46.317834 (+936931us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b4c00208300. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a95618a20 00007f4a95629a29 00007f4a9562a13f 00007f4a955ee2ab 00007f4a9561bf3c 00007f4a9561c3fe 00007f4a958a950b 00007f4a972a8381 00007f4a972a626b 00007f4a972acd53 00007f4a972accd9
0709 12:18:46.329719 (+ 11885us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b18003d6660. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a941d9c0a 00007f4a9d919219 00007f4a94261a40 00007f4a9425c4e4 00007f4a9425c455 00007f4a972a5b0b 00007f4a9732ab63 00007f4a97352752 00007f4a9c312d29
0709 12:19:01.088534 (+14758815us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24966,"raft.queue_time_us":841442,"raft.run_cpu_time_us":29714,"raft.run_wall_time_us":824659,"spinlock_wait_cycles":10405888,"thread_start_us":282333,"threads_started":2,"wal-append.queue_time_us":111034,"wal-append.run_cpu_time_us":2588,"wal-append.run_wall_time_us":1105514}
W20260709 12:19:02.126632 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.129482 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:02.150450 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:02.151562 24439 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.125s	user 0.015s	sys 0.028s
W20260709 12:19:02.309338 24439 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.283s	user 0.015s	sys 0.028s
I20260709 12:19:02.301367 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:02.152877 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:02.154064 24399 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:19:02.171306 24396 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:19:02.066444 26658 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:02.149950 26414 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:02.291070 24466 raft_consensus.cc:1240] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:02.310977 24399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2156) took 1232 ms. Trace:
I20260709 12:19:02.318329 24399 rpcz_store.cc:276] 0709 12:19:01.078766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.466187 (+387421us) service_pool.cc:224] Handling call
0709 12:19:02.310917 (+844730us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:02.131548 26530 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:02.128835 26661 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:02.290089 26784 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:02.324662 24391 pending_rounds.cc:85] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a: Aborting all ops after (but not including) 4
I20260709 12:19:02.343545 24391 pending_rounds.cc:107] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:19:02.343888 24391 raft_consensus.cc:2889] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:02.290035 26820 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:19:02.309671 26816 log.cc:927] Time spent T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:19:02.356222 26824 consensus_queue.cc:1048] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:19:02.361333 26812 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:02.347875 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:02.282786 26666 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:02.379325 24397 raft_consensus.cc:1275] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:19:02.333962 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:02.380491 25112 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:02.385950 26793 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:02.175532 26765 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:19:02.339567 26791 consensus_queue.cc:1059] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:19:02.283130 26766 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:02.289896 26764 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:02.287375 26815 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:02.339128 26668 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:02.383862 24397 pending_rounds.cc:85] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a: Aborting all ops after (but not including) 3
I20260709 12:19:02.397061 24440 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:02.337393 26658 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:02.408994 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.381532 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:02.411248 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:02.413563 24471 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.948s	user 0.024s	sys 0.035s
I20260709 12:19:02.414057 26668 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:02.404235 24474 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:02.293967 25114 rpcz_store.cc:276] 0709 12:18:59.786175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:59.788658 (+  2483us) service_pool.cc:224] Handling call
0709 12:18:59.855758 (+ 67100us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:59.938985 (+ 83227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:59.944662 (+  5677us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:59.984338 (+ 39676us) log.cc:844] Serialized 26 byte log entry
0709 12:19:00.450230 (+465892us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:00.460728 (+ 10498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:00.460863 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:02.079402 (+1618539us) raft_consensus.cc:1685] finished
0709 12:19:02.079430 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:02.115818 (+ 36388us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47333,"raft.queue_time_us":14962,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"thread_start_us":439760,"threads_started":1,"wal-append.queue_time_us":1184293}
W20260709 12:19:02.420967 24472 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.970s	user 0.031s	sys 0.048s
W20260709 12:19:02.422302 24471 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.025s	sys 0.035s
I20260709 12:19:02.176923 26802 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:02.416292 26786 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
W20260709 12:19:02.417215 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.414304 24397 pending_rounds.cc:107] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:19:02.463644 24397 raft_consensus.cc:2889] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:02.431739 26825 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:02.436873 24438 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.003s	sys 0.000s
W20260709 12:19:02.466361 24438 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.004s	sys 0.000s
W20260709 12:19:02.469305 25119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.943s	user 0.020s	sys 0.032s
W20260709 12:19:02.438119 24317 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.946s	user 0.024s	sys 0.043s
I20260709 12:19:02.382732 26481 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:02.442384 25082 leader_election.cc:336] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 3.192s (SENT)
W20260709 12:19:02.452919 24472 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.002s	user 0.031s	sys 0.048s
I20260709 12:19:02.455564 26803 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:02.379951 26691 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:02.451157 26461 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.000s	sys 0.032s
I20260709 12:19:02.450773 26668 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:02.411232 26696 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:02.470271 24397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2161) took 1292 ms. Trace:
W20260709 12:19:02.470732 25119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.020s	sys 0.032s
I20260709 12:19:02.377841 26820 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:02.487533 24397 rpcz_store.cc:276] 0709 12:19:01.177846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:02.327159 (+1149313us) service_pool.cc:224] Handling call
0709 12:19:02.378871 (+ 51712us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:02.468805 (+ 89934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:02.470202 (+  1397us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:02.485723 24321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
mode: GRACEFUL
new_leader_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:42226
I20260709 12:19:02.496253 24321 raft_consensus.cc:606] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Received request to transfer leadership to TS c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:02.437620 26843 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:02.471199 25082 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:02.498266 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 55929.2us
W20260709 12:19:02.471333 24317 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.024s	sys 0.043s
W20260709 12:19:02.479874 24469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.992s	user 0.029s	sys 0.024s
W20260709 12:19:02.500061 24469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.013s	user 0.029s	sys 0.024s
I20260709 12:19:02.504736 24474 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:02.471685 26673 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.959s	user 0.011s	sys 0.042s
W20260709 12:19:02.471016 26800 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.150s	user 0.013s	sys 0.038s
W20260709 12:19:02.480041 26461 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.000s	sys 0.033s
I20260709 12:19:02.475442 26826 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.477337 26788 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:02.510389 26673 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.000s	user 0.011s	sys 0.042s
I20260709 12:19:02.468480 26786 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:02.481472 26803 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:02.505106 26658 raft_consensus.cc:2749] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:02.514744 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:02.513739 26800 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.193s	user 0.013s	sys 0.039s
I20260709 12:19:02.547282 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:02.513564 26742 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.982s	user 0.015s	sys 0.008s
I20260709 12:19:02.479028 26825 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:02.505548 26696 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
W20260709 12:19:02.465204 26761 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.011s	sys 0.027s
I20260709 12:19:02.513245 26827 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:02.598031 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:02.598301 26827 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:19:02.535248 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:02.599464 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:02.599704 24318 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
I20260709 12:19:02.600001 24474 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:02.555402 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:02.526693 26753 consensus_meta.cc:287] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.977s	user 0.010s	sys 0.003s
W20260709 12:19:02.561975 26742 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.039s	user 0.015s	sys 0.008s
I20260709 12:19:02.600652 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:02.543455 26771 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:19:02.590214 26761 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.011s	sys 0.027s
W20260709 12:19:02.602746 24437 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.981s	user 0.008s	sys 0.022s
I20260709 12:19:02.602974 24318 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:19:02.608126 24396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2158) took 1521 ms. Trace:
W20260709 12:19:02.608860 24437 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.008s	sys 0.022s
I20260709 12:19:02.522660 26843 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:02.608976 24396 rpcz_store.cc:276] 0709 12:19:01.086419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:02.316952 (+1230533us) service_pool.cc:224] Handling call
0709 12:19:02.317314 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:02.317574 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:02.334342 (+ 16768us) log.cc:844] Serialized 14 byte log entry
0709 12:19:02.606880 (+272538us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:02.606936 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:02.606999 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:02.607078 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:02.608039 (+   961us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":114792,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":136,"thread_start_us":272149,"threads_started":1}
I20260709 12:19:02.573403 26530 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:02.567991 26770 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.335s	user 0.023s	sys 0.041s
I20260709 12:19:02.589272 26629 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:02.590437 26661 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:02.528231 26826 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:02.551595 26803 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:02.694288 24322 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.248s	user 0.019s	sys 0.026s
W20260709 12:19:02.601590 26678 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.008s	sys 0.022s
W20260709 12:19:02.610193 26739 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.008s	sys 0.025s
W20260709 12:19:02.861984 24322 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.415s	user 0.027s	sys 0.041s
W20260709 12:19:02.654465 24289 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.143s	user 0.025s	sys 0.058s
I20260709 12:19:02.854485 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1716) took 1368 ms. Trace:
I20260709 12:19:02.785221 24472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1713) took 1354 ms. Trace:
W20260709 12:19:02.636677 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.854655 24438 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:02.818838 26766 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:02.798913 26837 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:02.756183 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:02.762866 26666 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:02.605314 26753 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:02.610953 26771 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:03.654390 24321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.004s	sys 0.017s
I20260709 12:19:03.836912 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:03.837293 24321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.008s	sys 0.020s
W20260709 12:19:02.962725 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:03.837697 24323 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:19:03.840162 24323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2084) took 1244 ms. Trace:
I20260709 12:19:02.897244 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:03.040849 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 418993us
I20260709 12:19:03.841128 24323 rpcz_store.cc:276] 0709 12:19:02.596063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:02.608440 (+ 12377us) service_pool.cc:224] Handling call
0709 12:19:03.840102 (+1231662us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:02.944342 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:02.894268 24474 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
W20260709 12:19:03.076030 24320 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.007s	sys 0.007s
I20260709 12:19:02.892804 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:03.837654 24318 raft_consensus.cc:3055] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:03.844242 24318 raft_consensus.cc:740] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:02.950487 24317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1602) took 1850 ms. Trace:
W20260709 12:19:03.843453 24320 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.814s	user 0.014s	sys 0.019s
W20260709 12:19:02.620862 26770 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.415s	user 0.023s	sys 0.041s
I20260709 12:19:03.839742 24469 rpcz_store.cc:276] 0709 12:19:01.486065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.486217 (+   152us) service_pool.cc:224] Handling call
0709 12:19:01.486605 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:01.486860 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:01.487204 (+   344us) log.cc:844] Serialized 14 byte log entry
0709 12:19:02.853867 (+1366663us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:02.853957 (+    90us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:02.854038 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:02.854125 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:02.854399 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20908,"prepare.queue_time_us":255,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":258433,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":27292,"thread_start_us":1362317,"threads_started":2,"wal-append.queue_time_us":1039706}
I20260709 12:19:02.617399 26658 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:02.626813 24467 raft_consensus.cc:1240] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:03.837354 24472 rpcz_store.cc:276] 0709 12:19:01.431334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.436511 (+  5177us) service_pool.cc:224] Handling call
0709 12:19:01.436895 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:01.437171 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:19:01.450362 (+ 13191us) log.cc:844] Serialized 14 byte log entry
0709 12:19:02.784762 (+1334400us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:02.784830 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:02.784899 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:02.784980 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:02.785134 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12423,"prepare.queue_time_us":12983,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":145689,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":73721,"thread_start_us":1333228,"threads_started":2,"wal-append.queue_time_us":1096675}
W20260709 12:19:03.001958 26838 log.cc:927] Time spent T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.392s	user 0.000s	sys 0.000s
W20260709 12:19:03.843314 24474 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 1641) took 1733 ms (client timeout 1969 ms). Trace:
W20260709 12:19:03.883323 24474 rpcz_store.cc:269] 0709 12:19:02.110419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:02.599184 (+488765us) service_pool.cc:224] Handling call
0709 12:19:03.843252 (+1244068us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:03.883170 24318 consensus_queue.cc:260] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:03.884230 24318 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:03.884666 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:03.885452 24474 raft_consensus.cc:2393] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 4: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:03.885912 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33198 (request call id 501) took 1267 ms. Trace:
I20260709 12:19:03.886268 24474 rpcz_store.cc:276] 0709 12:19:02.618887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:03.884327 (+1265440us) service_pool.cc:224] Handling call
0709 12:19:03.885857 (+  1530us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:03.064357 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:03.751629 26825 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:03.887476 25114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35188 (request call id 864) took 1022 ms. Trace:
W20260709 12:19:03.840962 25113 consensus_meta.cc:287] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 1.939s	user 0.011s	sys 0.006s
W20260709 12:19:03.003775 25112 consensus_meta.cc:287] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.618s	user 0.010s	sys 0.003s
I20260709 12:19:03.887971 25114 rpcz_store.cc:276] 0709 12:19:02.865625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:02.877894 (+ 12269us) service_pool.cc:224] Handling call
0709 12:19:03.887397 (+1009503us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:03.888787 25112 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:03.888501 25113 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
W20260709 12:19:03.889950 25113 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35194 (request call id 390) took 2789 ms (client timeout 1807 ms). Trace:
W20260709 12:19:03.890326 25113 rpcz_store.cc:269] 0709 12:19:01.101029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.123582 (+ 22553us) service_pool.cc:224] Handling call
0709 12:19:03.889844 (+2766262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:03.876598 26837 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:03.891430 26849 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:03.892493 26771 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:03.831828 26803 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:03.527390 26727 consensus_meta.cc:287] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 1.442s	user 0.012s	sys 0.000s
I20260709 12:19:03.892098 26849 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:03.893170 26777 log.cc:927] Time spent T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 2.751s	user 0.003s	sys 0.016s
W20260709 12:19:03.585758 26845 log.cc:927] Time spent T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.707s	user 0.000s	sys 0.001s
W20260709 12:19:03.831228 26853 log.cc:927] Time spent T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:19:03.909267 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:03.910068 24472 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:03.589439 26844 log.cc:927] Time spent T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:19:03.878525 24317 rpcz_store.cc:276] 0709 12:19:01.100481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.439503 (+339022us) service_pool.cc:224] Handling call
0709 12:19:01.439802 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:01.446848 (+  7046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:01.446893 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:01.447415 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 12:19:02.499572 (+1052157us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:02.511401 (+ 11829us) log.cc:844] Serialized 14 byte log entry
0709 12:19:02.950069 (+438668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:02.950177 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:02.950227 (+    50us) raft_consensus.cc:1685] finished
0709 12:19:02.950239 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:02.950403 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6585,"prepare.queue_time_us":13979,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":82284,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":36063,"thread_start_us":1446048,"threads_started":2,"wal-append.queue_time_us":945284,"wal-append.run_cpu_time_us":3409,"wal-append.run_wall_time_us":1153951}
W20260709 12:19:03.585197 26846 log.cc:927] Time spent T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.736s	user 0.001s	sys 0.000s
W20260709 12:19:03.445745 26826 net_util.cc:396] Time spent resolve address for 127.22.155.194: real 0.238s	user 0.000s	sys 0.000s
I20260709 12:19:03.874465 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:03.894675 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 1.04003e+06us
I20260709 12:19:03.966217 24438 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:02.857234 26691 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:03.885469 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:03.880841 26354 consensus_meta.cc:287] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 1.781s	user 0.020s	sys 0.000s
W20260709 12:19:03.890444 24394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 1731) took 2874 ms (client timeout 1569 ms). Trace:
W20260709 12:19:03.974771 24394 rpcz_store.cc:269] 0709 12:19:01.016450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.017337 (+   887us) service_pool.cc:224] Handling call
0709 12:19:03.890191 (+2872854us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54001a7054. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:03.890338 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329412480}
I20260709 12:19:03.912305 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:03.976279 24474 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:19:03.977125 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 1647) took 1519 ms. Trace:
I20260709 12:19:03.977479 24474 rpcz_store.cc:276] 0709 12:19:02.457636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:03.895938 (+1438302us) service_pool.cc:224] Handling call
0709 12:19:03.977055 (+ 81117us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:03.004246 26833 log.cc:927] Time spent T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.433s	user 0.000s	sys 0.001s
W20260709 12:19:02.877945 26678 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.011s	sys 0.028s
W20260709 12:19:03.000705 26831 log.cc:927] Time spent T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
W20260709 12:19:03.092257 26830 log.cc:927] Time spent T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.540s	user 0.002s	sys 0.000s
I20260709 12:19:03.999189 26849 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:02.862627 26461 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:19:03.683391 26828 log.cc:927] Time spent T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.967s	user 0.003s	sys 0.003s
I20260709 12:19:03.999886 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48252 (request call id 365) took 2506 ms. Trace:
W20260709 12:19:02.999825 26841 log.cc:927] Time spent T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.407s	user 0.000s	sys 0.001s
W20260709 12:19:03.001164 26832 log.cc:927] Time spent T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.440s	user 0.000s	sys 0.001s
I20260709 12:19:02.842401 26843 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:02.764130 26769 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:04.000288 25119 rpcz_store.cc:276] 0709 12:19:01.493555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.494409 (+   854us) service_pool.cc:224] Handling call
0709 12:19:01.509033 (+ 14624us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:01.525381 (+ 16348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:01.525430 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:01.526069 (+   639us) log.cc:844] Serialized 26 byte log entry
0709 12:19:02.488110 (+962041us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:02.855780 (+367670us) log.cc:844] Serialized 14 byte log entry
0709 12:19:02.860929 (+  5149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:02.861015 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:03.999645 (+1138630us) raft_consensus.cc:1685] finished
0709 12:19:03.999668 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:03.999818 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20711,"prepare.queue_time_us":296516,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":68,"raft.queue_time_us":22929,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":27498,"spinlock_wait_cycles":1651456,"thread_start_us":1306942,"threads_started":2,"wal-append.queue_time_us":983294}
I20260709 12:19:04.002941 26769 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:04.006369 26769 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:03.893194 26837 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:03.837002 26739 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.729s	user 0.039s	sys 0.106s
I20260709 12:19:02.879318 26802 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:02.820223 26812 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:02.970553 26764 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:03.094537 26786 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:03.888794 26852 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:04.008373 26812 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:03.392747 26820 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:04.009469 26852 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:03.982339 26666 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:04.013128 26666 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:04.015858 26666 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:03.846230 26629 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:04.016744 26629 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:03.480883 26696 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:02.881135 26768 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.823s	user 0.007s	sys 0.023s
W20260709 12:19:04.020447 26768 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.974s	user 0.027s	sys 0.053s
W20260709 12:19:04.003095 26848 log.cc:927] Time spent T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.434s	user 0.000s	sys 0.000s
I20260709 12:19:03.893118 26840 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:03.995165 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:04.027192 24474 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 1642) took 1916 ms (client timeout 2492 ms). Trace:
W20260709 12:19:04.027652 24474 rpcz_store.cc:269] 0709 12:19:02.110883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:03.983958 (+1873075us) service_pool.cc:224] Handling call
0709 12:19:04.027110 (+ 43152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:03.893716 26850 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:03.893695 26727 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:04.026357 26784 consensus_meta.cc:287] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.679s	user 0.014s	sys 0.000s
I20260709 12:19:04.012290 26852 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:04.039644 26785 consensus_meta.cc:287] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.860s	user 0.007s	sys 0.008s
W20260709 12:19:04.051703 26668 consensus_meta.cc:287] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 1.547s	user 0.010s	sys 0.004s
I20260709 12:19:04.044099 26860 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:04.034684 26840 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:04.052426 26784 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:04.068176 26860 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:04.077551 26826 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:04.113037 24289 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.602s	user 0.045s	sys 0.125s
I20260709 12:19:03.905794 24318 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
W20260709 12:19:04.116079 24318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2085) took 1510 ms (client timeout 1939 ms). Trace:
W20260709 12:19:04.116932 24291 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.246s	user 0.013s	sys 0.008s
I20260709 12:19:04.116096 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:04.118391 24317 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
W20260709 12:19:04.119621 24317 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2087) took 1506 ms (client timeout 1925 ms). Trace:
W20260709 12:19:04.117429 24291 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.247s	user 0.013s	sys 0.008s
W20260709 12:19:04.121395 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 1.25097e+06us
I20260709 12:19:04.123229 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 347) took 3044 ms. Trace:
W20260709 12:19:03.977988 24438 connection.cc:256] RPC call timeout handler was delayed by -1.4122341270001471s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
I20260709 12:19:03.961380 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:04.124910 24438 connection.cc:256] RPC call timeout handler was delayed by -1.292812240000103s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.169s for a response
I20260709 12:19:04.125613 24323 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
I20260709 12:19:04.126484 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1714) took 2691 ms. Trace:
W20260709 12:19:04.129086 24366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.990s	user 0.010s	sys 0.026s
W20260709 12:19:04.126632 24323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2088) took 1370 ms (client timeout 1615 ms). Trace:
W20260709 12:19:04.129703 24366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.991s	user 0.010s	sys 0.026s
W20260709 12:19:04.130416 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 1.99164e+06us
I20260709 12:19:04.123869 24391 rpcz_store.cc:276] 0709 12:19:01.078363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:02.320932 (+1242569us) service_pool.cc:224] Handling call
0709 12:19:02.324375 (+  3443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:02.382609 (+ 58234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:02.382658 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:02.383277 (+   619us) log.cc:844] Serialized 26 byte log entry
0709 12:19:02.605778 (+222501us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:02.621381 (+ 15603us) log.cc:844] Serialized 14 byte log entry
0709 12:19:02.621684 (+   303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:02.621774 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:04.122397 (+1500623us) raft_consensus.cc:1685] finished
0709 12:19:04.122460 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:04.122865 (+   405us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20615,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":7451,"raft.queue_time_us":94,"spinlock_wait_cycles":155974016,"thread_start_us":166151,"threads_started":1,"wal-append.queue_time_us":663554}
I20260709 12:19:04.127135 24471 rpcz_store.cc:276] 0709 12:19:01.435236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.435395 (+   159us) service_pool.cc:224] Handling call
0709 12:19:01.435811 (+   416us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:19:02.452092 (+1016281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:02.452126 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:19:02.465985 (+ 13859us) log.cc:844] Serialized 78 byte log entry
0709 12:19:02.815605 (+349620us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:02.815660 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:02.815771 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:04.125656 (+1309885us) raft_consensus.cc:1685] finished
0709 12:19:04.125700 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:04.126147 (+   447us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":535721,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":160,"thread_start_us":1294633,"threads_started":2,"wal-append.queue_time_us":965799}
I20260709 12:19:04.031879 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:04.116881 24318 rpcz_store.cc:269] 0709 12:19:02.605252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:02.614521 (+  9269us) service_pool.cc:224] Handling call
0709 12:19:04.115718 (+1501197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:04.134727 26354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35188 (request call id 835) took 6446 ms. Trace:
W20260709 12:19:04.135736 24438 leader_election.cc:336] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.539s (SENT)
I20260709 12:19:04.152915 26354 rpcz_store.cc:276] 0709 12:18:57.693426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:57.702564 (+  9138us) service_pool.cc:224] Handling call
0709 12:18:57.789228 (+ 86664us) ts_tablet_manager.cc:934] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
0709 12:19:00.485058 (+2695830us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:19:02.086392 (+1601334us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:02.095453 (+  9061us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:19:04.022105 (+1926652us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:19:04.053623 (+ 31518us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:04.134176 (+ 80553us) ts_tablet_manager.cc:989] Replica registered.
0709 12:19:04.134384 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":41571,"tablet-copy.queue_time_us":13597,"thread_start_us":89525,"threads_started":1}
I20260709 12:19:04.155827 26354 tablet_copy_client.cc:806] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:04.156981 26354 tablet_copy_client.cc:670] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
W20260709 12:19:04.137790 25082 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.019s	sys 0.043s
I20260709 12:19:04.064854 26668 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:04.157894 25082 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.019s	sys 0.044s
W20260709 12:19:04.158608 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 815514us
W20260709 12:19:04.052066 25111 consensus_meta.cc:287] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 1.934s	user 0.009s	sys 0.005s
I20260709 12:19:04.139626 24324 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
W20260709 12:19:04.145735 24323 rpcz_store.cc:269] 0709 12:19:02.759998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:03.875783 (+1115785us) service_pool.cc:224] Handling call
0709 12:19:04.126495 (+250712us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:04.140813 26676 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.141702 26629 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:04.142271 24321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44278 (request call id 2073) took 1630 ms. Trace:
W20260709 12:19:04.144488 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:04.120211 24317 rpcz_store.cc:269] 0709 12:19:02.613134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.114707 (+1501573us) service_pool.cc:224] Handling call
0709 12:19:04.119486 (+  4779us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:03.916977 26658 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:04.186300 26727 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:04.173919 26676 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:04.192839 25111 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:19:04.059058 26785 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:04.181368 24469 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 5: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:04.180904 26739 consensus_queue.cc:1048] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:04.181649 26694 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:04.208990 26872 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.071579 26678 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:04.183661 26860 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:04.188444 24474 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:04.189036 26658 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:04.202662 26676 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:04.222431 26668 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:04.223651 24474 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 1643) took 2112 ms (client timeout 2785 ms). Trace:
W20260709 12:19:04.224211 24474 rpcz_store.cc:269] 0709 12:19:02.111315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.028484 (+1917169us) service_pool.cc:224] Handling call
0709 12:19:04.223495 (+195011us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:04.225255 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:04.226547 24474 raft_consensus.cc:1240] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:04.227392 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1640) took 2117 ms. Trace:
I20260709 12:19:04.227885 24474 rpcz_store.cc:276] 0709 12:19:02.110095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.225447 (+2115352us) service_pool.cc:224] Handling call
0709 12:19:04.226088 (+   641us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:04.227072 (+   984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.227307 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:04.229274 24473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 492) took 2694 ms. Trace:
I20260709 12:19:04.229915 24473 rpcz_store.cc:276] 0709 12:19:01.534387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.722823 (+188436us) service_pool.cc:224] Handling call
0709 12:19:02.053101 (+330278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:02.453700 (+400599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:02.453751 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:02.453810 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:02.453872 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.228455 (+1774583us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b540010f754. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:04.228553 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:04.229022 (+   469us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":920590848}
I20260709 12:19:04.232059 26863 consensus_queue.cc:1048] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:04.234416 26786 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:04.170651 24321 rpcz_store.cc:276] 0709 12:19:02.511842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:02.512052 (+   210us) service_pool.cc:224] Handling call
0709 12:19:02.512515 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:02.950112 (+437597us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:02.950163 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:03.001160 (+ 50997us) log.cc:844] Serialized 26 byte log entry
0709 12:19:03.838247 (+837087us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:03.838289 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.141168 (+302879us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b540025ab54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:04.141272 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:04.141409 (+   137us) raft_consensus.cc:1685] finished
0709 12:19:04.141435 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:04.141966 (+   531us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1005334272,"thread_start_us":836453,"threads_started":1,"wal-append.queue_time_us":1049511}
I20260709 12:19:04.197212 26784 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:04.210561 26872 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:04.224165 26868 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:04.241200 26753 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:04.242209 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:04.243353 24471 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:04.243981 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33198 (request call id 508) took 1547 ms. Trace:
I20260709 12:19:04.245585 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:04.246115 26840 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:04.248091 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:19:04.248806 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 75241.6us
I20260709 12:19:04.237829 26629 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:04.226909 24470 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:19:04.252767 26629 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:04.253134 24470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33198 (request call id 499) took 2635 ms (client timeout 1885 ms). Trace:
W20260709 12:19:04.253927 24470 rpcz_store.cc:269] 0709 12:19:01.618126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.830983 (+212857us) service_pool.cc:224] Handling call
0709 12:19:04.224608 (+2393625us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b58001c3e98. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c3120a0 00007f4a9c311984 00007f4a9588c6d4 00007f4a9588c662
0709 12:19:04.252964 (+ 28356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38051200}
I20260709 12:19:04.255868 26629 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:04.258526 26691 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:04.259440 26691 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:04.260293 26621 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.262125 26621 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:04.260983 26855 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.251785 26642 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:04.244349 24471 rpcz_store.cc:276] 0709 12:19:02.697177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.196986 (+1499809us) service_pool.cc:224] Handling call
0709 12:19:04.243871 (+ 46885us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:04.262477 26678 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:04.265851 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1715) took 2807 ms. Trace:
I20260709 12:19:04.235517 26786 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:04.279099 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 50566.5us
W20260709 12:19:04.335080 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 96936.1us
I20260709 12:19:04.286902 24321 raft_consensus.cc:1275] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:19:04.437492 26810 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.394s	user 0.009s	sys 0.012s
W20260709 12:19:04.438205 26810 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.395s	user 0.009s	sys 0.012s
I20260709 12:19:04.430251 24466 rpcz_store.cc:276] 0709 12:19:01.458244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.458457 (+   213us) service_pool.cc:224] Handling call
0709 12:19:01.500180 (+ 41723us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:02.317176 (+816996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.262986 (+1945810us) spinlock_profiling.cc:243] Waited 791 ms on lock 0x7b54002bbbd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:04.265613 (+  2627us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1818197376}
I20260709 12:19:04.283497 26691 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:04.443131 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:04.447266 26785 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:04.447800 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 505) took 1827 ms. Trace:
I20260709 12:19:04.448550 24466 rpcz_store.cc:276] 0709 12:19:02.620038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.441545 (+1821507us) service_pool.cc:224] Handling call
0709 12:19:04.442256 (+   711us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:04.442846 (+   590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:04.447229 (+  4383us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:04.447314 (+    85us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:04.447422 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.447516 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:04.447688 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:04.387705 24289 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:04.451375 24466 raft_consensus.cc:1275] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:19:04.451988 24466 pending_rounds.cc:85] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 5
I20260709 12:19:04.454082 26872 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:04.454806 26786 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:04.455075 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 114759us
W20260709 12:19:04.455843 26821 log.cc:927] Time spent T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 2.121s	user 0.011s	sys 0.005s
W20260709 12:19:04.456431 24438 leader_election.cc:336] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.763s (SENT)
I20260709 12:19:04.283506 26696 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:04.459957 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:04.457144 24438 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:04.261039 26676 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.352136 26530 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:04.284500 26414 consensus_meta.cc:287] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.949s	user 0.008s	sys 0.013s
I20260709 12:19:04.452363 24466 pending_rounds.cc:107] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:19:04.463567 24321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44278 (request call id 2081) took 1890 ms. Trace:
I20260709 12:19:04.467823 24466 raft_consensus.cc:2889] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:04.468741 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:04.384763 24472 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:04.468030 24321 rpcz_store.cc:276] 0709 12:19:02.569665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.285829 (+1716164us) service_pool.cc:224] Handling call
0709 12:19:04.286375 (+   546us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:04.434785 (+148410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.460255 (+ 25470us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:04.262121 26461 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:04.465569 24320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1599) took 3424 ms. Trace:
I20260709 12:19:04.455981 24473 raft_consensus.cc:2955] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
W20260709 12:19:04.473575 24317 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2086) took 1864 ms (client timeout 2147 ms). Trace:
W20260709 12:19:04.474030 24317 rpcz_store.cc:269] 0709 12:19:02.609284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.340152 (+1730868us) service_pool.cc:224] Handling call
0709 12:19:04.473500 (+133348us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:04.475638 26621 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:04.475334 26794 consensus_queue.cc:1059] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:19:04.478097 26794 raft_consensus.cc:3055] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:04.478580 26794 raft_consensus.cc:740] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:04.481417 25113 raft_consensus.cc:1275] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:19:04.464334 26676 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:04.483103 24400 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 350) took 3403 ms (client timeout 3192 ms). Trace:
I20260709 12:19:04.423004 26863 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:19:04.483736 24400 rpcz_store.cc:269] 0709 12:19:01.079148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.482656 (+3403508us) service_pool.cc:211] Skipping call since client already timed out
0709 12:19:04.482865 (+   209us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:19:04.484824 26825 raft_consensus.cc:2749] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:04.485415 26676 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:04.489034 26720 raft_consensus.cc:2749] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:19:04.493021 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 155973us
I20260709 12:19:04.288169 26855 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:04.484426 26863 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:04.498574 26530 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:04.501187 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:04.502761 26703 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.343s	user 0.013s	sys 0.009s
W20260709 12:19:04.503219 26703 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.475s	user 0.013s	sys 0.009s
I20260709 12:19:04.503454 24319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44278 (request call id 2075) took 1989 ms. Trace:
W20260709 12:19:04.508289 24472 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 1645) took 2113 ms (client timeout 2019 ms). Trace:
I20260709 12:19:04.510020 26621 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:04.511087 26621 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:04.494138 26414 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:04.503949 24319 rpcz_store.cc:276] 0709 12:19:02.513566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:02.514084 (+   518us) service_pool.cc:224] Handling call
0709 12:19:02.530793 (+ 16709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:02.606301 (+ 75508us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:02.695725 (+ 89424us) log.cc:844] Serialized 14 byte log entry
0709 12:19:02.959447 (+263722us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:02.959549 (+   102us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:02.959649 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.502905 (+1543256us) spinlock_profiling.cc:243] Waited 75.2 ms on lock 0x7b540019f354. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:04.502989 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:04.503246 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":89225,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":1355,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":60007,"spinlock_wait_cycles":182385280,"thread_start_us":250951,"threads_started":1,"wal-append.queue_time_us":1347267}
W20260709 12:19:04.513764 24325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 1588) took 3839 ms (client timeout 1519 ms). Trace:
W20260709 12:19:04.514578 24325 rpcz_store.cc:269] 0709 12:19:00.674135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:00.674274 (+   139us) service_pool.cc:224] Handling call
0709 12:19:04.513266 (+3838992us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54000a7654. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:04.513545 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2651195136}
I20260709 12:19:04.287425 26868 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:04.508766 24472 rpcz_store.cc:269] 0709 12:19:02.382016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:03.908966 (+1526950us) service_pool.cc:224] Handling call
0709 12:19:04.491159 (+582193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:04.517635 26863 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:04.496688 26691 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.520354 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 502) took 1889 ms. Trace:
I20260709 12:19:04.524441 24474 rpcz_store.cc:276] 0709 12:19:02.619205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.276752 (+1657547us) service_pool.cc:224] Handling call
0709 12:19:04.459854 (+183102us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:04.497811 (+ 37957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:04.497843 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:04.507879 (+ 10036us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:04.507944 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.508015 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:04.508156 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:04.492658 26461 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:04.526705 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 506) took 1898 ms. Trace:
I20260709 12:19:04.528301 24466 rpcz_store.cc:276] 0709 12:19:02.620953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.450114 (+1829161us) service_pool.cc:224] Handling call
0709 12:19:04.450709 (+   595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:04.518201 (+ 67492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.518472 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:04.522830 26691 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:04.523658 24472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 507) took 1902 ms. Trace:
I20260709 12:19:04.529633 24472 rpcz_store.cc:276] 0709 12:19:02.621273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.522133 (+1900860us) service_pool.cc:224] Handling call
0709 12:19:04.522772 (+   639us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:04.523218 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:04.523247 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:04.523321 (+    74us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:04.523370 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.523447 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:04.523590 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:04.531430 26691 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:04.531724 24472 raft_consensus.cc:1275] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:19:04.502063 26530 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:04.526351 24366 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:04.537031 26691 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.532473 24472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1722) took 1596 ms. Trace:
I20260709 12:19:04.538800 24472 rpcz_store.cc:276] 0709 12:19:02.935976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.530700 (+1594724us) service_pool.cc:224] Handling call
0709 12:19:04.531251 (+   551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:04.532163 (+   912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.532401 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:04.470856 24320 rpcz_store.cc:276] 0709 12:19:00.921651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.096582 (+174931us) service_pool.cc:224] Handling call
0709 12:19:01.096991 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:01.151176 (+ 54185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:01.151210 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:01.165046 (+ 13836us) log.cc:844] Serialized 26 byte log entry
0709 12:19:02.029374 (+864328us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:03.873133 (+1843759us) log.cc:844] Serialized 14 byte log entry
0709 12:19:04.283142 (+410009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.304502 (+ 21360us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:04.336612 (+ 32110us) raft_consensus.cc:1685] finished
0709 12:19:04.336650 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:04.346151 (+  9501us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47066,"prepare.queue_time_us":87094,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":63,"raft.queue_time_us":69506,"raft.run_cpu_time_us":492,"raft.run_wall_time_us":2489,"thread_start_us":3063010,"threads_started":3,"wal-append.queue_time_us":1816390,"wal-append.run_cpu_time_us":11270,"wal-append.run_wall_time_us":1035756}
W20260709 12:19:04.523739 26836 log.cc:927] Time spent T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.652s	user 0.002s	sys 0.000s
I20260709 12:19:04.545615 26691 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:04.527750 26786 raft_consensus.cc:2804] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:04.480136 26794 consensus_queue.cc:260] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:04.548451 26621 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:04.559330 25082 leader_election.cc:336] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.507s (SENT)
I20260709 12:19:04.565507 26691 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:04.566617 26863 consensus_queue.cc:1059] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:04.567824 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 509) took 1819 ms. Trace:
I20260709 12:19:04.568346 24474 rpcz_store.cc:276] 0709 12:19:02.748578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.526011 (+1777433us) service_pool.cc:224] Handling call
0709 12:19:04.566758 (+ 40747us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:04.567216 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:04.567244 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:04.567326 (+    82us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:04.567475 (+   149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.567562 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:04.567711 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:04.572410 25082 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:04.571331 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 504) took 1951 ms. Trace:
W20260709 12:19:04.570070 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 76240.4us
I20260709 12:19:04.569350 24321 raft_consensus.cc:1275] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:04.568325 26794 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:04.568445 26786 raft_consensus.cc:697] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:04.582435 24321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44278 (request call id 2082) took 2007 ms. Trace:
I20260709 12:19:04.586592 24321 rpcz_store.cc:276] 0709 12:19:02.571361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.475036 (+1903675us) service_pool.cc:224] Handling call
0709 12:19:04.547157 (+ 72121us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:04.578828 (+ 31671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.579048 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:04.551874 26696 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:04.578398 24471 rpcz_store.cc:276] 0709 12:19:02.619762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.336458 (+1716696us) service_pool.cc:224] Handling call
0709 12:19:04.340915 (+  4457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:04.341755 (+   840us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:04.468447 (+126692us) log.cc:844] Serialized 14 byte log entry
0709 12:19:04.571058 (+102611us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:04.571103 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:04.571167 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.571209 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:04.571286 (+    77us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8394,"prepare.queue_time_us":205420,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":74,"raft.queue_time_us":11575,"spinlock_wait_cycles":7468288,"thread_start_us":169109,"threads_started":2}
I20260709 12:19:04.588102 26851 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.577751 26414 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:04.590399 24466 raft_consensus.cc:1275] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:19:04.591018 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1721) took 1655 ms. Trace:
I20260709 12:19:04.591284 24466 rpcz_store.cc:276] 0709 12:19:02.935552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.536853 (+1601301us) service_pool.cc:224] Handling call
0709 12:19:04.569243 (+ 32390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:04.590780 (+ 21537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.590971 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:04.592705 25112 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35188 (request call id 859) took 2560 ms (client timeout 1569 ms). Trace:
W20260709 12:19:04.593253 25112 rpcz_store.cc:269] 0709 12:19:02.031687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:02.064709 (+ 33022us) service_pool.cc:224] Handling call
0709 12:19:04.592164 (+2527455us) spinlock_profiling.cc:243] Waited 73.8 ms on lock 0x7b540048ce54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:04.592466 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169657728}
I20260709 12:19:04.594390 26868 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:04.595268 24472 raft_consensus.cc:1240] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:04.596750 24472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1723) took 1660 ms. Trace:
I20260709 12:19:04.597165 24472 rpcz_store.cc:276] 0709 12:19:02.936319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.539356 (+1603037us) service_pool.cc:224] Handling call
0709 12:19:04.580299 (+ 40943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:04.596392 (+ 16093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.596692 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:04.604771 24317 raft_consensus.cc:1275] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:04.605640 25083 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:04.606078 26851 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:04.608001 26720 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:04.608300 26673 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.608920 26720 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:04.612690 26673 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:04.613091 26448 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:04.613582 26448 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:04.613968 26448 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:04.614902 24290 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:04.620124 26720 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:04.621063 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:04.618538 26673 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:04.621236 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 72042.7us
W20260709 12:19:04.622437 25082 leader_election.cc:336] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.510s (SENT)
I20260709 12:19:04.622689 26868 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:04.623355 26868 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:04.624246 26868 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:04.625272 26872 consensus_queue.cc:1048] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:04.625732 26530 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:19:04.629519 25082 leader_election.cc:336] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.522s (SENT)
I20260709 12:19:04.631466 24322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1601) took 3531 ms. Trace:
I20260709 12:19:04.632001 24322 rpcz_store.cc:276] 0709 12:19:01.100216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.439133 (+338917us) service_pool.cc:224] Handling call
0709 12:19:01.439488 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:01.445521 (+  6033us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:01.445564 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:01.446137 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 12:19:03.844966 (+2398829us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:03.882394 (+ 37428us) log.cc:844] Serialized 14 byte log entry
0709 12:19:03.882846 (+   452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:03.882922 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:04.489489 (+606567us) spinlock_profiling.cc:243] Waited 35.3 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:19:04.630858 (+141369us) raft_consensus.cc:1685] finished
0709 12:19:04.631031 (+   173us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:04.631264 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5604,"prepare.queue_time_us":190276,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":6961,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":24565,"spinlock_wait_cycles":81204480,"thread_start_us":2398369,"threads_started":1,"wal-append.queue_time_us":2092086}
W20260709 12:19:04.634292 25082 leader_election.cc:336] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.611s (SENT)
I20260709 12:19:04.635070 25082 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:04.637740 26872 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:04.642624 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:04.634159 24365 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:04.651118 24466 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:19:04.651163 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:04.658190 24474 raft_consensus.cc:1240] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:04.658995 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1724) took 1722 ms. Trace:
I20260709 12:19:04.659430 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 493) took 3087 ms. Trace:
I20260709 12:19:04.659337 24474 rpcz_store.cc:276] 0709 12:19:02.936663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.569792 (+1633129us) service_pool.cc:224] Handling call
0709 12:19:04.609226 (+ 39434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:04.658656 (+ 49430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.658923 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:04.659864 26753 consensus_queue.cc:1048] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:04.660392 24465 rpcz_store.cc:276] 0709 12:19:01.555505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.725664 (+170159us) service_pool.cc:224] Handling call
0709 12:19:04.485532 (+2759868us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b58001c3e98. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c325fc0 00007f4a9c310929 00007f4a9c3103d2 00007f4a95887bd4
0709 12:19:04.485893 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:04.486408 (+   515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:04.486448 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:04.487056 (+   608us) log.cc:844] Serialized 26 byte log entry
0709 12:19:04.553540 (+ 66484us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:04.553600 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.553691 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:04.609197 (+ 55506us) raft_consensus.cc:1685] finished
0709 12:19:04.609223 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:04.642548 (+ 33325us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1225,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":219,"spinlock_wait_cycles":3614976,"thread_start_us":65913,"threads_started":1,"wal-append.queue_time_us":82232}
I20260709 12:19:04.660287 24472 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:19:04.669102 26855 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:04.669909 24440 connection.cc:256] RPC call timeout handler was delayed by -1.0631681190000108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
W20260709 12:19:04.670948 26879 log.cc:927] Time spent T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:19:04.653350 26414 raft_consensus.cc:2749] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:04.674145 26868 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:04.674289 26827 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:04.674404 26461 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:04.669303 26786 consensus_queue.cc:237] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:04.668934 26863 consensus_queue.cc:1059] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:04.676940 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:04.677541 25083 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:04.679776 24466 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:19:04.650492 26678 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:04.680963 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 47102.6us
I20260709 12:19:04.667908 26448 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:04.681092 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 90926.1us
I20260709 12:19:04.681201 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:04.692740 26872 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:04.693240 26872 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:04.693610 26872 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:04.694542 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 494) took 3109 ms. Trace:
I20260709 12:19:04.694959 24468 rpcz_store.cc:276] 0709 12:19:01.585486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.870187 (+284701us) service_pool.cc:224] Handling call
0709 12:19:04.693361 (+2823174us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b58001c3e98. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c325fc0 00007f4a9c310929 00007f4a9c3103d2 00007f4a95887bd4
0709 12:19:04.693671 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:04.693954 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:04.693983 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:04.694051 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:04.694093 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.694146 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:04.694380 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37236480}
I20260709 12:19:04.696965 26753 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:04.697247 26819 consensus_queue.cc:1048] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:04.688017 24318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44278 (request call id 2079) took 2140 ms. Trace:
I20260709 12:19:04.686565 26461 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:04.728700 24318 rpcz_store.cc:276] 0709 12:19:02.547930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.515193 (+1967263us) service_pool.cc:224] Handling call
0709 12:19:04.515815 (+   622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:04.516252 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:19:04.521093 (+  4841us) log.cc:844] Serialized 14 byte log entry
0709 12:19:04.684131 (+163038us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:04.684176 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:04.687662 (+  3486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.687789 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:04.687942 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7860,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":53,"raft.queue_time_us":5598,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":2797,"thread_start_us":108112,"threads_started":1}
W20260709 12:19:04.741879 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:04.798527 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:04.793140 26753 raft_consensus.cc:697] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:04.793171 24322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:42226
I20260709 12:19:05.405807 26765 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:19:04.803165 26863 raft_consensus.cc:3055] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:04.936034 24323 raft_consensus.cc:1275] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:04.954726 26793 raft_consensus.cc:3055] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:04.845227 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:04.878265 24366 leader_election.cc:400] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6.
I20260709 12:19:04.905486 24467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1719) took 3388 ms. Trace:
I20260709 12:19:05.182999 26791 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:19:05.448804 26794 consensus_meta.cc:287] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.851s	user 0.008s	sys 0.004s
I20260709 12:19:04.955734 26753 consensus_queue.cc:237] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:05.145964 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 698850us
W20260709 12:19:04.968780 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:05.452169 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 650115us
W20260709 12:19:05.120520 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:05.461009 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:04.842540 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:04.966990 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 346) took 3888 ms. Trace:
W20260709 12:19:05.266568 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:04.906574 25111 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 363) took 4312 ms (client timeout 2230 ms). Trace:
W20260709 12:19:04.953794 24324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 1586) took 4298 ms (client timeout 1525 ms). Trace:
I20260709 12:19:05.455698 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:05.456437 26815 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:05.474282 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:04.894362 24473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1644) took 2771 ms. Trace:
I20260709 12:19:04.853679 24322 raft_consensus.cc:606] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:04.860337 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:05.434065 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:05.439200 26793 raft_consensus.cc:740] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:05.459887 24323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44278 (request call id 2080) took 2897 ms. Trace:
I20260709 12:19:05.494834 24323 rpcz_store.cc:276] 0709 12:19:02.562425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.934797 (+2372372us) service_pool.cc:224] Handling call
0709 12:19:04.935530 (+   733us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:05.459576 (+524046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:05.459808 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:04.892956 26882 log.cc:927] Time spent T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:19:05.462128 24392 rpcz_store.cc:276] 0709 12:19:01.078063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.078211 (+   148us) service_pool.cc:224] Handling call
0709 12:19:01.120573 (+ 42362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:01.289718 (+169145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.966174 (+3676456us) spinlock_profiling.cc:243] Waited 77.9 ms on lock 0x7b54001b9754. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:04.966740 (+   566us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179232512}
W20260709 12:19:04.953780 24469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 1720) took 2069 ms (client timeout 1501 ms). Trace:
I20260709 12:19:04.893929 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:04.894660 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:05.497573 24322 raft_consensus.cc:614] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:05.523277 25112 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
I20260709 12:19:05.523757 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:05.524571 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:05.525154 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:05.525974 25115 raft_consensus.cc:2393] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 4: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:05.525722 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:04.955622 26824 raft_consensus.cc:3055] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:05.526643 26824 raft_consensus.cc:740] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:05.527088 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:05.527881 25115 raft_consensus.cc:2393] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 6: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:04.876233 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:05.469098 24324 rpcz_store.cc:269] 0709 12:19:00.655187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:00.655409 (+   222us) service_pool.cc:224] Handling call
0709 12:19:04.953388 (+4297979us) spinlock_profiling.cc:243] Waited 3.48 s on lock 0x7b5400167e54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:04.953646 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8008839424}
I20260709 12:19:05.475972 24473 rpcz_store.cc:276] 0709 12:19:02.111641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.231918 (+2120277us) service_pool.cc:224] Handling call
0709 12:19:04.237256 (+  5338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:04.455657 (+218401us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:19:04.646795 (+191138us) log.cc:844] Serialized 14 byte log entry
0709 12:19:04.881585 (+234790us) log.cc:844] Serialized 14 byte log entry
0709 12:19:04.881869 (+   284us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:04.882112 (+   243us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:04.882198 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.882381 (+   183us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:04.882553 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39571,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":63,"raft.queue_time_us":38810,"raft.run_cpu_time_us":394,"raft.run_wall_time_us":30077,"thread_start_us":123065,"threads_started":1}
I20260709 12:19:05.527928 26824 consensus_queue.cc:260] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:05.444056 26863 raft_consensus.cc:740] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:05.535141 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:05.497071 24466 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:05.521459 24469 rpcz_store.cc:269] 0709 12:19:02.884647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:03.874206 (+989559us) service_pool.cc:224] Handling call
0709 12:19:04.953358 (+1079152us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b540029ed54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:04.953618 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":467983744}
I20260709 12:19:05.539791 25115 raft_consensus.cc:1275] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:19:05.543308 26435 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.006s	sys 0.006s
I20260709 12:19:05.543946 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:05.543521 26793 consensus_queue.cc:260] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:05.545290 26793 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:05.452523 26791 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:05.547585 26791 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:05.549715 26824 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:05.499634 26851 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:05.525997 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:05.553037 26851 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:05.553792 26851 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:05.557103 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:05.557404 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:05.544061 26435 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.006s	sys 0.006s
I20260709 12:19:05.446661 24467 rpcz_store.cc:276] 0709 12:19:01.516970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.518364 (+  1394us) service_pool.cc:224] Handling call
0709 12:19:01.556050 (+ 37686us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:03.882074 (+2326024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.904833 (+1022759us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54003863d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:04.905257 (+   424us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2418121984}
I20260709 12:19:05.556396 26851 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:05.559445 25118 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:19:05.566071 24471 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:19:05.492954 26448 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:05.576395 24325 raft_consensus.cc:1275] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:05.559830 26868 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:05.580592 24322 raft_consensus.cc:1275] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:05.581475 24398 raft_consensus.cc:1240] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 2. Current term is 4. Ops: []
I20260709 12:19:05.563853 26678 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:19:05.473217 25111 rpcz_store.cc:269] 0709 12:19:00.594630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:00.624704 (+ 30074us) service_pool.cc:224] Handling call
0709 12:19:04.906259 (+4281555us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400136d54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:04.906450 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2999709952}
I20260709 12:19:05.568605 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:05.591619 26678 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:05.606882 26872 consensus_meta.cc:287] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.913s	user 0.016s	sys 0.000s
W20260709 12:19:05.610607 26862 log.cc:927] Time spent T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 1.471s	user 0.011s	sys 0.006s
I20260709 12:19:05.615182 25112 raft_consensus.cc:2393] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 4: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:05.611096 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:05.621677 26696 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:05.615024 26872 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:05.615361 26863 consensus_queue.cc:260] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:05.646935 26678 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:05.648763 25113 raft_consensus.cc:2393] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 5: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
W20260709 12:19:05.651464 26884 log.cc:927] Time spent T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:19:05.653087 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:05.654721 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:05.656271 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:05.662392 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:05.662200 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:05.663280 24325 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:19:05.665819 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:05.668985 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:05.669886 26872 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:05.670357 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:05.686579 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 224264us
I20260709 12:19:05.689841 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:05.690536 24322 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:05.691286 24323 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:05.692890 25083 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:19:05.694553 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 162635us
W20260709 12:19:05.694283 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 173850us
I20260709 12:19:05.697432 25083 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:19:05.700512 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 240707us
I20260709 12:19:05.701439 24466 raft_consensus.cc:2410] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:19:05.696858 26678 raft_consensus.cc:2804] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:05.701499 26863 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:05.711948 24474 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.015s	sys 0.006s
W20260709 12:19:05.715659 24474 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.016s	sys 0.006s
I20260709 12:19:05.713295 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:05.681943 26696 consensus_queue.cc:1048] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:19:05.715099 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:05.717576 26753 consensus_queue.cc:1048] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:19:05.720707 26872 raft_consensus.cc:2804] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:05.748127 26872 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:05.717358 26893 consensus_queue.cc:1059] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:19:05.748801 26872 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:05.749469 26893 raft_consensus.cc:3055] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:05.749905 26893 raft_consensus.cc:740] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:05.751017 26893 consensus_queue.cc:260] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:05.752708 26894 consensus_queue.cc:1175] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c711faa13ead43ebbea0192cb74a4756" responder_term: 4 status { last_received { term: 4 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 4 index: 4 } }
I20260709 12:19:05.755201 26694 raft_consensus.cc:1064] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:19:05.713174 26678 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:05.727350 24322 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:19:05.763626 26678 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:05.758580 26694 consensus_queue.cc:237] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:05.772260 24321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 324) took 1181 ms. Trace:
I20260709 12:19:05.773753 24321 rpcz_store.cc:276] 0709 12:19:04.590615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:05.770813 (+1180198us) service_pool.cc:224] Handling call
0709 12:19:05.771426 (+   613us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:05.771728 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:05.771767 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:05.771834 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:05.771902 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:05.771977 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:05.772162 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:05.781044 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:05.781771 24322 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:05.716444 24473 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:05.718411 24466 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:05.792935 24470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 503) took 3161 ms. Trace:
I20260709 12:19:05.752516 26893 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:05.793584 24470 rpcz_store.cc:276] 0709 12:19:02.619494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:05.431441 (+2811947us) service_pool.cc:224] Handling call
0709 12:19:05.432079 (+   638us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:05.432565 (+   486us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:05.600164 (+167599us) log.cc:844] Serialized 14 byte log entry
0709 12:19:05.780510 (+180346us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:05.780567 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:05.780662 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:05.780768 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:05.780964 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":196441,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":419,"raft.queue_time_us":116,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":143,"thread_start_us":334090,"threads_started":2}
I20260709 12:19:05.788578 25110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 869) took 1545 ms. Trace:
W20260709 12:19:05.812970 25084 leader_election.cc:336] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Timed out: RequestConsensusVote RPC to 127.22.155.193:36951 timed out after 1.671s (SENT)
I20260709 12:19:05.813589 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:05.807614 25110 rpcz_store.cc:276] 0709 12:19:04.243424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.251530 (+  8106us) service_pool.cc:224] Handling call
0709 12:19:04.252219 (+   689us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:04.549723 (+297504us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:04.550846 (+  1123us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:04.550925 (+    79us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:04.551030 (+   105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:05.788010 (+1236980us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b540044d4d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:05.788090 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:05.788305 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":680476928}
I20260709 12:19:05.851836 26793 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:05.852651 26793 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:05.853920 26791 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:05.831019 26703 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:05.854547 26791 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:05.855037 26793 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:05.857733 24473 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
W20260709 12:19:05.859113 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:05.858933 24290 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:05.861419 24322 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:19:05.861799 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:05.865142 26824 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:05.854979 26703 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:05.865810 26824 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:05.866796 25110 raft_consensus.cc:1275] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:19:05.867290 26703 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:05.867975 26824 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:05.868703 26786 consensus_queue.cc:1048] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:05.869557 26886 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:05.869854 26824 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:05.870187 26886 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:05.870652 26824 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:05.872574 26886 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:05.872469 24323 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:19:05.873857 26435 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:05.874439 26886 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:05.874577 26435 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:05.875129 26886 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:05.874006 26448 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:05.860898 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 141476us
W20260709 12:19:05.882478 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:05.886619 24466 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:05.892088 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:05.892735 24323 raft_consensus.cc:2376] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4. Re-sending same reply.
I20260709 12:19:05.875905 26824 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:05.876797 26876 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:05.893652 24470 raft_consensus.cc:1240] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:05.903366 24473 raft_consensus.cc:1275] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:05.904196 26786 raft_consensus.cc:2804] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:05.904667 26786 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:05.904768 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:05.905216 26786 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:05.906452 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:05.907263 25114 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:05.909047 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:05.909718 24467 raft_consensus.cc:1240] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:05.891419 26791 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:05.885334 26793 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:05.895004 26435 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:05.920172 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:05.912779 26448 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:05.938479 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:05.939266 24469 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 5: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:05.939996 26448 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:05.940220 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:05.943770 24466 raft_consensus.cc:1275] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:19:05.927026 26876 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:05.928767 26903 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:05.929314 26812 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:05.930787 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 517) took 1278 ms. Trace:
I20260709 12:19:05.931635 24470 raft_consensus.cc:1240] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:05.931512 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:05.932212 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:05.964316 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:05.932456 26793 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:19:05.933377 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:05.942355 24398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 355) took 4862 ms. Trace:
W20260709 12:19:05.927989 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 69146.7us
I20260709 12:19:05.953780 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:05.955318 24318 raft_consensus.cc:1240] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:05.956228 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:05.957676 24317 raft_consensus.cc:1240] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:05.958320 24319 raft_consensus.cc:1240] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:05.959101 24316 raft_consensus.cc:1240] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:19:05.959235 26886 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:05.964231 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:05.914147 26824 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:05.970014 24325 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 5: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:05.967069 24398 rpcz_store.cc:276] 0709 12:19:01.080189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:02.319919 (+1239730us) service_pool.cc:224] Handling call
0709 12:19:02.320317 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:05.581982 (+3261665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:05.941943 (+359961us) spinlock_profiling.cc:243] Waited 3.26 s on lock 0x7b54002a3d54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:05.942268 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7487022464}
I20260709 12:19:05.961037 24474 rpcz_store.cc:276] 0709 12:19:04.652304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.661125 (+  8821us) service_pool.cc:224] Handling call
0709 12:19:04.661630 (+   505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:04.663401 (+  1771us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:04.663441 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:04.680246 (+ 16805us) log.cc:844] Serialized 26 byte log entry
0709 12:19:05.716086 (+1035840us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:05.716130 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:05.716199 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:05.930496 (+214297us) raft_consensus.cc:1685] finished
0709 12:19:05.930521 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:05.930685 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":964,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":157,"thread_start_us":873948,"threads_started":1,"wal-append.queue_time_us":1070591}
I20260709 12:19:05.972818 24290 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:05.973853 26793 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:05.977408 24290 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:05.977787 26876 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:05.970283 26874 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.654s	user 0.025s	sys 0.041s
I20260709 12:19:05.980855 26696 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:19:05.981114 26874 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.801s	user 0.025s	sys 0.042s
I20260709 12:19:05.981715 26696 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:05.981580 26753 consensus_queue.cc:1048] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:05.982247 26696 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:05.982703 26696 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:05.986367 26889 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:05.985978 26678 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:05.985868 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:05.922063 26872 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:05.991374 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:05.987082 26889 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:05.948578 26435 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:06.000756 26911 consensus_queue.cc:1048] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:19:06.000767 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:06.012599 26824 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:06.013533 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:06.004972 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:06.015872 26435 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:19:06.010393 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:06.018447 26435 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:06.018679 24322 raft_consensus.cc:1240] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:19:06.020287 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:19:06.023474 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:06.026892 24321 raft_consensus.cc:1240] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:19:06.026929 24322 raft_consensus.cc:1240] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:06.027561 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.028427 24396 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
W20260709 12:19:06.030280 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:06.030678 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.031462 24393 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:19:06.032575 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:05.984221 26786 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:05.976037 26791 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:06.052852 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.053848 24396 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:19:05.963217 26903 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:06.057296 25114 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
W20260709 12:19:06.060322 25082 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.781s (SENT) [suppressed 34 similar messages]
W20260709 12:19:06.112142 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 227832us
I20260709 12:19:06.055264 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:06.062330 24391 raft_consensus.cc:1275] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:06.103418 24400 raft_consensus.cc:1275] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:19:06.216796 24393 raft_consensus.cc:3055] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:19:06.224568 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 164272us
I20260709 12:19:06.225947 24393 raft_consensus.cc:740] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:06.135928 24399 raft_consensus.cc:1275] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:19:06.157491 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:06.231599 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:06.065869 24366 connection.cc:256] RPC call timeout handler was delayed by -3.71325841099997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1525s for a response
W20260709 12:19:06.235055 24366 connection.cc:256] RPC call timeout handler was delayed by -3.6898584109999319s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
W20260709 12:19:06.235822 24366 connection.cc:256] RPC call timeout handler was delayed by -3.4594584110000142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1807s for a response
W20260709 12:19:06.236574 24366 connection.cc:256] RPC call timeout handler was delayed by -3.0517584109998097s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22599999999999998s for a response
W20260709 12:19:06.237521 24366 connection.cc:256] RPC call timeout handler was delayed by -2.5009584109998286s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2872s for a response
I20260709 12:19:06.233036 24396 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
W20260709 12:19:06.238153 24366 connection.cc:256] RPC call timeout handler was delayed by -2.1526584109999476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3259s for a response
W20260709 12:19:06.170619 24218 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54244 (request call id 270) took 19697 ms (client timeout 15000 ms). Trace:
I20260709 12:19:06.124734 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:06.244242 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:06.173005 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:06.249969 24473 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:19:06.172777 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.250593 24472 raft_consensus.cc:2393] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 4: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:06.265828 24394 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:06.265851 24467 raft_consensus.cc:2393] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:06.123692 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.272608 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.273770 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.275674 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:06.276851 24467 raft_consensus.cc:2410] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:06.278214 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.278839 24395 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:19:06.279753 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:06.280952 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:06.282104 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.282609 24396 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:06.283401 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.095331 26851 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:06.283914 24396 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 2.
I20260709 12:19:06.283768 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:06.147027 26791 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:06.285104 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.436941 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:06.437085 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:06.437326 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:06.438190 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:06.438529 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:06.438918 24474 raft_consensus.cc:2393] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 6: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:06.439162 24393 consensus_queue.cc:260] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:06.440384 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:06.440541 24393 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:06.436995 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:06.442035 24472 raft_consensus.cc:2393] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 4: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
W20260709 12:19:06.401544 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 177735us
W20260709 12:19:06.452194 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:06.141007 24219 catalog_manager.cc:5697] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 3 to 4, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 4 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:06.453009 26851 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:06.284689 26872 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:06.320225 26915 log.cc:927] Time spent T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:19:06.439690 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:06.381960 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:06.274518 24391 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
W20260709 12:19:06.335348 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 51025.3us
W20260709 12:19:06.363147 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 44975.6us
W20260709 12:19:06.413311 26912 log.cc:927] Time spent T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 12:19:06.372365 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:06.412461 26910 log.cc:927] Time spent T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 12:19:06.482345 24467 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:06.432575 25113 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.001s	sys 0.012s
W20260709 12:19:06.381685 24350 heartbeater.cc:646] Failed to heartbeat to 127.22.155.254:34311 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.22.155.254:34311 timed out after 15.000s (SENT)
W20260709 12:19:06.480458 25082 leader_election.cc:336] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.817s (SENT)
I20260709 12:19:06.484701 25082 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:06.298882 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.486133 24392 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:19:06.299713 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.487470 24398 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:19:06.317519 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.483842 24393 raft_consensus.cc:1275] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
W20260709 12:19:06.477406 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 303104us
W20260709 12:19:06.307722 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:06.699980 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:06.700695 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:06.597282 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.468389 26824 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:06.571637 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 50014.2us
I20260709 12:19:06.708998 25083 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:06.710002 24391 raft_consensus.cc:2393] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 4: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:06.710335 26889 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:06.710952 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:06.711194 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:06.711925 26898 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:06.712544 26898 raft_consensus.cc:697] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:06.714262 26898 consensus_queue.cc:237] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:06.380903 26481 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:06.376525 26678 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:06.497205 26872 raft_consensus.cc:2749] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:19:06.492614 25113 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.001s	sys 0.012s
I20260709 12:19:06.599974 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:06.717612 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:06.717823 24471 raft_consensus.cc:2376] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6. Re-sending same reply.
I20260709 12:19:06.493971 24399 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:06.718295 25083 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:06.719450 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.720764 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.572592 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:06.488813 24393 pending_rounds.cc:85] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a: Aborting all ops after (but not including) 2
I20260709 12:19:06.721907 24393 pending_rounds.cc:107] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:19:06.722265 24393 raft_consensus.cc:2889] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:06.576802 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:06.722906 24472 raft_consensus.cc:2376] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6. Re-sending same reply.
I20260709 12:19:06.492729 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:06.519639 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.718253 24468 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:06.380720 26902 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:06.557854 26786 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:06.564043 24219 catalog_manager.cc:5697] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 2 to 3, leader changed from d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 3 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:19:06.721344 24399 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:19:06.469568 26903 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:06.651784 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 82668.9us
W20260709 12:19:06.686008 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 193890us
W20260709 12:19:06.685456 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 205017us
I20260709 12:19:06.684732 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:06.636685 26696 consensus_meta.cc:287] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.654s	user 0.009s	sys 0.004s
I20260709 12:19:06.609596 26791 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:06.701217 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:06.702144 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.701891 24366 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:06.725003 24396 raft_consensus.cc:2368] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5.
W20260709 12:19:06.730079 25082 leader_election.cc:336] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.885s (SENT)
I20260709 12:19:06.730887 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:06.718371 26851 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:06.735311 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.744122 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.746897 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.749202 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.727795 26678 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:19:06.249223 24218 rpcz_store.cc:269] 0709 12:18:46.465255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:46.474912 (+  9657us) service_pool.cc:224] Handling call
0709 12:19:06.155575 (+19680663us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:57.576735 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:57.739008 (+162273us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:57.742487 (+  3479us) write_op.cc:435] Acquired schema lock
0709 12:18:57.753916 (+ 11429us) tablet.cc:662] Decoding operations
0709 12:18:57.950389 (+196473us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:57.959459 (+  9070us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:57.980222 (+ 20763us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:18:58.107536 (+127314us) tablet.cc:701] Row locks acquired
0709 12:18:58.107556 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:18:58.137227 (+ 29671us) write_op.cc:270] Start()
0709 12:18:58.151951 (+ 14724us) write_op.cc:276] Timestamp: P: 1783599538130990 usec, L: 0
0709 12:18:58.151987 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:18:58.401032 (+249045us) log.cc:844] Serialized 1708 byte log entry
0709 12:19:00.755431 (+2354399us) op_driver.cc:464] REPLICATION: finished
0709 12:19:00.952440 (+197009us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a942420ac 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425ec02 00007f4a9ad82ef0
0709 12:19:01.206235 (+253795us) write_op.cc:301] APPLY: starting
0709 12:19:01.217719 (+ 11484us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:01.292987 (+ 75268us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:01.321585 (+ 28598us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:01.677723 (+356138us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:02.042764 (+365041us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:19:02.042811 (+    47us) write_op.cc:312] APPLY: finished
0709 12:19:02.043181 (+   370us) log.cc:844] Serialized 41 byte log entry
0709 12:19:04.429702 (+2386521us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a942420ac 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425ec02 00007f4a96ee620b
0709 12:19:04.438815 (+  9113us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:04.439091 (+   276us) write_op.cc:454] Released schema lock
0709 12:19:04.439179 (+    88us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:04.439997 (+   818us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:04.440041 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":392576,"apply.run_cpu_time_us":33401,"apply.run_wall_time_us":3253188,"num_ops":4,"prepare.queue_time_us":471616,"prepare.run_cpu_time_us":45645,"prepare.run_wall_time_us":1918860,"raft.queue_time_us":898536,"raft.run_cpu_time_us":27308,"raft.run_wall_time_us":473483,"replication_time_us":2523577,"spinlock_wait_cycles":110515840,"thread_start_us":4444769,"threads_started":5,"wal-append.queue_time_us":3660742,"wal-append.run_cpu_time_us":46861,"wal-append.run_wall_time_us":2827763}]]}
I20260709 12:19:06.745803 24219 catalog_manager.cc:5697] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 3 to 6, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 6 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:06.752539 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:06.752964 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:06.749814 24398 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:19:06.758757 24471 raft_consensus.cc:2410] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:19:06.747445 24397 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:19:06.761834 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:06.763082 24472 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:06.765502 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:06.768334 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.769476 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:06.771312 24399 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:19:06.773996 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.779697 24394 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:19:06.784245 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.784967 24394 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:19:06.732508 26902 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:19:06.742118 26696 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:06.788735 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:06.788607 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:06.788563 24398 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:06.789369 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:06.790066 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.791783 24396 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:19:06.772783 26905 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:06.795472 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:06.796603 24466 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:06.799224 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.789469 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.799760 24395 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:19:06.821480 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.825354 24394 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 1.
I20260709 12:19:06.827875 24471 raft_consensus.cc:2393] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 4: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:06.735931 26481 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:06.828725 24399 raft_consensus.cc:2368] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5.
I20260709 12:19:06.840837 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.845247 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.846556 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.847616 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:06.849673 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 147893us
I20260709 12:19:06.851476 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:06.841751 24395 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:19:06.853643 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:06.855965 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 69070.3us
I20260709 12:19:06.856168 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:06.861178 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.863900 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:06.866235 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.867338 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:06.876102 24393 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:19:06.877490 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.878247 24393 raft_consensus.cc:2393] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 5: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:06.880321 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:06.881436 24470 raft_consensus.cc:2393] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:06.879273 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:06.839953 26924 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:06.885273 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:06.884661 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 114172us
I20260709 12:19:06.869307 24219 catalog_manager.cc:5697] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 2 to 3, leader changed from d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 3 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:19:06.885998 24395 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:06.887603 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.888885 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:06.889562 24394 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:06.890509 24392 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:19:06.893491 24471 raft_consensus.cc:2393] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 4: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:06.893021 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.895210 24396 raft_consensus.cc:2410] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:19:06.895982 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:06.898123 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.899194 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.899852 24399 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:06.898722 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.868990 26851 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:06.903363 26851 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:06.905433 26924 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:06.907691 26924 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:06.887696 26753 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:06.909090 26753 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:06.913353 24393 raft_consensus.cc:2410] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:19:06.914230 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.915915 24398 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:06.916347 24468 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:19:06.917163 24474 raft_consensus.cc:1240] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:06.917488 24395 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:06.918591 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:06.855818 26905 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:06.869699 26922 consensus_queue.cc:1048] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
I20260709 12:19:06.967972 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.930148 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:06.967736 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:06.972726 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:07.059396 24399 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 5: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:06.920347 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:06.931221 24289 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:06.970039 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:07.063686 26924 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:06.998692 26678 raft_consensus.cc:697] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:07.075719 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:07.075171 24470 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
W20260709 12:19:07.063577 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 132430us
I20260709 12:19:07.076571 24397 raft_consensus.cc:1240] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:06.928294 24394 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:19:06.987974 24466 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:19:07.077059 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:06.999063 24391 raft_consensus.cc:1275] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:07.275691 24471 raft_consensus.cc:2410] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:07.149691 24440 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:07.276039 24467 consensus_meta.cc:287] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.705s	user 0.009s	sys 0.000s
W20260709 12:19:06.993315 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 74562.5us
I20260709 12:19:07.277074 24467 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
W20260709 12:19:07.278148 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 290887us
I20260709 12:19:06.999027 24219 catalog_manager.cc:5697] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 2 to 4, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 4 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:07.278826 24395 raft_consensus.cc:2376] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3. Re-sending same reply.
I20260709 12:19:07.279796 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:07.089166 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1734) took 1144 ms. Trace:
I20260709 12:19:07.280946 24396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1748) took 1002 ms. Trace:
I20260709 12:19:07.284925 24396 rpcz_store.cc:276] 0709 12:19:06.278444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.069589 (+791145us) service_pool.cc:224] Handling call
0709 12:19:07.280424 (+210835us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:07.280617 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:07.280657 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:07.280703 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:07.280747 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:07.280794 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:07.280881 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:07.274061 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:07.076508 26678 consensus_queue.cc:237] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:07.280404 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 431215us
I20260709 12:19:06.968287 24472 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:19:07.289790 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:07.291769 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:07.297737 24467 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:07.282493 24474 raft_consensus.cc:2376] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6. Re-sending same reply.
I20260709 12:19:07.292824 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2193) took 1139 ms. Trace:
I20260709 12:19:07.299775 24391 rpcz_store.cc:276] 0709 12:19:06.137103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:06.975818 (+838715us) service_pool.cc:224] Handling call
0709 12:19:06.997760 (+ 21942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:07.275862 (+278102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:07.276054 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:06.911293 26753 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:07.312219 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:07.313500 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:07.283113 24469 rpcz_store.cc:276] 0709 12:19:05.945014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:05.951932 (+  6918us) service_pool.cc:224] Handling call
0709 12:19:05.952260 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:05.968415 (+ 16155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:05.968436 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:05.969053 (+   617us) log.cc:844] Serialized 26 byte log entry
0709 12:19:05.970118 (+  1065us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:19:05.970176 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:05.970259 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:07.087492 (+1117233us) spinlock_profiling.cc:243] Waited 48.6 ms on lock 0x7b2400203378. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a940e59c4 00007f4a940e3acb 00007f4a9429edc9 00007f4a9429ea55 00007f4a9429dfb0 00007f4a96f14488 00007f4a96f14be8 00007f4a96eec398 00007f4a96ee776a 00007f4a96ee6bb6
0709 12:19:07.088718 (+  1226us) raft_consensus.cc:1685] finished
0709 12:19:07.088751 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:07.089069 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7859,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":149,"spinlock_wait_cycles":111888128,"thread_start_us":16417,"threads_started":2,"wal-append.queue_time_us":149998}
I20260709 12:19:06.918495 26791 raft_consensus.cc:2749] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:07.316731 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:07.321272 24324 raft_consensus.cc:1240] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:07.324383 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:07.317397 24438 leader_election.cc:336] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.753s (SENT)
I20260709 12:19:07.329887 24219 catalog_manager.cc:5697] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:07.323752 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:07.277957 26924 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:07.340818 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:07.342336 24396 raft_consensus.cc:2376] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4. Re-sending same reply.
I20260709 12:19:07.343281 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:07.344347 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:07.341341 24392 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:19:07.344908 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:07.345647 24397 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 5: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:07.345521 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:07.346040 24392 raft_consensus.cc:2376] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5. Re-sending same reply.
I20260709 12:19:07.347044 24397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1750) took 1068 ms. Trace:
I20260709 12:19:07.347335 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1751) took 1068 ms. Trace:
I20260709 12:19:07.347723 24392 rpcz_store.cc:276] 0709 12:19:06.279397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.346568 (+1067171us) service_pool.cc:224] Handling call
0709 12:19:07.346844 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:07.347041 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:07.347064 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:07.347102 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:07.347159 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:07.347208 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:07.347291 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:07.347421 24397 rpcz_store.cc:276] 0709 12:19:06.279085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.346182 (+1067097us) service_pool.cc:224] Handling call
0709 12:19:07.346469 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:07.346696 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:07.346719 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:07.346778 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:07.346820 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:07.346871 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:07.346967 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:07.349887 24397 pending_rounds.cc:85] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a: Aborting all ops after (but not including) 5
I20260709 12:19:07.350142 24397 pending_rounds.cc:107] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:19:07.350371 24397 raft_consensus.cc:2889] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:07.354166 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:07.355010 24400 raft_consensus.cc:2393] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:07.354632 24366 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:07.356886 26753 raft_consensus.cc:2764] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:19:07.358188 24399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1740) took 1216 ms. Trace:
I20260709 12:19:07.358485 26905 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:07.358569 24399 rpcz_store.cc:276] 0709 12:19:06.141359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.062735 (+921376us) service_pool.cc:224] Handling call
0709 12:19:07.357517 (+294782us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b58001c9e98. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c325fc0 00007f4a9c310929 00007f4a9c3103d2 00007f4a95887bd4
0709 12:19:07.357688 (+   171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:07.357899 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:07.357922 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:07.357959 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:07.357996 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:07.358044 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:07.358136 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4083584}
I20260709 12:19:07.361877 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:07.363044 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:07.364032 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:07.360580 24399 raft_consensus.cc:1275] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:19:07.289760 26786 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:07.366371 24396 raft_consensus.cc:1275] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:07.367702 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:07.368803 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:07.364543 24400 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:19:07.370035 26916 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:07.369469 26924 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:07.372685 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:07.378733 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:07.379814 24399 raft_consensus.cc:2393] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:07.356550 24366 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:07.385947 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:07.390846 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:07.392688 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:07.393316 24395 raft_consensus.cc:2376] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4. Re-sending same reply.
I20260709 12:19:07.389729 24396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2196) took 1011 ms. Trace:
I20260709 12:19:07.398878 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:07.399712 24395 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:19:07.400590 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:07.329543 26851 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:07.399096 24399 raft_consensus.cc:2393] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 5: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:07.406108 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:07.410607 24400 raft_consensus.cc:2410] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:19:07.398283 24396 rpcz_store.cc:276] 0709 12:19:06.362260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.352577 (+990317us) service_pool.cc:224] Handling call
0709 12:19:07.353175 (+   598us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:07.372953 (+ 19778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:07.373120 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:07.337211 26929 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:07.412216 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:07.405834 24219 catalog_manager.cc:5697] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 3 to 4, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 4 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:07.423118 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:07.426133 24395 raft_consensus.cc:2393] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 4: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
W20260709 12:19:07.421633 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 95601.8us
W20260709 12:19:07.423382 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 273755us
W20260709 12:19:07.429984 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 112643us
W20260709 12:19:07.430653 24438 leader_election.cc:336] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.910s (SENT)
I20260709 12:19:07.419625 26753 raft_consensus.cc:2749] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:07.377964 26786 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:07.435307 24438 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:07.434401 24289 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:07.437552 24440 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:07.436915 24219 catalog_manager.cc:5697] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 2 to 5, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 5 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:07.440557 24219 catalog_manager.cc:5697] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 2 to 3, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 3 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:07.444619 24400 raft_consensus.cc:1275] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:19:07.402866 26916 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:07.447065 24289 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:07.446290 24219 catalog_manager.cc:5697] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 3 to 4, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 4 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:19:07.449891 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 93448.5us
I20260709 12:19:07.454610 24289 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:07.456526 26786 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:07.455492 24219 catalog_manager.cc:5697] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 3 to 4, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 4 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:19:07.467749 25082 leader_election.cc:336] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.671s (SENT)
I20260709 12:19:07.468376 25082 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:07.470153 24438 leader_election.cc:336] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.918s (SENT)
W20260709 12:19:07.471313 24438 leader_election.cc:336] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.929s (SENT)
W20260709 12:19:07.471463 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:07.475183 26481 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:07.475854 26481 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:19:07.477473 24438 leader_election.cc:336] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.114s (SENT)
I20260709 12:19:07.477375 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:07.477988 24438 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:07.479344 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:07.479768 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 1760) took 1035 ms. Trace:
I20260709 12:19:07.480113 24393 rpcz_store.cc:276] 0709 12:19:06.444756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:06.878775 (+434019us) service_pool.cc:224] Handling call
0709 12:19:07.479588 (+600813us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b54001112d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:07.479709 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31750400}
I20260709 12:19:07.482836 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:07.484115 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:07.484802 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:07.485401 24470 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:19:07.487862 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:07.489578 24366 leader_election.cc:400] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6.
I20260709 12:19:07.489989 24366 leader_election.cc:403] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:07.451223 26851 raft_consensus.cc:2804] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:07.494403 24400 raft_consensus.cc:1275] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:19:07.453440 26354 tablet_copy_client.cc:538] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:07.494833 24219 catalog_manager.cc:5697] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:19:07.504173 24468 raft_consensus.cc:1240] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:07.506253 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:07.507978 24465 raft_consensus.cc:1240] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:07.466322 26786 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:07.510473 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:07.511607 24473 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:19:07.513494 25114 raft_consensus.cc:1240] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:07.514420 26945 raft_consensus.cc:2749] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:07.515210 26786 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:07.515694 26786 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:07.514531 26629 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:07.498944 26937 consensus_queue.cc:1059] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:19:07.518002 26937 raft_consensus.cc:3055] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:07.518353 26937 raft_consensus.cc:740] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:07.518893 26898 consensus_queue.cc:1059] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:07.520129 26940 raft_consensus.cc:2764] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:19:07.522795 26753 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6.
I20260709 12:19:07.512411 25083 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:19:07.526285 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 59470.6us
I20260709 12:19:07.493940 26851 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:07.439870 26929 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:07.538784 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:07.535291 25083 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:07.559476 26934 raft_consensus.cc:2804] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:07.566743 26696 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:07.568919 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 91464.6us
I20260709 12:19:07.574875 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:07.578953 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:07.584175 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 129625us
I20260709 12:19:07.585465 24289 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:07.587352 24289 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:07.598016 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 130283us
I20260709 12:19:07.549798 26629 raft_consensus.cc:2804] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:07.549428 26851 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:07.584403 26939 raft_consensus.cc:2749] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:19:07.650517 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 122936us
W20260709 12:19:07.688057 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 100784us
W20260709 12:19:07.688282 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 126720us
I20260709 12:19:07.617499 26629 raft_consensus.cc:697] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
W20260709 12:19:07.687207 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 127114us
I20260709 12:19:07.649690 26947 raft_consensus.cc:2749] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:07.705371 24465 raft_consensus.cc:1240] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 12:19:07.700336 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 47276.9us
I20260709 12:19:07.702013 24366 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:07.712034 24391 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:19:07.716876 25110 raft_consensus.cc:1240] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:07.717679 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:07.719121 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:07.721006 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:07.721971 24324 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:19:07.722277 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:07.725033 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:07.725399 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:07.726529 25118 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:07.726851 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:07.728799 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:07.720916 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:07.731472 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:07.734007 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:07.735800 24316 raft_consensus.cc:1240] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:19:07.739169 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:07.727823 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:07.743058 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:07.745213 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:07.747861 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:07.749611 24324 raft_consensus.cc:1240] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:07.753778 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:07.763970 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:07.765514 26955 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:07.691632 26957 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:07.766062 26955 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:07.781100 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:07.756333 24324 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
W20260709 12:19:07.791661 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 58317.7us
W20260709 12:19:07.829414 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 394682us
I20260709 12:19:07.780180 26481 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:19:07.800500 26936 log.cc:927] Time spent T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:19:07.851462 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:07.852582 24465 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:19:07.779925 26955 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:07.845199 26481 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:07.779740 26939 consensus_queue.cc:1048] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 12:19:07.903126 24440 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:07.906023 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:07.859622 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:07.926901 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:07.806878 26957 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:07.807605 26947 consensus_queue.cc:1048] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:19:07.869406 26753 raft_consensus.cc:2804] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:19:07.948156 24366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:07.949446 24290 leader_election.cc:336] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.969s (SENT)
I20260709 12:19:07.950040 24290 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:07.950765 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 378248us
I20260709 12:19:07.902814 26481 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:07.900712 26934 raft_consensus.cc:697] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
W20260709 12:19:07.957625 24398 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.027s	sys 0.041s
W20260709 12:19:07.981009 24398 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.028s	sys 0.051s
W20260709 12:19:07.983368 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 115791us
I20260709 12:19:07.831406 26937 consensus_queue.cc:260] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:07.982810 25110 raft_consensus.cc:2410] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:19:07.994649 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 287879us
I20260709 12:19:07.866906 26629 consensus_queue.cc:237] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:07.998147 24440 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:08.005373 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 55968.9us
W20260709 12:19:08.008744 24290 leader_election.cc:336] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.019s (SENT)
I20260709 12:19:08.009253 24290 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:08.010705 24398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2188) took 1875 ms. Trace:
I20260709 12:19:07.983009 26753 raft_consensus.cc:697] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:19:08.006862 26935 log.cc:927] Time spent T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.319s	user 0.001s	sys 0.000s
W20260709 12:19:08.033636 24399 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.005s	sys 0.013s
W20260709 12:19:08.047358 24399 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.009s	sys 0.013s
W20260709 12:19:08.046305 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 56159.2us
W20260709 12:19:08.060115 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 70501.3us
I20260709 12:19:07.993479 26966 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:07.999364 26902 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:08.054734 26937 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:08.102198 24440 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:08.061491 26929 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:08.065326 26916 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:08.066249 26966 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:08.112746 24366 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:08.078696 26970 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:08.078485 26956 raft_consensus.cc:2749] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:08.125558 24440 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
W20260709 12:19:08.108224 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 98854.4us
W20260709 12:19:08.112215 26924 consensus_meta.cc:287] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.696s	user 0.014s	sys 0.000s
I20260709 12:19:08.008816 26940 consensus_queue.cc:1048] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 12:19:08.086438 26939 consensus_queue.cc:1048] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:19:08.136694 24399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 366) took 1688 ms. Trace:
I20260709 12:19:08.125200 26970 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:08.137208 26949 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:08.182052 26970 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:08.140411 26791 consensus_queue.cc:1059] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:08.141078 24366 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:08.183025 26791 raft_consensus.cc:3055] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:08.183422 26791 raft_consensus.cc:740] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:08.184376 26791 consensus_queue.cc:260] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:08.185643 26791 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:08.141296 26976 consensus_queue.cc:1059] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:08.147703 24438 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:08.161953 26942 log.cc:927] Time spent T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.474s	user 0.001s	sys 0.000s
I20260709 12:19:08.188483 24397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 361) took 1864 ms. Trace:
I20260709 12:19:08.123883 26962 raft_consensus.cc:2749] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:08.116806 26947 raft_consensus.cc:2804] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:08.190177 26947 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:08.190682 26947 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:08.191579 26949 raft_consensus.cc:2749] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:08.192346 26949 consensus_queue.cc:1059] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:08.193971 26924 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:08.196341 26924 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:08.141382 26946 log.cc:927] Time spent T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 12:19:08.196990 24316 raft_consensus.cc:2393] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 7: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:08.131894 26934 consensus_queue.cc:237] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:08.114548 26966 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:08.210374 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 151585us
W20260709 12:19:08.243235 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 234503us
I20260709 12:19:08.244349 24473 raft_consensus.cc:1275] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:08.097222 26696 consensus_queue.cc:1059] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:19:08.181793 24399 rpcz_store.cc:276] 0709 12:19:06.448077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.425200 (+977123us) service_pool.cc:224] Handling call
0709 12:19:07.425599 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:07.432862 (+  7263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:07.432897 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:07.435967 (+  3070us) log.cc:844] Serialized 26 byte log entry
0709 12:19:08.052312 (+616345us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:08.052697 (+   385us) log.cc:844] Serialized 14 byte log entry
0709 12:19:08.052881 (+   184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:08.052953 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:08.136407 (+ 83454us) raft_consensus.cc:1685] finished
0709 12:19:08.136431 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:08.136601 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":905,"prepare.queue_time_us":181,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":142592,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":2762,"thread_start_us":594788,"threads_started":1,"wal-append.queue_time_us":691098}
W20260709 12:19:08.240512 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 131024us
W20260709 12:19:08.249300 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 231364us
W20260709 12:19:08.252084 24289 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.003s	sys 0.004s
W20260709 12:19:08.252579 24289 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.003s	sys 0.004s
W20260709 12:19:08.252988 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 559640us
W20260709 12:19:08.246332 24290 leader_election.cc:336] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.733s (SENT)
I20260709 12:19:08.246490 25083 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:08.092270 26965 consensus_queue.cc:1059] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:19:08.257133 24440 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:08.189038 24397 rpcz_store.cc:276] 0709 12:19:06.324487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.349400 (+1024913us) service_pool.cc:224] Handling call
0709 12:19:07.349697 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:07.350927 (+  1230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:07.350952 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:07.351378 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 12:19:07.422222 (+ 70844us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:07.650819 (+228597us) log.cc:844] Serialized 14 byte log entry
0709 12:19:07.902098 (+251279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:07.902195 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:08.161135 (+258940us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:19:08.188147 (+ 27012us) raft_consensus.cc:1685] finished
0709 12:19:08.188271 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:08.188417 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":379104,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":4871,"raft.queue_time_us":211192,"raft.run_cpu_time_us":8815,"raft.run_wall_time_us":70285,"spinlock_wait_cycles":6351616,"thread_start_us":507610,"threads_started":3,"wal-append.queue_time_us":182664}
W20260709 12:19:08.245729 26953 log.cc:927] Time spent T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.250s	user 0.004s	sys 0.000s
I20260709 12:19:08.130205 26967 consensus_queue.cc:1059] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.121s
W20260709 12:19:08.278715 25082 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.037s	sys 0.033s
W20260709 12:19:08.279356 25082 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.037s	sys 0.033s
W20260709 12:19:08.279740 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 680687us
I20260709 12:19:08.248944 26939 raft_consensus.cc:2804] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:19:08.300113 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 170304us
W20260709 12:19:08.308665 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:08.283514 26904 raft_consensus.cc:2804] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:19:08.315389 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 129851us
I20260709 12:19:08.317167 24366 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:08.293565 26939 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:08.297092 26977 raft_consensus.cc:2749] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:19:08.323247 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 46809.2us
W20260709 12:19:08.323625 24365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.023s	sys 0.035s
I20260709 12:19:08.326123 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 360) took 2039 ms. Trace:
I20260709 12:19:08.312454 26904 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:08.336920 24392 rpcz_store.cc:276] 0709 12:19:06.286834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.348579 (+1061745us) service_pool.cc:224] Handling call
0709 12:19:07.365745 (+ 17166us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:07.370339 (+  4594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:07.370452 (+   113us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:07.395617 (+ 25165us) log.cc:844] Serialized 26 byte log entry
0709 12:19:07.496496 (+100879us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:07.632888 (+136392us) log.cc:844] Serialized 14 byte log entry
0709 12:19:07.645842 (+ 12954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:07.645921 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:08.325854 (+679933us) raft_consensus.cc:1685] finished
0709 12:19:08.325879 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:08.326050 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12602,"prepare.queue_time_us":336882,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":18642,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":30393,"thread_start_us":194431,"threads_started":2,"wal-append.queue_time_us":188308}
W20260709 12:19:08.354928 24365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.023s	sys 0.035s
I20260709 12:19:08.327744 26939 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:08.377810 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:08.380955 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 60594.7us
I20260709 12:19:08.299664 26902 consensus_queue.cc:1059] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:19:08.328109 26918 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:08.385164 26918 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:08.325695 26926 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:08.298581 26753 consensus_queue.cc:237] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:08.374357 26904 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:08.386927 26960 log.cc:927] Time spent T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 12:19:08.389001 26991 consensus_queue.cc:1048] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
W20260709 12:19:08.418987 25082 leader_election.cc:336] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.206s (SENT)
I20260709 12:19:08.387487 26945 raft_consensus.cc:2804] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:19:08.412992 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 100278us
W20260709 12:19:08.434273 25082 leader_election.cc:336] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 3.075s (SENT)
I20260709 12:19:08.434798 25082 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:08.435739 26980 raft_consensus.cc:3055] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:08.436183 26980 raft_consensus.cc:740] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:08.436990 26944 raft_consensus.cc:3055] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:08.437398 26944 raft_consensus.cc:740] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:08.438344 26944 consensus_queue.cc:260] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:08.439759 26944 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:08.440686 26979 consensus_queue.cc:1048] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.144s
W20260709 12:19:08.429138 26851 consensus_meta.cc:287] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.785s	user 0.011s	sys 0.003s
I20260709 12:19:08.454059 26988 raft_consensus.cc:3055] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:19:08.433308 26786 consensus_meta.cc:287] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.917s	user 0.011s	sys 0.007s
W20260709 12:19:08.462172 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 160508us
I20260709 12:19:08.465916 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:08.467553 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:08.479709 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:08.403244 26926 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:08.389750 26977 consensus_queue.cc:1048] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 12:19:08.490044 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:08.494730 24438 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:08.480464 24392 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
W20260709 12:19:08.495090 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 113332us
W20260709 12:19:08.474412 26955 consensus_meta.cc:287] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.603s	user 0.010s	sys 0.001s
I20260709 12:19:08.502800 24366 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:08.469079 26988 raft_consensus.cc:740] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:08.454773 26696 consensus_queue.cc:1048] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
W20260709 12:19:08.548508 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 61655.1us
I20260709 12:19:08.557276 26993 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:08.557996 26993 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:08.553077 26976 consensus_queue.cc:1059] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:19:08.558383 26993 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:08.480371 26992 raft_consensus.cc:2749] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:08.480858 26902 consensus_queue.cc:1048] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
W20260709 12:19:08.576411 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 91338.6us
I20260709 12:19:08.475764 26786 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:08.593212 24319 raft_consensus.cc:2393] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:19:08.585965 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 83229.2us
I20260709 12:19:08.473178 26851 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:19:08.531821 26955 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:08.596462 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:08.011097 24398 rpcz_store.cc:276] 0709 12:19:06.135484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:06.920453 (+784969us) service_pool.cc:224] Handling call
0709 12:19:06.920843 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:06.921091 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:06.921116 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:06.974138 (+ 53022us) log.cc:844] Serialized 26 byte log entry
0709 12:19:07.409317 (+435179us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:07.981561 (+572244us) log.cc:844] Serialized 14 byte log entry
0709 12:19:07.983756 (+  2195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:07.983843 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:08.010495 (+ 26652us) raft_consensus.cc:1685] finished
0709 12:19:08.010515 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:08.010643 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1921,"prepare.queue_time_us":357352,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":6573,"raft.queue_time_us":27664,"thread_start_us":879854,"threads_started":2,"wal-append.queue_time_us":511351}
W20260709 12:19:08.682046 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 131744us
I20260709 12:19:08.690236 24365 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:08.685160 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:08.599812 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:08.688015 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 253783us
W20260709 12:19:08.690546 24366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:08.691459 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:08.728591 24322 raft_consensus.cc:1240] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6. Ops: []
W20260709 12:19:08.905958 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 176979us
I20260709 12:19:08.930456 24365 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:08.931145 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 340412us
I20260709 12:19:08.691283 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:08.740895 24318 raft_consensus.cc:2393] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:08.933225 24317 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:19:08.934141 24391 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:19:08.813306 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:08.932610 24366 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:08.745250 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:08.935930 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 80155.5us
I20260709 12:19:08.739714 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:08.937141 24393 raft_consensus.cc:1275] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:19:08.937211 24394 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:08.718156 24325 raft_consensus.cc:1240] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:08.745756 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:08.741044 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:08.939093 24396 raft_consensus.cc:2368] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5.
I20260709 12:19:08.591603 26945 raft_consensus.cc:697] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:08.935478 24398 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:19:08.932601 24399 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:19:08.613688 26957 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:08.588411 26980 consensus_queue.cc:260] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:08.965112 26980 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:08.965682 26959 raft_consensus.cc:2749] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:08.966445 26354 tablet_bootstrap.cc:492] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:19:08.600878 26994 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:08.942734 26970 consensus_meta.cc:287] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.760s	user 0.012s	sys 0.001s
I20260709 12:19:08.968979 26994 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:08.969436 24365 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:08.969782 26970 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:08.971275 26994 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:08.972090 26994 raft_consensus.cc:2804] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:08.973148 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:08.974409 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:08.975205 26944 consensus_meta.cc:287] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.535s	user 0.015s	sys 0.000s
I20260709 12:19:08.975819 24322 raft_consensus.cc:1275] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:19:08.975989 26944 consensus_queue.cc:1059] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:08.977108 27006 consensus_queue.cc:1059] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:08.978960 26993 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:08.971431 24290 leader_election.cc:336] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.583s (SENT)
I20260709 12:19:08.995076 24290 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:08.982950 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 50423.8us
I20260709 12:19:08.997089 24366 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:08.972112 24365 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:08.672858 26926 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:08.972079 26970 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:08.900794 26937 consensus_meta.cc:287] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.797s	user 0.013s	sys 0.001s
W20260709 12:19:08.996206 24290 leader_election.cc:336] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.734s (SENT)
W20260709 12:19:08.812577 26947 consensus_meta.cc:287] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.621s	user 0.012s	sys 0.000s
W20260709 12:19:08.986708 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 492007us
W20260709 12:19:09.000398 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 62367.7us
I20260709 12:19:08.739720 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:08.665051 26976 consensus_queue.cc:1243] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer c711faa13ead43ebbea0192cb74a4756 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:19:08.855270 27005 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:19:08.957949 26943 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.251s	user 0.004s	sys 0.011s
I20260709 12:19:08.972491 26994 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:09.011672 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:09.014758 24290 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:09.022192 24324 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:08.868852 27001 raft_consensus.cc:2804] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:08.848181 27002 raft_consensus.cc:2749] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:08.997395 27003 raft_consensus.cc:2749] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:19:09.007287 26481 consensus_meta.cc:287] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.010s	user 0.009s	sys 0.005s
I20260709 12:19:08.673018 26990 consensus_queue.cc:1048] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.332s
I20260709 12:19:08.665534 26982 consensus_queue.cc:1059] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.344s
I20260709 12:19:09.027299 24366 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:08.746899 26753 consensus_queue.cc:1048] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.274s
I20260709 12:19:09.006367 27011 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:09.054311 24440 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:09.056043 24440 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:09.056861 27002 raft_consensus.cc:2804] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:09.057350 27002 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:09.057780 27002 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:09.027601 26943 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.379s	user 0.004s	sys 0.012s
I20260709 12:19:09.061056 27011 raft_consensus.cc:2749] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:19:09.066262 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 70076.5us
W20260709 12:19:09.067272 24290 leader_election.cc:336] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.778s (SENT)
I20260709 12:19:09.067754 24290 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:09.020267 26904 consensus_meta.cc:287] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.590s	user 0.013s	sys 0.000s
W20260709 12:19:09.031950 25082 leader_election.cc:336] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.781s (SENT)
I20260709 12:19:09.020560 26947 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:09.045073 26481 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:09.045426 26970 consensus_queue.cc:1048] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:08.868181 27012 consensus_queue.cc:1048] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.167s
I20260709 12:19:09.046404 27018 raft_consensus.cc:2749] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:19:09.076776 24290 leader_election.cc:336] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.883s (SENT)
I20260709 12:19:09.069252 24323 raft_consensus.cc:1240] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:09.077353 24290 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:09.070977 25082 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:09.028483 26994 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:09.072659 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 100681us
I20260709 12:19:09.032984 27001 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:09.035118 27006 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:19:09.119917 24290 leader_election.cc:336] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.919s (SENT)
I20260709 12:19:09.121678 24473 raft_consensus.cc:1240] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:08.604522 26988 consensus_queue.cc:260] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:09.122166 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:09.078639 24440 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:09.075186 26944 raft_consensus.cc:2804] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:19:09.116817 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 84906.6us
I20260709 12:19:09.078642 26924 raft_consensus.cc:2749] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:19:09.087888 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 55616.1us
I20260709 12:19:09.126399 24470 raft_consensus.cc:1275] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:09.026018 26945 consensus_queue.cc:237] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:09.071935 27008 consensus_queue.cc:1048] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.125s
I20260709 12:19:09.142439 27003 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.031001 27007 consensus_queue.cc:1048] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.109s
W20260709 12:19:09.086458 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 59253.6us
I20260709 12:19:09.150616 27003 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:09.151364 24366 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:09.096722 27005 raft_consensus.cc:2749] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:09.152570 27015 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:09.153045 27015 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:09.153479 27015 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:09.123335 26982 consensus_queue.cc:1059] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:19:09.144922 24473 raft_consensus.cc:1240] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:09.145944 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:09.086671 26990 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:09.155260 24366 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:09.146502 24290 leader_election.cc:336] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.731s (SENT)
I20260709 12:19:09.164276 24290 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:09.156811 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:09.157639 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:09.164706 24472 raft_consensus.cc:1240] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:19:09.164762 24366 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:09.157881 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:09.158866 27008 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:09.149784 26481 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:09.174829 27008 raft_consensus.cc:697] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:09.176093 27008 consensus_queue.cc:237] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:09.176748 26753 raft_consensus.cc:2749] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:09.177603 27005 raft_consensus.cc:2749] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:09.169459 24366 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:09.178716 27003 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:09.179371 27003 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:19:09.165279 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 89264.7us
I20260709 12:19:09.142526 27018 raft_consensus.cc:2749] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:19:09.167927 24290 leader_election.cc:336] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.906s (SENT)
I20260709 12:19:09.123965 27001 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:09.181038 24290 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:09.186817 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:09.191630 24398 raft_consensus.cc:2376] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5. Re-sending same reply.
I20260709 12:19:09.190711 25082 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:09.193532 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:09.194876 24473 raft_consensus.cc:2410] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 7 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:19:09.142453 26944 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:09.074776 26904 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:09.126646 26997 raft_consensus.cc:2749] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:19:09.181476 26966 consensus_meta.cc:287] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.932s	user 0.005s	sys 0.013s
I20260709 12:19:09.222138 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:09.239352 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 48770.4us
I20260709 12:19:09.274611 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:09.274763 25082 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:09.275279 24392 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:19:09.275995 25082 leader_election.cc:400] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5.
I20260709 12:19:09.276317 25082 leader_election.cc:403] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 12:19:09.242516 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 73602.1us
I20260709 12:19:09.142352 26965 consensus_queue.cc:1059] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
W20260709 12:19:09.220139 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 52225us
W20260709 12:19:09.283625 24290 leader_election.cc:336] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.983s (SENT)
I20260709 12:19:09.284296 24290 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:09.250545 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:09.249454 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:09.272069 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:09.286702 24394 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:09.274056 24397 raft_consensus.cc:2376] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5. Re-sending same reply.
I20260709 12:19:09.288733 24393 raft_consensus.cc:1275] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:09.169466 26957 raft_consensus.cc:2749] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:09.289923 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:09.290066 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:09.281605 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:09.312927 24398 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:09.313088 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:09.315223 24400 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:19:09.312569 24438 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:09.312605 24399 raft_consensus.cc:2376] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6. Re-sending same reply.
I20260709 12:19:09.316244 24391 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 1.
I20260709 12:19:09.188885 26990 raft_consensus.cc:697] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:09.242228 26924 raft_consensus.cc:2749] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:09.277694 26937 raft_consensus.cc:2804] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:19:09.331472 24440 connection.cc:256] RPC call timeout handler was delayed by -3.3503694090002227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
W20260709 12:19:09.316298 24290 leader_election.cc:336] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.002s (SENT)
W20260709 12:19:09.401255 24440 connection.cc:256] RPC call timeout handler was delayed by -3.254069409000067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16080000000000003s for a response
W20260709 12:19:09.401685 24440 connection.cc:256] RPC call timeout handler was delayed by -3.1982694090002042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.167s for a response
W20260709 12:19:09.401734 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 85483.9us
W20260709 12:19:09.402281 24440 connection.cc:256] RPC call timeout handler was delayed by -3.110969409000063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
W20260709 12:19:09.402596 24290 leader_election.cc:336] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.130s (SENT)
I20260709 12:19:09.243050 26944 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:09.403486 24473 raft_consensus.cc:1240] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:09.289848 27004 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.257905 26982 consensus_queue.cc:1059] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 12:19:09.404546 24290 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:09.404829 26982 consensus_queue.cc:1243] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer c711faa13ead43ebbea0192cb74a4756 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:19:09.404724 27004 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:09.405378 26982 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:09.405762 24290 leader_election.cc:336] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.171s (SENT)
I20260709 12:19:09.406176 24290 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:09.405933 26982 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:09.407218 27004 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:09.407972 26481 raft_consensus.cc:2749] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:19:09.390708 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 61655.6us
I20260709 12:19:09.196316 27015 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:09.408552 26924 raft_consensus.cc:2749] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:09.409355 26980 raft_consensus.cc:3055] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:09.409783 26980 raft_consensus.cc:740] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:09.276774 27006 consensus_queue.cc:1048] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:19:09.410671 26980 consensus_queue.cc:260] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:09.317945 27018 raft_consensus.cc:2749] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:09.335585 25116 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
W20260709 12:19:09.402815 24440 connection.cc:256] RPC call timeout handler was delayed by -3.0398694090001754s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
W20260709 12:19:09.413400 24440 connection.cc:256] RPC call timeout handler was delayed by -2.9831694090000838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
W20260709 12:19:09.413932 24440 connection.cc:256] RPC call timeout handler was delayed by -2.9687694090000605s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1925s for a response
W20260709 12:19:09.414206 24440 connection.cc:256] RPC call timeout handler was delayed by -2.9345694090002326s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
W20260709 12:19:09.414703 24440 connection.cc:256] RPC call timeout handler was delayed by -2.9336694090002311s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
W20260709 12:19:09.415307 24440 connection.cc:256] RPC call timeout handler was delayed by -2.8670694090001234s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
I20260709 12:19:09.415633 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:09.414146 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 101673us
I20260709 12:19:09.403314 26937 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:19:09.415725 24440 connection.cc:256] RPC call timeout handler was delayed by -2.6501694090002275s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2279s for a response
I20260709 12:19:09.333634 26938 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:09.384840 27008 raft_consensus.cc:2749] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:09.295996 26934 consensus_queue.cc:1048] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.101s
W20260709 12:19:09.418979 24440 connection.cc:256] RPC call timeout handler was delayed by -2.0048694090000936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29960000000000003s for a response
I20260709 12:19:09.377966 26993 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:09.416519 24473 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:19:09.422490 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:09.289149 26966 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:09.412077 26980 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:09.423784 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:09.377315 26997 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5.
I20260709 12:19:09.421572 25110 raft_consensus.cc:1275] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:09.427742 24438 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:09.411798 26944 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:09.428403 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 152526us
I20260709 12:19:09.421656 26938 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:09.437956 26938 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:09.438519 27014 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.439358 27014 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:09.400530 26947 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:09.441208 27016 log.cc:927] Time spent T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:19:09.432379 24440 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:09.422830 26937 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:09.448951 24465 raft_consensus.cc:1240] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:09.450064 26966 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:09.455307 26939 consensus_meta.cc:287] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 1.053s	user 0.012s	sys 0.000s
I20260709 12:19:09.455864 26939 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:09.428375 26934 consensus_queue.cc:1243] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer c855242ec9d34a5397741ef20db9de8a log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:19:09.465055 26947 raft_consensus.cc:2804] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:09.465770 26947 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:09.466295 26947 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:09.469957 24438 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:09.471638 24438 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:09.472659 26970 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:09.472925 26786 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:09.473140 26970 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:09.473587 26970 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:09.474022 27014 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:09.474355 26904 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:09.477387 26976 raft_consensus.cc:3055] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:09.477851 26976 raft_consensus.cc:740] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:09.478756 26976 consensus_queue.cc:260] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:09.479884 26976 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:09.480904 27008 raft_consensus.cc:2749] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:09.481786 27014 consensus_queue.cc:1048] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:19:09.437197 27017 log.cc:927] Time spent T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.313s	user 0.001s	sys 0.000s
W20260709 12:19:09.483273 27027 log.cc:927] Time spent T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 12:19:09.485481 27029 log.cc:927] Time spent T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:19:09.487955 26939 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:09.436817 26990 consensus_queue.cc:237] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:09.489032 26966 raft_consensus.cc:2764] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:19:09.490367 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 58099.4us
I20260709 12:19:09.423839 27005 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.425807 24398 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:19:09.481832 27008 consensus_queue.cc:1048] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:09.443149 25082 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:09.503991 24440 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:09.508431 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 65374us
W20260709 12:19:09.514015 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:09.514446 24323 raft_consensus.cc:1240] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:19:09.515220 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:09.518247 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:09.513922 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 105807us
I20260709 12:19:09.521976 24440 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:09.521551 24322 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:09.522977 24438 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:09.534122 24290 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:09.546412 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:09.542563 24440 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:12.302734 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 2.76003e+06us
I20260709 12:19:12.303733 24440 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:09.550217 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:12.307243 25115 raft_consensus.cc:2368] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 4. Current term is 5.
W20260709 12:19:12.307925 25115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 383) took 2791 ms (client timeout 2230 ms). Trace:
I20260709 12:19:09.550834 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:12.310113 25118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 384) took 2784 ms (client timeout 2159 ms). Trace:
W20260709 12:19:12.310640 25118 rpcz_store.cc:269] 0709 12:19:09.525558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:09.525703 (+   145us) service_pool.cc:224] Handling call
0709 12:19:12.310013 (+2784310us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:09.543893 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:12.312899 24472 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:09.544732 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 545) took 1489 ms. Trace:
I20260709 12:19:12.318945 24465 rpcz_store.cc:276] 0709 12:19:08.055625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:08.059039 (+  3414us) service_pool.cc:224] Handling call
0709 12:19:08.059356 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:09.449421 (+1390065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:09.544458 (+ 95037us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54001504d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:09.544669 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3195287424}
I20260709 12:19:09.549677 25114 raft_consensus.cc:1275] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEARNER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:19:12.322492 25114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48252 (request call id 385) took 2795 ms. Trace:
I20260709 12:19:12.322939 25114 rpcz_store.cc:276] 0709 12:19:09.526718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:09.529004 (+  2286us) service_pool.cc:224] Handling call
0709 12:19:09.549259 (+ 20255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:12.322067 (+2772808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:12.322386 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:09.545617 26938 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:09.542109 26944 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:09.555143 27004 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:12.328866 26991 raft_consensus.cc:2749] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:19:12.296454 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 2.76223e+06us
I20260709 12:19:12.329386 27004 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:12.330346 24290 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:12.331873 27004 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:09.538398 27001 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:12.333192 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:12.334187 24398 raft_consensus.cc:2410] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:19:12.334561 27001 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:09.516673 26904 raft_consensus.cc:2804] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:12.336249 26904 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:12.336408 24393 raft_consensus.cc:1240] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:19:12.336738 26904 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:12.340149 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:09.547434 26966 raft_consensus.cc:2804] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:12.341535 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:12.341936 26966 raft_consensus.cc:697] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:12.343374 24440 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:09.546674 27007 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:19:12.308436 25115 rpcz_store.cc:269] 0709 12:19:09.524886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:09.525095 (+   209us) service_pool.cc:224] Handling call
0709 12:19:12.307812 (+2782717us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:09.507022 27005 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:09.544967 27014 raft_consensus.cc:2749] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:12.347040 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:09.541230 27015 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:09.686233 27035 log.cc:927] Time spent T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260709 12:19:09.941028 24438 leader_election.cc:336] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.660s (SENT)
I20260709 12:19:12.349650 24438 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:12.350042 26904 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:12.350620 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 2.40945e+06us
W20260709 12:19:12.351976 24438 connection.cc:256] RPC call timeout handler was delayed by -1.3047720469999149s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
I20260709 12:19:12.352133 26904 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:10.659471 24254 debug-util.cc:398] Leaking SignalData structure 0x7b08002d3460 after lost signal to thread 23154
W20260709 12:19:11.132370 27024 log.cc:927] Time spent T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 1.747s	user 0.018s	sys 0.009s
W20260709 12:19:12.341975 24290 connection.cc:256] RPC call timeout handler was delayed by -3.048274881999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.202s for a response
W20260709 12:19:12.083873 24316 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 1630) took 4349 ms (client timeout 2155 ms). Trace:
W20260709 12:19:12.353039 24290 connection.cc:256] RPC call timeout handler was delayed by -3.0326350139998794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
I20260709 12:19:09.584386 26934 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.353119 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:12.353643 26934 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:12.356220 26934 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:12.281514 26956 raft_consensus.cc:3055] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:12.356822 26956 raft_consensus.cc:740] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:12.357633 26786 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:12.358079 24472 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:19:12.357750 26956 consensus_queue.cc:260] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:12.358642 24472 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 1763) took 2815 ms (client timeout 2210 ms). Trace:
I20260709 12:19:12.359231 26956 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:12.304843 26940 raft_consensus.cc:2749] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:12.360354 26940 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:09.516938 27002 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:12.557256 26983 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.557940 26983 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:12.558523 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:12.341042 24398 raft_consensus.cc:2393] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 6: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:12.560084 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:12.561193 24465 raft_consensus.cc:1240] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:12.561769 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:12.562635 24317 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:19:12.563639 26678 consensus_queue.cc:1059] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:12.563977 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:12.343227 26991 consensus_queue.cc:1048] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:12.565083 26898 raft_consensus.cc:3055] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:12.565490 26898 raft_consensus.cc:740] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:12.343570 26966 consensus_queue.cc:237] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:12.566391 26898 consensus_queue.cc:260] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:12.567979 26898 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:12.569005 26791 raft_consensus.cc:3055] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:12.569551 26791 raft_consensus.cc:740] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:09.549005 26970 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:12.573870 26970 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:12.344165 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:12.359037 24472 rpcz_store.cc:269] 0709 12:19:09.543387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:09.543572 (+   185us) service_pool.cc:224] Handling call
0709 12:19:12.358552 (+2814980us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:12.345001 27004 raft_consensus.cc:2804] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:12.576442 27004 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:12.576997 27004 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:12.347357 27005 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:12.353554 24290 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.692s (SENT) [suppressed 53 similar messages]
W20260709 12:19:12.587338 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 233797us
W20260709 12:19:12.588757 24290 connection.cc:256] RPC call timeout handler was delayed by -2.6549748820000332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2457s for a response
W20260709 12:19:12.589134 24290 connection.cc:256] RPC call timeout handler was delayed by -2.6301115329999902s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
W20260709 12:19:12.589483 24290 connection.cc:256] RPC call timeout handler was delayed by -2.5837613300000157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
W20260709 12:19:12.589814 24290 connection.cc:256] RPC call timeout handler was delayed by -2.545174882000083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2579s for a response
W20260709 12:19:12.590094 24290 connection.cc:256] RPC call timeout handler was delayed by -2.4460613300000205s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1835s for a response
W20260709 12:19:12.590373 24290 connection.cc:256] RPC call timeout handler was delayed by -2.386852140999963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2163s for a response
W20260709 12:19:12.590656 24290 connection.cc:256] RPC call timeout handler was delayed by -2.1514708830000018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2889s for a response
W20260709 12:19:12.284919 24289 connection.cc:256] RPC call timeout handler was delayed by -2.3172737949998918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
W20260709 12:19:12.352454 24438 connection.cc:256] RPC call timeout handler was delayed by -1.02667204699992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
W20260709 12:19:12.591138 24289 connection.cc:256] RPC call timeout handler was delayed by -2.0229737949998707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
W20260709 12:19:12.353312 24316 rpcz_store.cc:269] 0709 12:19:07.737496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.747559 (+ 10063us) service_pool.cc:224] Handling call
0709 12:19:12.083429 (+4335870us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b540025ab54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:12.083722 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1030718848}
I20260709 12:19:12.367928 26786 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:12.377868 26956 raft_consensus.cc:2749] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:12.592847 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:12.593144 24323 raft_consensus.cc:1240] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:12.378301 26918 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:09.576658 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:19:12.594573 25111 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 386) took 3064 ms (client timeout 1671 ms). Trace:
I20260709 12:19:12.361899 26989 raft_consensus.cc:3055] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:19:12.595011 25111 rpcz_store.cc:269] 0709 12:19:09.575791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:09.576112 (+   321us) service_pool.cc:224] Handling call
0709 12:19:12.594469 (+3018357us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:09.539204 26937 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:12.595507 26989 raft_consensus.cc:740] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:12.596855 26989 consensus_queue.cc:260] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:12.421347 25110 raft_consensus.cc:1240] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:12.598214 26989 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:12.599144 26969 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.599785 26969 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:12.327715 26938 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:12.600805 25110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48252 (request call id 382) took 3090 ms. Trace:
I20260709 12:19:12.601249 25110 rpcz_store.cc:276] 0709 12:19:09.510757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:09.513708 (+  2951us) service_pool.cc:224] Handling call
0709 12:19:09.552240 (+ 38532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:12.598623 (+3046383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:12.600502 (+  1879us) spinlock_profiling.cc:243] Waited 2.87 s on lock 0x7b5400630e54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:12.600738 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6596105472}
W20260709 12:19:12.428018 26994 consensus_meta.cc:287] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 3.282s	user 0.022s	sys 0.012s
I20260709 12:19:12.602814 26994 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:19:12.605736 26994 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:12.467442 24318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 1628) took 4736 ms (client timeout 1805 ms). Trace:
W20260709 12:19:12.606812 24318 rpcz_store.cc:269] 0709 12:19:07.730975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.731156 (+   181us) service_pool.cc:224] Handling call
0709 12:19:12.467170 (+4736014us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540019f354. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:12.467355 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2319476096}
W20260709 12:19:12.479031 24319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 1631) took 4740 ms (client timeout 1803 ms). Trace:
I20260709 12:19:12.484433 26962 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.456167 26955 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:12.490178 26959 raft_consensus.cc:3055] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:12.630494 26959 raft_consensus.cc:740] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:19:12.630731 24254 debug-util.cc:398] Leaking SignalData structure 0x7b08002c2bc0 after lost signal to thread 24257
I20260709 12:19:12.631371 26959 consensus_queue.cc:260] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:12.632088 24254 debug-util.cc:398] Leaking SignalData structure 0x7b08000675e0 after lost signal to thread 24349
I20260709 12:19:12.632284 26959 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:12.494731 26354 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 2.953s	user 0.011s	sys 0.039s
W20260709 12:19:12.632797 26354 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 3.092s	user 0.011s	sys 0.039s
I20260709 12:19:12.497184 26982 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:12.501418 26990 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.010s	user 0.021s	sys 0.060s
W20260709 12:19:12.633285 24254 debug-util.cc:398] Leaking SignalData structure 0x7b0800067480 after lost signal to thread 24424
I20260709 12:19:12.505239 24394 raft_consensus.cc:1240] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:19:12.633611 26990 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.142s	user 0.021s	sys 0.060s
I20260709 12:19:12.634315 24469 raft_consensus.cc:1240] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:12.635663 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1753) took 3492 ms. Trace:
I20260709 12:19:12.635963 24469 rpcz_store.cc:276] 0709 12:19:09.143638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:09.143806 (+   168us) service_pool.cc:224] Handling call
0709 12:19:09.170232 (+ 26426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:12.634628 (+3464396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:12.635475 (+   847us) spinlock_profiling.cc:243] Waited 3.46 s on lock 0x7b5400143cd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:12.635611 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7966147456}
W20260709 12:19:12.506359 24320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.940s	user 0.018s	sys 0.011s
I20260709 12:19:12.517450 24468 raft_consensus.cc:1275] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:19:12.519304 24466 raft_consensus.cc:1240] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:12.521216 26851 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:12.524554 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:12.638682 24474 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:12.529026 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:12.534864 25084 connection.cc:256] RPC call timeout handler was delayed by -3.0307562679997773s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22200000000000003s for a response
I20260709 12:19:12.539119 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:12.642853 24325 raft_consensus.cc:2393] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 5: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:12.541460 24399 raft_consensus.cc:1240] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:19:12.642853 26965 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:12.345376 24440 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:12.550338 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:12.686686 25113 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35188 (request call id 897) took 4002 ms (client timeout 1692 ms). Trace:
W20260709 12:19:12.686736 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 341421us
W20260709 12:19:12.687232 25113 rpcz_store.cc:269] 0709 12:19:08.683950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:08.688593 (+  4643us) service_pool.cc:224] Handling call
0709 12:19:12.550134 (+3861541us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b5800004598. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c3120a0 00007f4a9c311984 00007f4a9588c6d4 00007f4a9588c662
0709 12:19:12.686610 (+136476us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57577344}
I20260709 12:19:12.554256 26922 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.688315 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:12.688994 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:12.689473 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:12.689653 24469 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:19:12.560161 26983 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:12.562053 24291 connection.cc:256] RPC call timeout handler was delayed by -2.8131903250000505s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260709 12:19:12.690631 24291 connection.cc:256] RPC call timeout handler was delayed by -2.7789903249999952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
W20260709 12:19:12.690982 24291 connection.cc:256] RPC call timeout handler was delayed by -2.3550903249999919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2163s for a response
I20260709 12:19:12.692104 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:12.692847 24400 raft_consensus.cc:2393] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:12.597509 26937 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:12.407681 25082 connection.cc:256] RPC call timeout handler was delayed by -1.9744268889999148s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15600000000000003s for a response
W20260709 12:19:12.405194 26947 consensus_meta.cc:287] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 2.938s	user 0.027s	sys 0.013s
W20260709 12:19:12.696259 25082 connection.cc:256] RPC call timeout handler was delayed by -1.765018155000007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
I20260709 12:19:12.696468 26947 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:12.697273 25082 connection.cc:256] RPC call timeout handler was delayed by -1.7233268889999636s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1839s for a response
W20260709 12:19:12.697606 25082 connection.cc:256] RPC call timeout handler was delayed by -1.623426888999802s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.195s for a response
W20260709 12:19:12.697893 25082 connection.cc:256] RPC call timeout handler was delayed by -1.4947268889998213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2093s for a response
W20260709 12:19:12.698170 25082 connection.cc:256] RPC call timeout handler was delayed by -1.4785268890000225s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21110000000000004s for a response
W20260709 12:19:12.698444 25082 connection.cc:256] RPC call timeout handler was delayed by -1.3039268889999676s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23050000000000004s for a response
I20260709 12:19:12.698887 26947 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:12.608914 26962 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:12.608578 24319 rpcz_store.cc:269] 0709 12:19:07.738592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.738805 (+   213us) service_pool.cc:224] Handling call
0709 12:19:12.478788 (+4739983us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b54002139d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:12.478947 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1961915648}
I20260709 12:19:12.699913 24316 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:12.486318 26958 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:12.700361 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:12.701119 26958 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:12.702482 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:12.703452 24319 raft_consensus.cc:2410] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:19:12.703732 26958 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:12.613816 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:12.705186 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:12.617928 25116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35194 (request call id 400) took 4898 ms (client timeout 2191 ms). Trace:
I20260709 12:19:12.706084 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:12.706300 25116 rpcz_store.cc:269] 0709 12:19:07.720018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.727326 (+  7308us) service_pool.cc:224] Handling call
0709 12:19:09.122004 (+1394678us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b5800004598. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227eee 000000000036eb39 00007f4a9c29b1e0 00007f4a9c3640c4 00007f4a9c364131 00007f4a9c3120a0 00007f4a9c311984 00007f4a9588c6d4 00007f4a9588c662
0709 12:19:12.617717 (+3495713us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54004b4bd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:12.617833 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479887744}
W20260709 12:19:12.618896 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 57921.1us
I20260709 12:19:12.618345 26977 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.707496 24471 raft_consensus.cc:1240] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:12.707860 26977 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:12.710800 24316 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:12.710836 24465 raft_consensus.cc:1275] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:12.710866 27012 consensus_queue.cc:1048] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:12.712044 26977 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:12.620180 27005 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.712565 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:12.713452 24324 raft_consensus.cc:2393] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:12.712918 27005 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:12.712991 27012 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:12.714289 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:12.714596 24219 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35986 (request call id 181) took 18141 ms (client timeout 15000 ms). Trace:
I20260709 12:19:12.714772 27012 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:12.715768 27005 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:12.633591 24254 debug-util.cc:398] Leaking SignalData structure 0x7b0800067460 after lost signal to thread 24425
I20260709 12:19:12.644552 26965 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:12.717885 24254 debug-util.cc:398] Leaking SignalData structure 0x7b0800377ce0 after lost signal to thread 24498
I20260709 12:19:12.717787 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:12.718250 24254 debug-util.cc:398] Leaking SignalData structure 0x7b0800377d80 after lost signal to thread 24499
I20260709 12:19:12.719033 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:12.719616 24254 debug-util.cc:398] Leaking SignalData structure 0x7b080022ad20 after lost signal to thread 25143
I20260709 12:19:12.719828 24317 raft_consensus.cc:2410] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 7 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:19:12.721557 26965 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:12.724807 24254 debug-util.cc:398] Leaking SignalData structure 0x7b08003cff00 after lost signal to thread 26981
I20260709 12:19:12.647498 24395 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 5: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
W20260709 12:19:12.726980 24395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2229) took 3570 ms (client timeout 1660 ms). Trace:
W20260709 12:19:12.727356 24395 rpcz_store.cc:269] 0709 12:19:09.156368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:09.156513 (+   145us) service_pool.cc:224] Handling call
0709 12:19:12.726742 (+3570229us) spinlock_profiling.cc:243] Waited 3.48 s on lock 0x7b5400146754. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:12.726878 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8006112640}
I20260709 12:19:12.648645 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:12.649336 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:12.649468 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:12.651013 26938 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:19:12.651481 25084 connection.cc:256] RPC call timeout handler was delayed by -2.394828557999972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15600000000000003s for a response
W20260709 12:19:12.736958 25084 connection.cc:256] RPC call timeout handler was delayed by -1.0668856319998667s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3286s for a response
I20260709 12:19:12.651890 26918 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:12.653208 26904 consensus_queue.cc:1048] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:12.653813 26990 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.654247 26868 consensus_queue.cc:1059] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:12.654865 24470 raft_consensus.cc:1275] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:12.655455 26934 consensus_queue.cc:1059] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:12.660306 24398 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:19:12.662043 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:12.665252 26791 consensus_queue.cc:260] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:12.666111 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:12.667354 26969 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:12.672787 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 80982.6us
I20260709 12:19:12.675932 24322 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:12.677209 24391 raft_consensus.cc:1240] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:12.679042 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:12.681670 27002 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:12.683396 26988 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:12.688565 26922 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:12.701125 26962 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:12.609835 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:12.786597 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:12.787071 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:12.787757 24365 connection.cc:256] RPC call timeout handler was delayed by -1.8776892149999185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
W20260709 12:19:12.788532 24365 connection.cc:256] RPC call timeout handler was delayed by -1.5527295229999254s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
W20260709 12:19:12.789044 24365 connection.cc:256] RPC call timeout handler was delayed by -1.4673815649998687s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18810000000000002s for a response
W20260709 12:19:12.789535 24365 connection.cc:256] RPC call timeout handler was delayed by -1.3693202729998575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
W20260709 12:19:12.715004 24219 rpcz_store.cc:269] 0709 12:18:54.643607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:54.717757 (+ 74150us) service_pool.cc:224] Handling call
0709 12:19:12.714521 (+17996764us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:08.502750 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:08.559452 (+ 56702us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:08.559510 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:19:08.559529 (+    19us) tablet.cc:662] Decoding operations
0709 12:19:08.640830 (+ 81301us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:08.669494 (+ 28664us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:08.669546 (+    52us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:19:09.024652 (+355106us) tablet.cc:701] Row locks acquired
0709 12:19:09.024689 (+    37us) write_op.cc:260] PREPARE: finished
0709 12:19:09.024912 (+   223us) write_op.cc:270] Start()
0709 12:19:09.025094 (+   182us) write_op.cc:276] Timestamp: P: 1783599549024824 usec, L: 0
0709 12:19:09.025123 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:19:09.112523 (+ 87400us) log.cc:844] Serialized 4786 byte log entry
0709 12:19:09.603845 (+491322us) op_driver.cc:464] REPLICATION: finished
0709 12:19:09.687500 (+ 83655us) write_op.cc:301] APPLY: starting
0709 12:19:09.687634 (+   134us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:09.688531 (+   897us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:09.688747 (+   216us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:09.690678 (+  1931us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:09.690976 (+   298us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:19:09.691033 (+    57us) write_op.cc:312] APPLY: finished
0709 12:19:09.691723 (+   690us) log.cc:844] Serialized 89 byte log entry
0709 12:19:09.692922 (+  1199us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:09.693091 (+   169us) write_op.cc:454] Released schema lock
0709 12:19:09.693154 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:09.693597 (+   443us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:09.693631 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":68844,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":82076,"apply.run_cpu_time_us":4388,"apply.run_wall_time_us":6364,"num_ops":12,"prepare.queue_time_us":368167,"prepare.run_cpu_time_us":43678,"prepare.run_wall_time_us":865277,"raft.queue_time_us":156656,"raft.run_cpu_time_us":9050,"raft.run_wall_time_us":82312,"replication_time_us":578448,"spinlock_wait_cycles":903552,"thread_start_us":596371,"threads_started":4,"wal-append.queue_time_us":316752,"wal-append.run_cpu_time_us":14415,"wal-append.run_wall_time_us":1258044}]]}
I20260709 12:19:12.706938 24318 raft_consensus.cc:2393] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 4: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:12.611939 27001 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.620963 27015 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:12.620299 24321 raft_consensus.cc:1240] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:19:12.689013 24468 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:12.708974 26967 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:12.709100 26993 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:12.709591 26982 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:12.709844 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:12.804158 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:12.805040 24469 raft_consensus.cc:2393] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 6: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:12.730266 25115 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
W20260709 12:19:12.730433 24290 connection.cc:256] RPC call timeout handler was delayed by -1.7000748820000808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3518s for a response
W20260709 12:19:12.805838 24290 connection.cc:256] RPC call timeout handler was delayed by -1.640704530999983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3155s for a response
I20260709 12:19:12.732718 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:12.729735 26902 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.729839 25111 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:12.733708 26786 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.797502 26965 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.728530 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:12.749517 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:12.818064 24395 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:19:12.818122 24322 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:12.818935 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:12.646126 26354 tablet_bootstrap.cc:492] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260709 12:19:12.755463 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:12.758282 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 44867.8us
I20260709 12:19:12.761675 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:12.766490 24474 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
W20260709 12:19:12.821888 24366 connection.cc:256] RPC call timeout handler was delayed by -3.0534572499998376s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2155s for a response
I20260709 12:19:12.768239 24324 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6.
W20260709 12:19:12.762503 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 66711.5us
W20260709 12:19:12.773378 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 97748.1us
I20260709 12:19:12.775030 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:12.823230 24398 raft_consensus.cc:2410] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:12.777100 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:12.779366 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:12.823869 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:12.773449 26931 consensus_queue.cc:1059] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
W20260709 12:19:12.777207 24438 leader_election.cc:336] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.299s (SENT)
I20260709 12:19:12.783434 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:12.776022 24323 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:19:12.784473 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:12.826263 24471 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:12.785151 26791 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:12.733857 26956 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.794703 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:12.834822 24473 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:12.802699 24321 raft_consensus.cc:1240] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:12.785552 24220 catalog_manager.cc:5697] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 4 to 5, leader changed from <none> to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 5 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:19:12.704464 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:12.836203 25115 raft_consensus.cc:1240] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:12.836881 24319 raft_consensus.cc:2393] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:12.807667 26993 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:12.806185 24290 connection.cc:256] RPC call timeout handler was delayed by -1.4420723360001375s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21440000000000003s for a response
I20260709 12:19:12.836931 26965 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:12.841594 26993 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:12.841965 26965 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:12.842469 26922 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:12.843159 24324 raft_consensus.cc:1240] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 12:19:12.808024 24465 raft_consensus.cc:2393] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 6: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:12.844595 24324 raft_consensus.cc:1240] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:19:12.845449 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:12.846024 26904 raft_consensus.cc:3055] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:12.846427 26904 raft_consensus.cc:740] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:12.847904 24322 raft_consensus.cc:1240] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
W20260709 12:19:12.844458 24290 leader_election.cc:336] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.751s (SENT)
I20260709 12:19:12.849938 24290 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:12.851176 24290 leader_election.cc:336] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.020s (SENT)
I20260709 12:19:12.839911 24319 raft_consensus.cc:1275] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:19:12.807936 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 104388us
I20260709 12:19:12.788306 27008 raft_consensus.cc:2749] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:12.855226 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:12.855923 24474 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:19:12.801936 27001 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:12.858727 27001 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:12.859297 26956 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:12.861579 26354 tablet_bootstrap.cc:492] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:19:12.861672 26956 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:12.862672 26354 ts_tablet_manager.cc:1403] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 3.897s	user 0.035s	sys 0.049s
I20260709 12:19:12.793133 26969 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.812259 24318 raft_consensus.cc:1240] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:12.734740 24320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1640) took 3241 ms. Trace:
I20260709 12:19:12.762663 26938 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:12.773218 26918 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:12.820564 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:12.822376 24366 connection.cc:256] RPC call timeout handler was delayed by -3.0210572499997852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2191s for a response
I20260709 12:19:12.824205 24470 raft_consensus.cc:2393] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:12.826532 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:12.826678 24469 raft_consensus.cc:1240] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260709 12:19:12.827919 24317 raft_consensus.cc:2410] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:19:12.829021 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:12.830214 24400 raft_consensus.cc:1240] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:12.876572 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:12.830461 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:12.782879 26990 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:12.831254 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:12.878618 24366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:12.878801 24396 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:12.830658 26949 consensus_queue.cc:1048] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
W20260709 12:19:12.835376 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 58185.2us
I20260709 12:19:12.820457 26678 consensus_queue.cc:1059] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:19:12.817276 26902 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:12.907648 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 72206.1us
I20260709 12:19:12.864467 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:12.865837 25082 leader_election.cc:336] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.665s (SENT)
W20260709 12:19:12.910823 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 45040us
W20260709 12:19:12.911440 25082 leader_election.cc:336] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.839s (SENT)
I20260709 12:19:12.911818 25082 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:12.867317 24290 leader_election.cc:336] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.457s (SENT)
I20260709 12:19:12.816970 27012 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:12.863644 24320 rpcz_store.cc:276] 0709 12:19:09.493319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:09.493518 (+   199us) service_pool.cc:224] Handling call
0709 12:19:09.513576 (+ 20058us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:09.513804 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:19:09.531879 (+ 18075us) log.cc:844] Serialized 14 byte log entry
0709 12:19:12.734387 (+3202508us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:12.734445 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:12.734498 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:12.734565 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:12.734680 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97352,"prepare.queue_time_us":21794,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":98216,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":3104643,"threads_started":1,"wal-append.queue_time_us":2974599}
I20260709 12:19:12.914893 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:12.871049 24289 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:12.877163 24474 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:19:12.916517 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:12.879354 24366 connection.cc:256] RPC call timeout handler was delayed by -2.1707393599999705s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
W20260709 12:19:12.917527 24366 connection.cc:256] RPC call timeout handler was delayed by -1.8396215509997091s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
I20260709 12:19:12.808094 27015 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:12.835035 26962 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.862608 24325 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:19:12.882403 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:12.880793 24220 catalog_manager.cc:5697] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 3 to 4, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 4 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:12.888711 24321 raft_consensus.cc:1240] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:19:12.889307 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:12.920256 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:12.890672 24319 raft_consensus.cc:1240] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:12.894212 25113 raft_consensus.cc:1240] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:12.894994 26938 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:12.895097 24473 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
W20260709 12:19:12.893232 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 115787us
I20260709 12:19:12.925896 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:12.926532 26926 consensus_queue.cc:1048] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:12.927125 26868 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:12.808872 26982 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:12.809705 24466 raft_consensus.cc:1240] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:19:12.881767 26965 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.864401 26986 raft_consensus.cc:2749] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:12.820799 26786 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:12.912613 24290 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:12.912910 24438 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:12.913466 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:12.914085 24440 connection.cc:256] RPC call timeout handler was delayed by -2.3529547180000918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
W20260709 12:19:12.943349 24440 connection.cc:256] RPC call timeout handler was delayed by -2.2440547179999157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
W20260709 12:19:12.943943 24440 connection.cc:256] RPC call timeout handler was delayed by -2.2017547180000747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260709 12:19:12.944373 24440 connection.cc:256] RPC call timeout handler was delayed by -2.2017547180000747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260709 12:19:12.944774 24440 connection.cc:256] RPC call timeout handler was delayed by -2.0226547180000125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
W20260709 12:19:12.945175 24440 connection.cc:256] RPC call timeout handler was delayed by -1.858854717999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
W20260709 12:19:12.945559 24440 connection.cc:256] RPC call timeout handler was delayed by -1.8318547179999314s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2082s for a response
W20260709 12:19:12.945935 24440 connection.cc:256] RPC call timeout handler was delayed by -1.7787547180000729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
W20260709 12:19:12.946328 24440 connection.cc:256] RPC call timeout handler was delayed by -1.7625547180000467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21589999999999998s for a response
W20260709 12:19:12.946705 24440 connection.cc:256] RPC call timeout handler was delayed by -1.7625547180000467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21589999999999998s for a response
W20260709 12:19:12.947096 24440 connection.cc:256] RPC call timeout handler was delayed by -1.6986547179999434s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.223s for a response
I20260709 12:19:12.947983 24440 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:12.951598 24220 catalog_manager.cc:5697] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 4 to 5, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 5 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:12.915478 24318 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:12.917860 24366 connection.cc:256] RPC call timeout handler was delayed by -1.7271215509997546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
I20260709 12:19:12.939554 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:12.954809 24366 connection.cc:256] RPC call timeout handler was delayed by -1.483221550999815s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2014s for a response
I20260709 12:19:12.917848 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:12.955197 24321 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:12.875198 26969 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:12.915282 24365 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:12.921307 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:12.955212 24366 connection.cc:256] RPC call timeout handler was delayed by -1.483221550999815s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2014s for a response
W20260709 12:19:12.957137 24366 connection.cc:256] RPC call timeout handler was delayed by -1.3482215509998241s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21640000000000004s for a response
W20260709 12:19:12.957552 24366 connection.cc:256] RPC call timeout handler was delayed by -1.3068215509997572s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
I20260709 12:19:12.958483 24365 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:12.922676 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:12.959475 24322 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:12.923309 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 52341.7us
I20260709 12:19:12.929646 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:12.804272 26967 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:12.925881 25082 leader_election.cc:336] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.950s (SENT)
W20260709 12:19:12.961678 25082 leader_election.cc:336] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.093s (SENT)
I20260709 12:19:12.932849 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:12.934597 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:12.962039 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:12.962934 24473 raft_consensus.cc:2393] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 4: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:12.935882 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:12.963987 24474 raft_consensus.cc:2393] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:12.902408 27001 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.929754 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:12.970013 24469 raft_consensus.cc:2393] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 6: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:12.969914 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:12.932344 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:12.971122 24319 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:19:12.876420 26955 consensus_queue.cc:1059] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:19:12.852669 27005 consensus_queue.cc:1059] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:19:12.928366 26956 raft_consensus.cc:2804] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:12.986076 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:12.962085 25082 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:12.965660 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:12.916150 26966 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:12.967986 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 100696us
I20260709 12:19:12.972738 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:12.991496 24472 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:19:12.992826 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:12.994103 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:12.973279 24466 raft_consensus.cc:2393] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:12.996040 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:12.973891 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:12.998121 24392 raft_consensus.cc:2410] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:12.967653 25083 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:12.957001 24470 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:12.975651 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:13.000609 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:13.002480 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:13.004026 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:12.979269 24465 raft_consensus.cc:1240] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:12.979728 24440 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:12.963783 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:13.005618 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:13.005851 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:12.914739 27006 consensus_queue.cc:1059] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:19:12.973661 24220 catalog_manager.cc:5697] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:19:13.006337 24466 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:19:13.010641 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:13.012385 26786 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:12.920691 27008 consensus_queue.cc:1059] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:19:13.012795 27002 raft_consensus.cc:2749] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:12.986809 24468 raft_consensus.cc:2376] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4. Re-sending same reply.
I20260709 12:19:12.900502 27004 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:12.990738 24290 leader_election.cc:336] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.889s (SENT)
I20260709 12:19:13.023723 24322 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6.
I20260709 12:19:13.024008 24290 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:13.024538 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 111715us
W20260709 12:19:13.025177 24290 leader_election.cc:336] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 3.155s (SENT)
I20260709 12:19:13.025452 24366 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:13.025607 24290 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:13.015475 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:13.028046 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:13.031068 24399 raft_consensus.cc:1275] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:13.016417 24473 raft_consensus.cc:2393] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 5: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:13.016304 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:13.036331 24323 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
W20260709 12:19:13.013782 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:13.038023 24365 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:13.017280 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:13.018293 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 56653.6us
W20260709 12:19:13.038962 25082 leader_election.cc:336] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.111s (SENT)
I20260709 12:19:12.979660 27012 raft_consensus.cc:2804] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:13.022802 24469 raft_consensus.cc:1240] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 4. Current term is 5. Ops: []
W20260709 12:19:13.059449 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:13.022663 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:13.022908 24393 pending_rounds.cc:85] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a: Aborting all ops after (but not including) 4
I20260709 12:19:13.060708 24393 pending_rounds.cc:107] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:19:13.061048 24393 raft_consensus.cc:2889] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:13.039449 25082 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:13.019500 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:12.977327 26916 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:13.040199 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:13.040367 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 72826.5us
I20260709 12:19:13.039307 25118 raft_consensus.cc:2393] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:13.041899 24366 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:12.975989 26753 raft_consensus.cc:2804] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:19:13.040218 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 60595.9us
I20260709 12:19:12.986552 26956 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:12.933938 26962 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:13.067873 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:13.118767 24465 raft_consensus.cc:1240] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:19:13.120869 26926 raft_consensus.cc:2804] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:13.121483 26926 raft_consensus.cc:697] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:12.975109 27062 consensus_queue.cc:1048] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:19:12.959443 26965 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:13.122699 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 83752us
I20260709 12:19:13.129714 24440 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:13.130270 25082 leader_election.cc:336] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.305s (SENT)
I20260709 12:19:13.066309 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:13.131048 25115 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:19:13.131372 25082 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:12.915673 26904 consensus_queue.cc:260] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:13.027729 26678 raft_consensus.cc:2749] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:13.123193 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:13.134500 24473 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:19:13.014218 26970 raft_consensus.cc:2749] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:13.032617 26786 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:13.040870 26937 raft_consensus.cc:3055] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:13.065649 26993 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:19:13.180933 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:12.987267 26958 consensus_queue.cc:1059] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.143s
W20260709 12:19:13.192250 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 60956.7us
I20260709 12:19:13.186065 25084 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:12.978623 27001 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:13.213559 24394 raft_consensus.cc:1275] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:13.056519 27003 raft_consensus.cc:3055] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:13.189590 24317 raft_consensus.cc:1275] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:19:13.175864 24220 catalog_manager.cc:5697] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:13.215226 24220 catalog_manager.cc:5697] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 3 to 6, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 6 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:13.216430 24470 raft_consensus.cc:2410] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 7 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:19:13.067932 27008 raft_consensus.cc:2749] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:13.124667 26956 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:13.117201 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:13.151904 26753 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:13.136919 26696 raft_consensus.cc:2749] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:13.019949 26966 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:13.175797 26938 raft_consensus.cc:2749] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:13.234874 24220 catalog_manager.cc:5697] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 1 to 3, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 3 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:13.116441 26991 consensus_queue.cc:1059] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.104s
I20260709 12:19:13.154646 27066 raft_consensus.cc:2804] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:19:13.251685 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 122054us
W20260709 12:19:13.249573 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 55109.4us
I20260709 12:19:13.155690 27002 consensus_queue.cc:1059] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 12:19:13.187467 26937 raft_consensus.cc:740] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:13.213807 26931 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:13.192183 26993 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:13.311789 24440 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:13.312208 25084 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:13.222136 26992 raft_consensus.cc:2804] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:13.180593 27012 raft_consensus.cc:697] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:19:13.502456 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 190307us
I20260709 12:19:13.218931 27003 raft_consensus.cc:740] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:13.249284 26947 raft_consensus.cc:2749] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:13.311589 26753 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:13.311754 27066 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:13.310726 26918 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:13.499912 26992 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:13.507982 26980 consensus_meta.cc:287] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 4.016s	user 0.032s	sys 0.007s
I20260709 12:19:13.352741 26982 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:13.342810 26990 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:13.221493 26926 consensus_queue.cc:237] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:13.379420 24396 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
W20260709 12:19:13.382931 24471 consensus_meta.cc:287] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.000s
W20260709 12:19:13.392926 24467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.016s	sys 0.015s
W20260709 12:19:13.518882 24467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.016s	sys 0.015s
I20260709 12:19:13.519086 24471 raft_consensus.cc:2410] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:19:13.393556 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 235624us
W20260709 12:19:13.379297 26959 consensus_meta.cc:287] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.709s	user 0.008s	sys 0.002s
I20260709 12:19:13.360925 27015 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:13.377952 27059 raft_consensus.cc:3055] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:13.487890 24220 catalog_manager.cc:5697] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:13.488476 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 446385us
I20260709 12:19:13.224257 27005 raft_consensus.cc:2804] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:19:13.500991 24290 leader_election.cc:336] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 3.897s (SENT)
I20260709 12:19:13.258587 26922 consensus_queue.cc:1048] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:19:13.511242 26992 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:13.514256 26994 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.520067 24391 raft_consensus.cc:1240] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:13.523025 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:13.499912 26993 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:13.555387 24366 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:13.567517 24290 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:13.572856 24220 catalog_manager.cc:5697] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:19:13.518723 26965 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:13.514259 27060 raft_consensus.cc:2804] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:13.512663 27066 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:13.599640 27061 log.cc:927] Time spent T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.267s	user 0.001s	sys 0.001s
I20260709 12:19:13.565335 26962 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:13.600008 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 44771us
I20260709 12:19:13.603293 24366 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:13.553015 27059 raft_consensus.cc:740] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:13.575426 27005 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:13.600793 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 99898.2us
W20260709 12:19:13.608852 24321 consensus_meta.cc:287] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.653s	user 0.005s	sys 0.005s
I20260709 12:19:13.617007 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:13.617264 24321 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:19:13.617945 24396 raft_consensus.cc:2410] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:19:13.598265 24220 catalog_manager.cc:5697] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 3 to 5, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 5 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:13.611563 24318 consensus_meta.cc:287] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.638s	user 0.010s	sys 0.000s
I20260709 12:19:13.618990 24318 raft_consensus.cc:2410] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:19:13.571477 26902 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:13.634768 24366 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:19:13.636195 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:13.604197 26988 consensus_meta.cc:287] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.818s	user 0.010s	sys 0.001s
W20260709 12:19:13.607074 26989 consensus_meta.cc:287] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 1.008s	user 0.011s	sys 0.003s
I20260709 12:19:13.649552 24220 catalog_manager.cc:5697] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 6 to 7, leader changed from d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 7 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:19:13.696276 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:13.697185 24398 raft_consensus.cc:2410] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:19:13.698132 24395 raft_consensus.cc:1240] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 2. Current term is 3. Ops: []
W20260709 12:19:13.697171 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 385450us
I20260709 12:19:13.652529 26947 raft_consensus.cc:2749] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:13.653930 26902 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.703239 24220 catalog_manager.cc:5697] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 2 to 3, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 3 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:13.705762 24220 catalog_manager.cc:5697] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 1 to 2, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:19:13.598858 27060 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:13.694252 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 59632.2us
I20260709 12:19:13.616005 26982 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:13.699187 24440 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:13.695163 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 86265.3us
W20260709 12:19:13.751901 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 52874.3us
I20260709 12:19:13.607602 26966 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:13.602722 27003 consensus_queue.cc:260] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:13.606374 26965 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:13.699996 24397 raft_consensus.cc:2410] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:19:13.633193 27005 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:13.632807 26990 raft_consensus.cc:3055] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:13.607810 27076 raft_consensus.cc:2749] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:13.707772 24220 catalog_manager.cc:5697] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 2 to 3, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 3 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:13.742048 24366 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:13.655805 26962 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:13.597718 26994 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:13.740790 27060 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:13.813365 26989 raft_consensus.cc:2804] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:13.813997 26989 raft_consensus.cc:697] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:13.753825 24440 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:13.814863 24392 raft_consensus.cc:2410] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 7 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
W20260709 12:19:13.815528 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 62921.7us
I20260709 12:19:13.816231 24440 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:13.818027 26970 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:13.818667 26970 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:13.819128 26970 raft_consensus.cc:697] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:13.819849 24440 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:13.703740 26959 raft_consensus.cc:2749] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:19:13.780730 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 260534us
I20260709 12:19:13.698971 27004 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:13.803380 24316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44278 (request call id 2109) took 1109 ms. Trace:
W20260709 12:19:13.803344 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 51045.6us
W20260709 12:19:13.807696 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 65749.2us
W20260709 12:19:13.779980 27068 log.cc:927] Time spent T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 12:19:13.739305 27012 consensus_queue.cc:237] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:19:13.810913 24220 catalog_manager.cc:5697] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 2 to 3, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 3 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:13.756258 26354 raft_consensus.cc:359] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 NON_PARTICIPANT]: Replica starting. Triggering 2 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:13.742374 26902 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:13.803157 26990 raft_consensus.cc:740] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:13.820036 26970 consensus_queue.cc:237] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:13.830552 26966 consensus_queue.cc:1059] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:19:13.827389 26947 consensus_queue.cc:1059] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:19:13.871591 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:13.802654 26945 raft_consensus.cc:2749] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:13.821568 24316 rpcz_store.cc:276] 0709 12:19:12.694231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.832453 (+138222us) service_pool.cc:224] Handling call
0709 12:19:12.832864 (+   411us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:12.833276 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:12.833309 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:12.833966 (+   657us) log.cc:844] Serialized 52 byte log entry
0709 12:19:12.977547 (+143581us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:12.977588 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:12.977680 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:13.803001 (+825321us) raft_consensus.cc:1685] finished
0709 12:19:13.803027 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:13.803306 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66,"raft.queue_time_us":1087,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":16038,"thread_start_us":143142,"threads_started":1,"wal-append.queue_time_us":380112}
I20260709 12:19:13.779330 27015 consensus_queue.cc:1059] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:19:13.853920 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:13.879640 24318 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:19:13.854681 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:13.855360 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:13.881433 24323 raft_consensus.cc:2393] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:13.883119 26354 raft_consensus.cc:740] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:19:13.855901 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:13.856146 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:13.824615 26963 raft_consensus.cc:3055] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:13.800674 26944 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.886591 26963 raft_consensus.cc:740] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:13.886780 26944 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:13.872530 24325 raft_consensus.cc:2393] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:13.887595 26963 consensus_queue.cc:260] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:13.888744 26963 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:13.873605 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:13.878212 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:13.883981 26354 consensus_queue.cc:260] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:19:13.896344 26354 ts_tablet_manager.cc:1434] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 1.033s	user 0.010s	sys 0.000s
I20260709 12:19:13.899686 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:13.900988 25082 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:13.904106 25082 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:13.827520 27014 consensus_queue.cc:1059] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:19:13.906605 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:13.848492 27067 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.831431 27008 consensus_queue.cc:1059] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
W20260709 12:19:13.912420 25111 consensus_meta.cc:287] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 1.078s	user 0.012s	sys 0.000s
I20260709 12:19:13.903288 27004 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:13.821079 26962 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:13.929039 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 107890us
I20260709 12:19:13.871201 26980 consensus_queue.cc:1048] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:19:13.913277 27080 raft_consensus.cc:2749] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:13.814863 26989 consensus_queue.cc:237] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:13.906839 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:19:13.901467 26354 ts_tablet_manager.cc:1467] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281: Tablet startup took 1038ms
W20260709 12:19:13.936668 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 78873us
I20260709 12:19:13.924294 27079 raft_consensus.cc:2749] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:13.941289 24438 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:13.922667 27004 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:13.860674 27086 consensus_queue.cc:1059] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 12:19:13.948607 27004 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:13.948967 26977 raft_consensus.cc:3055] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:13.949414 26977 raft_consensus.cc:740] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:13.949959 26962 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:13.950268 26977 consensus_queue.cc:260] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:13.951843 26977 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:13.923785 25111 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:13.953032 25111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35194 (request call id 410) took 1304 ms. Trace:
I20260709 12:19:13.953440 25111 rpcz_store.cc:276] 0709 12:19:12.648486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.649037 (+   551us) service_pool.cc:224] Handling call
0709 12:19:13.952935 (+1303898us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:13.954643 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:13.955801 27065 log.cc:927] Time spent T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.582s	user 0.001s	sys 0.000s
I20260709 12:19:13.956068 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:13.960062 26956 consensus_meta.cc:287] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.710s	user 0.008s	sys 0.000s
I20260709 12:19:13.960664 26902 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:13.962085 26986 raft_consensus.cc:3055] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:13.962529 26986 raft_consensus.cc:740] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:13.963521 26986 consensus_queue.cc:260] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:13.963760 27004 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:13.966341 26967 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:13.948725 27086 raft_consensus.cc:3055] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:13.955718 25113 raft_consensus.cc:1240] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 12:19:13.935738 26947 raft_consensus.cc:3055] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:13.934360 26966 raft_consensus.cc:3055] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:13.945585 25082 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:13.974659 25111 raft_consensus.cc:2393] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 4: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:13.975646 27004 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:13.939898 27014 raft_consensus.cc:3055] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:13.934360 27082 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
W20260709 12:19:14.000962 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 55439.8us
I20260709 12:19:13.912743 27088 consensus_queue.cc:1059] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:19:13.999456 24438 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:13.999925 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 54995.1us
I20260709 12:19:13.919528 27067 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:13.935981 27062 consensus_queue.cc:1048] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:19:13.972559 27086 raft_consensus.cc:740] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:13.964618 26986 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:14.014878 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:13.979933 27008 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:14.004485 27082 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:14.008663 27086 consensus_queue.cc:260] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:14.036739 27086 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:13.979803 26947 raft_consensus.cc:740] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:13.979586 26966 raft_consensus.cc:740] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:14.033592 24394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 410) took 1059 ms. Trace:
I20260709 12:19:13.960546 26956 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:14.047346 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 43909.6us
W20260709 12:19:14.045115 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 64597.5us
I20260709 12:19:14.039659 24394 rpcz_store.cc:276] 0709 12:19:12.974653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.974823 (+   170us) service_pool.cc:224] Handling call
0709 12:19:12.986163 (+ 11340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:13.213998 (+227835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:14.033236 (+819238us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54001b9c54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:14.033499 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522137344}
I20260709 12:19:14.051641 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:14.052671 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:14.052809 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:14.053275 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:14.052923 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:14.058107 24317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44278 (request call id 2121) took 1166 ms. Trace:
W20260709 12:19:14.058813 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 239004us
I20260709 12:19:14.060267 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:14.058712 24317 rpcz_store.cc:276] 0709 12:19:12.891996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.926986 (+ 34990us) service_pool.cc:224] Handling call
0709 12:19:12.927266 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:13.214247 (+286981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:14.057737 (+843490us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54002148d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:14.057989 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":602470272}
I20260709 12:19:14.060961 24398 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:19:14.061959 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:14.064646 27069 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:14.065254 27069 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:13.999655 27014 raft_consensus.cc:740] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:14.070662 24399 raft_consensus.cc:1275] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:19:14.067684 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:14.068463 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:14.072880 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:14.059751 24440 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:14.073904 24398 raft_consensus.cc:2410] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:19:14.078253 24320 raft_consensus.cc:1240] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:14.038561 27008 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:14.057749 27088 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:14.060842 26994 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:14.022542 26993 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:14.046667 26992 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:14.109163 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:14.060987 26922 consensus_queue.cc:1059] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:19:14.083181 27008 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:14.116180 27069 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:14.116338 26945 raft_consensus.cc:2749] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:14.137220 24395 raft_consensus.cc:1240] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:14.118834 26992 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:14.141350 27092 raft_consensus.cc:2749] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:14.113559 26994 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:14.107574 26966 consensus_queue.cc:260] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:14.110173 26947 consensus_queue.cc:260] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:14.145478 25116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 412) took 1435 ms. Trace:
I20260709 12:19:14.142319 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:14.130580 26791 consensus_meta.cc:287] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 1.275s	user 0.014s	sys 0.000s
I20260709 12:19:14.332645 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:14.338014 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:14.260923 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 201243us
W20260709 12:19:14.358530 24290 leader_election.cc:336] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.517s (SENT)
I20260709 12:19:14.393059 24290 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:14.398818 24440 leader_election.cc:400] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 4. Current term is 5.
I20260709 12:19:14.399338 24440 leader_election.cc:403] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:19:14.400688 24398 raft_consensus.cc:1240] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:19:14.296440 25116 rpcz_store.cc:276] 0709 12:19:12.710525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.721064 (+ 10539us) service_pool.cc:224] Handling call
0709 12:19:12.721740 (+   676us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:12.878314 (+156574us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:19:12.912912 (+ 34598us) log.cc:844] Serialized 14 byte log entry
0709 12:19:13.193954 (+281042us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:13.194021 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:13.194090 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:13.955100 (+761010us) spinlock_profiling.cc:243] Waited 5.27 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:19:14.145123 (+190023us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400514ad4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:14.145189 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:14.145389 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10149,"prepare.queue_time_us":36235,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":45506,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":60801,"spinlock_wait_cycles":371659520,"thread_start_us":274731,"threads_started":1,"wal-append.queue_time_us":424308}
I20260709 12:19:14.200079 26980 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:19:14.349943 26753 consensus_meta.cc:287] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.816s	user 0.011s	sys 0.002s
I20260709 12:19:14.148013 27003 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:14.298966 26969 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:14.199755 27098 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:14.206715 26965 raft_consensus.cc:2749] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:14.279456 25112 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6.
I20260709 12:19:14.265657 27088 raft_consensus.cc:697] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
W20260709 12:19:13.944554 26354 ts_tablet_manager.cc:1469] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281: Trace:
0709 12:18:57.693426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:57.702564 (+  9138us) service_pool.cc:224] Handling call
0709 12:18:57.789228 (+ 86664us) ts_tablet_manager.cc:934] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
0709 12:19:00.485058 (+2695830us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:19:02.086392 (+1601334us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:02.095453 (+  9061us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:19:04.022105 (+1926652us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:19:04.053623 (+ 31518us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:04.134176 (+ 80553us) ts_tablet_manager.cc:989] Replica registered.
0709 12:19:04.134384 (+   208us) inbound_call.cc:177] Queueing success response
0709 12:19:08.965988 (+4831604us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:19:12.863186 (+3897198us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:19:13.324647 (+461461us) tablet_replica.cc:261] Starting instrumentation
0709 12:19:13.485564 (+160917us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":41571,"mutex_wait_us":17843,"raft.queue_time_us":118,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"tablet-copy.queue_time_us":13597,"tablet-download-pool.queue_time_us":295,"tablet-download-pool.run_cpu_time_us":2190,"tablet-download-pool.run_wall_time_us":3290650,"thread_start_us":89525,"threads_started":1}
I20260709 12:19:14.279978 27005 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:14.416996 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:14.404572 26983 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:14.403102 26959 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:14.404825 26966 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:14.421921 24440 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:14.339984 26994 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:14.407341 25114 raft_consensus.cc:1240] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4. Ops: []
W20260709 12:19:14.423575 27060 consensus_meta.cc:287] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.610s	user 0.012s	sys 0.000s
I20260709 12:19:14.435916 26994 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:14.436395 27076 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:14.438238 27076 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:14.438865 24467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1765) took 1647 ms. Trace:
I20260709 12:19:14.439266 24467 rpcz_store.cc:276] 0709 12:19:12.791954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.792207 (+   253us) service_pool.cc:224] Handling call
0709 12:19:12.800325 (+  8118us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:12.800849 (+   524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:12.800889 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:12.816403 (+ 15514us) log.cc:844] Serialized 52 byte log entry
0709 12:19:13.519290 (+702887us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:13.519331 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:13.519391 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:13.944980 (+425589us) raft_consensus.cc:1685] finished
0709 12:19:13.945001 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:14.438605 (+493604us) spinlock_profiling.cc:243] Waited 7.63 ms on lock 0x7b5400315e50. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:14.438801 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1769,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":3810,"spinlock_wait_cycles":17545088,"thread_start_us":650372,"threads_started":1,"wal-append.queue_time_us":684539}
I20260709 12:19:14.426021 26956 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:14.433555 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:14.411257 26753 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:14.425961 27106 log.cc:927] Time spent T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
W20260709 12:19:14.437641 27066 consensus_meta.cc:287] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.834s	user 0.008s	sys 0.004s
I20260709 12:19:14.446228 26993 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:14.450878 24398 raft_consensus.cc:1240] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:14.409947 26970 raft_consensus.cc:2749] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 4. Current term is 5.
I20260709 12:19:14.454772 24399 raft_consensus.cc:1240] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:14.440317 27076 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:14.456646 27109 raft_consensus.cc:2749] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:14.461126 27066 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:14.459690 27070 consensus_queue.cc:1059] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
W20260709 12:19:14.464799 27073 log.cc:927] Time spent T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.664s	user 0.010s	sys 0.003s
I20260709 12:19:14.465150 24400 raft_consensus.cc:2393] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:14.465229 27109 raft_consensus.cc:3055] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:14.465701 27109 raft_consensus.cc:740] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:14.450479 27105 raft_consensus.cc:3055] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:14.466707 27105 raft_consensus.cc:740] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:14.466594 27109 consensus_queue.cc:260] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:14.467844 27109 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:14.467797 27105 consensus_queue.cc:260] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:14.469362 27105 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:14.469717 27059 consensus_queue.cc:260] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:14.470836 27059 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:14.470744 27008 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:14.436759 27060 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:14.459133 24440 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:14.466223 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 568) took 1346 ms. Trace:
I20260709 12:19:14.472146 24468 rpcz_store.cc:276] 0709 12:19:13.119865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:13.120033 (+   168us) service_pool.cc:224] Handling call
0709 12:19:13.120400 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:13.124129 (+  3729us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:13.124160 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:13.152483 (+ 28323us) log.cc:844] Serialized 26 byte log entry
0709 12:19:13.517268 (+364785us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:13.517331 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:13.517419 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:14.464095 (+946676us) spinlock_profiling.cc:243] Waited 42.3 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:19:14.465878 (+  1783us) raft_consensus.cc:1685] finished
0709 12:19:14.465901 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:14.466153 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10770,"raft.queue_time_us":3793,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":64034,"spinlock_wait_cycles":97347968,"thread_start_us":341094,"threads_started":1,"wal-append.queue_time_us":430514}
I20260709 12:19:14.468266 26753 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:14.457072 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:14.450314 26959 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:14.475157 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:14.478361 24398 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:14.581065 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:14.587170 24290 leader_election.cc:336] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.654s (SENT)
I20260709 12:19:14.589738 24290 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:14.592558 24290 leader_election.cc:336] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.687s (SENT)
I20260709 12:19:14.593321 24290 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:14.596311 24290 leader_election.cc:336] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.692s (SENT)
I20260709 12:19:14.606326 25110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 907) took 1680 ms. Trace:
I20260709 12:19:14.511524 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:14.614686 25112 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:14.461515 26983 raft_consensus.cc:2749] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:14.548310 27001 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:14.519498 27002 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.932s	user 0.017s	sys 0.005s
W20260709 12:19:14.620153 27002 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.039s	user 0.017s	sys 0.006s
I20260709 12:19:14.530827 27005 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:14.609748 25116 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:14.612862 26962 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:14.536662 27066 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:14.479952 26970 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:14.492976 27067 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:14.611755 26956 raft_consensus.cc:2749] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:14.539438 27060 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:14.412497 26980 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:14.485167 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:14.543974 27008 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:14.636714 25117 raft_consensus.cc:2393] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 5: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:14.166986 27014 consensus_queue.cc:260] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:14.638868 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:14.639969 26980 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:14.640810 24438 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:14.619728 25110 rpcz_store.cc:276] 0709 12:19:12.925849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.928450 (+  2601us) service_pool.cc:224] Handling call
0709 12:19:12.985502 (+ 57052us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:13.033644 (+ 48142us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:19:13.195717 (+162073us) log.cc:844] Serialized 14 byte log entry
0709 12:19:14.437139 (+1241422us) spinlock_profiling.cc:243] Waited 9.84 ms on lock 0x7b1800415c00. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a94241e07 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425ec02 00007f4a96ee620b 00007f4a96eebd23 00007f4a96eec23a 00007f4a97356a2a
0709 12:19:14.604934 (+167795us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:14.605108 (+   174us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:14.605273 (+   165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:14.605474 (+   201us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:14.605907 (+   433us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":111883,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":20816,"spinlock_wait_cycles":22624640,"thread_start_us":166944,"threads_started":1,"wal-append.queue_time_us":1329374}
I20260709 12:19:14.542732 27082 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:14.544468 27083 log.cc:927] Time spent T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.723s	user 0.002s	sys 0.010s
I20260709 12:19:14.416651 27088 consensus_queue.cc:237] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:14.668376 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 406) took 1709 ms. Trace:
W20260709 12:19:14.667694 27108 consensus_queue.cc:1175] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d99d5d772cfe4a96afcab3d3b009a281" responder_term: 5 status { last_received { term: 5 index: 5 } last_committed_idx: 5 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)" } } last_received_current_leader { term: 5 index: 5 } }
I20260709 12:19:14.422896 27098 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:14.675248 26994 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:14.675781 27098 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:14.655788 26970 raft_consensus.cc:697] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:14.677816 26970 consensus_queue.cc:237] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:14.679586 26959 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:14.657259 24398 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
W20260709 12:19:14.657351 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 1.64132e+06us
I20260709 12:19:14.640476 27014 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:14.686591 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 89430.3us
I20260709 12:19:14.689931 26962 consensus_queue.cc:1059] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:14.690474 27071 raft_consensus.cc:3055] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:14.690864 24291 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:14.691233 27071 raft_consensus.cc:740] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:14.691589 24290 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:14.693113 26986 raft_consensus.cc:2804] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:14.693835 26986 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:14.694190 26977 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:14.694305 26986 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:14.694617 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 90145.7us
I20260709 12:19:14.695400 26977 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:14.675380 26937 consensus_queue.cc:260] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:14.700902 26945 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:14.709699 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:14.710088 26945 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:14.711186 24317 raft_consensus.cc:1240] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:14.696940 27002 raft_consensus.cc:2749] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:14.697193 26902 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:14.700141 27076 consensus_queue.cc:1059] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
W20260709 12:19:14.714169 24470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 1776) took 1730 ms (client timeout 1881 ms). Trace:
I20260709 12:19:14.714277 27076 consensus_queue.cc:1243] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer c855242ec9d34a5397741ef20db9de8a log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:19:14.714732 24470 rpcz_store.cc:269] 0709 12:19:12.983136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.999452 (+ 16316us) service_pool.cc:224] Handling call
0709 12:19:14.713477 (+1714025us) spinlock_profiling.cc:243] Waited 97.9 ms on lock 0x7b540029e354. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:14.713817 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":225085184}
I20260709 12:19:14.717793 26904 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:14.696591 24438 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:14.718854 26786 raft_consensus.cc:3055] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:14.725153 26945 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:14.676512 26994 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:14.729413 25114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 908) took 1753 ms. Trace:
I20260709 12:19:14.729861 25114 rpcz_store.cc:276] 0709 12:19:12.975591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.980817 (+  5226us) service_pool.cc:224] Handling call
0709 12:19:14.028741 (+1047924us) spinlock_profiling.cc:243] Waited 66.5 ms on lock 0x7b5800004598. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c325fc0 00007f4a9c310929 00007f4a9c3103d2 00007f4a95887bd4
0709 12:19:14.029091 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:14.434616 (+405525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:14.728831 (+294215us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b540065d1d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:14.729231 (+   400us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":987623040}
I20260709 12:19:14.669198 24393 rpcz_store.cc:276] 0709 12:19:12.958612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.978302 (+ 19690us) service_pool.cc:224] Handling call
0709 12:19:13.022662 (+ 44360us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:13.486328 (+463666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:13.486374 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:13.486992 (+   618us) log.cc:844] Serialized 52 byte log entry
0709 12:19:13.581180 (+ 94188us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:13.625370 (+ 44190us) log.cc:844] Serialized 14 byte log entry
0709 12:19:13.693673 (+ 68303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:13.693761 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:14.431574 (+737813us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b1800182a40. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9425f522 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd 0000000000388634 0000000000388479 00007f4a9424283a
0709 12:19:14.543637 (+112063us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:19:14.667595 (+123958us) raft_consensus.cc:1685] finished
0709 12:19:14.667650 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:14.668001 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70752,"prepare.queue_time_us":332963,"prepare.run_cpu_time_us":904,"prepare.run_wall_time_us":5942,"raft.queue_time_us":409516,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":9161,"spinlock_wait_cycles":59311104,"thread_start_us":369901,"threads_started":3,"wal-append.queue_time_us":193655}
I20260709 12:19:14.722389 26786 raft_consensus.cc:740] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:14.762996 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:14.764134 24472 raft_consensus.cc:2393] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 4: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:14.742926 26991 raft_consensus.cc:2804] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:14.744083 24400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 1793) took 1767 ms. Trace:
I20260709 12:19:14.691469 26962 raft_consensus.cc:3055] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:14.774214 26962 raft_consensus.cc:740] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:14.739566 27071 consensus_queue.cc:260] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:14.744767 27002 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:19:14.745136 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 54557us
I20260709 12:19:14.747051 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:14.749432 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1782) took 1729 ms. Trace:
I20260709 12:19:14.731977 26990 consensus_queue.cc:260] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:14.750496 26994 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:14.798758 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:14.799860 24472 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:19:14.801193 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:14.801352 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:14.751924 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:14.753073 27118 consensus_queue.cc:1048] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:14.804282 27063 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:14.755636 26947 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:14.756413 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:14.756692 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:14.757097 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:14.758081 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:14.758749 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:14.698398 26977 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:14.759341 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:14.761417 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:14.699398 24290 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:14.764783 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:14.771436 26944 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:14.772806 26949 raft_consensus.cc:3055] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:19:14.773018 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:14.773524 27082 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:14.786608 24318 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:14.787753 26962 consensus_queue.cc:260] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:14.782656 24465 rpcz_store.cc:276] 0709 12:19:13.019821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:13.020036 (+   215us) service_pool.cc:224] Handling call
0709 12:19:13.020455 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:13.125321 (+104866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:14.748910 (+1623589us) spinlock_profiling.cc:243] Waited 98.1 ms on lock 0x7b54000fdcd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:14.749229 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":225557760}
W20260709 12:19:14.790011 24397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2242) took 2443 ms (client timeout 1669 ms). Trace:
I20260709 12:19:14.790516 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 1794) took 1775 ms. Trace:
I20260709 12:19:14.790779 27071 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:14.791049 24320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44278 (request call id 2124) took 1888 ms. Trace:
I20260709 12:19:14.791993 24291 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:14.792513 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:14.793221 26990 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:14.794813 24394 raft_consensus.cc:1275] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
W20260709 12:19:14.795193 27098 consensus_queue.cc:1175] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c855242ec9d34a5397741ef20db9de8a" responder_term: 5 status { last_received { term: 2 index: 2 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 4. Current term is 5. Ops: [4.3-4.3]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:19:14.799953 25082 leader_election.cc:336] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.560s (SENT)
I20260709 12:19:14.802551 24466 raft_consensus.cc:2410] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:19:14.750663 24317 raft_consensus.cc:1275] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:14.797851 24289 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:14.809322 24470 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:19:14.810745 24473 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:19:14.832671 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:14.828500 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:14.829314 24394 pending_rounds.cc:85] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a: Aborting all ops after (but not including) 2
I20260709 12:19:14.833279 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:14.767410 24400 rpcz_store.cc:276] 0709 12:19:12.976702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:13.005600 (+ 28898us) service_pool.cc:224] Handling call
0709 12:19:14.726594 (+1720994us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54000e38d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:14.743771 (+ 17177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3354403072}
I20260709 12:19:14.763797 26786 consensus_queue.cc:260] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:19:14.819789 24474 raft_consensus.cc:2468] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:19:14.820458 24467 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:14.828997 26937 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:14.816525 24397 rpcz_store.cc:269] 0709 12:19:12.345960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.346829 (+   869us) service_pool.cc:224] Handling call
0709 12:19:14.789425 (+2442596us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54000cdd54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:14.789757 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3021603584}
I20260709 12:19:14.833732 24394 pending_rounds.cc:107] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:19:14.838400 24394 raft_consensus.cc:2889] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:14.838652 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:14.840816 26918 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:14.841658 26918 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:14.843587 24470 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:14.827232 27076 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:14.844851 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:14.817139 24320 rpcz_store.cc:276] 0709 12:19:12.902938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.936704 (+ 33766us) service_pool.cc:224] Handling call
0709 12:19:12.976003 (+ 39299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:14.083571 (+1107568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:14.790491 (+706920us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540025b2d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:14.790825 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2534306048}
I20260709 12:19:14.813370 26949 raft_consensus.cc:740] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:14.846745 27082 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:14.824905 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 807748us
W20260709 12:19:14.825366 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:14.826330 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:14.848516 25082 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:14.827195 24393 raft_consensus.cc:2410] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:19:14.827538 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:14.816699 24392 rpcz_store.cc:276] 0709 12:19:13.014739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:13.022399 (+  7660us) service_pool.cc:224] Handling call
0709 12:19:14.790055 (+1767656us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b54002a4254. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:14.790291 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1734721280}
W20260709 12:19:14.825469 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:14.767154 26991 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:14.845458 24470 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:14.850616 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:14.820484 26962 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:14.844317 26918 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:14.852212 26991 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:14.854117 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:14.855769 24366 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:14.860965 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 63514.1us
I20260709 12:19:14.855854 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:14.856729 27002 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:14.857578 26902 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:19:14.866235 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:14.867787 24398 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:14.866722 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:14.870255 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:14.865968 26902 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:14.874732 24472 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:14.874955 24318 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:14.805272 27063 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:14.847759 26949 consensus_queue.cc:260] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:14.882947 26949 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:14.880721 24467 raft_consensus.cc:1240] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:14.886725 24474 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
W20260709 12:19:14.887169 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 87461us
I20260709 12:19:14.888302 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:14.888609 27002 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:14.889165 24474 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:14.889784 27082 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:14.890434 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:14.891382 24474 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:14.886850 26983 raft_consensus.cc:2804] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:14.883291 26786 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:14.908000 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:14.872561 26902 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:14.896922 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:14.892602 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:14.896216 24470 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:14.894297 26983 raft_consensus.cc:697] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:14.902781 27076 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:14.904064 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:14.905107 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 49515us
I20260709 12:19:14.905838 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:14.906363 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 207301us
I20260709 12:19:14.864605 26944 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:14.881822 26918 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:14.918496 24466 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:19:14.923951 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:14.925400 24398 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6.
W20260709 12:19:14.924333 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 52862.2us
I20260709 12:19:14.926280 26994 raft_consensus.cc:2749] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:14.930531 26944 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:14.934105 24366 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:14.935003 24290 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:14.936460 24290 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:14.938068 24465 raft_consensus.cc:2393] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 5: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:14.939248 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:14.940963 24468 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:19:14.941042 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:14.942127 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:14.945864 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:14.946286 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:14.946821 24466 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:14.940109 24465 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:14.953931 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 91388.4us
I20260709 12:19:14.957041 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:14.961704 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:14.964111 26988 raft_consensus.cc:2749] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:14.969192 24471 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:14.957839 24474 raft_consensus.cc:2468] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:19:14.968120 24472 raft_consensus.cc:2393] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 5: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:14.966099 24366 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:14.917106 27076 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:14.984884 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:14.984817 24470 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:14.983429 24467 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:14.988808 24468 raft_consensus.cc:1275] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:19:14.997543 24466 raft_consensus.cc:2393] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 6: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:14.998674 26944 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:14.999038 24365 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:15.002033 24365 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:14.996912 26994 raft_consensus.cc:2764] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:19:15.007236 24474 raft_consensus.cc:1275] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:19:15.009533 24474 pending_rounds.cc:85] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 2
I20260709 12:19:15.012354 24474 pending_rounds.cc:107] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:19:15.012708 24474 raft_consensus.cc:2889] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:15.015470 24473 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:15.023128 25119 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:19:15.011976 26937 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.028797 27063 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:15.029982 27125 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.030561 27125 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:15.031723 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:15.032527 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:15.033609 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 97263.6us
I20260709 12:19:15.036026 24290 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:15.036736 26678 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.037258 26678 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:15.038244 27076 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:15.039316 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 145882us
I20260709 12:19:15.039484 27076 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:15.040339 27121 log.cc:927] Time spent T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:19:15.040789 26944 consensus_queue.cc:1059] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:15.044850 27082 raft_consensus.cc:3055] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:15.045292 27082 raft_consensus.cc:740] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:15.046478 27082 consensus_queue.cc:260] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:15.047971 27082 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:15.038396 27070 consensus_queue.cc:1059] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:19:15.045305 26983 consensus_queue.cc:237] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:15.049866 27070 raft_consensus.cc:3055] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:15.050246 27070 raft_consensus.cc:740] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:15.038625 26988 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:15.051162 26988 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:15.051554 26988 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:15.041356 24468 raft_consensus.cc:1240] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:15.053968 26937 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:15.046969 24471 raft_consensus.cc:1240] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:15.057190 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 393) took 1180 ms. Trace:
I20260709 12:19:15.057617 25119 rpcz_store.cc:276] 0709 12:19:13.877023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:14.412815 (+535792us) service_pool.cc:224] Handling call
0709 12:19:15.024943 (+612128us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:15.061187 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 95201.9us
I20260709 12:19:15.020869 26956 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:15.060520 24465 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:15.062265 24365 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:15.065074 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 43797.3us
I20260709 12:19:15.030021 27001 raft_consensus.cc:2749] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:15.076838 27126 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:15.077544 25115 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:19:15.078027 25112 raft_consensus.cc:2410] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:15.077791 27126 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:15.079221 24474 raft_consensus.cc:1240] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:15.092940 26678 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:15.063880 26956 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:15.093065 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:15.102155 24471 raft_consensus.cc:1240] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:15.102614 26986 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:15.104717 27127 raft_consensus.cc:2749] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:15.106693 24472 raft_consensus.cc:1240] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:15.108275 27126 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:15.108942 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:15.070070 26937 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:15.121272 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:15.128775 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:15.124207 27001 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:19:15.126267 25115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 388) took 1289 ms (client timeout 1663 ms). Trace:
I20260709 12:19:15.121901 27006 raft_consensus.cc:2804] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:15.128342 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:15.128588 24290 leader_election.cc:336] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.682s (SENT)
I20260709 12:19:15.040455 27076 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:15.147660 25115 rpcz_store.cc:269] 0709 12:19:13.836318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:13.839851 (+  3533us) service_pool.cc:224] Handling call
0709 12:19:15.125922 (+1286071us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400709ed4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:15.126160 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2551865216}
W20260709 12:19:15.115003 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 90824.1us
I20260709 12:19:15.147917 24467 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:15.119673 26956 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:15.154776 24473 raft_consensus.cc:1240] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:19:15.153517 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:15.155560 24471 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:15.150955 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:15.126717 26991 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:15.157528 24472 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:15.158665 24316 raft_consensus.cc:2393] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 5: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:15.156764 24365 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:15.157262 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:15.162297 24320 raft_consensus.cc:2410] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:19:15.162155 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:15.149207 27006 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:15.163952 27006 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:15.165504 26991 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:15.166517 24474 raft_consensus.cc:1240] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:15.154606 27001 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:15.137430 27125 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:15.168923 24365 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:15.173202 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:15.177989 24398 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
W20260709 12:19:15.184927 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 78738.3us
W20260709 12:19:15.189733 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 61251.5us
I20260709 12:19:15.174010 26937 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:19:15.191208 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:15.195534 27005 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:15.181103 26991 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.205662 25084 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:15.196074 27005 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:15.202490 27001 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:15.209856 27128 raft_consensus.cc:2764] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:19:15.209610 26937 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:15.211302 24318 raft_consensus.cc:2393] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 5: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:15.213001 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:15.213879 24397 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:15.204341 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:15.214740 27127 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:15.203727 24335 tablet_copy_service.cc:342] P c711faa13ead43ebbea0192cb74a4756: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-97dd30b21cc14958a91b2da522e4bbe9 received from {username='slave'} at 127.0.0.1:57702
I20260709 12:19:15.215720 24335 tablet_copy_service.cc:434] P c711faa13ead43ebbea0192cb74a4756: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-97dd30b21cc14958a91b2da522e4bbe9 on tablet 97dd30b21cc14958a91b2da522e4bbe9 with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:15.218209 26986 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:15.215185 26902 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:15.221437 26902 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:15.229212 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 566) took 2110 ms. Trace:
I20260709 12:19:15.202903 27076 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:15.204594 26982 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:15.204404 27105 consensus_queue.cc:1048] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:15.208900 24365 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:15.212707 26988 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:15.214870 24396 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
W20260709 12:19:15.203014 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:15.204105 24322 raft_consensus.cc:1240] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:19:15.229956 24469 rpcz_store.cc:276] 0709 12:19:13.118487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:13.118659 (+   172us) service_pool.cc:224] Handling call
0709 12:19:14.716435 (+1597776us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:14.717478 (+  1043us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:14.718043 (+   565us) log.cc:844] Serialized 14 byte log entry
0709 12:19:14.785448 (+ 67405us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:14.835213 (+ 49765us) log.cc:844] Serialized 26 byte log entry
0709 12:19:14.848974 (+ 13761us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:14.849014 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:14.852097 (+  3083us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:15.042175 (+190078us) raft_consensus.cc:1685] finished
0709 12:19:15.042208 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:15.228831 (+186623us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b540029e350. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:15.228946 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":648,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":73,"raft.queue_time_us":307,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":291,"spinlock_wait_cycles":3668903040,"thread_start_us":64631,"threads_started":1,"wal-append.queue_time_us":165946}
I20260709 12:19:15.241855 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:15.242547 27122 log.cc:927] Time spent T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.410s	user 0.003s	sys 0.002s
I20260709 12:19:15.242862 24396 raft_consensus.cc:2393] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 5: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:15.245429 24325 raft_consensus.cc:1275] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:19:15.246636 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:15.247864 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:15.232677 27005 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:15.249990 26786 consensus_queue.cc:1059] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:15.236965 26991 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:15.205901 27126 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.255076 26991 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:15.261445 24400 raft_consensus.cc:1240] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:19:15.255796 27126 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:15.263738 27126 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:15.264914 26988 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:15.265158 26937 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:15.238337 26982 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:15.266212 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 79513.7us
I20260709 12:19:15.261485 24290 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:15.270093 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:15.271566 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:15.293744 24474 raft_consensus.cc:1275] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:15.294091 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:15.296270 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:15.297179 24396 raft_consensus.cc:2410] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:19:15.297492 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:15.297940 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:15.298193 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:15.298727 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:15.302938 24394 raft_consensus.cc:2393] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
W20260709 12:19:15.303025 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 112755us
I20260709 12:19:15.304042 24392 raft_consensus.cc:2410] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:19:15.215569 27127 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:15.309566 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:15.283169 26904 raft_consensus.cc:2804] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:15.275112 26982 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:15.318289 24289 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:15.338470 24325 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
I20260709 12:19:15.338352 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:15.347766 24398 raft_consensus.cc:1240] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:15.365350 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:15.366076 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 48540.6us
I20260709 12:19:15.349982 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:15.345894 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:15.329931 27076 raft_consensus.cc:2749] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:15.384845 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:15.330235 26786 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:15.387617 26786 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:15.388015 26786 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:15.362051 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:15.331627 26988 raft_consensus.cc:2804] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:19:15.345798 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 135020us
W20260709 12:19:15.392421 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 131141us
I20260709 12:19:15.365871 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:15.389564 24323 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:15.391701 25118 raft_consensus.cc:2393] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 5: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:15.395761 24365 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:15.362053 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:15.397593 25111 raft_consensus.cc:2393] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:15.336237 26904 raft_consensus.cc:697] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:15.405100 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:15.406770 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:15.407191 24319 raft_consensus.cc:1240] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 12:19:15.407938 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:15.408998 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:15.409857 24324 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
I20260709 12:19:15.412770 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:15.413673 25114 raft_consensus.cc:2393] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 6: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:15.415159 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:15.417573 24440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:15.356498 27127 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:15.418283 24319 raft_consensus.cc:1275] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:19:15.416371 25116 raft_consensus.cc:2376] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6. Re-sending same reply.
I20260709 12:19:15.423465 25083 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:15.425343 25083 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:15.425993 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:15.426743 25115 raft_consensus.cc:2393] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:15.422617 24290 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:15.430576 24322 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:15.381392 26956 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:15.420274 27098 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.421885 26678 consensus_queue.cc:1048] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:19:15.421412 26988 raft_consensus.cc:697] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:15.444404 27070 consensus_queue.cc:260] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:15.445093 26988 consensus_queue.cc:237] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:15.446442 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:15.434518 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:15.438516 26993 raft_consensus.cc:2804] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:15.450135 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:15.437552 27127 raft_consensus.cc:2804] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:15.439725 27098 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:15.441505 24290 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:15.442324 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:15.455420 24317 raft_consensus.cc:2393] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:15.456238 24365 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:15.458557 27125 raft_consensus.cc:3055] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:15.452533 26904 consensus_queue.cc:237] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:15.459915 27006 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:15.450043 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:15.536254 25114 raft_consensus.cc:2393] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 5: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:15.537119 24392 raft_consensus.cc:1240] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:15.537470 27006 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:15.453855 26993 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:15.538837 26993 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:15.542058 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 87680.8us
I20260709 12:19:15.433579 26963 consensus_queue.cc:1059] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:19:15.494264 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:15.496431 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:15.495473 24393 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:15.463429 24322 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:15.433285 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:15.548430 24319 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:19:15.502120 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:15.549597 25119 raft_consensus.cc:2393] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 5: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:15.505067 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:15.455546 27063 raft_consensus.cc:2804] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:15.479648 26937 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:15.510869 24291 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:15.558549 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 47796.2us
I20260709 12:19:15.559911 24291 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:15.504673 26966 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.517182 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:15.518059 24316 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:15.456652 27127 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:15.522624 27005 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:15.510062 27125 raft_consensus.cc:740] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:15.464165 26994 consensus_queue.cc:1048] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
W20260709 12:19:15.525503 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 84091.2us
I20260709 12:19:15.525369 27128 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:15.526729 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:15.528810 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:15.530117 26956 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:15.531911 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:15.534756 26786 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:15.544507 24365 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:15.550928 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 114526us
W20260709 12:19:15.551069 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 150513us
I20260709 12:19:15.552956 24323 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:15.553182 24320 raft_consensus.cc:2393] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 5: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:15.554616 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:15.452808 26944 consensus_queue.cc:1048] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 12:19:15.560680 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:15.595793 25119 raft_consensus.cc:2393] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 6: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:15.562888 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:15.593135 25115 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:15.584358 24317 raft_consensus.cc:2393] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:15.559216 26937 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:15.600399 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:15.601966 26937 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:15.555371 27063 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:15.585309 24318 raft_consensus.cc:2393] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:15.584975 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:15.562784 27129 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:19:15.599363 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 54955.2us
I20260709 12:19:15.603011 24394 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:15.602528 27082 raft_consensus.cc:2804] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:15.576573 27127 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:19:15.599442 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:15.596711 24325 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:15.582690 27006 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:15.587335 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:15.599797 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:15.613200 24290 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:15.599588 26983 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:15.626384 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:15.629128 24325 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:15.635212 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:15.635706 24440 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:15.612073 27063 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:15.633766 24366 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:15.586861 26966 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:15.588985 27125 consensus_queue.cc:260] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:15.624012 27006 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:15.624848 27082 raft_consensus.cc:697] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:19:15.669710 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:15.668648 26991 raft_consensus.cc:2804] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:15.684368 25082 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:15.685439 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:15.686463 25082 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:15.688936 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:15.689646 24438 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:15.692715 27082 consensus_queue.cc:237] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:15.696854 24474 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:15.697193 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:15.698207 26944 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:15.698959 24319 raft_consensus.cc:2393] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:15.700783 26868 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.701571 26868 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:15.704955 27142 raft_consensus.cc:3055] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:15.705524 27142 raft_consensus.cc:740] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:15.706696 27142 consensus_queue.cc:260] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:15.709147 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 87460.3us
I20260709 12:19:15.710333 24440 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:15.712819 27139 log.cc:927] Time spent T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:19:15.715047 26937 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:15.717501 26937 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:15.718189 26937 raft_consensus.cc:2804] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:15.718623 26937 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:15.719059 26937 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:15.722698 27063 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:15.725369 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 126002us
I20260709 12:19:15.726826 24290 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:15.726982 27127 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:15.729401 27127 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:15.733731 27005 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:15.737327 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:15.747653 27144 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:15.725596 27063 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:15.750137 26786 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:15.752318 27098 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:15.753449 27098 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:15.754076 27098 raft_consensus.cc:697] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:15.755336 27098 consensus_queue.cc:237] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:15.762842 26937 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:15.654408 27129 raft_consensus.cc:2804] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:15.765182 27129 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:15.765717 27129 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:15.768101 26990 consensus_queue.cc:1048] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:15.772708 26966 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:15.773561 26966 raft_consensus.cc:2749] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:15.773849 26937 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:15.660903 27006 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:15.805202 24318 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:15.708374 27142 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:15.819918 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 387686us
I20260709 12:19:15.821036 24290 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:15.832093 24323 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:15.826400 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:15.833356 24323 raft_consensus.cc:1240] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:15.704499 26868 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:15.841581 24399 raft_consensus.cc:1240] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:15.826344 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:15.843420 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:15.844254 24465 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:15.845955 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:15.835052 24322 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:15.843683 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:15.881757 24400 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 3.
I20260709 12:19:15.835456 26902 raft_consensus.cc:2764] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:19:15.893734 24465 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:19:15.854279 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:15.843160 26678 consensus_queue.cc:1059] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:19:15.829630 27144 consensus_queue.cc:1059] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:19:15.907395 24395 raft_consensus.cc:1275] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:19:15.910720 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 222560us
I20260709 12:19:15.887848 27128 raft_consensus.cc:2804] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:15.915378 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:15.923928 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 234404us
I20260709 12:19:15.907048 24394 raft_consensus.cc:2410] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:19:15.930563 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:15.932679 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:15.941471 24395 raft_consensus.cc:1275] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:19:15.949035 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:15.952282 24395 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
W20260709 12:19:15.952551 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 242347us
I20260709 12:19:15.916558 26868 raft_consensus.cc:3055] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:19:15.961321 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 340890us
I20260709 12:19:15.919248 27128 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:15.972117 25117 raft_consensus.cc:1240] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:15.965093 24398 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:15.969035 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:15.970450 24391 pending_rounds.cc:85] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a: Aborting all ops after (but not including) 2
I20260709 12:19:16.010164 24391 pending_rounds.cc:107] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:19:16.010584 24391 raft_consensus.cc:2889] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:15.970757 26931 consensus_queue.cc:1048] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.128s
I20260709 12:19:15.937129 26945 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.983004 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:16.015759 24393 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:15.984941 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 256262us
I20260709 12:19:15.986485 24394 raft_consensus.cc:1275] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:15.989460 27141 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.994177 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:15.928162 26991 raft_consensus.cc:697] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:15.998886 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:15.963811 26786 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:15.966166 26868 raft_consensus.cc:740] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:16.012825 24395 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:19:16.020114 24473 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:16.034297 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:16.037048 24366 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:16.038130 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:16.038878 24318 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:16.013288 27128 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:16.043588 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:16.045630 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:16.044051 24290 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:16.052148 24438 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:16.056388 24365 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:16.047441 24321 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
W20260709 12:19:16.035085 26982 consensus_meta.cc:287] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.636s	user 0.006s	sys 0.007s
I20260709 12:19:16.062557 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:16.067246 24466 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:16.036753 26944 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:16.076165 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:16.081725 24316 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:16.080416 24365 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:16.089901 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:16.095755 24438 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:16.026520 27141 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:16.094594 25084 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:16.098374 24438 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:16.041841 26786 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:16.101249 24323 raft_consensus.cc:1240] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:16.071823 27098 raft_consensus.cc:2804] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:16.026294 26945 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:16.104872 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 83817.6us
W20260709 12:19:16.105145 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:16.036226 26993 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:16.059295 27071 consensus_queue.cc:1059] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:19:16.080358 26988 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:16.085013 27076 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:16.090139 26994 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:16.117205 24398 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
W20260709 12:19:16.120712 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 88781.7us
I20260709 12:19:16.120290 24318 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
W20260709 12:19:16.122218 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 73361.8us
I20260709 12:19:16.114477 24366 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:16.102535 27001 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:16.068804 26982 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:16.107610 26990 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:16.105717 27098 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:16.115577 26963 raft_consensus.cc:2804] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:16.133337 24468 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
W20260709 12:19:16.137188 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 49763.1us
I20260709 12:19:16.118245 27076 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:16.085284 27152 consensus_queue.cc:1048] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:19:16.142280 27005 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:16.142406 24290 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:16.139221 26963 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:16.145709 27129 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:19:16.138995 27147 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:16.146310 27162 consensus_queue.cc:1048] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:16.148833 27137 raft_consensus.cc:2749] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:16.125563 26988 raft_consensus.cc:697] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:16.128858 27001 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:16.105381 27126 consensus_queue.cc:1059] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:19:16.153890 25084 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:16.101702 27149 consensus_queue.cc:1048] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
W20260709 12:19:16.150055 27158 log.cc:927] Time spent T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:19:16.137216 26990 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:16.149919 27154 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:16.104733 27151 consensus_queue.cc:1048] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:19:16.138837 27098 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:16.162030 26918 consensus_queue.cc:1059] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:19:16.158349 26963 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:16.196794 24322 raft_consensus.cc:1240] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:16.124779 26994 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:16.150911 27076 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:16.212437 26945 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:16.217741 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:16.219400 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:16.221554 24466 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:16.205118 26990 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:16.192840 27001 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:16.119529 26868 consensus_queue.cc:260] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:16.243467 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 108568us
I20260709 12:19:16.121616 26991 consensus_queue.cc:237] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:16.139130 26937 consensus_queue.cc:1059] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
W20260709 12:19:16.246865 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 172257us
I20260709 12:19:16.254922 24393 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:16.219760 27154 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:16.260494 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 146082us
I20260709 12:19:16.201424 26904 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:16.279356 24289 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:16.280339 24290 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:16.191150 27147 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:16.248211 26945 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:16.285638 24366 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:16.204236 27006 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:16.279510 24440 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:16.263607 26966 consensus_queue.cc:1059] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:19:16.317416 26786 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:16.323967 24316 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:16.281912 27154 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:16.299497 26868 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:16.335270 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 73891.3us
W20260709 12:19:16.331278 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 47555.8us
I20260709 12:19:16.310789 27148 raft_consensus.cc:2749] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:16.320174 27126 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:16.371075 26982 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:16.365691 26993 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:16.362903 24366 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:16.305888 26945 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:16.377285 27165 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:16.377871 27172 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:19:16.363318 27157 log.cc:927] Time spent T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:19:16.298877 26988 consensus_queue.cc:237] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:16.400985 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:16.383755 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:16.329257 27149 raft_consensus.cc:2749] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:19:16.402314 27156 log.cc:927] Time spent T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.244s	user 0.001s	sys 0.001s
I20260709 12:19:16.403609 26994 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:16.404399 27173 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:16.404945 27173 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:16.405092 27128 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:16.407342 27173 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:16.407970 24317 raft_consensus.cc:1240] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:16.409492 27147 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:16.356690 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 77017.6us
I20260709 12:19:16.384493 27126 raft_consensus.cc:697] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:16.411495 27126 consensus_queue.cc:237] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:16.417824 27076 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:16.418810 24290 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:16.419813 27006 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:16.418293 27148 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:16.424134 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 43551.8us
I20260709 12:19:16.420224 27076 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:16.432240 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:16.437397 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:16.440217 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 343390us
I20260709 12:19:16.448434 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:16.423374 27172 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:16.449206 24395 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6.
I20260709 12:19:16.427106 27128 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:16.437064 27162 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:16.379956 26966 consensus_queue.cc:1048] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:19:16.469053 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:16.469707 27125 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:16.472877 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 117178us
I20260709 12:19:16.473995 24366 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:16.451845 24398 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:16.421224 27141 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:16.454242 27162 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:19:16.453536 27172 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:16.479275 27162 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:16.480888 27170 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:16.481452 27170 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:16.481801 24365 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:16.483608 27170 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:16.484227 26990 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:16.484680 26982 raft_consensus.cc:2749] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:16.486449 26990 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:16.486498 26982 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:16.487224 26982 raft_consensus.cc:697] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:16.488104 26982 consensus_queue.cc:237] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:16.454954 24391 raft_consensus.cc:1240] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:19:16.455236 27149 consensus_queue.cc:1048] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:16.436941 27147 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:16.505903 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:16.464002 26945 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:16.476790 24366 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:16.493425 24440 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:16.497505 24470 raft_consensus.cc:1275] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:19:16.514750 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:16.503890 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:16.510965 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:16.515861 24473 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:19:16.515947 24466 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:16.502133 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:16.517271 24470 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:16.453430 27129 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:16.524645 25083 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:16.529654 24365 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:16.510980 27147 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:16.535283 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:16.536226 24467 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:16.428362 27165 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:16.542250 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:16.538901 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 62249.5us
I20260709 12:19:16.539678 24290 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:16.500583 26904 raft_consensus.cc:697] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:16.554186 24366 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:16.534588 27147 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:16.557160 24469 raft_consensus.cc:1275] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:19:16.544942 26993 raft_consensus.cc:2804] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:19:16.567531 27180 log.cc:927] Time spent T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:19:16.568890 26904 consensus_queue.cc:237] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:16.571226 27005 raft_consensus.cc:2749] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:16.571507 27165 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:16.573599 27001 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:16.527446 27098 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:16.575336 27070 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:16.577299 27142 raft_consensus.cc:3055] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:16.634622 27142 raft_consensus.cc:740] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:16.635756 27142 consensus_queue.cc:260] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:16.581507 24467 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:16.537847 27178 raft_consensus.cc:2804] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:16.601770 24466 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:16.530790 27006 consensus_queue.cc:1048] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
W20260709 12:19:16.613471 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 56588.9us
I20260709 12:19:16.640937 27178 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:16.641484 27178 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:16.642022 27150 consensus_queue.cc:1048] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:19:16.622337 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 68242.4us
W20260709 12:19:16.623857 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 130591us
I20260709 12:19:16.645538 24440 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:16.647089 24440 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:16.647650 27149 raft_consensus.cc:2804] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:16.579021 27166 raft_consensus.cc:3055] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:19:16.636895 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:16.648475 27166 raft_consensus.cc:740] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:16.649469 24366 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:16.650506 27006 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:16.648232 27149 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:16.651510 27149 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:16.652343 24366 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:16.650070 27166 consensus_queue.cc:260] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:16.655114 27166 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:16.648162 26991 raft_consensus.cc:2749] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:16.560982 26945 raft_consensus.cc:2749] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:16.597149 26993 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:16.623075 27126 raft_consensus.cc:2749] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:16.623255 27148 raft_consensus.cc:2749] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:16.701589 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:16.702404 24469 raft_consensus.cc:2393] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 8: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
W20260709 12:19:16.707485 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 60478.6us
I20260709 12:19:16.711460 24471 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:16.690809 27143 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:16.691255 27169 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:16.693002 27001 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:16.698146 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 166729us
I20260709 12:19:16.684458 24398 raft_consensus.cc:2410] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 7 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:19:16.686517 26993 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:16.725771 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 73530.2us
I20260709 12:19:16.729894 24440 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:16.735747 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 105396us
I20260709 12:19:16.739732 24290 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:16.745857 24290 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:16.721925 27143 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:16.741964 27063 raft_consensus.cc:3055] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:16.756013 24438 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:16.733691 27165 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:16.740366 27006 raft_consensus.cc:2764] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:19:16.764816 26678 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:16.765498 24319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1665) took 1413 ms. Trace:
I20260709 12:19:16.768781 24366 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:16.766399 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:16.774933 26678 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:16.775138 27151 consensus_queue.cc:1059] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:16.750777 26991 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:16.754643 27143 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:16.770380 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:16.765420 27164 raft_consensus.cc:2749] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:16.759682 27063 raft_consensus.cc:740] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:16.756672 27127 raft_consensus.cc:2804] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:16.777813 26918 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:16.922602 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 153991us
I20260709 12:19:16.933864 27129 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:16.924921 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 152472us
I20260709 12:19:16.780311 27165 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:16.925519 24290 leader_election.cc:336] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.835s (SENT)
I20260709 12:19:16.944893 24290 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:16.772330 24319 rpcz_store.cc:276] 0709 12:19:15.352047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:15.699696 (+347649us) service_pool.cc:224] Handling call
0709 12:19:15.700088 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:15.700371 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:19:15.926967 (+226596us) log.cc:844] Serialized 14 byte log entry
0709 12:19:16.074474 (+147507us) log.cc:844] Serialized 14 byte log entry
0709 12:19:16.210837 (+136363us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b1800314c20. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9425f3f3 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd 0000000000388634 0000000000388479 00007f4a9424283a
0709 12:19:16.213680 (+  2843us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b1800314c20. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9425f522 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd 0000000000388634 0000000000388479 00007f4a9424283a
0709 12:19:16.765005 (+551325us) spinlock_profiling.cc:243] Waited 7.86 ms on lock 0x7b1800314c20. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a96ef44bc 00007f4a9424248b 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425c455 00007f4a97344060 00007f4a97356716 00007f4a97367287
0709 12:19:16.765106 (+   101us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:16.765152 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:16.765211 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:16.765300 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:16.765424 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9384,"prepare.queue_time_us":261320,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":2477,"raft.queue_time_us":57257,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":22204,"spinlock_wait_cycles":53748864,"thread_start_us":362970,"threads_started":3,"wal-append.queue_time_us":129940}
W20260709 12:19:16.925827 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:16.770861 26966 raft_consensus.cc:2804] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:16.932538 24365 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:16.933416 24391 raft_consensus.cc:2393] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 8: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:16.923251 24396 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6.
I20260709 12:19:16.751092 27126 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:16.947125 27126 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:16.947348 24365 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:16.947558 27126 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:16.947417 27005 raft_consensus.cc:2804] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:16.948357 24365 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:16.948377 27005 raft_consensus.cc:697] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:16.949879 26982 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:16.949752 27005 consensus_queue.cc:237] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:16.952905 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:16.953965 24440 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:16.929186 27001 raft_consensus.cc:2749] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:16.951987 26949 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:16.937336 27127 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:16.955536 26966 raft_consensus.cc:697] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:16.944761 27151 raft_consensus.cc:3055] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:16.955852 27174 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:19:16.972419 26963 consensus_meta.cc:287] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.715s	user 0.012s	sys 0.000s
W20260709 12:19:17.003607 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 55290.1us
W20260709 12:19:17.006146 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 52261.8us
I20260709 12:19:16.984807 27127 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:16.945158 26918 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:16.971998 27098 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:16.990381 27076 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.023507 24438 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:16.953542 27129 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:17.012964 24440 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:17.019395 27165 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:16.990479 26949 raft_consensus.cc:697] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:17.012084 24366 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:17.030328 24472 raft_consensus.cc:1275] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:19:16.992784 27151 raft_consensus.cc:740] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:16.984676 27172 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:17.042284 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:17.055087 24398 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:17.010627 27193 raft_consensus.cc:2804] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:16.994275 26982 raft_consensus.cc:697] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:17.020957 26918 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:17.032081 27128 raft_consensus.cc:2749] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:19:17.061236 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 48420.3us
I20260709 12:19:17.041839 27098 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:17.003543 27174 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:17.045171 27177 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:17.093556 27177 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:17.095893 27177 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:17.096473 27001 consensus_queue.cc:1048] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:17.097189 26949 consensus_queue.cc:237] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:17.005476 27063 consensus_queue.cc:260] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:17.101800 27063 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:17.107038 27189 log.cc:927] Time spent T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:19:17.107868 27147 consensus_meta.cc:287] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.000s
I20260709 12:19:17.108482 27147 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:17.111742 27147 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:17.078955 24440 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:17.060384 26966 consensus_queue.cc:237] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:17.064697 27143 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:17.069648 27167 raft_consensus.cc:2749] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:17.060868 27150 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.076115 27098 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:17.092970 27194 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:17.114183 27172 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:17.118721 27183 log.cc:927] Time spent T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.615s	user 0.004s	sys 0.003s
W20260709 12:19:17.119676 27125 consensus_meta.cc:287] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.649s	user 0.003s	sys 0.006s
W20260709 12:19:17.120908 27184 log.cc:927] Time spent T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.573s	user 0.012s	sys 0.021s
I20260709 12:19:17.121263 27129 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:17.204849 24398 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
W20260709 12:19:17.123270 27154 consensus_meta.cc:287] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.767s	user 0.009s	sys 0.002s
I20260709 12:19:17.037413 27076 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:19:17.011401 26963 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:17.123302 24317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 381) took 1108 ms. Trace:
W20260709 12:19:17.077937 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 65965.7us
W20260709 12:19:17.177580 27166 consensus_meta.cc:287] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.005s
I20260709 12:19:17.184839 27098 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:17.211144 24317 rpcz_store.cc:276] 0709 12:19:16.014799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:16.014968 (+   169us) service_pool.cc:224] Handling call
0709 12:19:16.032077 (+ 17109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:16.408380 (+376303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:17.123059 (+714679us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b5400361d54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:17.123237 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":864031104}
W20260709 12:19:17.204349 26868 consensus_meta.cc:287] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.854s	user 0.014s	sys 0.000s
W20260709 12:19:17.217110 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 291608us
I20260709 12:19:17.203190 27194 raft_consensus.cc:697] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:19:17.224056 24290 connection.cc:256] RPC call timeout handler was delayed by -1.4275872960001834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
I20260709 12:19:17.124889 27151 consensus_queue.cc:260] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:17.204103 27193 raft_consensus.cc:697] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
W20260709 12:19:17.224694 27137 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.011s	sys 0.018s
W20260709 12:19:17.231783 27178 consensus_meta.cc:287] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.006s
I20260709 12:19:17.188292 27150 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:17.210979 27154 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:17.249130 27137 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.011s	sys 0.018s
I20260709 12:19:17.264017 25082 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:17.243221 27070 consensus_meta.cc:287] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.610s	user 0.011s	sys 0.002s
I20260709 12:19:17.236256 27129 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.272581 27151 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:17.276747 25082 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:17.291082 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 47117.7us
I20260709 12:19:17.220278 27126 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:17.263556 26983 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.266458 27202 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.252101 27147 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:17.238900 27001 consensus_queue.cc:1059] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
W20260709 12:19:17.293537 26993 consensus_meta.cc:287] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.003s
I20260709 12:19:17.288033 26868 raft_consensus.cc:2749] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:17.290225 26991 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.237207 26982 consensus_queue.cc:237] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:17.312204 27177 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:17.272536 27178 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:17.365826 24290 leader_election.cc:336] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.558s (SENT)
I20260709 12:19:17.328116 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:17.372947 26918 consensus_queue.cc:1059] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:19:17.391939 27209 raft_consensus.cc:2749] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:17.391960 27125 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:17.393198 26918 raft_consensus.cc:3055] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:17.393051 27125 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:17.393680 27198 log.cc:927] Time spent T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:19:17.328261 26983 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:17.395538 27197 log.cc:927] Time spent T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:19:17.397107 27125 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:17.397994 27126 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:17.402066 26963 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:17.403487 27154 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:17.407990 27150 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:17.408933 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:17.409785 24317 raft_consensus.cc:2393] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 7: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:17.329624 27127 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:17.411176 24319 raft_consensus.cc:1275] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:19:17.411707 27127 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:17.412509 27143 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:17.413407 27174 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:17.413714 27199 log.cc:927] Time spent T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 12:19:17.415112 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:17.402223 27178 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:17.419636 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:17.421124 24319 raft_consensus.cc:2393] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 7: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:17.416297 24322 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:17.416647 24290 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:17.414683 25111 raft_consensus.cc:1240] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:17.373077 27070 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:17.455026 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:17.462495 24325 raft_consensus.cc:2393] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:17.456043 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:17.393679 26918 raft_consensus.cc:740] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:17.460863 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:17.474428 24321 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:17.475399 24319 raft_consensus.cc:1240] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:17.461467 24324 raft_consensus.cc:1275] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:17.477214 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:17.478387 24398 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:17.479862 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:17.480715 24396 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:19:17.484200 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:17.484499 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:17.488984 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:17.486897 24321 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
W20260709 12:19:17.487991 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 408989us
I20260709 12:19:17.492596 24440 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:17.489727 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:17.494482 24399 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:19:17.497083 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:17.498430 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:17.493183 24391 raft_consensus.cc:1240] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:19:17.506132 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:17.366472 27202 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:17.507922 27076 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:17.375844 27193 consensus_queue.cc:237] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:17.509596 27202 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:17.371920 26991 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:17.367323 26993 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:17.514176 24322 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:17.508845 26983 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:17.458516 27149 consensus_meta.cc:287] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.806s	user 0.009s	sys 0.004s
I20260709 12:19:17.516992 25113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d"
dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:47070
I20260709 12:19:17.517205 26993 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:17.517269 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 151507us
I20260709 12:19:17.517957 27001 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.511943 27070 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:17.459844 27127 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.575151 25113 raft_consensus.cc:606] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:17.507479 24366 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:17.363049 27147 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:17.524894 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:17.507128 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:17.575246 24290 leader_election.cc:336] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.739s (SENT)
I20260709 12:19:17.582114 24290 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:17.323900 27129 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:17.511837 27174 raft_consensus.cc:2749] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:17.582783 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:17.584021 24321 raft_consensus.cc:1275] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:19:17.587010 24322 raft_consensus.cc:2393] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 8: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:17.522671 27211 raft_consensus.cc:2749] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:17.583953 25113 raft_consensus.cc:614] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:17.597380 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:17.518229 26918 consensus_queue.cc:260] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:17.606220 24317 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:19:17.610129 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:17.390738 27194 consensus_queue.cc:237] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:17.612687 24322 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
W20260709 12:19:17.617671 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 110248us
I20260709 12:19:17.594316 26983 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.572628 27149 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:17.580598 27127 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:17.623164 27204 log.cc:927] Time spent T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 12:19:17.582168 27001 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:17.608569 26993 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:19:17.625317 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 50120.9us
I20260709 12:19:17.631048 24366 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:17.613446 27202 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:17.642333 24466 raft_consensus.cc:1240] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 3. Current term is 4. Ops: []
W20260709 12:19:17.632972 24290 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.104s (SENT) [suppressed 35 similar messages]
I20260709 12:19:17.644017 27218 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:17.644395 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:17.644585 27218 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:19:17.645227 24321 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6.
I20260709 12:19:17.646015 27070 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:17.646600 27070 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.646930 27218 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:19:17.647033 27070 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:17.647500 27218 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:17.647919 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:17.649070 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:17.649298 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:17.649926 24471 raft_consensus.cc:2368] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6.
I20260709 12:19:17.650241 24469 raft_consensus.cc:2393] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:17.651065 27154 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.651602 27154 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:17.620613 26966 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.629351 26983 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:17.638494 27212 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:17.683202 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:17.684345 24465 raft_consensus.cc:2393] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:17.686822 27212 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:17.687762 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:17.689205 27212 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:17.690379 26966 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:17.642699 27174 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.697010 24324 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:19:17.718526 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:17.676944 27063 consensus_meta.cc:287] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.575s	user 0.005s	sys 0.010s
I20260709 12:19:17.719578 24471 raft_consensus.cc:2393] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:17.641650 27221 raft_consensus.cc:2749] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:17.699407 27174 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:17.721032 25113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c"
dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:47070
I20260709 12:19:17.690514 26918 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:17.724582 26904 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.725759 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:17.726465 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:17.742218 24469 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:17.683274 26993 raft_consensus.cc:697] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:17.727520 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:17.743224 24465 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:17.729103 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:17.745319 25084 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:17.745779 27143 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.746301 27143 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:17.746657 27150 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:17.747259 27150 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:17.748392 27143 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:17.647995 27218 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:17.748725 26963 raft_consensus.cc:2804] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:17.749388 26963 raft_consensus.cc:697] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:17.750604 27218 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:17.750340 26963 consensus_queue.cc:237] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:17.751539 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:17.753152 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:17.753836 25116 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:17.652153 27129 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:17.731616 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 111614us
I20260709 12:19:17.732784 24325 raft_consensus.cc:1275] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:19:17.739270 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:17.755378 24318 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:19:17.755609 25119 raft_consensus.cc:1240] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:17.755788 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:17.755940 24366 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:17.756353 24325 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:17.756904 27150 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:17.757002 27169 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:17.757282 24366 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:17.757884 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:17.758862 27148 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:17.759527 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:17.760248 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:17.760746 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:17.762038 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:17.764227 24366 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:17.766289 27178 raft_consensus.cc:2764] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:19:17.766909 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:17.767493 27148 raft_consensus.cc:2749] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:17.767580 25116 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:19:17.768106 24366 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:17.769878 24366 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:17.770431 24318 raft_consensus.cc:1240] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:17.770871 25084 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:17.771536 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:17.772964 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:17.773092 27141 consensus_queue.cc:1048] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:17.773540 27063 raft_consensus.cc:2804] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:17.774464 27063 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:17.774972 27063 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:17.775477 27148 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:17.773525 27178 raft_consensus.cc:2749] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:17.779742 27141 consensus_queue.cc:1059] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:17.783707 24318 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:19:17.791646 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:17.792855 25084 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:17.792650 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:17.794416 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:17.795817 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:17.795897 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:17.792438 24319 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:17.796883 24316 raft_consensus.cc:2410] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:19:17.808372 24465 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:17.734480 27154 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:17.810511 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:17.811220 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:17.811864 24465 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:17.812304 24316 raft_consensus.cc:1240] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:19:17.812067 25084 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:17.813189 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:17.748813 26868 consensus_queue.cc:1059] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:19:17.794852 25113 raft_consensus.cc:606] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:17.796301 26963 raft_consensus.cc:3055] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:17.819844 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:17.821700 24473 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:17.822045 24319 raft_consensus.cc:1240] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:19:17.801189 27150 raft_consensus.cc:2804] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:19:17.816385 27098 consensus_meta.cc:287] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.000s
I20260709 12:19:17.826361 24366 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:17.838081 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:17.827684 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:17.841413 24316 raft_consensus.cc:2393] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 8: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:17.819234 27178 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:17.859000 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:17.859951 24471 raft_consensus.cc:2393] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:17.798261 26904 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:17.849107 24319 raft_consensus.cc:1240] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:17.825492 25113 raft_consensus.cc:614] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:19:17.842025 27214 log.cc:927] Time spent T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 12:19:17.847862 24465 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:17.886467 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:17.887189 24322 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:17.887110 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:17.887882 24465 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:17.869350 25116 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEARNER]: Advancing to term 5
I20260709 12:19:17.872828 26993 consensus_queue.cc:237] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:17.873536 27001 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:17.841885 26937 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:17.875777 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1808) took 1826 ms. Trace:
I20260709 12:19:17.878379 27149 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:17.879236 27215 log.cc:927] Time spent T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 12:19:17.825242 26963 raft_consensus.cc:740] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:17.911036 26963 consensus_queue.cc:260] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:17.912194 26963 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:17.895505 24474 rpcz_store.cc:276] 0709 12:19:16.049123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:16.049346 (+   223us) service_pool.cc:224] Handling call
0709 12:19:16.058907 (+  9561us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:16.090610 (+ 31703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:16.090658 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:16.091529 (+   871us) log.cc:844] Serialized 26 byte log entry
0709 12:19:17.700271 (+1608742us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b1800047da0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a94241e07 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425ec02 00007f4a96ee620b 00007f4a96eebd23 00007f4a96eec0d1 00007f4a97307a0f
0709 12:19:17.741462 (+ 41191us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:17.741503 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:17.741571 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:17.875450 (+133879us) raft_consensus.cc:1685] finished
0709 12:19:17.875467 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:17.875708 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24783,"raft.queue_time_us":24530,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":3735,"spinlock_wait_cycles":4647680,"thread_start_us":40991,"threads_started":1,"wal-append.queue_time_us":1703891}
I20260709 12:19:17.863418 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:17.882547 24473 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:17.827659 27150 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:17.885249 24325 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:17.890192 25117 raft_consensus.cc:1275] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:19:17.917366 25117 pending_rounds.cc:85] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281: Aborting all ops after (but not including) 5
I20260709 12:19:17.917701 25117 pending_rounds.cc:107] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:19:17.918030 25117 raft_consensus.cc:2889] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:17.904814 27232 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:17.905007 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:17.893674 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:17.895299 26937 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:17.842303 27098 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:17.956202 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:17.944052 27150 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:17.967589 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:17.968492 24470 raft_consensus.cc:2410] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:19:17.973852 24290 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:17.977571 24316 raft_consensus.cc:1275] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:19:17.979252 24316 raft_consensus.cc:1275] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:19:17.990669 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:17.997200 25116 raft_consensus.cc:1275] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEARNER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:19:17.998965 27223 log.cc:927] Time spent T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:19:17.953477 26937 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:18.009473 24322 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:18.010870 24316 raft_consensus.cc:1240] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
W20260709 12:19:18.012408 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:18.015499 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:18.016525 24470 raft_consensus.cc:2393] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:18.017376 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:18.018004 24470 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:19:17.925980 24469 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:19:18.019711 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:17.945618 24471 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:19:18.033810 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:18.034963 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:18.035758 24471 raft_consensus.cc:2410] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:19:17.948660 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:17.949389 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:18.037062 24325 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:18.037348 24473 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:18.036444 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:18.041461 24471 raft_consensus.cc:2393] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 6: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:18.042923 24471 raft_consensus.cc:1275] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:19:18.043475 24471 pending_rounds.cc:85] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 3
I20260709 12:19:18.043766 24471 pending_rounds.cc:107] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:19:18.044064 24471 raft_consensus.cc:2889] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:18.051975 24325 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
W20260709 12:19:18.027980 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 143686us
I20260709 12:19:18.045645 24473 raft_consensus.cc:2468] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:18.054788 24291 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:17.946280 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:18.056829 24465 raft_consensus.cc:2393] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 7: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:17.887480 27178 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:17.894032 27169 consensus_queue.cc:1059] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 12:19:17.954674 26966 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:18.065081 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:18.085973 24391 raft_consensus.cc:2393] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 6: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:17.969893 27127 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:18.084434 24440 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:18.083387 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:18.093719 24470 raft_consensus.cc:2393] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 7: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:18.097190 24440 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:18.102689 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:18.082572 27149 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:18.193199 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:18.194276 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 220566us
I20260709 12:19:18.195078 24290 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:18.195163 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 140461us
I20260709 12:19:18.196092 24290 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:18.196306 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 92821us
I20260709 12:19:18.198354 24440 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:18.104749 26966 raft_consensus.cc:2804] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:18.200925 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:18.096370 27212 consensus_queue.cc:1048] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 12:19:18.109604 27174 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:18.215399 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:18.225170 27200 raft_consensus.cc:2804] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:18.225934 27200 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:18.226398 27200 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:18.229525 27225 log.cc:927] Time spent T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
I20260709 12:19:18.233270 26982 consensus_queue.cc:1048] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:18.233897 24396 raft_consensus.cc:2410] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:19:18.236204 27221 consensus_queue.cc:1059] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:18.237602 27169 raft_consensus.cc:3055] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:18.237999 27169 raft_consensus.cc:740] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:18.238970 27169 consensus_queue.cc:260] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:18.240603 27169 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:18.241745 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:18.236060 26937 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:18.197835 27209 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.242892 24396 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:19:18.242933 24366 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:18.245659 27194 consensus_queue.cc:1048] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:18.246085 27178 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:18.306865 27244 raft_consensus.cc:2749] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:18.222885 27127 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:18.246717 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:18.221273 27237 raft_consensus.cc:2749] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:18.311045 27127 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:18.313272 27127 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:18.247483 26904 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:18.204128 26966 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:18.281148 26993 consensus_queue.cc:1048] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:18.282300 27006 consensus_queue.cc:1048] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:18.286294 27150 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:18.287245 27174 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:18.292060 26937 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:18.270462 24366 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:18.301431 27098 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:18.304371 27238 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:18.306766 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1825) took 1279 ms. Trace:
I20260709 12:19:18.216228 27193 raft_consensus.cc:2749] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:18.340121 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:18.384280 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 113947us
I20260709 12:19:18.394971 24391 raft_consensus.cc:2393] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
W20260709 12:19:18.381570 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 185504us
I20260709 12:19:18.203549 27149 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:18.396082 24290 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:18.397614 27244 raft_consensus.cc:2749] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:18.397020 27149 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:18.385771 24321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.007s	sys 0.002s
W20260709 12:19:18.398869 24321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.008s	sys 0.002s
I20260709 12:19:18.397032 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:18.384618 26962 raft_consensus.cc:3055] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:18.399876 26962 raft_consensus.cc:740] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:18.399941 24324 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
W20260709 12:19:18.390306 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 194428us
I20260709 12:19:18.407130 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:18.381986 27151 consensus_meta.cc:287] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 1.074s	user 0.010s	sys 0.004s
I20260709 12:19:18.409699 24290 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:18.367754 26966 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:18.413874 24289 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:18.414011 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:18.414784 24396 raft_consensus.cc:2393] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 4: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:18.414204 24291 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:19:18.393872 27063 consensus_meta.cc:287] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.618s	user 0.015s	sys 0.000s
I20260709 12:19:18.418061 24290 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:18.420606 24468 raft_consensus.cc:2410] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:19:18.402247 26993 raft_consensus.cc:2804] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:18.394392 24466 rpcz_store.cc:276] 0709 12:19:17.027556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:17.027697 (+   141us) service_pool.cc:224] Handling call
0709 12:19:17.034452 (+  6755us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:17.643428 (+608976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:18.306313 (+662885us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54001225d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:18.306627 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1397443456}
W20260709 12:19:18.429245 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 231106us
I20260709 12:19:18.433411 27006 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.434326 27006 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:18.438544 27200 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:18.401046 26962 consensus_queue.cc:260] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:18.494033 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 75643.8us
W20260709 12:19:18.516253 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 55586.3us
W20260709 12:19:18.518528 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 89395.9us
I20260709 12:19:18.472162 27151 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.520080 24440 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:18.521420 24467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 602) took 1867 ms. Trace:
I20260709 12:19:18.523429 24366 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:18.310987 27209 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:18.523721 24467 rpcz_store.cc:276] 0709 12:19:16.653801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:16.653973 (+   172us) service_pool.cc:224] Handling call
0709 12:19:16.654344 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:16.702917 (+ 48573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:16.702948 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:16.706691 (+  3743us) log.cc:844] Serialized 26 byte log entry
0709 12:19:17.065012 (+358321us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:17.065051 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:17.412965 (+347914us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:19:18.521057 (+1108092us) spinlock_profiling.cc:243] Waited 43.7 ms on lock 0x7b5400243954. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:18.521123 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:18.521166 (+    43us) raft_consensus.cc:1685] finished
0709 12:19:18.521184 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:18.521346 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4389,"raft.queue_time_us":4895,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":19802,"spinlock_wait_cycles":109946624,"thread_start_us":357946,"threads_started":1,"wal-append.queue_time_us":477375,"wal-append.run_cpu_time_us":3891,"wal-append.run_wall_time_us":1314356}
I20260709 12:19:18.430620 27137 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:18.533962 27137 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:18.536242 27137 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:18.518405 26678 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:18.527495 27151 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:18.539399 27151 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:18.537195 27251 raft_consensus.cc:2804] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:18.527206 27244 consensus_queue.cc:1059] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:19:18.542948 27127 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:18.543685 27244 raft_consensus.cc:2804] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:18.570762 27244 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:18.570804 27200 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:18.571201 27244 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:18.544721 27006 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:18.548799 26988 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:18.573240 26988 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:18.573644 26988 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:18.551185 27209 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:18.425956 27063 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:18.456315 27238 raft_consensus.cc:697] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:18.578843 27209 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.578578 27238 consensus_queue.cc:237] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:18.579557 27209 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:18.551504 27150 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:18.519994 26993 raft_consensus.cc:697] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:18.570221 27127 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:18.578616 27063 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:18.527915 27193 raft_consensus.cc:2804] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:19:18.593559 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 175559us
I20260709 12:19:18.595966 24290 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:18.603595 27193 raft_consensus.cc:697] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:18.613351 27193 consensus_queue.cc:237] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:18.607592 27257 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.620235 24290 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:18.624758 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 101397us
I20260709 12:19:18.666066 27098 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:18.667049 27098 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:18.670476 27098 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:18.673115 27098 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:18.673951 27098 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:18.677047 27098 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:18.616246 27200 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:18.731784 24320 raft_consensus.cc:1240] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:18.735894 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:18.610330 27251 raft_consensus.cc:697] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:18.737980 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:18.740280 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:18.636086 27248 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:19:18.745270 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 125111us
I20260709 12:19:18.746157 24290 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:18.746160 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:18.747128 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:18.639887 27151 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:18.748005 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:18.749584 24320 raft_consensus.cc:2393] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 5: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:18.761199 27174 raft_consensus.cc:2749] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:18.779354 27127 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.780030 27127 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:18.780443 24290 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:18.782204 24290 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:18.787735 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:18.788802 24317 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6.
I20260709 12:19:18.732548 27237 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:18.750590 27246 raft_consensus.cc:2749] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:18.805958 24290 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:18.736934 27254 raft_consensus.cc:2749] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:18.837689 27098 consensus_queue.cc:1059] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:19:18.865876 27098 raft_consensus.cc:3055] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:18.866297 27098 raft_consensus.cc:740] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:18.731319 26993 consensus_queue.cc:237] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:18.869460 27251 consensus_queue.cc:237] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:19:18.751484 27248 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:18.807845 27151 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:18.875252 27151 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:18.742796 27200 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:19:18.864233 27209 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:18.619477 27257 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:18.867345 27098 consensus_queue.cc:260] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:18.895999 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:18.893323 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 87463.3us
I20260709 12:19:18.898784 24290 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:18.855842 27167 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:18.888725 27255 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:18.926019 24318 raft_consensus.cc:1275] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:19:18.891942 27258 raft_consensus.cc:2804] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:18.859483 26966 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:18.935557 24471 raft_consensus.cc:1275] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 12:19:18.936062 24471 pending_rounds.cc:85] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 5
I20260709 12:19:18.936504 24471 pending_rounds.cc:107] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 12:19:18.936774 24471 raft_consensus.cc:2889] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:18.937598 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 1735) took 1292 ms. Trace:
I20260709 12:19:18.939323 27259 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:18.940673 26991 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:18.940733 27259 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:18.894124 27262 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:18.938015 24468 rpcz_store.cc:276] 0709 12:19:17.645713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:17.647632 (+  1919us) service_pool.cc:224] Handling call
0709 12:19:18.934973 (+1287341us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b540029e854. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:18.937537 (+  2564us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1769912064}
I20260709 12:19:18.863215 26988 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:18.959076 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:18.960338 24317 raft_consensus.cc:2393] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 3: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:18.962393 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:18.963090 27195 raft_consensus.cc:3055] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:18.963153 24317 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:18.963827 27195 raft_consensus.cc:740] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:18.965211 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:18.965431 27147 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:18.927469 27200 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:18.932143 27098 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:18.935913 27258 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:18.959574 27127 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:18.927764 27167 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:18.974045 27262 raft_consensus.cc:697] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:19:18.986065 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 87395.7us
I20260709 12:19:18.991322 24290 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:18.994139 24290 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:18.978756 27258 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:18.995841 24290 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:18.997013 24290 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:18.976384 27255 raft_consensus.cc:697] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:19:19.003106 27181 log.cc:927] Time spent T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 2.469s	user 0.014s	sys 0.007s
I20260709 12:19:19.008101 24290 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:19.008332 27246 raft_consensus.cc:2804] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:19.011467 27246 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:19.011555 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:19.011960 27246 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:19.012336 24320 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:18.999711 27164 raft_consensus.cc:2804] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:18.998078 27127 raft_consensus.cc:2804] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:19.013650 24290 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:19.015542 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:18.999342 26986 raft_consensus.cc:2749] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:19.016247 27272 raft_consensus.cc:2749] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:19.020723 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1828) took 2610 ms. Trace:
I20260709 12:19:19.030172 24393 rpcz_store.cc:276] 0709 12:19:16.402638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:16.410462 (+  7824us) service_pool.cc:224] Handling call
0709 12:19:16.410803 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:16.411231 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:16.411260 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:16.411744 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 12:19:16.492007 (+ 80263us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:16.492079 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:16.492140 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:18.837073 (+2344933us) spinlock_profiling.cc:243] Waited 51.2 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:19:19.006285 (+169212us) raft_consensus.cc:1685] finished
0709 12:19:19.006319 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:19.012949 (+  6630us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1180,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":117724416,"thread_start_us":79875,"threads_started":1,"wal-append.queue_time_us":89905}
I20260709 12:19:19.027278 24317 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6.
I20260709 12:19:19.033082 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:19.058548 24290 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:19.060272 24317 raft_consensus.cc:1240] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:19:19.067986 24290 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:19.067574 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:19.025872 27127 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.028877 27193 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.058131 27164 raft_consensus.cc:697] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:19.119109 24473 raft_consensus.cc:1275] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:19:19.108114 27127 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:19.057827 27254 raft_consensus.cc:2749] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:19:19.178344 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 110458us
I20260709 12:19:19.218873 26966 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:19.175417 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:19.222304 24465 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:19.174898 24469 raft_consensus.cc:1240] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:19.176920 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:19.071224 27248 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:19.226524 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:19.158840 27257 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:19.141105 27255 consensus_queue.cc:237] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:19.175009 24468 raft_consensus.cc:1240] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:19.189267 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:19.071040 27270 consensus_queue.cc:1048] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.132s
I20260709 12:19:19.119844 27262 consensus_queue.cc:237] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:19.199263 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:19.247093 24325 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:19.199354 27267 log.cc:927] Time spent T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
W20260709 12:19:19.204829 27249 log.cc:927] Time spent T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.616s	user 0.000s	sys 0.007s
I20260709 12:19:19.207098 27141 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.208086 27143 raft_consensus.cc:3055] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:19.202924 26983 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:19.177860 27272 raft_consensus.cc:2804] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:19.219632 24290 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:19.177397 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:19.228341 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:19.186684 27251 raft_consensus.cc:2749] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:19.242226 24473 raft_consensus.cc:2393] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 7: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:19.284842 24473 raft_consensus.cc:1275] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:19:19.245424 27259 raft_consensus.cc:2749] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:19:19.202903 27244 consensus_meta.cc:287] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.631s	user 0.011s	sys 0.000s
I20260709 12:19:19.258051 24465 raft_consensus.cc:2410] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:19:19.216818 27142 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:19.253031 27270 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:19.216424 27193 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:19.308396 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 88846.1us
I20260709 12:19:19.282338 24467 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:19.291013 24325 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:19.235325 26993 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.292510 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:19.314455 25083 connection.cc:256] RPC call timeout handler was delayed by -1.2290096060000906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2215s for a response
W20260709 12:19:19.293392 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:19.293264 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:19.318745 24468 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:19.309305 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:19.275600 27143 raft_consensus.cc:740] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:19.350762 27150 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.353163 27150 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:19.354615 27127 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:19.355468 27150 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:19.356083 27150 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.257400 27258 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:19.319715 27244 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:19.358624 27258 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:19.359210 27244 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:19.359704 27143 consensus_queue.cc:260] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:19.356532 27150 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:19.362411 27150 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:19.362665 27274 log.cc:927] Time spent T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:19:19.322535 24465 raft_consensus.cc:1275] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:19:19.254073 27169 consensus_queue.cc:1048] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:19:19.367439 27169 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:19.367580 27246 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:19.367975 27169 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:19.321030 24473 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:19.369767 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:19.283823 27006 consensus_queue.cc:1048] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.088s
I20260709 12:19:19.371270 27006 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.319569 26993 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:19.371749 27006 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:19.372709 27276 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:19.373323 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1753) took 1643 ms. Trace:
I20260709 12:19:19.322456 27272 raft_consensus.cc:697] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:19.373230 27276 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:19.374079 24471 rpcz_store.cc:276] 0709 12:19:17.729582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:18.049652 (+320070us) service_pool.cc:224] Handling call
0709 12:19:18.935199 (+885547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:18.937188 (+  1989us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:19.372897 (+435709us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b540029e850. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:19.373223 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2035650944}
I20260709 12:19:19.374970 27272 consensus_queue.cc:237] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:19.376147 27276 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:19.378784 24471 raft_consensus.cc:1240] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:19.345759 27164 consensus_queue.cc:237] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:19.371282 24468 raft_consensus.cc:1275] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:19.382464 24321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44278 (request call id 2143) took 1696 ms. Trace:
I20260709 12:19:19.382136 27193 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:19.415390 27273 log.cc:927] Time spent T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:19:19.320832 27167 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:19.323208 27172 raft_consensus.cc:2749] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:19.398394 24321 rpcz_store.cc:276] 0709 12:19:17.686010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:17.686179 (+   169us) service_pool.cc:224] Handling call
0709 12:19:17.732672 (+ 46493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:17.740372 (+  7700us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:17.740404 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:17.793407 (+ 53003us) log.cc:844] Serialized 26 byte log entry
0709 12:19:18.399298 (+605891us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:18.399336 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:18.399399 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:19.204188 (+804789us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:19:19.382120 (+177932us) raft_consensus.cc:1685] finished
0709 12:19:19.382143 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:19.382397 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":142,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":57680,"spinlock_wait_cycles":24261888,"thread_start_us":574587,"threads_started":1,"wal-append.queue_time_us":699825}
I20260709 12:19:19.427929 27195 consensus_queue.cc:260] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:19:19.430784 26993 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:19.431429 27195 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:19.431574 27006 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:19.433118 27252 log.cc:927] Time spent T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.466s	user 0.000s	sys 0.002s
I20260709 12:19:19.294394 27141 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:19.431454 27169 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:19.442123 27141 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:19.456040 24467 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:19.460995 26944 raft_consensus.cc:3055] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:19.461705 26944 raft_consensus.cc:740] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:19.462818 26944 consensus_queue.cc:260] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:19.381456 24469 raft_consensus.cc:1240] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:19.464502 26944 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:19.403429 24320 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:19.342950 27270 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:19.413125 27127 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:19.414058 27246 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:19.482748 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:19.528613 27070 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:19.535065 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:19.543170 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:19.548166 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:19.616226 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 379853us
I20260709 12:19:19.588789 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:19.591784 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:19.759828 24397 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:19:19.604060 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:19.603668 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:19.596699 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:19.762646 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 299112us
W20260709 12:19:19.765425 25082 leader_election.cc:336] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.847s (SENT)
I20260709 12:19:19.766160 25082 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:19.593786 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:19.769882 24393 raft_consensus.cc:2410] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:19.777961 24391 raft_consensus.cc:2393] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:19.765033 25117 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
W20260709 12:19:19.811523 24365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.001s	sys 0.036s
W20260709 12:19:19.811952 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:19.812325 24365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.001s	sys 0.036s
W20260709 12:19:19.812716 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:19.812917 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 54409.5us
I20260709 12:19:19.815618 24400 raft_consensus.cc:1275] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:19:19.816128 24366 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:19.778086 27262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.013s	sys 0.017s
I20260709 12:19:19.556056 27141 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:19.814018 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 44433.6us
I20260709 12:19:19.541445 27169 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:19.830236 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 64850.3us
I20260709 12:19:19.833329 24320 raft_consensus.cc:1275] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:19:19.837091 25082 connection.cc:256] RPC call timeout handler was delayed by -1.6730440520000229s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
W20260709 12:19:19.837460 25082 connection.cc:256] RPC call timeout handler was delayed by -1.15189096600011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
I20260709 12:19:19.810564 27006 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.839103 25082 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:19.834853 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:19.577409 27278 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:19:19.840277 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 391906us
W20260709 12:19:19.841355 24366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:19.827535 27262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.014s	sys 0.017s
I20260709 12:19:19.825081 27173 raft_consensus.cc:2749] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:19.849882 24316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44278 (request call id 2148) took 1975 ms. Trace:
W20260709 12:19:19.846419 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 530529us
I20260709 12:19:19.847620 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:19.835390 27082 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:19.850265 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:19.856266 24394 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:19.853636 24316 rpcz_store.cc:276] 0709 12:19:17.874094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:17.991072 (+116978us) service_pool.cc:224] Handling call
0709 12:19:18.010583 (+ 19511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:18.011301 (+   718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:19.849675 (+1838374us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b540001d450. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:19.849824 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43649408}
I20260709 12:19:19.857321 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:19.857970 24394 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:19.858701 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:19.849597 24395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:19:19.859690 24395 raft_consensus.cc:606] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:19.860023 24395 raft_consensus.cc:614] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:19.833319 27221 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.837795 27148 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:19.872959 27148 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:19.873232 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:19.874274 25119 raft_consensus.cc:2410] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:19.874881 27148 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:19.875627 25113 raft_consensus.cc:2955] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEARNER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:19:19.880885 27284 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:19.881248 26944 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.865154 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:19.855624 27142 consensus_meta.cc:287] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.534s	user 0.009s	sys 0.002s
I20260709 12:19:19.881523 27284 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:19.881775 26944 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:19.867959 26962 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:19.885910 27082 raft_consensus.cc:697] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:19.886994 27082 consensus_queue.cc:237] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:19.887228 27221 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:19.833609 26949 consensus_queue.cc:1048] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:19:19.880311 26993 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:19.889345 26993 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:19.868402 27282 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.847569 27006 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:19.840056 27141 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:19.870136 27173 raft_consensus.cc:2804] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:19.853441 27278 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:19.864504 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:19.882783 27276 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.883972 26944 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:19.884095 27284 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:19.884758 26982 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:19.935236 26982 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:19.938576 26982 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:19.885464 27285 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.942553 27285 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:19.949007 25116 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 1.
I20260709 12:19:19.950512 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:19.951378 24399 raft_consensus.cc:2410] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:19.952196 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:19.843250 27169 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:19.925433 27006 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:19.926926 27141 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:19.952665 27278 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:19.904230 27173 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.954066 27173 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:19.954370 27169 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:19.929873 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:19.955917 24395 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
W20260709 12:19:19.957226 27220 log.cc:927] Time spent T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 2.306s	user 0.014s	sys 0.040s
I20260709 12:19:19.890815 27270 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:19.958720 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:19.959410 27218 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.959921 27218 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:19.931111 27276 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:19.963020 27200 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.931924 24366 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:19.938705 26993 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:19.963821 27276 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:19.893575 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:19.962407 27218 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:19.963581 27200 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:19.975363 27256 consensus_queue.cc:1048] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:19:19.977052 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 45230.4us
I20260709 12:19:19.897984 27282 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:20.001907 24393 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:20.011023 24397 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:20.001782 27169 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:19:20.028339 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:20.035532 24440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:20.093796 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.094481 24366 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:20.007200 27285 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:20.099244 24393 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:20.115063 24322 raft_consensus.cc:1275] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:19:20.117563 25116 raft_consensus.cc:1240] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:20.119822 24319 raft_consensus.cc:1275] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:20.121901 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:20.122928 24320 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:20.025770 27169 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:20.125269 25084 connection.cc:256] RPC call timeout handler was delayed by -1.543610598999976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2619s for a response
I20260709 12:19:20.025127 27282 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:20.024541 27200 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:20.126263 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:20.130679 24324 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:20.131536 25084 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:20.136113 27276 raft_consensus.cc:2804] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:20.136744 27276 raft_consensus.cc:697] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:20.136376 24218 catalog_manager.cc:5697] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 3 to 4, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 4 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:20.137678 27276 consensus_queue.cc:237] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:20.138218 24218 catalog_manager.cc:5697] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 2 to 3, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 3 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:19:20.139935 24218 catalog_manager.cc:5697] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:20.135250 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:20.144519 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:20.145161 25119 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:20.145403 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:20.143911 25116 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:20.146855 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:20.151253 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:20.109375 27289 raft_consensus.cc:2804] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:20.130944 27169 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:20.154896 25115 raft_consensus.cc:2393] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:20.167100 27164 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.169421 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 612) took 1096 ms. Trace:
I20260709 12:19:20.171958 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:20.172659 25116 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:20.148197 24320 raft_consensus.cc:1275] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:19:20.172443 24466 rpcz_store.cc:276] 0709 12:19:19.073457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:19.177705 (+104248us) service_pool.cc:224] Handling call
0709 12:19:19.179130 (+  1425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:19.190288 (+ 11158us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:19:19.474392 (+284104us) log.cc:844] Serialized 14 byte log entry
0709 12:19:19.830208 (+355816us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:19.836897 (+  6689us) log.cc:844] Serialized 26 byte log entry
0709 12:19:19.837279 (+   382us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:19.837342 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:19.837441 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:20.169129 (+331688us) raft_consensus.cc:1685] finished
0709 12:19:20.169155 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:20.169350 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10666,"prepare.queue_time_us":639568,"raft.queue_time_us":34801,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":3876,"spinlock_wait_cycles":5129984,"thread_start_us":612426,"threads_started":2,"wal-append.queue_time_us":637147}
I20260709 12:19:20.179937 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:20.180833 25116 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:20.181445 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:20.182037 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:20.182672 24320 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:20.186774 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:20.187891 24320 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:19:20.141978 27159 consensus_queue.cc:1059] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:19:20.156435 27289 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:20.170238 27218 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.192606 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:20.193907 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:20.199216 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:20.200500 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:20.201722 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:20.201790 24324 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:20.204115 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:20.211237 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 372205us
I20260709 12:19:20.202626 25112 raft_consensus.cc:2393] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:20.194628 27289 raft_consensus.cc:3060] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.214920 25082 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:20.200314 27246 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.199733 27218 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:20.230190 27218 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:20.236801 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:20.237995 25114 raft_consensus.cc:2393] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 7: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:20.240872 26988 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:20.243129 27173 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:20.246219 27173 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:20.247136 27173 raft_consensus.cc:3055] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:20.247733 27173 raft_consensus.cc:740] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:20.248893 27173 consensus_queue.cc:260] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:20.250530 27173 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:20.248231 27286 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:20.181598 27164 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:20.269181 24366 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:20.272913 27195 consensus_queue.cc:1048] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:19:20.270085 26988 consensus_queue.cc:1048] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:20.274758 27239 consensus_queue.cc:1048] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:19:20.278529 24218 catalog_manager.cc:5697] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 3 to 5, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 5 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:20.280608 24366 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:20.281586 26988 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:20.282016 26988 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.282388 26988 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:20.285691 24366 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:20.287318 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 432516us
I20260709 12:19:20.284484 24291 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:20.287667 24366 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:20.300577 24321 raft_consensus.cc:2393] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 5: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:20.223479 27246 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:20.284864 27239 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:20.314080 24291 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:20.338763 24218 catalog_manager.cc:5697] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 2 to 5, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 5 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:20.302403 24366 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:20.342433 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:20.347086 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:20.348229 24470 raft_consensus.cc:2410] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:19:20.349367 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:20.350239 24465 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:20.351374 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:20.352936 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:20.354563 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 54331.1us
I20260709 12:19:20.355722 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:20.355841 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 53515.5us
I20260709 12:19:20.297806 26994 raft_consensus.cc:2804] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:20.360325 26994 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.360790 26994 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:20.360829 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:20.361296 24220 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54252 (request call id 253) took 21705 ms (client timeout 15000 ms). Trace:
I20260709 12:19:20.361737 24468 raft_consensus.cc:2393] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:20.362524 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:20.364279 27282 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:20.364781 27282 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.365146 27282 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:20.365530 24218 catalog_manager.cc:5697] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 4 to 5, leader changed from d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 5 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:20.368180 27070 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.368673 26956 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:20.370167 27070 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:20.372841 27284 consensus_queue.cc:1059] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:20.374132 27284 raft_consensus.cc:3055] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:20.374488 27284 raft_consensus.cc:740] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:20.375316 27284 consensus_queue.cc:260] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:20.361761 24220 rpcz_store.cc:269] 0709 12:18:58.655613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:58.693204 (+ 37591us) service_pool.cc:224] Handling call
0709 12:18:59.478673 (+785469us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b540008ff54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b6090 00007f4a97354f3a 00007f4a9d10ae9c 00007f4a9d20904e 00007f4a9b6ca2a4 00007f4a9b6ca232 00007f4a9b6ca161 00007f4a9b6ca0dc 00007f4a9b6c9392 00007f4a9568748c 00007f4a956868c6
0709 12:19:20.361027 (+20882354us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:14.173127 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:14.205506 (+ 32379us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:14.205555 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:19:14.205582 (+    27us) tablet.cc:662] Decoding operations
0709 12:19:14.207381 (+  1799us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:14.207466 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:14.207515 (+    49us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:19:14.285939 (+ 78424us) tablet.cc:701] Row locks acquired
0709 12:19:14.285969 (+    30us) write_op.cc:260] PREPARE: finished
0709 12:19:14.286220 (+   251us) write_op.cc:270] Start()
0709 12:19:14.286394 (+   174us) write_op.cc:276] Timestamp: P: 1783599554286132 usec, L: 0
0709 12:19:14.286424 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:19:14.298075 (+ 11651us) log.cc:844] Serialized 6053 byte log entry
0709 12:19:14.553073 (+254998us) op_driver.cc:464] REPLICATION: finished
0709 12:19:15.068841 (+515768us) spinlock_profiling.cc:243] Waited 5.51 ms on lock 0x7b18003529c0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9425f3f3 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd 0000000000388634 0000000000388479 00007f4a9424283a
0709 12:19:15.090863 (+ 22022us) write_op.cc:301] APPLY: starting
0709 12:19:15.091027 (+   164us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:15.091494 (+   467us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:15.091546 (+    52us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:15.127036 (+ 35490us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:15.157407 (+ 30371us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 12:19:15.161548 (+  4141us) write_op.cc:312] APPLY: finished
0709 12:19:15.162107 (+   559us) log.cc:844] Serialized 107 byte log entry
0709 12:19:15.162331 (+   224us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:15.162675 (+   344us) write_op.cc:454] Released schema lock
0709 12:19:15.162751 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:15.163307 (+   556us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:15.163332 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":29,"spinlock_wait_cycles":1120376576,"child_traces":[["op",{"apply.queue_time_us":296439,"apply.run_cpu_time_us":9980,"apply.run_wall_time_us":72469,"num_ops":15,"prepare.queue_time_us":164674,"prepare.run_cpu_time_us":22164,"prepare.run_wall_time_us":339084,"raft.queue_time_us":4761,"raft.run_cpu_time_us":27199,"raft.run_wall_time_us":394212,"replication_time_us":266450,"spinlock_wait_cycles":12681600,"thread_start_us":371596,"threads_started":4,"wal-append.queue_time_us":165434,"wal-append.run_cpu_time_us":8818,"wal-append.run_wall_time_us":1722628}]]}
I20260709 12:19:20.367440 24218 catalog_manager.cc:5697] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 3 to 4, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 4 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:19:20.341801 27298 log.cc:927] Time spent T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.074s	user 0.002s	sys 0.000s
I20260709 12:19:20.377490 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:20.299835 27218 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.299882 27076 raft_consensus.cc:2804] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:19:20.358713 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 44871.8us
I20260709 12:19:20.303545 25083 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:20.328284 27285 raft_consensus.cc:2804] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:19:20.397182 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 93741.9us
I20260709 12:19:20.289314 27195 consensus_queue.cc:1048] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:19:20.340694 27239 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:20.408699 25083 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:20.372957 27006 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.418640 25112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "400165817fe74ada9a4793982993a5e3"
dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:47070
I20260709 12:19:20.408442 24218 catalog_manager.cc:5697] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } }
I20260709 12:19:20.424431 24470 raft_consensus.cc:1240] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: []
W20260709 12:19:20.426247 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 70564.8us
W20260709 12:19:20.430430 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 73559us
I20260709 12:19:20.398136 27076 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.432453 24218 catalog_manager.cc:5697] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 1 to 3, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 3 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:19:20.435030 25112 raft_consensus.cc:606] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:20.412011 27070 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:20.442016 26956 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:20.444329 24365 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:20.687969 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 243701us
I20260709 12:19:20.445061 27280 consensus_queue.cc:1048] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:20.415628 27239 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:20.447803 26993 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.448285 27195 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.449076 27260 consensus_queue.cc:1059] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:20.449991 24366 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:19:20.453472 27296 log.cc:927] Time spent T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 12:19:20.721760 24468 raft_consensus.cc:1275] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:19:20.455075 27237 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.408923 27284 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:20.460784 27287 consensus_queue.cc:1048] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:20.727840 27070 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:19:20.462497 27307 log.cc:927] Time spent T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:19:20.728422 27070 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:20.729764 27289 consensus_meta.cc:287] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.502s	user 0.011s	sys 0.008s
I20260709 12:19:20.729947 26994 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:20.730571 27070 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:20.470470 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 247713us
I20260709 12:19:20.733816 25082 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:20.405027 27285 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:20.734529 27285 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:20.413534 27150 raft_consensus.cc:2749] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:20.437378 27076 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:20.718760 26993 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:19:20.476936 25112 raft_consensus.cc:614] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:20.741019 26993 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:19:20.408272 27218 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:20.742285 27237 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:20.743283 27218 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:20.617542 24218 catalog_manager.cc:5697] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 3 to 4, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 4 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:20.437036 27006 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:20.649284 24472 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.010s	sys 0.009s
I20260709 12:19:20.414291 27255 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:20.408736 27299 consensus_queue.cc:1048] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.158s
I20260709 12:19:20.540679 27301 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.427860 27286 raft_consensus.cc:2749] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:20.686393 24466 raft_consensus.cc:1275] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:19:20.686713 24440 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:20.709092 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:20.692903 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 300104us
I20260709 12:19:20.716028 24320 raft_consensus.cc:1275] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:19:20.707984 24365 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:20.730259 27289 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:20.727177 27164 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:20.746821 27300 log.cc:927] Time spent T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.311s	user 0.000s	sys 0.001s
W20260709 12:19:20.790019 24472 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.012s	sys 0.011s
I20260709 12:19:20.722227 27195 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:20.790751 27200 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:20.791256 27200 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:20.791867 26956 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:20.792450 24472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1827) took 3576 ms. Trace:
I20260709 12:19:20.783777 27221 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:20.762051 27169 consensus_meta.cc:287] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.585s	user 0.012s	sys 0.000s
I20260709 12:19:20.792595 26956 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:20.793344 27289 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:20.793864 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 107217us
I20260709 12:19:20.795047 24440 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:20.795374 26956 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:20.796185 24440 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:20.796815 27309 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:20.818892 27309 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.819386 27309 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:20.821079 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:20.821302 27308 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:20.821820 24470 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:20.821908 27308 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.822497 27308 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:20.797081 27006 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:20.744434 27237 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:20.724763 27272 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.797550 27218 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:20.792860 24474 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:20.793296 27169 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:20.744494 24218 catalog_manager.cc:5697] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:19:20.849844 24218 catalog_manager.cc:5697] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:20.851394 24218 catalog_manager.cc:5697] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:19:20.851927 25115 raft_consensus.cc:1275] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:20.786947 27143 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:20.844826 27218 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.853955 26962 consensus_queue.cc:1048] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:20.854663 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:20.855312 24323 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:20.799587 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:20.836362 26956 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:20.799841 27301 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:20.857312 25112 raft_consensus.cc:1275] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:20.858382 27082 raft_consensus.cc:2804] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:20.858803 27082 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.859135 27082 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:20.860502 26962 consensus_queue.cc:1048] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:20.861198 27159 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:20.861688 27159 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.862022 27159 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:20.863830 26949 raft_consensus.cc:2804] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:20.864384 26949 raft_consensus.cc:697] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:20.865275 26949 consensus_queue.cc:237] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:20.800295 26988 consensus_meta.cc:287] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.517s	user 0.006s	sys 0.005s
I20260709 12:19:20.756551 24393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:19:20.800762 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:20.868194 26988 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:20.732494 26994 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:20.806959 27282 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:20.807471 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:20.793282 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.808391 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:20.793869 27255 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:20.782449 27246 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:20.809423 24465 raft_consensus.cc:1275] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:19:20.810105 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:20.792615 27195 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:20.813040 27076 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:20.768611 27285 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:20.817603 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:20.815454 27239 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:20.829605 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:20.830296 24317 raft_consensus.cc:1275] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:20.710228 26982 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:20.833240 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:20.836525 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 386593us
I20260709 12:19:20.845450 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:21.024351 24465 pending_rounds.cc:85] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 6
W20260709 12:19:21.020831 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 287047us
W20260709 12:19:21.026012 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 318153us
I20260709 12:19:21.026181 25082 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:21.025745 24467 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:19:20.792922 24472 rpcz_store.cc:276] 0709 12:19:17.216300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:17.216434 (+   134us) service_pool.cc:224] Handling call
0709 12:19:17.216878 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:17.225426 (+  8548us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:19:17.234727 (+  9301us) log.cc:844] Serialized 14 byte log entry
0709 12:19:19.424054 (+2189327us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b18002e4020. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a96ef44bc 00007f4a9424248b 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425c455 00007f4a97344060 00007f4a97356716 00007f4a97367287
0709 12:19:19.761002 (+336948us) log.cc:844] Serialized 14 byte log entry
0709 12:19:20.790517 (+1029515us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:20.790577 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:20.790626 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:20.792258 (+  1632us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:20.792378 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10368,"prepare.queue_time_us":454024,"prepare.run_cpu_time_us":149,"prepare.run_wall_time_us":3535,"raft.queue_time_us":128777,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":24491,"spinlock_wait_cycles":8502528,"thread_start_us":1492762,"threads_started":4,"wal-append.queue_time_us":404084}
I20260709 12:19:21.029247 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:21.029300 24397 raft_consensus.cc:1275] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:21.025238 24465 pending_rounds.cc:107] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:19:21.031667 24465 raft_consensus.cc:2889] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:21.029575 24366 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:21.027992 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:21.036373 25082 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:21.032573 24471 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
I20260709 12:19:21.031418 24325 raft_consensus.cc:2393] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 4: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:19:21.004858 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:21.025431 25117 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:19:21.078094 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:20.897233 26962 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:21.065817 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:21.098696 24398 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:19:21.061002 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:21.069686 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:20.853996 27218 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:20.881614 24218 catalog_manager.cc:5697] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:19:21.040359 25083 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:21.043147 24366 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:21.106158 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 65882.9us
W20260709 12:19:21.073632 24289 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.016s	sys 0.044s
W20260709 12:19:21.108606 24289 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.016s	sys 0.045s
I20260709 12:19:20.871030 27005 raft_consensus.cc:3055] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:20.989526 27284 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.870373 27200 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:21.008733 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:21.025981 26982 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:21.081385 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:21.047578 26994 consensus_queue.cc:1059] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 12:19:21.082749 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:21.170140 24396 raft_consensus.cc:2393] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 7: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:21.083280 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:21.170709 24395 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:21.083545 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:21.085870 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 49583.1us
I20260709 12:19:21.171743 24319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1718) took 1017 ms. Trace:
I20260709 12:19:21.172483 25082 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:21.085975 27150 raft_consensus.cc:2804] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:21.032164 24323 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6.
I20260709 12:19:20.857393 26956 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:20.871661 27272 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:21.011142 27309 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:20.846098 27070 consensus_queue.cc:1059] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.249s
I20260709 12:19:21.096517 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:21.184576 24397 raft_consensus.cc:2393] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 7: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:21.102437 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:21.035617 27277 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:21.068542 27195 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:19:21.116207 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 73153.1us
W20260709 12:19:21.109138 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 671238us
I20260709 12:19:21.114251 27173 raft_consensus.cc:2804] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:21.143079 27280 raft_consensus.cc:2749] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:21.170912 26982 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:21.225973 24323 raft_consensus.cc:1240] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:21.180517 27150 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:21.185950 27276 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:21.082173 24393 raft_consensus.cc:606] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:21.233230 24393 raft_consensus.cc:614] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:19:21.233302 24316 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.045s	sys 0.061s
I20260709 12:19:21.176267 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:21.177611 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:21.178846 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:21.145215 24291 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:21.180795 24400 raft_consensus.cc:2393] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 5: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:21.180665 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:21.236644 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 91503.2us
I20260709 12:19:21.237021 24394 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6.
I20260709 12:19:21.181814 24218 catalog_manager.cc:5697] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 3 to 6, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 6 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:21.182993 25116 raft_consensus.cc:1240] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:21.240051 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:21.127583 26962 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:21.125946 27005 raft_consensus.cc:740] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:21.172108 24319 rpcz_store.cc:276] 0709 12:19:20.154374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.154666 (+   292us) service_pool.cc:224] Handling call
0709 12:19:20.177129 (+ 22463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:20.177402 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:20.635071 (+457669us) log.cc:844] Serialized 14 byte log entry
0709 12:19:21.168955 (+533884us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:21.169026 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:21.169104 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:21.171570 (+  2466us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:21.171691 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21776,"prepare.queue_time_us":73196,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":434,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":12425,"thread_start_us":883893,"threads_started":2}
I20260709 12:19:21.207031 27173 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:21.143224 27006 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.221652 27070 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.266251 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:21.035349 27302 consensus_queue.cc:1048] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 12:19:21.267062 25116 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:21.209007 24289 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:21.228402 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:21.230751 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:20.870293 26988 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:21.147825 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:21.270188 24398 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
W20260709 12:19:21.233798 24316 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.045s	sys 0.061s
I20260709 12:19:21.187597 27304 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:21.141836 27301 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:21.191871 27169 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:21.250056 27164 raft_consensus.cc:2804] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:21.251636 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:21.144697 25083 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:19:21.294090 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 459906us
W20260709 12:19:21.294533 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 149932us
I20260709 12:19:21.295084 25083 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:21.168438 27284 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:21.256521 24318 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.014s	sys 0.009s
W20260709 12:19:21.296175 24318 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.015s	sys 0.009s
I20260709 12:19:21.193138 27195 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:21.216974 26994 consensus_queue.cc:1243] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer 99b8650fa8324ac2ac5f75eee9b1a1e3 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:19:21.259047 27287 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.255811 24218 catalog_manager.cc:5697] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index -1 to 3, term changed from 2 to 4, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 4 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:19:21.319468 24218 catalog_manager.cc:5697] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:19:21.213351 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:21.264781 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:21.180231 27221 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:19:21.279268 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 70353.1us
I20260709 12:19:21.280735 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:21.281008 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:21.285066 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:21.232954 27150 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:21.286710 24317 raft_consensus.cc:2393] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:21.289304 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:21.188997 27277 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:21.293982 24394 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:19:21.308482 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:21.266256 27173 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:21.271860 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:21.345763 24320 raft_consensus.cc:2393] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 7: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:21.324542 24324 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:19:21.333886 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:21.346093 24391 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:21.334954 24317 raft_consensus.cc:1240] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:21.293577 27164 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:21.321573 24218 catalog_manager.cc:5697] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 5 to 6, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 6 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:21.439285 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:21.353037 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:21.312739 27195 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:21.451880 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:21.454857 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:21.355887 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:21.441404 24317 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:21.387163 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 48877.4us
I20260709 12:19:21.364318 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:21.281603 27006 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:21.284220 27070 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:21.329922 27316 raft_consensus.cc:2804] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:21.342027 27277 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:21.332450 27076 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:21.335578 27286 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:21.290206 27304 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:21.483651 24289 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:21.433045 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:21.451382 27164 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:21.509898 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 254229us
W20260709 12:19:21.512868 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 243506us
I20260709 12:19:21.513049 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:21.318805 27308 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:21.514739 24398 raft_consensus.cc:1240] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:21.522665 27255 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:21.349684 27143 consensus_queue.cc:1048] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.160s
I20260709 12:19:21.438994 27320 consensus_queue.cc:1048] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.105s
I20260709 12:19:21.337024 27287 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:21.344578 27221 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:21.344516 27005 consensus_queue.cc:260] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:21.937956 24440 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:21.920688 24473 raft_consensus.cc:1275] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:19:21.939666 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:21.579030 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 107184us
I20260709 12:19:21.933158 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:21.941773 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:21.942500 24466 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:21.937856 24396 raft_consensus.cc:1240] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:21.450150 25110 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:19:21.945818 24467 raft_consensus.cc:1240] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6. Ops: []
W20260709 12:19:21.946316 24318 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.009s	sys 0.009s
W20260709 12:19:21.955132 24318 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.009s	sys 0.009s
W20260709 12:19:21.812129 27082 consensus_meta.cc:287] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.885s	user 0.009s	sys 0.000s
W20260709 12:19:21.737470 27329 log.cc:927] Time spent T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:19:21.877617 24470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 623) took 1069 ms. Trace:
W20260709 12:19:21.734104 27323 log.cc:927] Time spent T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.260s	user 0.000s	sys 0.000s
W20260709 12:19:21.868057 24439 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.007s	sys 0.026s
I20260709 12:19:21.746170 27331 raft_consensus.cc:3055] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:19:22.020780 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 44277.2us
W20260709 12:19:21.887985 24399 consensus_meta.cc:287] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.783s	user 0.009s	sys 0.000s
I20260709 12:19:22.021837 24399 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:19:21.637177 27299 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.542408 27289 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:21.759514 27309 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:22.023921 24395 consensus_meta.cc:287] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.843s	user 0.009s	sys 0.004s
I20260709 12:19:22.025432 24395 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:22.025563 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:21.958927 24325 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.029s	sys 0.034s
I20260709 12:19:21.836097 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:21.497354 27316 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:21.962852 24470 rpcz_store.cc:276] 0709 12:19:20.808504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.822537 (+ 14033us) service_pool.cc:224] Handling call
0709 12:19:20.822836 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:20.823076 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:19:21.298857 (+475781us) log.cc:844] Serialized 14 byte log entry
0709 12:19:21.877071 (+578214us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:21.877156 (+    85us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:21.877236 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:21.877339 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:21.877533 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":903760,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":68,"raft.queue_time_us":182710,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":104,"thread_start_us":927190,"threads_started":2}
W20260709 12:19:21.735177 27322 log.cc:927] Time spent T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.275s	user 0.000s	sys 0.000s
I20260709 12:19:22.036731 27289 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:22.037976 27308 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:22.039566 27289 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:21.732851 27327 consensus_queue.cc:1059] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.300s
I20260709 12:19:21.970853 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:21.932957 27332 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.541169 27142 raft_consensus.cc:2804] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:22.077912 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:22.026588 24366 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:21.954845 27218 consensus_meta.cc:287] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.841s	user 0.006s	sys 0.006s
I20260709 12:19:21.937279 26962 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:21.974287 24439 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.008s	sys 0.027s
I20260709 12:19:21.953434 27330 consensus_queue.cc:1048] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 12:19:22.023743 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:21.938115 27282 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:22.023185 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 349056us
W20260709 12:19:22.115087 27334 log.cc:927] Time spent T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 12:19:22.115305 24465 raft_consensus.cc:3055] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:22.120852 24465 raft_consensus.cc:740] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
W20260709 12:19:22.125977 27325 log.cc:927] Time spent T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
I20260709 12:19:22.127333 24465 consensus_queue.cc:260] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:22.128297 27142 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:21.945721 27272 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:22.035348 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:22.128791 27142 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:22.129199 24395 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:19:22.130191 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:22.130323 27287 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:22.131642 27304 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:22.132344 27343 raft_consensus.cc:2804] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:22.133044 24318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1725) took 1423 ms. Trace:
I20260709 12:19:22.133159 27343 raft_consensus.cc:697] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:22.133481 24318 rpcz_store.cc:276] 0709 12:19:20.709584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.709732 (+   148us) service_pool.cc:224] Handling call
0709 12:19:20.710160 (+   428us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:19:20.724853 (+ 14693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:20.724885 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:19:20.754290 (+ 29405us) log.cc:844] Serialized 78 byte log entry
0709 12:19:21.296676 (+542386us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:21.955495 (+658819us) log.cc:844] Serialized 14 byte log entry
0709 12:19:21.961322 (+  5827us) log.cc:844] Serialized 14 byte log entry
0709 12:19:21.961524 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:21.961592 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:22.111258 (+149666us) spinlock_profiling.cc:243] Waited 9.84 ms on lock 0x7b4800170358. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9c275aa1 00007f4a9c26cb37 00007f4a9c26c9ca 00007f4a9c36426f 00007f4a9c363f37 00007f4a9c37855c 00007f4a9c378508 00007f4a9c378488 00007f4a9c378443 00007f4a9c3776ec 00007f4a9b2a1a96
0709 12:19:22.132790 (+ 21532us) raft_consensus.cc:1685] finished
0709 12:19:22.132812 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:22.132979 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24764,"prepare.queue_time_us":39700,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":11013,"raft.queue_time_us":19786,"raft.run_cpu_time_us":2718,"raft.run_wall_time_us":162224,"spinlock_wait_cycles":140888448,"thread_start_us":1167674,"threads_started":2,"wal-append.queue_time_us":999169}
I20260709 12:19:22.134557 27343 consensus_queue.cc:237] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:22.136349 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:22.138046 27150 consensus_meta.cc:287] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.782s	user 0.007s	sys 0.003s
I20260709 12:19:22.139149 27239 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:22.141036 26962 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:22.141923 26962 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:21.970651 27318 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:22.148721 27318 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:22.151670 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:22.151865 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:22.152570 24467 raft_consensus.cc:2393] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 7: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:22.152393 24397 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:22.155495 24316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1727) took 1444 ms. Trace:
I20260709 12:19:22.154096 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:22.157131 24467 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:22.155920 24316 rpcz_store.cc:276] 0709 12:19:20.711072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.711188 (+   116us) service_pool.cc:224] Handling call
0709 12:19:20.711508 (+   320us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:20.731124 (+ 19616us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:19:20.731483 (+   359us) log.cc:844] Serialized 14 byte log entry
0709 12:19:21.283402 (+551919us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:21.298221 (+ 14819us) log.cc:844] Serialized 52 byte log entry
0709 12:19:22.150581 (+852360us) spinlock_profiling.cc:243] Waited 7.11 ms on lock 0x7b1800284b00. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a941d9c0a 00007f4a9d919219 00007f4a96f02d70 00007f4a96ef6293 00007f4a96eebcea 00007f4a96eec0d1 00007f4a97307a0f 00007f4a972c3621 00007f4a9734c92b
0709 12:19:22.150819 (+   238us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:22.150860 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.150937 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:22.155130 (+  4193us) raft_consensus.cc:1685] finished
0709 12:19:22.155275 (+   145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:22.155433 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":139684,"prepare.queue_time_us":819,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":39727,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":9342,"spinlock_wait_cycles":16359168,"thread_start_us":539226,"threads_started":1,"wal-append.queue_time_us":554600}
I20260709 12:19:21.963491 27277 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:22.158470 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:22.159543 27324 log.cc:927] Time spent T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.487s	user 0.002s	sys 0.000s
I20260709 12:19:22.159688 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:22.161126 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:22.163058 27312 log.cc:927] Time spent T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.993s	user 0.006s	sys 0.000s
I20260709 12:19:22.164494 25113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 442) took 2341 ms. Trace:
I20260709 12:19:22.166241 27285 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:22.164927 25113 rpcz_store.cc:276] 0709 12:19:19.823422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:19.823679 (+   257us) service_pool.cc:224] Handling call
0709 12:19:19.840889 (+ 17210us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:19.875444 (+ 34555us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:19:20.170783 (+295339us) log.cc:844] Serialized 14 byte log entry
0709 12:19:20.935310 (+764527us) log.cc:844] Serialized 14 byte log entry
0709 12:19:20.986216 (+ 50906us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:21.097751 (+111535us) log.cc:844] Serialized 26 byte log entry
0709 12:19:21.141069 (+ 43318us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:21.168050 (+ 26981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:21.181047 (+ 12997us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:22.162750 (+981703us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b2400350d08. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a940e59c4 00007f4a940e3acb 00007f4a9429edc9 00007f4a9429ea55 00007f4a9429e09d 00007f4a96ed010e 00007f4a96ee788c 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221
0709 12:19:22.164243 (+  1493us) raft_consensus.cc:1685] finished
0709 12:19:22.164269 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:22.164409 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22670,"prepare.queue_time_us":200375,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":231877,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":24400,"spinlock_wait_cycles":6745856,"thread_start_us":281040,"threads_started":1,"wal-append.queue_time_us":561114}
I20260709 12:19:22.026305 24399 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
W20260709 12:19:22.026926 24325 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.029s	sys 0.034s
W20260709 12:19:22.171916 24391 consensus_meta.cc:287] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.719s	user 0.009s	sys 0.000s
I20260709 12:19:22.173067 24391 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6.
W20260709 12:19:22.148079 26982 consensus_meta.cc:287] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.906s	user 0.004s	sys 0.004s
I20260709 12:19:22.079840 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:22.182962 24317 consensus_meta.cc:287] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.708s	user 0.010s	sys 0.001s
I20260709 12:19:22.183156 24470 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:22.183462 24317 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:22.184458 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:21.953747 27284 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:22.044265 27320 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:22.081772 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 55229.9us
I20260709 12:19:22.088150 24396 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
W20260709 12:19:22.186105 24469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.009s	sys 0.025s
I20260709 12:19:21.874325 26956 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:22.091192 27337 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:22.091777 27070 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:22.196002 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:22.091974 25115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 960) took 1235 ms. Trace:
I20260709 12:19:21.965342 27082 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:22.094609 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:49122 (request call id 12) took 1338 ms. Trace:
I20260709 12:19:22.212697 24393 rpcz_store.cc:276] 0709 12:19:20.756209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.756396 (+   187us) service_pool.cc:224] Handling call
0709 12:19:22.094386 (+1337990us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b540027f454. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a97346853 00007f4a9c31460a 00007f4a9589a7d4 00007f4a9589a762 00007f4a9589a691 00007f4a9589a60c 00007f4a958998c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:22.094512 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":491544320}
I20260709 12:19:22.214524 24393 raft_consensus.cc:1240] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:22.215256 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2317) took 1078 ms. Trace:
I20260709 12:19:22.215643 24393 rpcz_store.cc:276] 0709 12:19:21.136380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.213920 (+1077540us) service_pool.cc:224] Handling call
0709 12:19:22.214297 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:22.214977 (+   680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.215191 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:22.098464 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:22.099905 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:22.102391 27159 consensus_meta.cc:287] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 1.240s	user 0.009s	sys 0.003s
I20260709 12:19:22.103137 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:22.116959 25111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 958) took 1282 ms. Trace:
I20260709 12:19:21.975013 27302 consensus_queue.cc:1048] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.151s
I20260709 12:19:22.225018 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:22.121133 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:22.122226 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:22.122859 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:22.225735 24466 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:19:22.231546 24400 raft_consensus.cc:2393] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 6: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:22.123901 26944 raft_consensus.cc:3055] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:22.033563 26993 consensus_queue.cc:1059] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 12:19:22.124616 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:22.044198 27173 consensus_meta.cc:287] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.605s	user 0.000s	sys 0.007s
I20260709 12:19:22.045379 27316 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:22.022285 27331 raft_consensus.cc:740] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:22.060209 27299 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:22.138688 27150 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:22.081435 27332 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:21.637104 27076 raft_consensus.cc:2804] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:21.959688 24394 raft_consensus.cc:2410] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:19:21.963135 26949 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.007s	sys 0.027s
I20260709 12:19:21.973806 27005 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:22.128811 24465 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:22.181723 24467 raft_consensus.cc:2393] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 7: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:22.125341 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:22.185542 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:22.224071 27159 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:22.186875 24469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.009s	sys 0.025s
I20260709 12:19:22.274365 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 626) took 1235 ms. Trace:
I20260709 12:19:22.196406 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:22.092567 27308 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.274839 24469 rpcz_store.cc:276] 0709 12:19:21.038603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.038761 (+   158us) service_pool.cc:224] Handling call
0709 12:19:21.076033 (+ 37272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:21.076319 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:19:21.470212 (+393893us) log.cc:844] Serialized 14 byte log entry
0709 12:19:22.273907 (+803695us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:22.273977 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:22.274044 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.274131 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:22.274285 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":763497,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"thread_start_us":1179979,"threads_started":2}
I20260709 12:19:22.199347 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:22.200304 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:22.196277 24366 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:22.284070 24438 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.015s	sys 0.041s
W20260709 12:19:22.284430 24438 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.015s	sys 0.041s
I20260709 12:19:22.199177 25115 rpcz_store.cc:276] 0709 12:19:20.856483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.856663 (+   180us) service_pool.cc:224] Handling call
0709 12:19:21.001690 (+145027us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:21.002457 (+   767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:21.002489 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:21.003096 (+   607us) log.cc:844] Serialized 26 byte log entry
0709 12:19:21.257269 (+254173us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:21.257311 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:21.257381 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:22.091710 (+834329us) raft_consensus.cc:1685] finished
0709 12:19:22.091736 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:22.091902 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":126,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"thread_start_us":253769,"threads_started":1,"wal-append.queue_time_us":450507}
I20260709 12:19:22.144285 26962 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:22.205025 27320 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:19:22.205729 24396 raft_consensus.cc:1240] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6. Ops: []
W20260709 12:19:22.330667 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 44130.6us
I20260709 12:19:22.181790 27218 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:22.330365 24468 raft_consensus.cc:2393] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 7: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:22.206451 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:22.128813 27006 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:22.208335 27221 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:22.208729 24321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1726) took 1498 ms. Trace:
I20260709 12:19:22.209100 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:22.208350 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:22.211338 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2291) took 1183 ms. Trace:
I20260709 12:19:22.218393 24473 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:22.217139 24471 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:19:22.221462 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:22.337001 24472 raft_consensus.cc:2393] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 7: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:21.610448 27286 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:22.334908 24321 rpcz_store.cc:276] 0709 12:19:20.710783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.711334 (+   551us) service_pool.cc:224] Handling call
0709 12:19:20.737028 (+ 25694us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:20.737373 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:20.737398 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:20.737994 (+   596us) log.cc:844] Serialized 52 byte log entry
0709 12:19:21.212532 (+474538us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:21.270314 (+ 57782us) log.cc:844] Serialized 14 byte log entry
0709 12:19:21.290865 (+ 20551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:21.290958 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:22.158746 (+867788us) spinlock_profiling.cc:243] Waited 42.4 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:19:22.208408 (+ 49662us) raft_consensus.cc:1685] finished
0709 12:19:22.208512 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:22.208670 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65487,"prepare.queue_time_us":58990,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":7217,"raft.queue_time_us":28895,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":7215,"spinlock_wait_cycles":97502592,"thread_start_us":474142,"threads_started":1,"wal-append.queue_time_us":723884}
W20260709 12:19:22.225811 24474 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.005s	sys 0.024s
I20260709 12:19:22.227224 24393 raft_consensus.cc:1275] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:19:22.339608 24474 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.006s	sys 0.024s
I20260709 12:19:22.186172 27270 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.331447 27308 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:22.340415 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:22.340750 27270 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:22.341627 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:22.342350 24393 raft_consensus.cc:2393] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 6: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:22.342384 27308 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:22.335705 24324 raft_consensus.cc:2393] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 5: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:22.228758 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:22.169704 27321 raft_consensus.cc:2749] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:22.343257 27270 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:22.232576 24466 raft_consensus.cc:1275] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:22.195099 27337 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.345031 27337 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:22.220029 27169 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.011s	sys 0.042s
W20260709 12:19:22.348912 27169 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.012s	sys 0.043s
I20260709 12:19:22.239982 24400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2314) took 1104 ms. Trace:
I20260709 12:19:22.350111 24400 rpcz_store.cc:276] 0709 12:19:21.135590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.335745 (+200155us) service_pool.cc:224] Handling call
0709 12:19:22.239739 (+903994us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b54002a3d54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:22.239911 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1783995648}
I20260709 12:19:22.234277 26944 raft_consensus.cc:740] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:22.353569 26944 consensus_queue.cc:260] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:22.355394 26944 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:22.234278 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:22.359213 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:22.230984 27302 consensus_queue.cc:1243] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer c711faa13ead43ebbea0192cb74a4756 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:19:22.245944 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:22.197247 26982 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:22.365582 24392 raft_consensus.cc:2393] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 6: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:22.366568 26982 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:22.243450 27280 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:22.367414 27280 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:22.369874 27280 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:22.267959 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:22.243335 27318 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:22.191090 24399 raft_consensus.cc:1275] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:22.373505 24399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2315) took 1237 ms. Trace:
I20260709 12:19:22.373952 24399 rpcz_store.cc:276] 0709 12:19:21.135841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.170171 (+1034330us) service_pool.cc:224] Handling call
0709 12:19:22.170508 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:22.373125 (+202617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.373382 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:22.375430 24399 raft_consensus.cc:1240] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:22.277647 25117 raft_consensus.cc:2368] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6.
W20260709 12:19:22.284278 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 88107.7us
W20260709 12:19:22.376523 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:22.201761 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:22.286906 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 337817us
I20260709 12:19:22.380141 24322 raft_consensus.cc:2393] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 7: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
W20260709 12:19:22.380438 24440 leader_election.cc:336] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Timed out: RequestConsensusVote RPC to 127.22.155.196:35511 timed out after 1.663s (SENT)
I20260709 12:19:22.380622 24396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2316) took 1195 ms. Trace:
I20260709 12:19:22.380918 24440 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:22.268538 26949 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.007s	sys 0.027s
I20260709 12:19:22.335405 24391 rpcz_store.cc:276] 0709 12:19:21.027514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.027662 (+   148us) service_pool.cc:224] Handling call
0709 12:19:22.211157 (+1183495us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54002085d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:22.211275 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":713861376}
I20260709 12:19:22.380975 24396 rpcz_store.cc:276] 0709 12:19:21.136125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.198851 (+1062726us) service_pool.cc:224] Handling call
0709 12:19:22.205543 (+  6692us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:22.330868 (+125325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.331092 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:22.344394 24393 raft_consensus.cc:1275] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:19:22.384290 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:22.385356 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:22.245914 27173 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:22.398777 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:19:22.269747 27276 consensus_meta.cc:287] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 1.026s	user 0.008s	sys 0.005s
I20260709 12:19:22.186856 27256 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.422951 25119 raft_consensus.cc:2368] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 6. Current term is 7.
I20260709 12:19:22.352516 24400 raft_consensus.cc:1275] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:19:22.470932 24400 pending_rounds.cc:85] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a: Aborting all ops after (but not including) 1
I20260709 12:19:22.471256 24400 pending_rounds.cc:107] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a: Aborting uncommitted NO_OP operation due to leader change: 5.2
I20260709 12:19:22.471547 24400 raft_consensus.cc:2889] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:22.474974 24470 raft_consensus.cc:2393] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 8: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:22.484407 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:22.485234 24321 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:22.285806 27272 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:22.271983 27076 raft_consensus.cc:697] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:22.330904 27255 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:19:22.564894 24438 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.22.155.254:34311, user_credentials={real_user=slave}} blocked reactor thread for 92300.1us
I20260709 12:19:22.568030 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:22.569963 24465 raft_consensus.cc:1275] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:19:22.570508 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:22.378180 27336 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:22.613968 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 51701.3us
I20260709 12:19:22.331103 27345 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.456677 27304 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:22.616847 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:22.634606 24391 raft_consensus.cc:2393] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 2: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:22.618431 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:22.635473 25117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 401) took 1460 ms (client timeout 1746 ms). Trace:
W20260709 12:19:22.635891 24392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2304) took 1551 ms (client timeout 1676 ms). Trace:
I20260709 12:19:22.619973 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:22.623675 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:22.468057 27270 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.636147 24396 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:22.623507 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:22.626138 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 490770us
W20260709 12:19:22.641932 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 261500us
W20260709 12:19:22.642688 24440 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.155.196:35511 timed out after 1.664s (SENT) [suppressed 20 similar messages]
I20260709 12:19:22.633086 25118 raft_consensus.cc:2368] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6.
W20260709 12:19:22.636308 24392 rpcz_store.cc:269] 0709 12:19:21.084559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.102014 (+ 17455us) service_pool.cc:224] Handling call
0709 12:19:22.635725 (+1533711us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54003642d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:22.635838 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2712695168}
I20260709 12:19:22.334389 26962 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.641873 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:22.635923 25117 rpcz_store.cc:269] 0709 12:19:21.174707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.175924 (+  1217us) service_pool.cc:224] Handling call
0709 12:19:22.635278 (+1459354us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54006bc1d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:22.635412 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2384389888}
W20260709 12:19:22.645202 25119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 403) took 1466 ms (client timeout 1727 ms). Trace:
W20260709 12:19:22.690533 25119 rpcz_store.cc:269] 0709 12:19:21.178400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.178558 (+   158us) service_pool.cc:224] Handling call
0709 12:19:22.636307 (+1457749us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54004e3754. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:22.645113 (+  8806us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2630675712}
W20260709 12:19:22.627434 27330 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:19:22.610018 27327 raft_consensus.cc:2749] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:22.682322 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:22.571985 26982 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:22.683049 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:22.625799 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:19:22.763497 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:22.676488 25115 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:22.561571 27276 raft_consensus.cc:2749] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:22.781307 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:22.782249 24318 raft_consensus.cc:2393] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 7: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:22.787951 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:22.790822 24400 raft_consensus.cc:1275] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:22.702615 24394 raft_consensus.cc:1240] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:22.421411 27239 consensus_queue.cc:1048] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.255s
W20260709 12:19:22.794051 24365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.024s	sys 0.074s
I20260709 12:19:22.488449 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:22.816656 24398 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:22.674459 24465 raft_consensus.cc:1275] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:19:22.797796 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:22.842749 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:22.643457 27348 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:22.847728 24365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.024s	sys 0.074s
I20260709 12:19:22.566442 27256 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:22.857343 24321 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:22.894352 25116 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:22.637575 25113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 415) took 1172 ms. Trace:
I20260709 12:19:22.873720 25115 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEARNER]: Advancing to term 7
I20260709 12:19:22.876286 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:22.855738 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:22.897233 24366 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:22.877200 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 641060us
W20260709 12:19:22.903689 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:22.903950 24365 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:22.220475 25111 rpcz_store.cc:276] 0709 12:19:20.834550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.835826 (+  1276us) service_pool.cc:224] Handling call
0709 12:19:20.847812 (+ 11986us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:20.848090 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:20.848122 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:21.004422 (+156300us) log.cc:844] Serialized 26 byte log entry
0709 12:19:21.478211 (+473789us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:21.486432 (+  8221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:21.509475 (+ 23043us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:22.116642 (+607167us) raft_consensus.cc:1685] finished
0709 12:19:22.116662 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:22.116875 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":429083,"threads_started":1,"wal-append.queue_time_us":849774}
I20260709 12:19:22.797519 27082 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:22.895714 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:22.899822 24290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.005s	sys 0.005s
I20260709 12:19:22.911191 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:22.913750 24290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.005s	sys 0.005s
I20260709 12:19:22.772534 27270 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:22.854528 25114 raft_consensus.cc:3060] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:22.930634 24320 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:22.839524 27304 raft_consensus.cc:697] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:22.779946 26962 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:22.920423 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:22.940521 25117 raft_consensus.cc:2468] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:22.769950 27255 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:22.930066 24365 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:22.835222 26982 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:22.941033 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:22.912609 27276 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.624950 27272 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:22.964720 24316 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:22.948091 24365 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:22.627310 27336 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:22.946497 27285 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:22.458313 27331 consensus_queue.cc:260] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:22.996948 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:22.997495 24319 raft_consensus.cc:2410] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:19:22.997855 24321 raft_consensus.cc:2393] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:22.949985 25115 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEARNER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:22.998735 25115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 417) took 1039 ms. Trace:
I20260709 12:19:22.999164 25115 rpcz_store.cc:276] 0709 12:19:21.959694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.842382 (+882688us) service_pool.cc:224] Handling call
0709 12:19:22.998659 (+156277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:22.981812 24398 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:19:22.984135 24323 raft_consensus.cc:1275] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:19:22.902338 27308 consensus_queue.cc:1048] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:19:22.902165 25113 rpcz_store.cc:276] 0709 12:19:21.454121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.197539 (+743418us) service_pool.cc:224] Handling call
0709 12:19:22.625998 (+428459us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:23.003834 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:23.005887 24321 raft_consensus.cc:2393] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 7: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:23.007344 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:23.008129 24318 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:23.010546 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:23.011540 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:23.014045 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:22.965904 27006 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:23.025199 24399 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:23.021077 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:22.951818 27150 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:22.952292 27195 consensus_meta.cc:287] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 1.455s	user 0.013s	sys 0.000s
I20260709 12:19:22.768095 27345 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:22.965085 27082 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:19:22.996618 27340 log.cc:927] Time spent T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.716s	user 0.000s	sys 0.002s
I20260709 12:19:23.002975 25112 raft_consensus.cc:2410] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:23.073803 25115 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:23.078544 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:23.081167 24318 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:19:23.016702 27169 raft_consensus.cc:2749] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:22.919436 27076 consensus_queue.cc:237] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:23.091224 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 138695us
I20260709 12:19:23.092478 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:23.016499 27299 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:23.133968 25084 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:23.056965 27331 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:23.092769 24366 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:23.138206 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 45523.4us
I20260709 12:19:22.984503 27276 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:23.083659 24321 raft_consensus.cc:1240] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:23.103175 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:23.105163 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:22.911702 27348 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:23.059527 27082 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:23.065410 27218 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:23.152611 24321 raft_consensus.cc:1240] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 3. Current term is 4. Ops: []
W20260709 12:19:23.154433 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 239870us
W20260709 12:19:23.137217 27344 log.cc:927] Time spent T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.499s	user 0.001s	sys 0.000s
W20260709 12:19:23.106805 25112 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 413) took 1769 ms (client timeout 2029 ms). Trace:
I20260709 12:19:23.080503 27360 consensus_queue.cc:1059] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 12:19:23.133481 27173 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:23.066192 27285 raft_consensus.cc:697] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:23.123781 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:23.179898 24318 raft_consensus.cc:2468] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:23.126868 24399 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:23.129822 25115 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:23.131484 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:23.119277 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:23.135462 24289 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:23.086408 27332 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:23.059672 27304 consensus_queue.cc:237] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:23.148564 27370 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:23.176317 24290 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:23.151587 27082 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:23.076800 27195 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:23.142324 27299 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:23.150833 27169 raft_consensus.cc:2804] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:23.137336 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:23.181159 25115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35194 (request call id 450) took 1966 ms. Trace:
I20260709 12:19:23.207158 25115 rpcz_store.cc:276] 0709 12:19:21.215227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.020732 (+1805505us) service_pool.cc:224] Handling call
0709 12:19:23.181097 (+160365us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:23.181923 24467 raft_consensus.cc:2468] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:19:23.181731 24470 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:23.185513 24325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1730) took 1988 ms. Trace:
W20260709 12:19:23.190274 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 199998us
W20260709 12:19:23.182364 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 47032us
I20260709 12:19:23.276559 24365 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:23.192898 24290 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:23.179344 27363 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:19:23.208135 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:23.201509 27318 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:23.288285 27254 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:23.233431 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:23.289709 25115 raft_consensus.cc:2393] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 7: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:23.290261 25115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35194 (request call id 455) took 1105 ms. Trace:
I20260709 12:19:23.290560 25115 rpcz_store.cc:276] 0709 12:19:22.184766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.233137 (+1048371us) service_pool.cc:224] Handling call
0709 12:19:23.290193 (+ 57056us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:23.290833 27005 consensus_meta.cc:287] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 1.019s	user 0.008s	sys 0.004s
I20260709 12:19:23.291715 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:23.292486 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:23.246395 24397 raft_consensus.cc:1240] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:23.275905 24325 rpcz_store.cc:276] 0709 12:19:21.197006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.197590 (+   584us) service_pool.cc:224] Handling call
0709 12:19:21.198031 (+   441us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:21.198396 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:21.198421 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:21.231546 (+ 33125us) log.cc:844] Serialized 52 byte log entry
0709 12:19:22.169421 (+937875us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:22.169466 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.169549 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:23.185276 (+1015727us) raft_consensus.cc:1685] finished
0709 12:19:23.185296 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:23.185451 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6419,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":14306,"thread_start_us":882828,"threads_started":1,"wal-append.queue_time_us":988149}
I20260709 12:19:23.246953 24366 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:23.294118 25083 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:23.206862 27169 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:23.294641 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:23.295271 25115 raft_consensus.cc:2393] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 4: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
W20260709 12:19:23.260857 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:23.294662 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 47828.6us
I20260709 12:19:23.202067 27370 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:23.215842 27356 log.cc:927] Time spent T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:19:23.190946 27366 raft_consensus.cc:2804] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:23.265558 27372 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:23.233403 27285 consensus_queue.cc:237] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:23.270083 27142 consensus_meta.cc:287] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 1.141s	user 0.010s	sys 0.003s
I20260709 12:19:23.272248 27195 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:23.283773 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 90970.6us
I20260709 12:19:23.278947 24365 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:23.312353 27366 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:23.217140 27369 log.cc:927] Time spent T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
W20260709 12:19:23.173300 25112 rpcz_store.cc:269] 0709 12:19:21.337796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.269658 (+931862us) service_pool.cc:224] Handling call
0709 12:19:23.101004 (+831346us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:23.213124 27354 consensus_queue.cc:1048] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:23.300875 24325 pending_rounds.cc:85] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756: Aborting all ops after (but not including) 2
I20260709 12:19:23.295914 26982 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:23.295596 27359 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:23.180039 27351 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:23.310978 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:23.354406 25115 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
W20260709 12:19:23.354733 24471 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.000s	sys 0.017s
W20260709 12:19:23.313273 24469 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.006s	sys 0.003s
W20260709 12:19:23.273363 27164 consensus_meta.cc:287] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.308s	user 0.011s	sys 0.001s
W20260709 12:19:23.355046 24471 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.000s	sys 0.017s
I20260709 12:19:23.308072 27352 raft_consensus.cc:2804] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:23.168241 27320 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:23.254341 27299 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:23.305986 27005 raft_consensus.cc:2804] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:23.293684 26962 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:23.294763 27255 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:23.299034 27169 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:23.299242 27270 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:23.335453 24290 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:23.349094 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 191545us
I20260709 12:19:23.412941 25082 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:23.350021 24325 pending_rounds.cc:107] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:19:23.414182 24325 raft_consensus.cc:2889] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:23.346904 24470 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:23.317899 27272 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:23.352933 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 74076.7us
I20260709 12:19:23.421936 24365 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
W20260709 12:19:23.351146 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 66234.5us
W20260709 12:19:23.355648 24469 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.006s	sys 0.003s
W20260709 12:19:23.396535 26944 consensus_meta.cc:287] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 1.041s	user 0.013s	sys 0.000s
I20260709 12:19:23.319168 27286 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:23.429628 27143 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:23.361240 27164 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:23.376895 27005 raft_consensus.cc:697] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:23.365513 27351 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:19:23.357081 27352 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:23.357302 27195 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:23.425927 27282 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:23.425798 27354 raft_consensus.cc:2804] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:23.384101 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:23.301410 27363 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:23.355000 27366 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:23.387260 27337 consensus_meta.cc:287] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 1.041s	user 0.015s	sys 0.000s
I20260709 12:19:23.387559 24473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1858) took 1302 ms. Trace:
I20260709 12:19:23.445891 24324 raft_consensus.cc:1275] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:23.435211 27348 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:23.389690 27368 log.cc:927] Time spent T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:19:23.391763 27316 consensus_meta.cc:287] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 1.146s	user 0.007s	sys 0.005s
I20260709 12:19:23.393117 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:23.395701 27349 log.cc:927] Time spent T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.578s	user 0.001s	sys 0.000s
I20260709 12:19:23.395066 27082 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:23.396723 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:23.396733 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:23.400141 27256 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:23.389683 27276 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:23.402035 27299 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:23.410354 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:23.317046 24438 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.003s	sys 0.006s
W20260709 12:19:23.503278 24438 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.003s	sys 0.006s
W20260709 12:19:23.503634 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 826839us
W20260709 12:19:23.428508 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 93129.8us
I20260709 12:19:23.417057 25114 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 2.
I20260709 12:19:23.427742 27380 consensus_queue.cc:1059] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:19:23.433350 24317 raft_consensus.cc:2368] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 4. Current term is 5.
I20260709 12:19:23.504801 24438 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:23.504969 25114 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35194 (request call id 451) took 2287 ms (client timeout 2163 ms). Trace:
I20260709 12:19:23.343899 27142 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:23.437315 27352 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:23.376200 27370 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:23.446458 27337 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:23.444481 24473 rpcz_store.cc:276] 0709 12:19:22.085297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.609619 (+524322us) service_pool.cc:224] Handling call
0709 12:19:22.613545 (+  3926us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:22.633646 (+ 20101us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:19:22.681590 (+ 47944us) log.cc:844] Serialized 14 byte log entry
0709 12:19:22.945799 (+264209us) log.cc:844] Serialized 14 byte log entry
0709 12:19:22.945886 (+    87us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:22.995648 (+ 49762us) log.cc:844] Serialized 26 byte log entry
0709 12:19:22.996353 (+   705us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:22.996389 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.996473 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:23.387315 (+390842us) raft_consensus.cc:1685] finished
0709 12:19:23.387350 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:23.387493 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20148,"prepare.queue_time_us":53463,"prepare.run_wall_time_us":10470,"raft.queue_time_us":27509,"raft.run_wall_time_us":89721,"spinlock_wait_cycles":53415552,"thread_start_us":86935,"threads_started":1,"wal-append.queue_time_us":166675}
I20260709 12:19:23.447817 27270 consensus_queue.cc:1048] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:23.448318 27363 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:23.443145 27320 consensus_queue.cc:1059] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:19:23.451252 25113 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:23.456218 27005 consensus_queue.cc:237] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:23.458129 27164 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:23.459527 24320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 1743) took 1076 ms. Trace:
I20260709 12:19:23.460837 27351 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:23.462189 24397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2313) took 2326 ms. Trace:
I20260709 12:19:23.525049 24397 rpcz_store.cc:276] 0709 12:19:21.135324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.154521 (+1019197us) service_pool.cc:224] Handling call
0709 12:19:22.154834 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:23.293536 (+1138702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:23.461915 (+168379us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001a6b54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:23.462124 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2451417472}
I20260709 12:19:23.465066 25083 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:23.467414 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:23.526310 25118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 402) took 2349 ms (client timeout 1663 ms). Trace:
I20260709 12:19:23.468377 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:23.527381 24465 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:23.523604 27320 raft_consensus.cc:3055] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:19:23.469749 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 170489us
I20260709 12:19:23.528002 27320 raft_consensus.cc:740] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:23.441907 27282 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:23.524423 24320 rpcz_store.cc:276] 0709 12:19:22.383269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.384042 (+   773us) service_pool.cc:224] Handling call
0709 12:19:23.459213 (+1075171us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b54000a7b54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:23.459381 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1179063552}
I20260709 12:19:23.528906 27282 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:23.529840 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 887112us
W20260709 12:19:23.530476 24440 leader_election.cc:336] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Timed out: RequestConsensusVote RPC to 127.22.155.196:35511 timed out after 1.727s (SENT)
W20260709 12:19:23.526957 25118 rpcz_store.cc:269] 0709 12:19:21.177170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.177318 (+   148us) service_pool.cc:224] Handling call
0709 12:19:23.526002 (+2348684us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400709ed4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:23.526185 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3175135616}
I20260709 12:19:23.477705 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:23.531936 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:23.481528 24472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1867) took 1245 ms. Trace:
I20260709 12:19:23.487282 24325 raft_consensus.cc:1240] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:23.434784 24365 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:23.432478 27143 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:23.505601 24290 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:23.534446 27351 raft_consensus.cc:2749] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:23.506750 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 625) took 2481 ms. Trace:
I20260709 12:19:23.478713 27316 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:23.535323 27143 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:23.536425 25118 raft_consensus.cc:2393] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 7: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:23.508845 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:23.510239 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1856) took 1486 ms. Trace:
I20260709 12:19:23.510883 24438 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:23.510740 27377 log.cc:927] Time spent T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:19:23.524540 25112 raft_consensus.cc:2410] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:23.469619 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:23.445967 27354 raft_consensus.cc:697] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:23.536924 25115 raft_consensus.cc:2393] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 6: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:23.537177 27289 raft_consensus.cc:3055] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:23.512580 27276 raft_consensus.cc:3055] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:23.537659 24290 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:23.537997 27142 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:23.539027 27384 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:23.622483 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 84908.9us
I20260709 12:19:23.535151 24474 rpcz_store.cc:276] 0709 12:19:21.025606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.025740 (+   134us) service_pool.cc:224] Handling call
0709 12:19:21.033233 (+  7493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:21.344983 (+311750us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:21.345010 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:21.458307 (+113297us) log.cc:844] Serialized 26 byte log entry
0709 12:19:22.340091 (+881784us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:22.340147 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.340232 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:23.395100 (+1054868us) spinlock_profiling.cc:243] Waited 9.4 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:19:23.506463 (+111363us) raft_consensus.cc:1685] finished
0709 12:19:23.506486 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:23.506688 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53525,"raft.queue_time_us":478590,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":88419,"spinlock_wait_cycles":21612288,"thread_start_us":1102760,"threads_started":2,"wal-append.queue_time_us":972975}
I20260709 12:19:23.623915 24290 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:23.539825 27316 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:23.540257 24316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57702 (request call id 406) took 1032 ms. Trace:
I20260709 12:19:23.624894 24316 rpcz_store.cc:276] 0709 12:19:22.508039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.910899 (+402860us) service_pool.cc:224] Handling call
0709 12:19:23.540056 (+629157us) spinlock_profiling.cc:243] Waited 51.1 ms on lock 0x7b5400339d54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:23.540176 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117461248}
W20260709 12:19:23.540748 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:23.532385 24467 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:23.542086 27082 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:23.532862 24472 rpcz_store.cc:276] 0709 12:19:22.235840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.634768 (+398928us) service_pool.cc:224] Handling call
0709 12:19:22.635087 (+   319us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:19:22.641632 (+  6545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:22.641666 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:19:22.795482 (+153816us) log.cc:844] Serialized 78 byte log entry
0709 12:19:23.339199 (+543717us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:23.443778 (+104579us) log.cc:844] Serialized 14 byte log entry
0709 12:19:23.444533 (+   755us) log.cc:844] Serialized 14 byte log entry
0709 12:19:23.480718 (+ 36185us) log.cc:844] Serialized 14 byte log entry
0709 12:19:23.481080 (+   362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:23.481190 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:23.481245 (+    55us) raft_consensus.cc:1685] finished
0709 12:19:23.481263 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:23.481452 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35557,"prepare.queue_time_us":278417,"prepare.run_cpu_time_us":142,"prepare.run_wall_time_us":2645,"raft.queue_time_us":93939,"raft.run_cpu_time_us":650,"raft.run_wall_time_us":58205,"spinlock_wait_cycles":1545984,"thread_start_us":507325,"threads_started":2,"wal-append.queue_time_us":520643}
W20260709 12:19:23.542595 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 77665.8us
I20260709 12:19:23.542995 24319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2173) took 1344 ms. Trace:
I20260709 12:19:23.630028 24319 rpcz_store.cc:276] 0709 12:19:22.198302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.198477 (+   175us) service_pool.cc:224] Handling call
0709 12:19:23.542750 (+1344273us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b5400256cd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:23.542934 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1522263296}
I20260709 12:19:23.545675 27277 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:23.546187 24440 connection.cc:256] RPC call timeout handler was delayed by -1.771503396000071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16620000000000001s for a response
I20260709 12:19:23.549463 27345 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:23.552860 27363 raft_consensus.cc:2804] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:23.640208 27363 raft_consensus.cc:697] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:23.630837 27302 consensus_queue.cc:1048] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:19:23.641251 27363 consensus_queue.cc:237] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:23.510170 27348 raft_consensus.cc:2749] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:19:23.645161 25116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 407) took 2406 ms (client timeout 1810 ms). Trace:
W20260709 12:19:23.645650 25116 rpcz_store.cc:269] 0709 12:19:21.238457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.280407 (+ 41950us) service_pool.cc:224] Handling call
0709 12:19:23.644974 (+2364567us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b540072f454. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:23.645085 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3610411264}
I20260709 12:19:23.646792 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:23.648893 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:23.649510 24322 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:23.649917 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:23.650729 24320 raft_consensus.cc:2376] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5. Re-sending same reply.
I20260709 12:19:23.651365 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:23.565758 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 55255.1us
I20260709 12:19:23.652086 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:23.653208 24438 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:23.564752 24469 rpcz_store.cc:276] 0709 12:19:22.024319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.460146 (+435827us) service_pool.cc:224] Handling call
0709 12:19:22.614916 (+154770us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:23.426733 (+811817us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:23.426785 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:23.427516 (+   731us) log.cc:844] Serialized 26 byte log entry
0709 12:19:23.502534 (+ 75018us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:23.502600 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:23.502707 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:23.509249 (+  6542us) raft_consensus.cc:1685] finished
0709 12:19:23.509280 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:23.510145 (+   865us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":177167,"raft.queue_time_us":236956,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":34093,"thread_start_us":690147,"threads_started":2,"wal-append.queue_time_us":61589}
I20260709 12:19:23.567654 25117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 416) took 2024 ms. Trace:
I20260709 12:19:23.568398 24395 raft_consensus.cc:2393] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:23.654013 25117 rpcz_store.cc:276] 0709 12:19:21.543050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.508515 (+1965465us) service_pool.cc:224] Handling call
0709 12:19:23.567585 (+ 59070us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:23.567425 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 132758us
I20260709 12:19:23.552274 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:23.621809 27276 raft_consensus.cc:740] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:23.573827 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:23.573498 27330 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:19:23.569446 27383 log.cc:927] Time spent T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:19:23.573649 27285 raft_consensus.cc:2804] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:23.631392 27270 consensus_queue.cc:1048] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:19:23.629413 24366 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:23.632901 24440 connection.cc:256] RPC call timeout handler was delayed by -1.6956261530001484s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
W20260709 12:19:23.625849 27390 log.cc:927] Time spent T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.140s	user 0.000s	sys 0.012s
I20260709 12:19:23.620155 27289 raft_consensus.cc:740] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:23.610409 25112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 423) took 1570 ms. Trace:
I20260709 12:19:23.635643 25083 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:19:23.637220 24290 connection.cc:256] RPC call timeout handler was delayed by -1.2673375709998709s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
I20260709 12:19:23.638944 27282 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:23.638875 27366 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:23.629827 27239 raft_consensus.cc:1064] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:19:23.684587 25112 rpcz_store.cc:276] 0709 12:19:22.040085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.369825 (+1329740us) service_pool.cc:224] Handling call
0709 12:19:23.591818 (+221993us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:23.626680 27076 raft_consensus.cc:2749] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:23.656459 25116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 419) took 1617 ms. Trace:
I20260709 12:19:23.648999 24291 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:19:23.786036 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 137154us
I20260709 12:19:23.656510 24438 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:23.657433 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:23.658159 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:19:23.787546 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 132486us
I20260709 12:19:23.787699 25117 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:23.657810 27348 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:23.630465 27164 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:23.791030 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:23.681259 24440 connection.cc:256] RPC call timeout handler was delayed by -1.6861538729999666s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
I20260709 12:19:23.664862 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:23.791996 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 628) took 1149 ms. Trace:
I20260709 12:19:23.764142 24323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1741) took 1381 ms. Trace:
I20260709 12:19:23.663856 25111 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
W20260709 12:19:23.753295 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 71261.5us
I20260709 12:19:23.792445 24471 rpcz_store.cc:276] 0709 12:19:22.642299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.643762 (+  1463us) service_pool.cc:224] Handling call
0709 12:19:22.644185 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:23.361344 (+717159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:23.361378 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:23.361988 (+   610us) log.cc:844] Serialized 26 byte log entry
0709 12:19:23.485118 (+123130us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:23.485160 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:23.485235 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:23.791778 (+306543us) raft_consensus.cc:1685] finished
0709 12:19:23.791797 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:23.791928 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36663,"raft.queue_time_us":183486,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":17237,"thread_start_us":802736,"threads_started":2,"wal-append.queue_time_us":123092}
I20260709 12:19:23.630538 27351 consensus_queue.cc:1048] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
W20260709 12:19:23.769073 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 111964us
I20260709 12:19:23.668618 27285 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:23.797344 24365 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:23.722811 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:23.792879 24323 rpcz_store.cc:276] 0709 12:19:22.382731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.383898 (+  1167us) service_pool.cc:224] Handling call
0709 12:19:22.467433 (+ 83535us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:23.000191 (+532758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:23.688929 (+688738us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b540025ab54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:23.764047 (+ 75118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1187149184}
I20260709 12:19:23.800113 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:23.660739 27330 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:23.728909 27354 consensus_queue.cc:237] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:23.775774 24322 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
W20260709 12:19:23.777981 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 142383us
W20260709 12:19:23.779227 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 149872us
W20260709 12:19:23.508278 25114 rpcz_store.cc:269] 0709 12:19:21.217943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.377077 (+1159134us) service_pool.cc:224] Handling call
0709 12:19:23.504891 (+1127814us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:23.778864 27359 consensus_queue.cc:1048] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:19:23.783432 26949 raft_consensus.cc:2764] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:19:23.781167 27362 log.cc:927] Time spent T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.702s	user 0.007s	sys 0.002s
I20260709 12:19:23.785584 25116 rpcz_store.cc:276] 0709 12:19:22.038806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.646528 (+1607722us) service_pool.cc:224] Handling call
0709 12:19:23.656402 (+  9874us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:23.788272 24438 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:23.849771 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:23.850551 24394 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:23.851785 24440 connection.cc:256] RPC call timeout handler was delayed by -1.7978272699999707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23090000000000002s for a response
I20260709 12:19:23.801038 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:23.767143 24317 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 1744) took 1383 ms (client timeout 1807 ms). Trace:
W20260709 12:19:23.854218 24317 rpcz_store.cc:269] 0709 12:19:22.383545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.385129 (+  1584us) service_pool.cc:224] Handling call
0709 12:19:23.699721 (+1314592us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400384d54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:23.767081 (+ 67360us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2334583168}
I20260709 12:19:23.855850 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:23.802106 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:23.785557 27364 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:23.817859 25110 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:23.812827 25111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35194 (request call id 460) took 1196 ms. Trace:
I20260709 12:19:23.809222 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:23.808811 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:23.808044 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:23.818068 27373 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.801875 25084 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:23.658403 27320 consensus_queue.cc:260] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:23.821682 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:23.877251 24322 raft_consensus.cc:2376] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6. Re-sending same reply.
I20260709 12:19:23.822050 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:23.878536 24474 raft_consensus.cc:2468] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:19:23.863731 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:23.822578 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:23.829758 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 59623.8us
I20260709 12:19:23.830942 24468 raft_consensus.cc:1275] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:23.880214 24317 raft_consensus.cc:2410] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:19:23.880700 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:23.881505 24468 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:19:23.791481 27070 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:23.842240 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:23.886660 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:23.887593 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:23.842561 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:23.824101 24366 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:23.860561 27364 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:23.840770 27076 consensus_queue.cc:1048] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.056s
W20260709 12:19:23.846150 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 48955.2us
I20260709 12:19:23.874361 27255 raft_consensus.cc:2804] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:23.818876 27276 consensus_queue.cc:260] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:23.902936 27276 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:23.902876 27169 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:23.903640 27221 consensus_queue.cc:1048] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:23.900228 27364 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:23.847250 24467 raft_consensus.cc:1275] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:23.803805 27285 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:23.629453 27384 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:23.910012 27282 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:23.880604 27380 raft_consensus.cc:2804] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:23.867098 25111 rpcz_store.cc:276] 0709 12:19:22.616422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.551824 (+935402us) service_pool.cc:224] Handling call
0709 12:19:23.802713 (+250889us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:23.918293 27380 raft_consensus.cc:697] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:23.918502 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:23.919234 27384 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:23.811879 27331 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.919755 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:23.919298 27380 consensus_queue.cc:237] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:23.920516 24467 raft_consensus.cc:2393] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 4: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:23.809499 27336 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:23.809536 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:23.860917 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 72718.5us
W20260709 12:19:23.921437 27397 log.cc:927] Time spent T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:19:23.921692 24438 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:23.922482 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:23.922847 27401 log.cc:927] Time spent T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:19:23.923121 24467 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:23.923195 24438 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:23.923974 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:23.924850 27070 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:23.925597 27070 raft_consensus.cc:2749] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:23.920224 27331 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:23.866325 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:23.820962 27330 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:23.869029 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:23.929919 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:23.814441 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:23.817287 27337 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:23.871640 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 74980.4us
I20260709 12:19:23.941668 25117 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:23.819567 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:23.872298 24396 raft_consensus.cc:2410] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:19:23.875370 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:23.960858 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:23.961668 24392 raft_consensus.cc:2393] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 6: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:23.812397 27370 consensus_queue.cc:1059] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:19:23.885473 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:23.891897 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:23.928386 27331 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:23.889842 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:23.891368 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:23.826282 27142 consensus_queue.cc:1059] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:19:23.894212 24473 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:23.892470 24319 raft_consensus.cc:2393] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:19:23.893555 24440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:23.975960 24440 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:23.894995 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 70955.3us
I20260709 12:19:23.977455 24366 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:23.791260 27164 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:23.868768 27287 raft_consensus.cc:2804] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:23.864732 27348 raft_consensus.cc:2764] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:19:23.897641 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:23.840698 27280 consensus_queue.cc:1048] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:19:23.841197 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:23.867628 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:23.846793 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:23.895831 27352 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:23.882606 27373 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:23.913774 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:23.825856 27289 consensus_queue.cc:260] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:23.810236 24325 raft_consensus.cc:1240] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 5. Current term is 6. Ops: []
W20260709 12:19:23.947525 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:23.961794 24320 raft_consensus.cc:2410] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:19:23.962689 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:23.889137 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:23.965507 25116 raft_consensus.cc:2393] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 6: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:23.966312 25084 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:23.968371 24317 raft_consensus.cc:2393] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 8: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:24.008755 25116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35188 (request call id 965) took 2691 ms. Trace:
I20260709 12:19:23.967567 24468 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:24.009130 25116 rpcz_store.cc:276] 0709 12:19:21.317290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.882063 (+2564773us) service_pool.cc:224] Handling call
0709 12:19:24.008682 (+126619us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:23.981137 24394 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:23.966547 24471 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:19:23.911352 27255 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:23.989913 24323 raft_consensus.cc:2393] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 7: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:23.991707 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:24.010855 24474 raft_consensus.cc:2410] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:19:23.994012 24319 raft_consensus.cc:1240] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:19:23.988240 27164 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:23.998685 24366 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:23.906612 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:23.988346 27287 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:24.001675 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:24.001935 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:24.004312 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 197468us
I20260709 12:19:23.900321 27304 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:24.011570 24470 raft_consensus.cc:2393] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 6: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:23.929922 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:23.984789 27337 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:24.018008 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 51767.8us
I20260709 12:19:24.044713 24473 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:24.000367 24398 raft_consensus.cc:2393] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 4: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:24.012594 27255 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:24.022047 25116 raft_consensus.cc:1240] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6. Ops: []
W20260709 12:19:24.027356 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.049800 25116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48252 (request call id 408) took 2783 ms. Trace:
I20260709 12:19:24.050197 25116 rpcz_store.cc:276] 0709 12:19:21.266443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.009839 (+2743396us) service_pool.cc:224] Handling call
0709 12:19:24.021848 (+ 12009us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.049508 (+ 27660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.049735 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:24.028445 25113 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35194 (request call id 459) took 1461 ms (client timeout 1761 ms). Trace:
I20260709 12:19:24.031471 27299 raft_consensus.cc:2749] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:24.033375 25083 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:19:24.033531 24399 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 452) took 1415 ms (client timeout 1764 ms). Trace:
W20260709 12:19:24.033953 27358 log.cc:927] Time spent T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.732s	user 0.000s	sys 0.001s
I20260709 12:19:24.034857 25112 raft_consensus.cc:1240] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:24.034924 25119 raft_consensus.cc:1240] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6. Ops: []
W20260709 12:19:24.035882 25115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35194 (request call id 454) took 2774 ms (client timeout 3301 ms). Trace:
W20260709 12:19:24.036950 27399 log.cc:927] Time spent T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 12:19:24.037818 27402 log.cc:927] Time spent T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:19:24.040001 24289 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:24.074301 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:24.040849 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.077003 24291 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:24.007264 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 104076us
I20260709 12:19:24.080312 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:24.049484 27287 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:24.002653 27336 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:24.049813 25118 raft_consensus.cc:2368] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6.
I20260709 12:19:24.052004 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:24.099648 24466 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:24.053278 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:24.057520 24399 rpcz_store.cc:269] 0709 12:19:22.618641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.619673 (+  1032us) service_pool.cc:224] Handling call
0709 12:19:24.033317 (+1413644us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b54001a6654. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:24.033443 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":892084480}
I20260709 12:19:24.101400 24471 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:19:24.061949 24469 raft_consensus.cc:1275] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:19:24.068161 25115 rpcz_store.cc:269] 0709 12:19:21.261483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.383823 (+2122340us) service_pool.cc:224] Handling call
0709 12:19:24.035700 (+651877us) spinlock_profiling.cc:243] Waited 94.1 ms on lock 0x7b54005b18d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:24.035827 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":216462720}
I20260709 12:19:24.069363 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48252 (request call id 414) took 2709 ms. Trace:
I20260709 12:19:24.016664 27384 raft_consensus.cc:2749] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:24.075282 24473 raft_consensus.cc:2468] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:24.044960 24467 raft_consensus.cc:2393] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 6: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:24.046818 27304 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:24.011919 26993 consensus_queue.cc:1048] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:19:24.095778 25084 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:24.126324 25084 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:24.097240 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:24.105280 25119 rpcz_store.cc:276] 0709 12:19:21.438303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.034388 (+2596085us) service_pool.cc:224] Handling call
0709 12:19:24.034727 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.069120 (+ 34393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.069309 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.127849 24474 raft_consensus.cc:2393] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 6: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:24.128109 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:24.065037 27282 raft_consensus.cc:2804] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:19:24.122355 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 123769us
I20260709 12:19:24.074118 27366 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:24.130252 24366 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
W20260709 12:19:24.132740 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 156892us
I20260709 12:19:24.129967 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:24.138420 24398 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:24.141065 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:24.143576 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:24.143796 24440 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:24.148723 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:24.149605 25119 raft_consensus.cc:2368] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6.
I20260709 12:19:24.150210 24466 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:19:24.062997 27337 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:24.141551 24366 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:24.144214 24469 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:24.149578 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:24.165061 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:24.165690 24317 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:24.167287 24398 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
W20260709 12:19:24.171211 24366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.154726 24440 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:24.121019 27304 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:24.103760 27169 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:24.153723 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:24.172804 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:24.190527 25119 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:24.173949 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:24.190737 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:24.172437 24471 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
W20260709 12:19:24.147452 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 89520.1us
I20260709 12:19:24.191666 24468 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:24.058667 25113 rpcz_store.cc:269] 0709 12:19:22.566999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.292175 (+725176us) service_pool.cc:224] Handling call
0709 12:19:24.028201 (+736026us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54007d0354. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:24.028359 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363313536}
I20260709 12:19:24.131851 25112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48252 (request call id 412) took 2791 ms. Trace:
I20260709 12:19:24.187680 24317 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:24.198575 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:24.147126 27406 raft_consensus.cc:2804] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:24.199705 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:24.203677 25117 raft_consensus.cc:1240] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:24.194723 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:24.209309 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:24.159618 27366 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:24.147433 27270 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:24.148463 27070 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:24.148280 27082 raft_consensus.cc:2804] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:24.251856 24471 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:24.209690 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:24.250672 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 173759us
I20260709 12:19:24.267055 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:24.253468 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 44162.6us
I20260709 12:19:24.268878 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:24.263813 24466 raft_consensus.cc:1275] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:19:24.274479 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:24.275516 25115 raft_consensus.cc:2368] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 3. Current term is 4.
I20260709 12:19:24.197747 27142 raft_consensus.cc:2749] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:24.276965 24473 raft_consensus.cc:1275] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:19:24.284937 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:24.282125 24289 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:24.253054 27403 log.cc:927] Time spent T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.352s	user 0.000s	sys 0.001s
I20260709 12:19:24.285673 24466 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:19:24.252486 27316 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:24.256351 27348 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:24.306988 27348 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:24.307168 27412 log.cc:927] Time spent T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:19:24.307507 27348 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:24.308408 24324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1756) took 1374 ms. Trace:
I20260709 12:19:24.309931 27337 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:24.309983 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:24.312621 27352 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:24.312789 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:24.313087 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:24.313582 24469 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:24.314138 25113 raft_consensus.cc:2410] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:24.276505 27414 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:24.315304 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:24.315594 27414 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:24.316224 25113 raft_consensus.cc:2410] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:19:24.317952 27414 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:24.308833 24324 rpcz_store.cc:276] 0709 12:19:22.934369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.458711 (+524342us) service_pool.cc:224] Handling call
0709 12:19:23.553107 (+ 94396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:23.553351 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:19:23.553629 (+   278us) log.cc:844] Serialized 14 byte log entry
0709 12:19:23.633525 (+ 79896us) log.cc:844] Serialized 14 byte log entry
0709 12:19:23.633711 (+   186us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:23.633756 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:23.633818 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:23.633882 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:24.308197 (+674315us) spinlock_profiling.cc:243] Waited 94 ms on lock 0x7b5400256cd0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:24.308333 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5936,"prepare.queue_time_us":1592,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":3554,"raft.queue_time_us":6331,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":25195,"spinlock_wait_cycles":330642048,"thread_start_us":73345,"threads_started":1,"wal-append.queue_time_us":82657}
I20260709 12:19:24.321417 25083 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:24.264708 27406 raft_consensus.cc:697] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:24.251539 27373 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:24.353596 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 371366us
W20260709 12:19:24.306504 27407 log.cc:927] Time spent T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 12:19:24.296350 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:24.352074 24468 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
W20260709 12:19:24.355638 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 57125.9us
W20260709 12:19:24.305706 27411 log.cc:927] Time spent T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:19:24.273658 27082 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:19:24.358738 24438 connection.cc:256] RPC call timeout handler was delayed by -1.4696505899999011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1779s for a response
I20260709 12:19:24.414587 24466 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:24.343945 24469 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:24.423051 25115 raft_consensus.cc:1240] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:24.423980 25115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48252 (request call id 424) took 2383 ms. Trace:
I20260709 12:19:24.424343 25115 rpcz_store.cc:276] 0709 12:19:22.040400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.422325 (+2381925us) service_pool.cc:224] Handling call
0709 12:19:24.422796 (+   471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.423674 (+   878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.423910 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.428539 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:24.430199 24469 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:19:24.277196 27169 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:24.414615 25083 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:24.197866 25112 rpcz_store.cc:276] 0709 12:19:21.330864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.034255 (+2703391us) service_pool.cc:224] Handling call
0709 12:19:24.034617 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.080797 (+ 46180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.122367 (+ 41570us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:24.440160 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 248536us
I20260709 12:19:24.443913 25083 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:24.448781 25115 raft_consensus.cc:1240] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:24.449507 25115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 966) took 2064 ms. Trace:
I20260709 12:19:24.449811 25115 rpcz_store.cc:276] 0709 12:19:22.385407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.448105 (+2062698us) service_pool.cc:224] Handling call
0709 12:19:24.448556 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.449235 (+   679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.449448 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.451105 25115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 967) took 2065 ms. Trace:
I20260709 12:19:24.451386 25115 rpcz_store.cc:276] 0709 12:19:22.385728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.450452 (+2064724us) service_pool.cc:224] Handling call
0709 12:19:24.450715 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.450900 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:24.450917 (+    17us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:24.450947 (+    30us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:24.450967 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.450999 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:24.451061 (+    62us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.292092 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:24.453231 25114 raft_consensus.cc:2376] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEARNER]: Leader pre-election vote request: Already granted yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7. Re-sending same reply.
I20260709 12:19:24.320770 27413 consensus_queue.cc:1059] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 12:19:24.457644 24440 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:24.434460 27299 raft_consensus.cc:2804] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:19:24.522732 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.273823 27270 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:24.434901 27082 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:24.446102 27282 raft_consensus.cc:697] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:24.553035 27299 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:24.477310 27169 raft_consensus.cc:697] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:19:24.564311 27407 log.cc:927] Time spent T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 12:19:24.594395 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.639312 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:24.892257 24319 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.003s	sys 0.006s
I20260709 12:19:24.925258 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:24.848807 24366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.002s	sys 0.009s
I20260709 12:19:24.586141 27299 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:24.756615 24465 raft_consensus.cc:1275] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:19:24.692564 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 47075.2us
I20260709 12:19:24.685447 24318 raft_consensus.cc:1275] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:19:24.723762 27420 log.cc:927] Time spent T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 12:19:24.925693 24469 raft_consensus.cc:2468] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
W20260709 12:19:24.936766 24366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.002s	sys 0.010s
I20260709 12:19:24.697422 27427 raft_consensus.cc:2804] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:19:24.637341 27364 consensus_meta.cc:287] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.732s	user 0.005s	sys 0.005s
W20260709 12:19:24.871529 27276 consensus_meta.cc:287] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.955s	user 0.009s	sys 0.005s
W20260709 12:19:24.865809 27164 consensus_meta.cc:287] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.810s	user 0.008s	sys 0.002s
W20260709 12:19:24.684166 25110 consensus_meta.cc:287] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.802s	user 0.007s	sys 0.000s
I20260709 12:19:24.576454 27423 raft_consensus.cc:2804] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:24.943078 25115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 456) took 2485 ms. Trace:
I20260709 12:19:24.965947 25115 rpcz_store.cc:276] 0709 12:19:22.457356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.452112 (+1994756us) service_pool.cc:224] Handling call
0709 12:19:24.452374 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.452525 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:19:24.593292 (+140767us) log.cc:844] Serialized 14 byte log entry
0709 12:19:24.942720 (+349428us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:24.942772 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:24.942821 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.942888 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:24.943022 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":271511,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":8626,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":3689,"thread_start_us":462564,"threads_started":2}
W20260709 12:19:24.680294 27336 consensus_meta.cc:287] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.001s
W20260709 12:19:24.951800 27255 consensus_meta.cc:287] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.883s	user 0.011s	sys 0.001s
I20260709 12:19:24.638823 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:24.936563 24319 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.004s	sys 0.006s
I20260709 12:19:24.949652 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:24.640339 27320 raft_consensus.cc:3060] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:24.952332 25083 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:19:24.721863 27285 consensus_meta.cc:287] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.798s	user 0.011s	sys 0.000s
I20260709 12:19:24.591061 25113 raft_consensus.cc:1240] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:24.679760 27373 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:24.973322 24399 raft_consensus.cc:2393] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 6: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:24.596616 25112 raft_consensus.cc:1240] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:24.969228 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:24.983367 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:24.721817 27143 raft_consensus.cc:3055] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:24.970212 25115 raft_consensus.cc:1240] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:24.970800 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:24.946141 24365 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:24.721351 27363 raft_consensus.cc:3055] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:24.932193 27159 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:24.984705 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:24.964569 27427 raft_consensus.cc:697] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:24.634763 27348 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:24.975971 27336 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:24.998709 25115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 461) took 2368 ms. Trace:
I20260709 12:19:24.634409 27304 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:24.963598 25110 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:24.962203 27352 consensus_queue.cc:1048] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:19:25.011708 25115 rpcz_store.cc:276] 0709 12:19:22.629871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.967389 (+2337518us) service_pool.cc:224] Handling call
0709 12:19:24.967667 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.988694 (+ 21027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.998645 (+  9951us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.640697 27169 consensus_queue.cc:237] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:24.985430 27354 raft_consensus.cc:2804] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:24.992583 27143 raft_consensus.cc:740] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:24.968313 27164 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:24.964425 27364 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:24.999521 25113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48252 (request call id 422) took 2957 ms. Trace:
I20260709 12:19:25.004328 27316 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:24.999984 27423 raft_consensus.cc:697] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:25.004051 27363 raft_consensus.cc:740] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:24.981715 27255 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:24.981078 27285 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:24.989404 27373 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:24.597162 27406 consensus_queue.cc:237] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:24.967922 27282 consensus_queue.cc:237] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:25.020910 27370 raft_consensus.cc:2764] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:19:25.041749 25116 raft_consensus.cc:2368] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6.
I20260709 12:19:25.028074 27336 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.028187 27354 raft_consensus.cc:697] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:25.048870 27427 consensus_queue.cc:237] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:25.052482 27354 consensus_queue.cc:237] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:25.055124 27164 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:25.056123 27348 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:25.055874 27336 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:25.056803 27143 consensus_queue.cc:260] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:25.058063 27143 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:25.060281 27423 consensus_queue.cc:237] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:25.069221 27255 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:25.068995 27363 consensus_queue.cc:260] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:25.070425 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 973) took 1411 ms. Trace:
I20260709 12:19:25.071069 25119 rpcz_store.cc:276] 0709 12:19:23.659474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:25.069172 (+1409698us) service_pool.cc:224] Handling call
0709 12:19:25.069654 (+   482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:25.069944 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:25.069987 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:25.070051 (+    64us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:25.070105 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.070180 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:25.070337 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:25.073817 27336 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:25.038905 27316 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:25.078595 27316 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:25.078192 27239 consensus_queue.cc:237] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:25.080029 27304 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:25.043494 27270 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:25.070322 27363 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:25.086488 27373 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:25.060367 27364 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:25.082127 27330 consensus_meta.cc:287] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 1.115s	user 0.012s	sys 0.004s
I20260709 12:19:25.100916 27330 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:25.104291 27330 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:25.105890 27082 consensus_meta.cc:287] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.001s
I20260709 12:19:25.106511 27082 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:25.206842 24323 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.011s	sys 0.016s
W20260709 12:19:25.208107 24323 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.011s	sys 0.016s
I20260709 12:19:25.208724 24319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1761) took 1045 ms. Trace:
I20260709 12:19:25.210881 24322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44278 (request call id 2185) took 1373 ms. Trace:
I20260709 12:19:25.209447 24319 rpcz_store.cc:276] 0709 12:19:24.163407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.163614 (+   207us) service_pool.cc:224] Handling call
0709 12:19:24.163900 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:24.199400 (+ 35500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:24.199430 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:24.219076 (+ 19646us) log.cc:844] Serialized 26 byte log entry
0709 12:19:24.970992 (+751916us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:24.971040 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.971139 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:25.207519 (+236380us) raft_consensus.cc:1685] finished
0709 12:19:25.207626 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:25.208265 (+   639us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35108,"raft.queue_time_us":109758,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":12801,"thread_start_us":671105,"threads_started":1,"wal-append.queue_time_us":762928}
I20260709 12:19:25.211313 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1879) took 1020 ms. Trace:
I20260709 12:19:25.213209 24320 raft_consensus.cc:1240] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:25.211891 24471 rpcz_store.cc:276] 0709 12:19:24.190243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.270010 (+ 79767us) service_pool.cc:224] Handling call
0709 12:19:24.270421 (+   411us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:24.270907 (+   486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:24.270950 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:24.280974 (+ 10024us) log.cc:844] Serialized 52 byte log entry
0709 12:19:24.555787 (+274813us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:24.555824 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.555905 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:25.210521 (+654616us) raft_consensus.cc:1685] finished
0709 12:19:25.210567 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:25.210978 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":558826,"raft.run_cpu_time_us":391,"raft.run_wall_time_us":77497,"thread_start_us":139289,"threads_started":1,"wal-append.queue_time_us":660107}
W20260709 12:19:25.216853 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.217610 24316 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 2.
I20260709 12:19:25.218189 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:24.995796 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:25.220118 24397 raft_consensus.cc:2393] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 6: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:25.239037 27082 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:25.024372 25110 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35194 (request call id 464) took 2073 ms (client timeout 2230 ms). Trace:
I20260709 12:19:25.220911 24394 raft_consensus.cc:1240] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:25.240911 27082 raft_consensus.cc:2749] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:25.236438 25119 raft_consensus.cc:1240] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:25.242384 24399 raft_consensus.cc:2393] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 7: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:25.242815 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:25.240916 25110 rpcz_store.cc:269] 0709 12:19:22.950920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.626531 (+675611us) service_pool.cc:224] Handling call
0709 12:19:25.021364 (+1394833us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:25.243901 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:25.017091 25112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 970) took 2528 ms. Trace:
W20260709 12:19:25.216368 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 270106us
I20260709 12:19:25.245174 25112 rpcz_store.cc:276] 0709 12:19:22.485364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.477328 (+1991964us) service_pool.cc:224] Handling call
0709 12:19:24.576655 (+ 99327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.985636 (+408981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.013636 (+ 28000us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:25.246289 24365 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:25.247696 24366 leader_election.cc:400] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 4. Current term is 5.
I20260709 12:19:25.248234 24366 leader_election.cc:403] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:25.249754 24365 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:25.222759 24466 raft_consensus.cc:1240] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:25.211513 24322 rpcz_store.cc:276] 0709 12:19:23.837433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.008948 (+171515us) service_pool.cc:224] Handling call
0709 12:19:24.009365 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:24.130061 (+120696us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:24.130091 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:24.130573 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 12:19:24.291545 (+160972us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:24.291585 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.291651 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:25.210129 (+918478us) raft_consensus.cc:1685] finished
0709 12:19:25.210180 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:25.210564 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14591,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":190292,"threads_started":2,"wal-append.queue_time_us":898473}
I20260709 12:19:25.244110 24398 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:25.254601 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:25.228041 24440 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.007s	sys 0.010s
W20260709 12:19:25.264017 24440 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.007s	sys 0.012s
I20260709 12:19:25.241372 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:25.265892 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:25.028509 25113 rpcz_store.cc:276] 0709 12:19:22.039812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.433028 (+2393216us) service_pool.cc:224] Handling call
0709 12:19:24.563815 (+130787us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.980967 (+417152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.997055 (+ 16088us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:25.282073 27195 raft_consensus.cc:2749] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:25.283291 27195 raft_consensus.cc:2749] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 4. Current term is 5.
I20260709 12:19:25.284221 27195 raft_consensus.cc:2749] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:25.267226 24399 raft_consensus.cc:2393] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 6: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:25.286018 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:25.287310 24399 raft_consensus.cc:2393] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 8: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:25.295785 24399 raft_consensus.cc:1240] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:19:25.135679 27287 consensus_meta.cc:287] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 1.019s	user 0.013s	sys 0.000s
W20260709 12:19:25.300660 27345 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.004s	sys 0.012s
W20260709 12:19:25.301491 27345 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.004s	sys 0.013s
I20260709 12:19:25.301440 27287 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:19:25.308660 24400 raft_consensus.cc:1240] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:19:25.310936 27284 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.311378 27287 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:19:25.311959 27284 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:25.317667 27284 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:25.270076 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:25.266000 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 808402us
I20260709 12:19:25.242177 27082 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:25.273176 24365 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
W20260709 12:19:25.322276 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 49434.1us
I20260709 12:19:25.325505 27082 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:25.327149 27284 raft_consensus.cc:2804] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:25.252223 24366 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:25.332530 27284 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:25.322467 27143 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.331316 27195 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:25.333556 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:25.334120 27143 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:25.334259 27195 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:25.333181 27284 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:25.337392 27164 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.338207 27164 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:25.340442 24316 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57702 (request call id 421) took 1691 ms (client timeout 2051 ms). Trace:
I20260709 12:19:25.341081 27255 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:25.340978 24316 rpcz_store.cc:269] 0709 12:19:23.648838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.651151 (+  2313us) service_pool.cc:224] Handling call
0709 12:19:25.340062 (+1688911us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b54002558d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:25.340269 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3599018880}
I20260709 12:19:25.341840 27255 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:25.339927 27239 consensus_queue.cc:1048] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:25.345705 27270 raft_consensus.cc:2804] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:25.346508 27270 raft_consensus.cc:697] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 6 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:25.347313 27164 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:25.347515 27143 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:25.349747 27429 consensus_queue.cc:1048] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:25.352366 27429 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:25.353120 27429 raft_consensus.cc:697] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:25.353292 27308 raft_consensus.cc:3055] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:25.353904 27308 raft_consensus.cc:740] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:25.355341 25117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 453) took 4104 ms. Trace:
I20260709 12:19:25.354848 27429 consensus_queue.cc:237] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:25.355932 24321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1748) took 2740 ms. Trace:
I20260709 12:19:25.357172 27413 raft_consensus.cc:2749] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:25.355563 27308 consensus_queue.cc:260] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:25.347999 27270 consensus_queue.cc:237] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:25.358155 27348 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.320451 24440 leader_election.cc:400] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6.
I20260709 12:19:25.330585 24365 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:25.356520 24321 rpcz_store.cc:276] 0709 12:19:22.615881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.153537 (+537656us) service_pool.cc:224] Handling call
0709 12:19:23.153810 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:23.154031 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:19:23.299010 (+144979us) log.cc:844] Serialized 14 byte log entry
0709 12:19:23.798851 (+499841us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b1800313de0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a94241e07 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425ec02 00007f4a96ee620b 00007f4a96eebd23 00007f4a96eec23a 00007f4a97356a2a
0709 12:19:24.254987 (+456136us) log.cc:844] Serialized 14 byte log entry
0709 12:19:25.330320 (+1075333us) spinlock_profiling.cc:243] Waited 6.52 ms on lock 0x7b1800313de0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a941d9c0a 00007f4a9d919219 00007f4a94261a40 00007f4a9425c4e4 00007f4a9425c455 00007f4a97344060 00007f4a97356716 00007f4a97367287 00007f4a97367208
0709 12:19:25.355186 (+ 24866us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:25.355323 (+   137us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:25.355467 (+   144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.355575 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:25.355721 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78370,"prepare.queue_time_us":120401,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":109,"raft.queue_time_us":1142125,"raft.run_cpu_time_us":388,"raft.run_wall_time_us":16038,"spinlock_wait_cycles":79123584,"thread_start_us":576390,"threads_started":3,"wal-append.queue_time_us":852696,"wal-append.run_cpu_time_us":2758,"wal-append.run_wall_time_us":1150333}
W20260709 12:19:25.333388 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 81489us
I20260709 12:19:25.346536 27255 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:25.355857 25117 rpcz_store.cc:276] 0709 12:19:21.250573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.946072 (+2695499us) service_pool.cc:224] Handling call
0709 12:19:23.962527 (+ 16455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.204295 (+241768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.354649 (+1150354us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b540065de54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:25.354988 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":553934208}
I20260709 12:19:25.411653 24398 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
W20260709 12:19:25.424527 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:25.425920 24395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 1867) took 3412 ms (client timeout 1794 ms). Trace:
I20260709 12:19:25.426147 26962 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:19:25.426486 24395 rpcz_store.cc:269] 0709 12:19:21.947717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.129923 (+182206us) service_pool.cc:224] Handling call
0709 12:19:25.359526 (+3229603us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54003241d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:25.359894 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3305211776}
W20260709 12:19:25.428521 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:25.433841 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 103510us
W20260709 12:19:25.440776 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 1.15839e+06us
W20260709 12:19:25.445816 27465 log.cc:927] Time spent T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:19:25.447180 27308 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:25.463227 27285 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:25.465353 24318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 414) took 2512 ms. Trace:
I20260709 12:19:25.465024 27299 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:25.465970 24318 rpcz_store.cc:276] 0709 12:19:22.953258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.506205 (+552947us) service_pool.cc:224] Handling call
0709 12:19:23.506554 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.948530 (+1441976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.464737 (+516207us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400338e54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:25.465136 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2709913984}
I20260709 12:19:25.471984 27143 consensus_queue.cc:1059] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:25.473140 24396 raft_consensus.cc:1240] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:25.428875 27348 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:25.535624 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 651) took 1106 ms. Trace:
I20260709 12:19:25.537546 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1885) took 1239 ms. Trace:
I20260709 12:19:25.473485 27143 raft_consensus.cc:3055] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:25.536890 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:25.559461 24465 rpcz_store.cc:276] 0709 12:19:24.416113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.957836 (+541723us) service_pool.cc:224] Handling call
0709 12:19:24.958267 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.958570 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:19:24.961711 (+  3141us) log.cc:844] Serialized 14 byte log entry
0709 12:19:25.521991 (+560280us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:25.522163 (+   172us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:25.522296 (+   133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.522445 (+   149us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:25.522781 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":123609,"prepare.queue_time_us":3425,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":3099,"raft.queue_time_us":135537,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":166,"spinlock_wait_cycles":34560,"thread_start_us":352052,"threads_started":2,"wal-append.queue_time_us":136555}
I20260709 12:19:25.537726 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:25.560062 24468 rpcz_store.cc:276] 0709 12:19:24.298104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.413488 (+115384us) service_pool.cc:224] Handling call
0709 12:19:24.461132 (+ 47644us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:24.565959 (+104827us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:24.566010 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:24.566692 (+   682us) log.cc:844] Serialized 26 byte log entry
0709 12:19:24.728934 (+162242us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:24.755605 (+ 26671us) log.cc:844] Serialized 14 byte log entry
0709 12:19:25.343717 (+588112us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b18003fb500. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a941d9c0a 00007f4a9d919219 00007f4a94261a40 00007f4a9425c4e4 00007f4a9425c455 00007f4a97344060 00007f4a97356716 00007f4a97367287 00007f4a97367208
0709 12:19:25.423836 (+ 80119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.439906 (+ 16070us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:25.523254 (+ 83348us) raft_consensus.cc:1685] finished
0709 12:19:25.536935 (+ 13681us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:25.537254 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80471,"prepare.queue_time_us":133,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":65,"raft.queue_time_us":1496860,"raft.run_cpu_time_us":359,"raft.run_wall_time_us":358,"spinlock_wait_cycles":63802624,"thread_start_us":330983,"threads_started":3,"wal-append.queue_time_us":459584}
I20260709 12:19:25.478013 25115 raft_consensus.cc:1240] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:25.560907 27143 raft_consensus.cc:740] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
W20260709 12:19:25.482715 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 62888.5us
I20260709 12:19:25.566133 27143 consensus_queue.cc:260] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:25.536737 27289 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:25.481741 27195 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:25.569223 27348 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:25.437448 27287 raft_consensus.cc:2804] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:25.468566 27082 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:25.577767 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 132417us
I20260709 12:19:25.577932 27287 raft_consensus.cc:697] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:19:25.591004 25118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 425) took 3550 ms (client timeout 2965 ms). Trace:
I20260709 12:19:25.592569 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:25.595371 24393 raft_consensus.cc:1240] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:25.601332 24365 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
W20260709 12:19:25.597607 25118 rpcz_store.cc:269] 0709 12:19:22.040676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.573502 (+1532826us) service_pool.cc:224] Handling call
0709 12:19:25.589204 (+2015702us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b54006301d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:25.590693 (+  1489us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":898964224}
I20260709 12:19:25.603348 24391 raft_consensus.cc:2393] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 6: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:25.581840 27284 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:25.615598 27284 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:25.620528 25115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 972) took 1961 ms. Trace:
I20260709 12:19:25.621084 25115 rpcz_store.cc:276] 0709 12:19:23.659192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:25.016687 (+1357495us) service_pool.cc:224] Handling call
0709 12:19:25.017204 (+   517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:25.564501 (+547297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.620132 (+ 55631us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b540075fdd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:25.620434 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1038968704}
W20260709 12:19:25.621959 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 116051us
I20260709 12:19:25.607192 27299 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:25.635071 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 314994us
I20260709 12:19:25.642464 27282 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:25.643586 24396 raft_consensus.cc:1275] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:25.643550 27282 raft_consensus.cc:697] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:25.646353 27282 consensus_queue.cc:237] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:25.637920 27471 consensus_queue.cc:1059] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:19:25.657680 24318 raft_consensus.cc:1275] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:19:25.660596 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:25.654696 27143 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:25.677395 24321 raft_consensus.cc:1275] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:25.672585 24440 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:25.680030 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 90410.9us
I20260709 12:19:25.685307 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:25.682271 27348 consensus_queue.cc:1059] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:19:25.689548 27472 raft_consensus.cc:2749] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:25.690551 27472 raft_consensus.cc:3055] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:25.690660 25084 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:25.691025 27472 raft_consensus.cc:740] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:25.691975 27299 raft_consensus.cc:2764] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:19:25.692518 27472 consensus_queue.cc:260] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:25.693928 27472 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:25.697088 27468 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:25.697968 27468 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:25.696822 27473 consensus_queue.cc:1059] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:19:25.700420 27468 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:25.701333 27473 raft_consensus.cc:3055] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:25.701782 27473 raft_consensus.cc:740] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:25.702378 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:25.703701 24322 raft_consensus.cc:2393] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:25.703346 27473 consensus_queue.cc:260] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:25.702507 24323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1759) took 1542 ms. Trace:
I20260709 12:19:25.704841 24323 rpcz_store.cc:276] 0709 12:19:24.160107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.160295 (+   188us) service_pool.cc:224] Handling call
0709 12:19:24.210544 (+ 50249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.584852 (+374308us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:19:24.585168 (+   316us) log.cc:844] Serialized 14 byte log entry
0709 12:19:25.423739 (+838571us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:25.439830 (+ 16091us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:25.523370 (+ 83540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.702118 (+178748us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b54002dbc54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:25.702169 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:25.702431 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":253070,"prepare.queue_time_us":2269,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":135941,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":260,"spinlock_wait_cycles":763817856,"thread_start_us":698762,"threads_started":2,"wal-append.queue_time_us":489968}
I20260709 12:19:25.708818 24317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1764) took 1477 ms. Trace:
I20260709 12:19:25.709009 24323 raft_consensus.cc:1240] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:25.711056 27473 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:25.709455 24317 rpcz_store.cc:276] 0709 12:19:24.190090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.205769 (+ 15679us) service_pool.cc:224] Handling call
0709 12:19:24.208430 (+  2661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.263099 (+ 54669us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:19:24.455558 (+192459us) log.cc:844] Serialized 14 byte log entry
0709 12:19:25.578178 (+1122620us) log.cc:844] Serialized 14 byte log entry
0709 12:19:25.600189 (+ 22011us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:25.604262 (+  4073us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:25.644414 (+ 40152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.656265 (+ 11851us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:25.667537 (+ 11272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":879795,"prepare.queue_time_us":192922,"prepare.run_cpu_time_us":193,"prepare.run_wall_time_us":9610,"raft.queue_time_us":893206,"raft.run_cpu_time_us":523,"raft.run_wall_time_us":30682,"thread_start_us":237185,"threads_started":2}
I20260709 12:19:25.712255 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:25.715348 25111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 964) took 4477 ms. Trace:
I20260709 12:19:25.718206 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:25.719126 24316 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
W20260709 12:19:25.719767 27460 log.cc:927] Time spent T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:19:25.720846 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:25.723251 24316 raft_consensus.cc:3055] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:19:25.726922 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.688246 24391 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:25.724038 24316 raft_consensus.cc:740] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:25.774994 25082 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:25.777346 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 134821us
I20260709 12:19:25.723165 26962 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:25.805869 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:25.806969 24323 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
W20260709 12:19:25.811561 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 153280us
I20260709 12:19:25.814980 24440 leader_election.cc:400] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 3. Current term is 4.
I20260709 12:19:25.815502 24440 leader_election.cc:403] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:25.818845 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:25.715881 25111 rpcz_store.cc:276] 0709 12:19:21.238015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.918489 (+2680474us) service_pool.cc:224] Handling call
0709 12:19:25.713990 (+1795501us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b5800004598. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c325fc0 00007f4a9c310929 00007f4a9c3103d2 00007f4a95887bd4
0709 12:19:25.714388 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:25.714764 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:25.714795 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:25.714886 (+    91us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:25.714938 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.715004 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:25.715135 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51530496}
I20260709 12:19:25.826481 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:25.826506 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 86602.6us
I20260709 12:19:25.832262 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:25.834421 24323 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:25.834787 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 976) took 1783 ms. Trace:
I20260709 12:19:25.835212 25119 rpcz_store.cc:276] 0709 12:19:24.051804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:25.093086 (+1041282us) service_pool.cc:224] Handling call
0709 12:19:25.093522 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:25.242341 (+148819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.781730 (+539389us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54006bb554. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:25.834717 (+ 52987us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326642048}
W20260709 12:19:25.836866 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.780014 27287 consensus_queue.cc:237] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:25.785100 26962 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:25.840504 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.839617 24324 raft_consensus.cc:1275] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:19:25.826324 24316 consensus_queue.cc:260] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:25.848169 24366 connection.cc:256] RPC call timeout handler was delayed by -1.3184133089998795s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33010000000000006s for a response
I20260709 12:19:25.854743 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:25.859771 27478 log.cc:927] Time spent T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:19:25.860723 24324 raft_consensus.cc:1275] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:19:25.860917 27425 consensus_queue.cc:1048] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:25.862876 25113 raft_consensus.cc:1275] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:19:25.864307 24317 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:19:25.866602 24321 raft_consensus.cc:1275] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:19:25.871310 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 648) took 1568 ms. Trace:
I20260709 12:19:25.874061 24316 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:25.871804 24466 rpcz_store.cc:276] 0709 12:19:24.302923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.430194 (+127271us) service_pool.cc:224] Handling call
0709 12:19:24.430438 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:25.260151 (+829713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.856622 (+596471us) spinlock_profiling.cc:243] Waited 792 ms on lock 0x7b540029e354. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:25.871239 (+ 14617us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1820606208}
I20260709 12:19:25.878093 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:25.879076 24394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1891) took 1800 ms. Trace:
I20260709 12:19:25.879665 27474 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.879511 24394 rpcz_store.cc:276] 0709 12:19:24.078818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.078976 (+   158us) service_pool.cc:224] Handling call
0709 12:19:24.084029 (+  5053us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:25.241655 (+1157626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.878720 (+637065us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54001e9bd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:25.878981 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2612611328}
I20260709 12:19:25.880445 27474 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:19:25.880895 27308 consensus_queue.cc:1048] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:25.887559 24400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1888) took 2039 ms. Trace:
I20260709 12:19:25.888082 24400 rpcz_store.cc:276] 0709 12:19:23.847903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.914503 (+ 66600us) service_pool.cc:224] Handling call
0709 12:19:23.914869 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:25.309433 (+1394564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.887197 (+577764us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54002a3354. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:25.887484 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3203690368}
W20260709 12:19:25.889509 24290 leader_election.cc:336] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.642s (SENT)
I20260709 12:19:25.889848 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:25.890193 24290 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:25.890897 25111 raft_consensus.cc:2393] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 7: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
W20260709 12:19:25.891871 24290 leader_election.cc:336] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.935s (SENT)
I20260709 12:19:25.892807 27471 raft_consensus.cc:2749] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 3. Current term is 4.
I20260709 12:19:25.892809 27468 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.894582 27468 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:25.895577 27440 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:25.896297 27348 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.896826 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:25.897152 27348 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:25.897729 25117 raft_consensus.cc:2393] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 6: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:25.899708 27348 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:25.901098 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 86490.1us
I20260709 12:19:25.901958 24440 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:25.903040 24289 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:25.903471 24440 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:25.900434 27354 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:25.905807 27425 raft_consensus.cc:2749] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:25.906339 27474 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:19:25.878118 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:25.896548 27440 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:25.895510 24438 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:25.892402 24290 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:25.915347 27471 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:25.916491 27272 consensus_queue.cc:1048] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:25.918673 27272 raft_consensus.cc:2804] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:25.918797 27449 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:25.920042 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.919682 27449 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:25.920528 24470 raft_consensus.cc:1275] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:19:25.920782 24467 raft_consensus.cc:1275] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:19:25.919137 27272 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:25.922235 27449 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:25.906780 27425 raft_consensus.cc:2749] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:25.924950 24316 raft_consensus.cc:1275] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:19:25.940809 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 264216us
I20260709 12:19:25.943816 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:25.924850 27272 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:25.916193 27471 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:19:25.955264 27437 raft_consensus.cc:2749] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:25.957021 26956 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:19:25.957628 27482 log.cc:927] Time spent T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260709 12:19:25.958359 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 66544.3us
I20260709 12:19:25.958814 24394 raft_consensus.cc:1240] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: [4.2-7.3]
I20260709 12:19:25.958966 27164 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:25.959329 24440 leader_election.cc:400] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6.
I20260709 12:19:25.982372 24440 leader_election.cc:403] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:25.983510 27437 raft_consensus.cc:2749] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6.
I20260709 12:19:25.988345 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:25.989182 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 93848.8us
I20260709 12:19:25.990339 24438 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:25.991134 27277 consensus_queue.cc:1059] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:25.991765 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2333) took 1352 ms. Trace:
I20260709 12:19:25.943729 27354 consensus_queue.cc:1048] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:19:25.974225 27468 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:25.992672 27299 consensus_queue.cc:1048] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:19:25.993955 27475 log.cc:927] Time spent T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.333s	user 0.002s	sys 0.000s
I20260709 12:19:25.994638 27354 consensus_queue.cc:1048] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:25.996142 27472 raft_consensus.cc:2749] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:25.998107 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:25.992300 24392 rpcz_store.cc:276] 0709 12:19:24.639637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.640998 (+  1361us) service_pool.cc:224] Handling call
0709 12:19:25.538602 (+897604us) spinlock_profiling.cc:243] Waited 33.7 ms on lock 0x7b58001c9e98. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c325fc0 00007f4a9c310929 00007f4a9c3103d2 00007f4a95887bd4
0709 12:19:25.538983 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:25.913910 (+374927us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:25.913949 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:25.915230 (+  1281us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:25.915291 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.974842 (+ 59551us) spinlock_profiling.cc:243] Waited 7.98 ms on lock 0x7b180000dc60. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9422d2a6 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419
0709 12:19:25.991354 (+ 16512us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b54001112d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:25.991403 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:25.991561 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18947,"raft.queue_time_us":6174,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"spinlock_wait_cycles":943721088}
I20260709 12:19:26.003180 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:25.960563 25082 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:25.961484 27348 consensus_queue.cc:1059] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:25.963110 27254 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.964210 27256 raft_consensus.cc:2749] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:25.969182 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:25.970422 24317 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:25.974676 27415 consensus_queue.cc:1059] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:25.975289 24320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 432) took 1833 ms. Trace:
I20260709 12:19:25.976034 26956 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:25.976495 27484 log.cc:927] Time spent T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 12:19:25.978404 24290 leader_election.cc:336] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.956s (SENT)
I20260709 12:19:25.980964 25117 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:25.981354 27469 raft_consensus.cc:2749] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:25.959934 27425 consensus_queue.cc:1059] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:26.005110 24438 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:25.968802 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:25.916208 27466 consensus_queue.cc:1059] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 12:19:26.007963 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:26.027912 24320 rpcz_store.cc:276] 0709 12:19:24.142331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.142742 (+   411us) service_pool.cc:224] Handling call
0709 12:19:24.143037 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:25.214261 (+1071224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.970719 (+756458us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540030b454. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:25.975209 (+  4490us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2459505408}
I20260709 12:19:25.964434 27255 consensus_queue.cc:1059] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:19:26.035318 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:26.037632 24290 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:26.036661 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:26.043613 24394 raft_consensus.cc:1240] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:26.044113 24472 raft_consensus.cc:2410] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:19:26.041040 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:25.982374 27164 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:26.003271 26962 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:26.034473 27424 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.067199 27070 raft_consensus.cc:3055] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:26.067939 27070 raft_consensus.cc:740] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:26.068413 24470 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:26.069527 27070 consensus_queue.cc:260] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:26.070478 24470 raft_consensus.cc:1275] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:26.072221 27070 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:26.073082 25116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 428) took 1991 ms (client timeout 1611 ms). Trace:
I20260709 12:19:26.080523 27424 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:26.081255 25116 rpcz_store.cc:269] 0709 12:19:24.046163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.054595 (+  8432us) service_pool.cc:224] Handling call
0709 12:19:25.968746 (+1914151us) spinlock_profiling.cc:243] Waited 960 ms on lock 0x7b540044e8d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:26.037711 (+ 68965us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2208638208}
I20260709 12:19:26.081830 27466 raft_consensus.cc:3055] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:26.082304 27466 raft_consensus.cc:740] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:26.082592 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:26.083348 25116 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:26.083425 27424 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:26.084122 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 91559.2us
I20260709 12:19:26.083912 27472 raft_consensus.cc:2749] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:26.083714 27348 raft_consensus.cc:3055] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:26.085632 24438 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:26.073316 25114 raft_consensus.cc:1240] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:26.087024 27472 raft_consensus.cc:2749] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:26.087571 24438 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:26.074607 24467 raft_consensus.cc:1275] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:19:26.075733 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.086268 27348 raft_consensus.cc:740] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:26.089517 27348 consensus_queue.cc:260] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:26.090975 27348 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:26.091115 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:26.091861 24396 raft_consensus.cc:2376] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7. Re-sending same reply.
I20260709 12:19:26.092988 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:26.094426 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:26.095216 24399 raft_consensus.cc:2393] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 6: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:26.076124 24466 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:26.076858 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 116571us
W20260709 12:19:26.077188 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 98861us
I20260709 12:19:26.077693 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:26.078248 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:26.079027 27483 raft_consensus.cc:2749] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:19:26.099205 24290 leader_election.cc:336] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.645s (SENT)
I20260709 12:19:26.099611 27256 raft_consensus.cc:2749] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:26.079208 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:26.099112 24469 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:26.079599 27440 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:26.080937 27471 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:26.087849 27427 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.980s	user 0.030s	sys 0.025s
W20260709 12:19:26.103176 27427 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.048s	user 0.030s	sys 0.026s
I20260709 12:19:26.074069 26956 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:26.106869 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:26.107625 25115 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:26.107950 25082 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:26.109197 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:26.090484 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:26.110206 24474 raft_consensus.cc:2393] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 6: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:26.110775 24391 raft_consensus.cc:2393] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 8: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:26.113152 27427 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:26.113754 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:26.108568 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:26.114754 25115 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:26.114766 24397 raft_consensus.cc:2393] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 7: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:26.043180 27254 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:26.118134 27254 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:26.118825 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:26.119786 24395 raft_consensus.cc:2393] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 8: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:26.120980 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:26.042831 27351 consensus_queue.cc:1059] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 12:19:26.125425 24396 raft_consensus.cc:1240] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6. Ops: [4.6-5.7]
I20260709 12:19:26.129751 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:26.130582 24465 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:26.133602 24469 raft_consensus.cc:2468] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:26.098934 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:26.141129 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:26.073773 25111 raft_consensus.cc:1275] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:26.144053 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:26.144824 25119 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:26.149667 27270 raft_consensus.cc:3055] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:26.150128 27270 raft_consensus.cc:740] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:26.150339 27164 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:26.151275 27270 consensus_queue.cc:260] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:26.152405 27255 raft_consensus.cc:3055] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:26.152921 27255 raft_consensus.cc:740] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:26.154053 27255 consensus_queue.cc:260] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:26.154637 24473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1884) took 1856 ms. Trace:
I20260709 12:19:26.155252 27255 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:26.139865 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:26.157225 25112 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:26.125501 27351 raft_consensus.cc:3055] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:26.158845 27351 raft_consensus.cc:740] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:26.157225 27437 raft_consensus.cc:3055] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:26.160586 27437 raft_consensus.cc:740] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:26.138253 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:19:26.140282 24290 leader_election.cc:336] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.684s (SENT)
I20260709 12:19:26.167635 24290 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:26.168699 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 113946us
I20260709 12:19:26.171535 24471 raft_consensus.cc:1275] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:26.174486 24393 raft_consensus.cc:1275] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:19:26.160116 27480 log.cc:927] Time spent T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:19:26.175077 24472 raft_consensus.cc:1240] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: [4.2-7.3]
I20260709 12:19:26.176235 24319 raft_consensus.cc:1275] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:19:26.177207 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:26.181125 24317 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:26.155055 24473 rpcz_store.cc:276] 0709 12:19:24.297756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.298766 (+  1010us) service_pool.cc:224] Handling call
0709 12:19:24.299081 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:25.648855 (+1349774us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:19:25.831740 (+182885us) log.cc:844] Serialized 14 byte log entry
0709 12:19:25.876327 (+ 44587us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:25.916877 (+ 40550us) log.cc:844] Serialized 26 byte log entry
0709 12:19:25.917037 (+   160us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:25.917319 (+   282us) log.cc:844] Serialized 14 byte log entry
0709 12:19:25.917505 (+   186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.154085 (+236580us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400243e54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:26.154134 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:26.154275 (+   141us) raft_consensus.cc:1685] finished
0709 12:19:26.154304 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:26.154467 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25048,"prepare.queue_time_us":203779,"prepare.run_cpu_time_us":136,"prepare.run_wall_time_us":6358,"raft.queue_time_us":33824,"raft.run_cpu_time_us":2222,"raft.run_wall_time_us":4719,"spinlock_wait_cycles":3099707136,"thread_start_us":167392,"threads_started":2,"wal-append.queue_time_us":12610}
I20260709 12:19:26.178278 24399 raft_consensus.cc:1240] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:19:26.179435 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:26.186417 24396 raft_consensus.cc:1240] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:26.184072 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:26.161731 27437 consensus_queue.cc:260] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:26.191905 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:26.197510 24467 raft_consensus.cc:2393] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 6: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:26.083364 27466 consensus_queue.cc:260] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:26.205192 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:26.160125 27351 consensus_queue.cc:260] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:19:26.227007 27351 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:26.229460 27466 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:26.200067 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:26.235697 24391 raft_consensus.cc:2376] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4. Re-sending same reply.
I20260709 12:19:26.237056 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:26.238014 24467 raft_consensus.cc:2393] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:26.238885 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:26.240110 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:26.240762 27468 consensus_queue.cc:1175] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c855242ec9d34a5397741ef20db9de8a" responder_term: 7 status { last_received { term: 6 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:19:26.242688 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:26.244170 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:26.244796 24472 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:26.245663 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:26.246236 24472 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:26.247187 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:26.249024 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:26.249361 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:26.249699 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:26.249933 24323 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6.
W20260709 12:19:26.250276 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.250597 24322 raft_consensus.cc:2393] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 8: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:26.251348 27427 consensus_queue.cc:1059] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:26.251740 25084 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:26.252380 27427 consensus_queue.cc:1243] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer c711faa13ead43ebbea0192cb74a4756 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:19:26.253158 27427 raft_consensus.cc:3055] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:26.194941 27270 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:26.253858 27427 raft_consensus.cc:740] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:26.255151 27427 consensus_queue.cc:260] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:26.256546 27427 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:26.246246 26962 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:26.173151 27348 raft_consensus.cc:2749] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:19:26.226871 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 139492us
I20260709 12:19:26.262372 24467 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
W20260709 12:19:26.273138 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 76355.2us
I20260709 12:19:26.272204 24474 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:26.194761 27437 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:26.282225 24473 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:19:26.287835 24399 raft_consensus.cc:1275] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:19:26.283859 25119 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:26.285485 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:26.290575 24440 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:26.296056 24466 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:26.298573 24472 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:19:26.299886 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:26.301844 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 161629us
I20260709 12:19:26.307382 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:26.304142 27254 consensus_queue.cc:1048] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:19:26.311471 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:26.314342 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:26.314865 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:26.315330 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.316215 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:26.318327 24466 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:26.320205 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:26.321365 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 329934us
I20260709 12:19:26.325287 24395 raft_consensus.cc:2393] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:26.354848 24440 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:26.303483 27348 raft_consensus.cc:2749] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:26.359361 24438 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:26.354164 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:26.364913 24290 leader_election.cc:336] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.722s (SENT)
I20260709 12:19:26.365651 24290 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:26.368402 24471 raft_consensus.cc:2393] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 4: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:26.289788 26956 consensus_queue.cc:1059] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:19:26.369853 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:26.372865 27422 consensus_queue.cc:1048] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:19:26.373380 25114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 971) took 3808 ms. Trace:
I20260709 12:19:26.373737 25114 rpcz_store.cc:276] 0709 12:19:22.565242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.477831 (+1912589us) service_pool.cc:224] Handling call
0709 12:19:26.040838 (+1563007us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.086670 (+ 45832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.373151 (+286481us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b540044e8d0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:26.373318 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3251659136}
W20260709 12:19:26.376564 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.303258 26962 consensus_queue.cc:1059] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:19:26.381999 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:26.379987 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:26.353147 27143 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:26.389295 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:26.392330 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 82896us
I20260709 12:19:26.393446 24440 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:26.387669 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:26.383771 27473 consensus_meta.cc:287] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.667s	user 0.013s	sys 0.000s
I20260709 12:19:26.403515 24467 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:26.406948 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:26.405294 27449 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:26.388525 27470 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:26.408746 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:26.410336 24474 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:26.417327 24473 raft_consensus.cc:2393] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 6: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:26.387262 27143 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:26.422380 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:26.414978 27449 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:26.424399 27449 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:26.385387 27254 raft_consensus.cc:2749] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:26.428776 27427 consensus_queue.cc:1048] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:26.430892 27427 consensus_queue.cc:1048] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:19:26.433765 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:26.438051 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 129221us
W20260709 12:19:26.441630 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.401947 27308 raft_consensus.cc:2749] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:26.446002 24466 raft_consensus.cc:2393] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 8: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
W20260709 12:19:26.458041 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 171090us
I20260709 12:19:26.463500 24440 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:26.467132 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:26.465057 24438 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:26.434142 27143 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:26.475914 24290 leader_election.cc:336] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.118s (SENT)
I20260709 12:19:26.411387 27425 consensus_queue.cc:1048] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:19:26.485837 24290 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:26.483376 24467 raft_consensus.cc:1275] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:19:26.488252 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:26.494853 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:26.495630 24322 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
W20260709 12:19:26.503929 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.507213 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:26.489180 27272 consensus_meta.cc:287] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.517s	user 0.006s	sys 0.006s
I20260709 12:19:26.484664 27348 raft_consensus.cc:2804] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:19:26.518728 24440 leader_election.cc:336] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Timed out: RequestConsensusVote RPC to 127.22.155.196:35511 timed out after 1.611s (SENT)
I20260709 12:19:26.523226 25116 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:19:26.525077 24440 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:26.526930 24366 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.028s	sys 0.042s
I20260709 12:19:26.521129 27308 raft_consensus.cc:2804] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:19:26.527422 24366 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.028s	sys 0.042s
I20260709 12:19:26.537238 25115 raft_consensus.cc:1275] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEARNER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:19:26.519670 27348 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:19:26.539438 24321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.022s	sys 0.028s
I20260709 12:19:26.524567 27483 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.524698 27470 raft_consensus.cc:2749] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:19:26.541533 24321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.022s	sys 0.028s
W20260709 12:19:26.542063 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 674535us
I20260709 12:19:26.562099 24365 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:19:26.563267 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 100742us
I20260709 12:19:26.566097 24290 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:26.567730 24290 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:26.522588 27272 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:26.542315 27348 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:26.571123 27308 raft_consensus.cc:697] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:26.539004 27473 raft_consensus.cc:2749] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:19:26.576089 27277 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.021s	sys 0.056s
I20260709 12:19:26.577875 24316 raft_consensus.cc:1240] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 5. Current term is 6. Ops: []
W20260709 12:19:26.581084 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 73005.8us
I20260709 12:19:26.568678 27254 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:26.591915 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:26.592857 24399 raft_consensus.cc:2393] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 6: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
W20260709 12:19:26.574141 24392 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.021s	sys 0.014s
I20260709 12:19:26.600181 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:26.598141 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:26.593422 24392 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.022s	sys 0.015s
I20260709 12:19:26.593976 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:26.634346 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 72378us
W20260709 12:19:26.635922 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.627451 24440 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
W20260709 12:19:26.588050 27277 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.021s	sys 0.056s
I20260709 12:19:26.645037 24391 raft_consensus.cc:1275] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:26.654881 24317 raft_consensus.cc:2410] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:19:26.549319 27483 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:26.662869 24365 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:26.646756 24290 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:26.660737 24395 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:26.601297 27471 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.598116 27282 raft_consensus.cc:2749] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:26.674182 24396 raft_consensus.cc:2376] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6. Re-sending same reply.
W20260709 12:19:26.676370 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 478270us
W20260709 12:19:26.674691 24470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.011s	sys 0.035s
I20260709 12:19:26.657148 27473 raft_consensus.cc:2804] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:19:26.680159 24470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.012s	sys 0.035s
I20260709 12:19:26.689167 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:26.725347 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:26.748250 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 72484.8us
I20260709 12:19:26.754339 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:26.755684 24391 raft_consensus.cc:2393] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 7: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
W20260709 12:19:26.779336 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:26.796510 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 47016.2us
W20260709 12:19:26.798496 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.815443 24395 raft_consensus.cc:1240] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:26.693989 27351 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:26.685725 27473 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:26.813560 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:26.825133 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 234203us
I20260709 12:19:26.825546 27467 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:26.853158 27467 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:26.853648 27467 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:26.853864 27488 log.cc:927] Time spent T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:19:26.854775 27254 consensus_queue.cc:1048] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:26.830931 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:26.858527 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:26.859304 24468 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:26.833978 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:26.853665 27336 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:26.861639 27336 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:26.861989 27336 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:26.668491 27308 consensus_queue.cc:237] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:26.835577 27449 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:26.837018 24325 raft_consensus.cc:1275] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:26.835629 24323 raft_consensus.cc:1275] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:26.839865 27272 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:26.849236 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:26.852447 24290 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:26.852617 27435 raft_consensus.cc:2749] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:26.860317 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:26.870820 24396 raft_consensus.cc:2376] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6. Re-sending same reply.
I20260709 12:19:26.678965 27471 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:26.881757 24366 connection.cc:256] RPC call timeout handler was delayed by -1.2437817830000313s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1584s for a response
W20260709 12:19:26.887596 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 64420.4us
I20260709 12:19:26.890549 24474 raft_consensus.cc:2393] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:26.866307 27473 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:26.900969 25084 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.081s	sys 0.120s
W20260709 12:19:26.903023 25084 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.081s	sys 0.121s
W20260709 12:19:26.903507 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 650002us
I20260709 12:19:26.905697 24291 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:26.906709 27272 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:26.907126 27272 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:26.907480 27272 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:26.910607 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:26.878476 26956 consensus_queue.cc:1243] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer c855242ec9d34a5397741ef20db9de8a log is divergent from this leader: its last log entry 8.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:19:26.914880 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:26.915582 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:26.914444 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 62108.2us
I20260709 12:19:26.919400 24465 raft_consensus.cc:1275] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:19:26.922631 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:19:26.923601 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.912223 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:26.927282 24468 raft_consensus.cc:2410] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:19:26.848165 27287 consensus_queue.cc:1048] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:19:26.881325 27490 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.934578 24365 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:26.921304 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:26.949784 25114 raft_consensus.cc:2376] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEARNER]: Leader election vote request: Already granted yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7. Re-sending same reply.
I20260709 12:19:26.891247 27470 raft_consensus.cc:2749] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:26.956338 27508 consensus_queue.cc:1048] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:26.961547 27502 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:26.929920 27270 consensus_meta.cc:287] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.675s	user 0.012s	sys 0.001s
I20260709 12:19:26.984258 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:26.985963 24323 raft_consensus.cc:1275] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:19:26.984930 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 520251us
W20260709 12:19:26.965243 27466 consensus_meta.cc:287] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.722s	user 0.000s	sys 0.013s
I20260709 12:19:26.822292 27289 consensus_queue.cc:1048] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.124s
I20260709 12:19:26.902266 27499 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.985318 25083 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:27.027140 25118 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6.
I20260709 12:19:27.046828 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:26.886277 27489 consensus_queue.cc:1059] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:19:26.986554 24394 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:19:27.050817 24438 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:26.925489 26962 consensus_queue.cc:1048] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
W20260709 12:19:26.984496 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 51567.3us
I20260709 12:19:27.064003 25114 raft_consensus.cc:2393] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 8: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:27.047345 27424 raft_consensus.cc:2804] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:19:27.070995 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 141469us
I20260709 12:19:27.077383 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:27.079289 25115 raft_consensus.cc:1275] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:19:27.079708 25115 pending_rounds.cc:85] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281: Aborting all ops after (but not including) 5
I20260709 12:19:27.079289 24471 raft_consensus.cc:1275] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:27.073734 25083 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
W20260709 12:19:27.072420 27255 consensus_meta.cc:287] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.916s	user 0.009s	sys 0.006s
I20260709 12:19:27.080482 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:26.976377 27490 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:27.066746 27270 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.073366 27424 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:27.079984 25115 pending_rounds.cc:107] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:19:27.094331 25115 raft_consensus.cc:2889] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:27.095796 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 45058.9us
I20260709 12:19:27.097031 24438 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:27.097187 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:27.117156 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:27.117570 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 196444us
I20260709 12:19:27.118503 24471 raft_consensus.cc:1275] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 8 index: 2. (index mismatch)
I20260709 12:19:27.046922 27502 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:27.118374 24290 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:27.062346 27501 consensus_queue.cc:1059] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 12:19:27.135156 27500 log.cc:927] Time spent T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:19:27.135664 27498 consensus_queue.cc:1059] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.076s
W20260709 12:19:27.136860 27491 log.cc:927] Time spent T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
W20260709 12:19:27.137606 27494 log.cc:927] Time spent T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
W20260709 12:19:27.138365 27348 consensus_meta.cc:287] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.000s
W20260709 12:19:27.138816 27495 log.cc:927] Time spent T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
I20260709 12:19:27.177832 27490 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:27.140911 27515 raft_consensus.cc:2804] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:27.178407 27490 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.178897 27490 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:27.142067 27143 consensus_meta.cc:287] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.640s	user 0.011s	sys 0.000s
W20260709 12:19:27.180667 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 83733.9us
I20260709 12:19:27.181051 27143 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:27.182528 24438 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:27.184175 27143 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:27.118064 27508 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:19:27.154480 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 80867.7us
I20260709 12:19:27.203593 25083 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:27.099282 27424 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:27.168916 27492 log.cc:927] Time spent T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:19:27.121145 27270 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:27.170096 27471 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:27.171159 27518 consensus_queue.cc:1048] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:27.076704 27499 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:27.173166 25116 raft_consensus.cc:1240] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:19:27.173013 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 79007.8us
I20260709 12:19:27.175439 27502 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:27.176352 27070 consensus_meta.cc:287] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 1.003s	user 0.009s	sys 0.000s
I20260709 12:19:27.184490 26956 raft_consensus.cc:2749] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:27.185283 27515 raft_consensus.cc:697] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:27.093184 27470 consensus_queue.cc:1059] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.091s
I20260709 12:19:27.185354 25114 raft_consensus.cc:2393] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 8: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
W20260709 12:19:27.185582 27505 log.cc:927] Time spent T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:19:27.188973 27287 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.233722 27287 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:27.132316 26944 consensus_queue.cc:1048] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.280s
I20260709 12:19:27.237187 27523 raft_consensus.cc:2749] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:19:27.150381 24366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.195379 25119 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
W20260709 12:19:27.171164 27493 log.cc:927] Time spent T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:19:27.189337 27514 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:27.219393 24290 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:27.189854 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:27.201916 27508 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:27.230564 27515 consensus_queue.cc:237] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:27.191084 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.217157 27425 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:27.230661 27511 log.cc:927] Time spent T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:19:27.207775 26962 consensus_queue.cc:1048] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:19:27.220495 27351 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:27.276307 24290 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:27.238581 26944 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:27.262557 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.201963 27348 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:27.279294 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 147298us
I20260709 12:19:27.256196 27501 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:27.290155 24322 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:27.292798 24290 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:27.255904 27508 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:27.300650 27485 log.cc:927] Time spent T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.928s	user 0.005s	sys 0.000s
I20260709 12:19:27.300768 26944 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:27.304653 24321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1780) took 1431 ms. Trace:
I20260709 12:19:27.363128 24321 rpcz_store.cc:276] 0709 12:19:25.873690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:25.873891 (+   201us) service_pool.cc:224] Handling call
0709 12:19:25.922828 (+ 48937us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:25.923413 (+   585us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:19:25.923775 (+   362us) log.cc:844] Serialized 14 byte log entry
0709 12:19:26.545773 (+621998us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:26.546372 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 12:19:26.549942 (+  3570us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:26.549995 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.550088 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:27.304399 (+754311us) raft_consensus.cc:1685] finished
0709 12:19:27.304421 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:27.304575 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4025,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":7122,"raft.queue_time_us":661,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":210,"thread_start_us":621483,"threads_started":1,"wal-append.queue_time_us":961497}
I20260709 12:19:27.304786 24440 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:27.306246 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1804) took 1157 ms. Trace:
I20260709 12:19:27.307621 27272 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:27.308887 27287 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:27.253643 27336 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:27.309621 27348 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:27.310213 27490 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:27.310904 24290 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:27.374660 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 63874.3us
I20260709 12:19:27.243935 27467 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:27.287753 27522 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:27.293884 27469 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:19:27.312654 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 130202us
I20260709 12:19:27.313735 27270 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:27.258862 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:27.320132 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:27.412804 24391 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:27.321171 24470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1892) took 1283 ms. Trace:
I20260709 12:19:27.413790 24470 rpcz_store.cc:276] 0709 12:19:26.037327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.071490 (+ 34163us) service_pool.cc:224] Handling call
0709 12:19:26.071996 (+   506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:26.095556 (+ 23560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.095593 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:26.096378 (+   785us) log.cc:844] Serialized 26 byte log entry
0709 12:19:26.741210 (+644832us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:26.741285 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.741384 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:27.320988 (+579604us) raft_consensus.cc:1685] finished
0709 12:19:27.321008 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:27.321111 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22921,"raft.queue_time_us":24580,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":167,"thread_start_us":589272,"threads_started":1,"wal-append.queue_time_us":794626}
I20260709 12:19:27.322588 27255 raft_consensus.cc:3055] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:27.416878 27255 raft_consensus.cc:740] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:27.418244 27255 consensus_queue.cc:260] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:27.420081 27255 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:27.324051 25082 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:27.325975 27437 consensus_meta.cc:287] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 1.030s	user 0.014s	sys 0.000s
I20260709 12:19:27.326352 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:27.328051 27524 consensus_queue.cc:1048] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:27.329205 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:27.310243 27499 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:27.330912 24366 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:27.310962 27468 raft_consensus.cc:2804] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:27.334877 27282 consensus_queue.cc:1048] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:19:27.343570 27473 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:19:27.353991 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:27.356794 24473 raft_consensus.cc:1240] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:27.360930 24365 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:27.364501 24469 rpcz_store.cc:276] 0709 12:19:26.149241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.150635 (+  1394us) service_pool.cc:224] Handling call
0709 12:19:26.151087 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:26.153855 (+  2768us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.153904 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:26.154603 (+   699us) log.cc:844] Serialized 26 byte log entry
0709 12:19:26.600164 (+445561us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:26.600202 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.600281 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:27.306027 (+705746us) raft_consensus.cc:1685] finished
0709 12:19:27.306051 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:27.306188 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1818,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":185,"thread_start_us":438171,"threads_started":1,"wal-append.queue_time_us":756707}
W20260709 12:19:27.434203 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 73341.8us
I20260709 12:19:27.434727 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:27.379298 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:27.375962 24290 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:27.435142 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:27.435504 24471 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:27.398682 24467 raft_consensus.cc:1275] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:19:27.425223 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 139042us
I20260709 12:19:27.384794 27351 raft_consensus.cc:2804] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:27.394088 27469 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:27.413432 27425 raft_consensus.cc:2749] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:19:27.437099 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 113162us
I20260709 12:19:27.421006 27522 raft_consensus.cc:697] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:27.432318 24438 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:27.440291 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:27.436033 24470 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 3.
W20260709 12:19:27.442703 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 111861us
I20260709 12:19:27.443425 25082 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:27.432853 27490 raft_consensus.cc:2749] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:19:27.447588 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 71747.4us
I20260709 12:19:27.432199 27468 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:27.448114 25083 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:27.450050 27516 raft_consensus.cc:2749] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:27.451076 27517 raft_consensus.cc:2804] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:27.452705 27518 raft_consensus.cc:2749] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:27.453397 27529 raft_consensus.cc:2804] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:27.453308 25082 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:27.453296 25112 raft_consensus.cc:1275] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:19:27.457073 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1902) took 1429 ms. Trace:
I20260709 12:19:27.457050 27534 consensus_queue.cc:1048] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:27.458017 26962 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.457772 27522 consensus_queue.cc:237] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:27.460796 24290 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:27.461265 27515 consensus_queue.cc:1059] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:27.462570 24324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 443) took 1432 ms. Trace:
I20260709 12:19:27.439981 27469 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:27.435781 25111 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 2.
I20260709 12:19:27.438769 27351 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:27.439980 27270 raft_consensus.cc:2749] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:27.513525 27467 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:27.483673 25083 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:27.446682 27287 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:27.471634 27468 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:27.488598 27499 consensus_queue.cc:1048] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:27.486240 27498 raft_consensus.cc:2804] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:27.513458 27351 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:27.491235 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 91529.8us
I20260709 12:19:27.491789 24366 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:27.492673 27525 log.cc:927] Time spent T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:19:27.497834 27424 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:27.499945 27473 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:27.501796 27308 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.504108 24469 raft_consensus.cc:1240] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:19:27.508070 27528 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:27.506101 24324 rpcz_store.cc:276] 0709 12:19:26.030595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.030728 (+   133us) service_pool.cc:224] Handling call
0709 12:19:26.042189 (+ 11461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:26.117002 (+ 74813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.117037 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:26.117607 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 12:19:26.529485 (+411878us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:26.916318 (+386833us) log.cc:844] Serialized 14 byte log entry
0709 12:19:26.916547 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:27.461266 (+544719us) spinlock_profiling.cc:243] Waited 8.42 ms on lock 0x7b18003ca720. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9422d2a6 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419
0709 12:19:27.462149 (+   883us) spinlock_profiling.cc:243] Waited 74.4 ms on lock 0x7b5400338e54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:27.462199 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:27.462240 (+    41us) raft_consensus.cc:1685] finished
0709 12:19:27.462252 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:27.462487 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12552,"prepare.queue_time_us":551471,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":3213,"raft.queue_time_us":1473,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":13562,"spinlock_wait_cycles":190430848,"thread_start_us":775375,"threads_started":2,"wal-append.queue_time_us":632528}
I20260709 12:19:27.515599 27517 raft_consensus.cc:697] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:27.518173 27287 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:19:27.518451 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 81190us
I20260709 12:19:27.521706 24391 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
W20260709 12:19:27.513983 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 65432.9us
I20260709 12:19:27.554945 24290 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:27.543844 27518 raft_consensus.cc:2749] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:27.507071 26962 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:19:27.522254 27498 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:27.558818 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 105645us
I20260709 12:19:27.545851 24469 raft_consensus.cc:1240] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:27.546166 27308 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:27.487109 24392 rpcz_store.cc:276] 0709 12:19:26.028087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.033150 (+  5063us) service_pool.cc:224] Handling call
0709 12:19:26.043637 (+ 10487us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:26.066744 (+ 23107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.066786 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:26.067563 (+   777us) log.cc:844] Serialized 26 byte log entry
0709 12:19:26.623349 (+555786us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:26.623414 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.624893 (+  1479us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:27.455975 (+831082us) spinlock_profiling.cc:243] Waited 7.66 ms on lock 0x7b24000fda78. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a940e59c4 00007f4a940e3acb 00007f4a9429edc9 00007f4a9429ea55 00007f4a9429dfb0 00007f4a96f14488 00007f4a96f14be8 00007f4a96eec398 00007f4a96ee776a 00007f4a96ee6bb6
0709 12:19:27.456667 (+   692us) raft_consensus.cc:1685] finished
0709 12:19:27.456696 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:27.456999 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3909,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":147,"spinlock_wait_cycles":17607552,"thread_start_us":555249,"threads_started":1,"wal-append.queue_time_us":813843}
I20260709 12:19:27.517911 27529 raft_consensus.cc:697] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:27.535828 27524 raft_consensus.cc:2749] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:27.565763 27531 raft_consensus.cc:2804] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:27.566406 27531 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:27.565816 27490 consensus_queue.cc:1059] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:27.566854 27531 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:27.548002 27272 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:27.572921 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 91562.4us
I20260709 12:19:27.573738 24366 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:27.591316 27483 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:27.593506 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.594184 27467 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.594782 27467 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:27.597122 27467 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:27.562772 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:27.556716 27287 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:27.558859 27336 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:27.607972 24440 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:27.609642 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 162368us
I20260709 12:19:27.610792 24289 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:27.611934 24391 raft_consensus.cc:1240] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:27.612519 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:27.559139 27498 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:27.614755 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:27.597747 27528 raft_consensus.cc:2804] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:27.617121 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:27.618085 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 63226us
I20260709 12:19:27.692054 26962 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:27.692369 27519 consensus_queue.cc:1048] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.079s
W20260709 12:19:27.693162 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 138670us
I20260709 12:19:27.694046 24440 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:27.612787 27472 raft_consensus.cc:2749] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:27.610055 26944 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:27.698418 27529 consensus_queue.cc:237] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:27.610039 27518 raft_consensus.cc:2749] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:27.701556 24290 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:27.715044 25116 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
W20260709 12:19:27.701220 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 127546us
I20260709 12:19:27.701040 27348 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.726141 27517 consensus_queue.cc:237] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:27.726594 27348 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:27.728418 27472 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:27.728998 27472 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:27.729377 27472 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:27.738454 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 44556.1us
I20260709 12:19:27.739324 24440 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:27.748596 25082 leader_election.cc:336] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.886s (SENT)
I20260709 12:19:27.749238 25082 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:27.750164 27483 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:19:27.757829 25082 leader_election.cc:336] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.977s (SENT)
I20260709 12:19:27.758426 25082 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:27.759107 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 148337us
I20260709 12:19:27.618028 27528 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:27.760818 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:27.716305 27255 raft_consensus.cc:2804] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:19:27.765282 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.775194 24440 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:27.777443 24440 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:27.779762 27470 raft_consensus.cc:2749] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:19:27.802341 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 183456us
I20260709 12:19:27.802964 24320 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:27.803220 24290 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:27.813875 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:27.764961 27528 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:27.816722 24366 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:27.821904 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:27.822299 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:27.823210 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:27.782658 27256 raft_consensus.cc:3055] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:27.829491 24321 raft_consensus.cc:2393] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 8: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:27.826742 24469 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:27.795632 27483 raft_consensus.cc:2749] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:27.794763 27437 raft_consensus.cc:2749] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:27.826701 24465 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:27.808018 27348 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:27.832409 27549 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.793972 27534 consensus_queue.cc:1059] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:19:27.834604 25116 raft_consensus.cc:1275] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:19:27.841794 25116 pending_rounds.cc:85] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281: Aborting all ops after (but not including) 6
I20260709 12:19:27.763072 27336 consensus_queue.cc:1048] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:19:27.842069 25116 pending_rounds.cc:107] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:19:27.801345 27425 raft_consensus.cc:2749] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:27.856755 27549 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:27.844551 25116 raft_consensus.cc:2889] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:27.832515 27470 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:27.850510 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 92726.5us
W20260709 12:19:27.873461 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 70292.8us
I20260709 12:19:27.837348 27424 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:27.829680 27256 raft_consensus.cc:740] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:19:27.898295 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.917431 24290 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:27.937493 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.941103 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:27.937477 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 62680.4us
I20260709 12:19:27.942099 24290 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:27.921442 27255 raft_consensus.cc:697] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 6 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:27.946072 24290 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:27.950315 24321 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
I20260709 12:19:27.952363 27550 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:27.953202 27550 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:27.953680 27550 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:27.947391 25084 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:27.859552 27351 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:27.940802 26956 raft_consensus.cc:2749] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:19:27.971143 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 154533us
I20260709 12:19:27.931071 27545 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:27.976372 24366 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:27.949267 27516 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.992905 24366 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:27.993973 27551 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:27.994554 27551 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:27.994474 24366 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:27.995296 27551 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:27.973023 27348 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:19:27.997853 27546 log.cc:927] Time spent T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:19:27.997305 27348 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:27.976543 27255 consensus_queue.cc:237] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:28.000437 27256 consensus_queue.cc:260] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:28.002018 27256 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:28.009033 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:28.014446 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 68452.2us
I20260709 12:19:28.015385 24290 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:27.975346 27308 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:27.988458 27299 raft_consensus.cc:3055] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:19:28.008721 27508 consensus_meta.cc:287] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.614s	user 0.000s	sys 0.012s
I20260709 12:19:28.069388 24469 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:28.013630 27545 raft_consensus.cc:3055] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:27.987888 27469 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:28.037536 27299 raft_consensus.cc:740] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:28.037786 27308 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:28.078497 27440 raft_consensus.cc:2764] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
W20260709 12:19:28.125702 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 178369us
W20260709 12:19:28.095312 27537 log.cc:927] Time spent T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:19:28.084317 27545 raft_consensus.cc:740] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:19:28.144451 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 149983us
W20260709 12:19:28.150847 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:28.150643 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 347325us
I20260709 12:19:28.151808 24440 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:28.154269 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:28.022635 27516 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:28.163518 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:28.170037 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:28.170855 25116 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 4.
I20260709 12:19:28.173789 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:28.125465 27427 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:28.176275 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:28.088739 27287 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:28.124871 27549 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:28.180953 24400 raft_consensus.cc:1240] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:19:28.182391 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:28.081598 27508 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:28.184350 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:28.189553 24396 raft_consensus.cc:2393] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 6: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:28.187674 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:28.194957 24366 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:28.192688 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 114647us
I20260709 12:19:28.177685 27336 raft_consensus.cc:2804] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:28.133752 27308 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:28.198088 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:28.184054 27544 log.cc:927] Time spent T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.344s	user 0.000s	sys 0.001s
I20260709 12:19:28.201112 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:28.219784 25114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 445) took 1151 ms. Trace:
I20260709 12:19:28.188411 27415 raft_consensus.cc:2749] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:28.222164 25114 rpcz_store.cc:276] 0709 12:19:27.068184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.068680 (+   496us) service_pool.cc:224] Handling call
0709 12:19:28.217906 (+1149226us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b540075e754. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:28.219711 (+  1805us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230252288}
I20260709 12:19:28.219796 24397 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
W20260709 12:19:28.219749 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 204453us
I20260709 12:19:28.187579 27490 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.196911 27282 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:28.227727 24469 raft_consensus.cc:1275] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:19:28.233435 24290 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:28.232460 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:28.204535 27336 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:28.244880 27336 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:28.245610 27557 log.cc:927] Time spent T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:19:28.247365 24316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 442) took 2308 ms. Trace:
I20260709 12:19:28.247766 24316 rpcz_store.cc:276] 0709 12:19:25.939265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:25.939475 (+   210us) service_pool.cc:224] Handling call
0709 12:19:25.939994 (+   519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.588323 (+648329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:28.247101 (+1658778us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b540001cf54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:28.247296 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1466506624}
W20260709 12:19:28.240893 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 52379.6us
I20260709 12:19:28.242563 27469 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:28.243624 27516 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:28.244201 27449 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:28.266682 24317 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2196) took 2018 ms (client timeout 1662 ms). Trace:
W20260709 12:19:28.267355 24317 rpcz_store.cc:269] 0709 12:19:26.248482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.248679 (+   197us) service_pool.cc:224] Handling call
0709 12:19:28.255589 (+2006910us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b540001ca54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:28.266554 (+ 10965us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":907271424}
I20260709 12:19:28.235365 27489 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.269310 24393 raft_consensus.cc:1275] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:19:28.270252 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 118553us
I20260709 12:19:28.227201 27562 raft_consensus.cc:2804] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:28.283510 27564 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.283960 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:28.240434 27415 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.288028 24438 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:28.292234 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 59114.7us
I20260709 12:19:28.308187 24290 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:28.307904 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:28.255560 27351 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:28.317569 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:28.318444 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:28.319711 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:28.325112 24393 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6.
I20260709 12:19:28.322081 25117 raft_consensus.cc:2393] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 8: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
W20260709 12:19:28.328747 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:28.286989 27472 consensus_meta.cc:287] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.548s	user 0.015s	sys 0.008s
I20260709 12:19:28.269570 27427 raft_consensus.cc:3055] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:28.337888 25116 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:28.341636 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:28.229642 27490 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:28.278422 27469 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
W20260709 12:19:28.202090 27547 consensus_queue.cc:1175] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c855242ec9d34a5397741ef20db9de8a" responder_term: 6 status { last_received { term: 5 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:19:28.299425 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:28.343055 27472 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:28.322036 27549 raft_consensus.cc:2749] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:28.348912 27561 consensus_queue.cc:1048] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:19:28.316955 27282 raft_consensus.cc:697] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:28.205185 27545 consensus_queue.cc:260] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:28.376907 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 88982.9us
I20260709 12:19:28.382678 24438 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:28.336730 27562 raft_consensus.cc:697] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:28.341274 27427 raft_consensus.cc:740] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:28.349511 27554 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:28.360970 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:28.411311 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 119356us
I20260709 12:19:28.416983 24365 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:28.297375 27489 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:28.381628 25111 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6.
I20260709 12:19:28.427963 24365 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:28.432132 27574 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:28.389755 27469 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:28.414570 27351 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:19:28.447330 27531 consensus_meta.cc:287] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.880s	user 0.009s	sys 0.006s
I20260709 12:19:28.424551 27513 raft_consensus.cc:2749] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:28.426543 27566 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:19:28.445770 27560 log.cc:927] Time spent T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
W20260709 12:19:28.484241 27539 log.cc:927] Time spent T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 12:19:28.395419 27569 consensus_queue.cc:1175] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d99d5d772cfe4a96afcab3d3b009a281" responder_term: 5 status { last_received { term: 5 index: 5 } last_committed_idx: 5 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)" } } last_received_current_leader { term: 5 index: 5 } }
I20260709 12:19:28.344417 27564 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:28.346885 27415 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
W20260709 12:19:28.465373 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 168243us
W20260709 12:19:28.502351 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 119800us
W20260709 12:19:28.536067 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:28.484309 27498 consensus_meta.cc:287] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.864s	user 0.008s	sys 0.011s
I20260709 12:19:28.467996 27508 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:28.482012 27574 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:28.477066 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 49288.7us
I20260709 12:19:28.491397 27554 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:28.483444 27581 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:28.609748 27581 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:28.483623 27287 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:28.551429 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 276253us
I20260709 12:19:28.553596 24438 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:28.614454 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 61033.6us
I20260709 12:19:28.482877 27575 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:28.616966 27575 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:28.617594 27575 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:28.620814 27562 consensus_queue.cc:237] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:28.616076 24438 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:28.628963 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 69186.4us
I20260709 12:19:28.630225 24438 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:28.636183 25114 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6.
I20260709 12:19:28.637959 27564 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:28.552601 27556 log.cc:927] Time spent T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.320s	user 0.001s	sys 0.000s
I20260709 12:19:28.642269 27472 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:28.643220 27472 consensus_queue.cc:1059] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:28.644249 27472 raft_consensus.cc:2749] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:28.645359 27490 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:28.538190 27531 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:28.654013 27470 consensus_meta.cc:287] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.740s	user 0.008s	sys 0.008s
I20260709 12:19:28.654668 27470 raft_consensus.cc:2749] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:28.475945 27427 consensus_queue.cc:260] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:28.656683 27427 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:28.561902 27513 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.661427 27513 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:28.664394 27571 log.cc:927] Time spent T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.379s	user 0.000s	sys 0.001s
I20260709 12:19:28.543339 27308 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:28.667390 27308 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:28.565325 27498 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:28.673883 27498 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:28.551306 27565 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:28.565881 27574 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:28.677536 27588 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:28.678121 27588 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:28.678516 27588 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:28.680531 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.652439 27531 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:28.682483 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 1901) took 2220 ms. Trace:
I20260709 12:19:28.683132 24466 rpcz_store.cc:276] 0709 12:19:26.466512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.482430 (+ 15918us) service_pool.cc:224] Handling call
0709 12:19:28.682129 (+2199699us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b540030dc54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:28.682334 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1798449408}
W20260709 12:19:28.685364 27585 log.cc:927] Time spent T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 12:19:28.544618 27282 consensus_queue.cc:237] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:28.693502 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 1817) took 2464 ms. Trace:
I20260709 12:19:28.545135 27566 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:28.578310 27489 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:28.585186 27469 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:28.587502 27415 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:28.589094 27563 log.cc:927] Time spent T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:19:28.594297 27589 raft_consensus.cc:2749] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:19:28.555699 27559 log.cc:927] Time spent T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.364s	user 0.000s	sys 0.001s
I20260709 12:19:28.484395 27558 consensus_queue.cc:1059] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.263s
I20260709 12:19:28.554988 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:28.688948 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:28.628328 27468 consensus_meta.cc:287] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.094s	user 0.011s	sys 0.000s
I20260709 12:19:28.694088 24474 rpcz_store.cc:276] 0709 12:19:26.229417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.439086 (+209669us) service_pool.cc:224] Handling call
0709 12:19:28.693198 (+2254112us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b54001504d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:28.693420 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":971294080}
I20260709 12:19:28.703563 27566 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:28.708145 24468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.039s	sys 0.036s
I20260709 12:19:28.543367 27351 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:28.714406 24466 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:28.690493 27554 raft_consensus.cc:697] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:28.710074 27581 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:28.735745 27554 consensus_queue.cc:237] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:28.734676 24468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.040s	sys 0.036s
I20260709 12:19:28.711763 27287 consensus_queue.cc:1048] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:19:28.709263 27424 consensus_queue.cc:1048] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
W20260709 12:19:28.784340 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 152814us
W20260709 12:19:28.790581 24470 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.002s	sys 0.005s
W20260709 12:19:28.793489 24470 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.003s	sys 0.006s
I20260709 12:19:28.719180 27468 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:28.759977 27592 raft_consensus.cc:3055] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:28.776823 27489 raft_consensus.cc:3055] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:28.817425 27164 raft_consensus.cc:3055] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:28.774403 27513 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:28.822026 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 189851us
W20260709 12:19:28.825191 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 193893us
I20260709 12:19:28.828312 24466 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:28.835047 24438 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:28.823844 24440 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:28.820726 27164 raft_consensus.cc:740] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:28.732909 27575 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:28.756338 27299 consensus_queue.cc:260] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:28.846624 27483 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:28.819420 27592 raft_consensus.cc:740] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:28.818989 27489 raft_consensus.cc:740] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
W20260709 12:19:28.839872 27591 log.cc:927] Time spent T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
W20260709 12:19:28.843040 27336 consensus_meta.cc:287] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.598s	user 0.011s	sys 0.003s
W20260709 12:19:28.844122 27256 consensus_meta.cc:287] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.841s	user 0.013s	sys 0.003s
W20260709 12:19:28.853878 27550 consensus_meta.cc:287] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.900s	user 0.016s	sys 0.008s
I20260709 12:19:28.887292 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:28.888051 24466 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:28.889073 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:28.840147 27513 consensus_queue.cc:1048] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:19:28.860689 27566 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:28.864455 27581 raft_consensus.cc:2804] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:28.902043 24470 raft_consensus.cc:1240] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:19:28.899523 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:28.905365 24473 raft_consensus.cc:2393] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:28.859350 27483 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:28.856596 27588 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:28.912251 27164 consensus_queue.cc:260] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:28.917846 27308 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:28.918056 27483 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:28.919808 27602 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:28.920696 27489 consensus_queue.cc:260] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:28.928182 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:28.887913 27550 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:28.931195 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.932832 27348 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:28.933585 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1923) took 1137 ms. Trace:
I20260709 12:19:28.936244 27299 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:28.898950 27581 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:28.877619 27336 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:28.920475 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:28.952883 27468 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:28.957235 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:28.953475 27256 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:28.955047 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:28.959812 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 112266us
I20260709 12:19:28.973744 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:28.974877 24324 raft_consensus.cc:1275] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:19:28.982226 24366 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:28.972291 24468 rpcz_store.cc:276] 0709 12:19:27.795800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.860513 (+ 64713us) service_pool.cc:224] Handling call
0709 12:19:27.919186 (+ 58673us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:27.925820 (+  6634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:27.925874 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:27.941509 (+ 15635us) log.cc:844] Serialized 26 byte log entry
0709 12:19:28.775084 (+833575us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:19:28.775149 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:28.775254 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:28.933317 (+158063us) raft_consensus.cc:1685] finished
0709 12:19:28.933350 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:28.933511 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3251,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":17564,"thread_start_us":781920,"threads_started":1,"wal-append.queue_time_us":851343}
I20260709 12:19:28.978045 24466 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:28.912071 27528 consensus_meta.cc:287] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.077s	user 0.009s	sys 0.009s
I20260709 12:19:28.981048 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:28.991200 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:28.993017 24290 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:28.995776 24290 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:28.996488 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:28.997422 24324 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:28.998890 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:28.977535 27581 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:28.973364 27351 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:28.980540 27489 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:29.004170 24474 raft_consensus.cc:1240] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:29.003211 24325 raft_consensus.cc:2393] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 8: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:29.005553 24468 raft_consensus.cc:1240] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: [4.2-7.3]
I20260709 12:19:29.002862 27468 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:28.994575 27519 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:29.012576 24366 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:28.998556 27469 raft_consensus.cc:2804] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:29.000401 27513 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:29.013810 27599 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.997888 27528 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:19:29.025568 27528 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:29.026736 24323 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:29.001868 27575 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:29.032876 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.035863 24440 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:28.975941 27592 consensus_queue.cc:260] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:29.031630 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:29.037992 24325 raft_consensus.cc:2410] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:19:28.994819 27256 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:29.036293 27551 consensus_meta.cc:287] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.040s	user 0.017s	sys 0.000s
I20260709 12:19:29.043939 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:29.044203 24470 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:29.045347 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:29.046458 24316 raft_consensus.cc:2393] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 9: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:28.971462 27602 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:29.016399 27469 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:29.049417 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:29.047681 24440 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:29.043463 27515 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.051445 24366 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:29.053732 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:29.054018 27587 raft_consensus.cc:2804] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:29.054556 27515 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:29.045519 27522 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:29.055395 25116 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:19:29.055867 27308 consensus_queue.cc:1048] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:29.056015 27615 raft_consensus.cc:2764] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:19:29.023293 27599 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:29.059044 24466 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:19:29.057708 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:29.060367 24440 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:29.049517 27437 raft_consensus.cc:2749] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:29.085191 24474 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:29.071981 27277 raft_consensus.cc:3055] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:29.069833 27522 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:29.073889 27602 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:29.075947 27336 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:29.052908 27469 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:29.064078 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:29.069830 25111 raft_consensus.cc:2368] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 6. Current term is 7.
I20260709 12:19:29.075766 27574 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:29.071385 27588 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:29.070564 27597 log.cc:927] Time spent T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:19:29.076432 27520 log.cc:927] Time spent T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 1.782s	user 0.000s	sys 0.013s
I20260709 12:19:29.104118 27550 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:29.104700 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:29.085584 27611 log.cc:927] Time spent T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:19:29.057441 27516 raft_consensus.cc:2749] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:29.049995 27592 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:29.094408 24440 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:29.042884 27513 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:29.044899 27528 consensus_queue.cc:1059] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:19:29.096953 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:29.065769 24366 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:29.051177 27551 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:29.077064 27587 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:29.016875 27519 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:29.102671 27256 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:29.093350 27282 raft_consensus.cc:2749] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:29.095124 27277 raft_consensus.cc:740] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:29.110033 24290 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
W20260709 12:19:29.162145 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 52226.6us
I20260709 12:19:29.162943 24290 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:29.110476 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:29.097280 27308 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:29.114598 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 673) took 1757 ms. Trace:
I20260709 12:19:29.115383 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:29.115674 27522 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:29.116246 27598 log.cc:927] Time spent T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:19:29.109833 27440 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:19:29.117465 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.118119 27566 raft_consensus.cc:2749] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:29.123414 24291 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:29.134910 27164 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:29.191412 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.172087 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:29.192724 24395 raft_consensus.cc:2393] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 6: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
W20260709 12:19:29.143478 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.148319 24440 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:29.154747 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 89103.7us
I20260709 12:19:29.195035 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:19:29.195421 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 47204.7us
I20260709 12:19:29.196568 24366 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:29.155829 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:29.196432 24440 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:29.197680 24394 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6.
I20260709 12:19:29.155886 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:29.157569 27336 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:29.203066 24440 leader_election.cc:400] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 6. Current term is 7.
I20260709 12:19:29.203423 24440 leader_election.cc:403] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:19:29.165477 24325 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:29.164175 24471 rpcz_store.cc:276] 0709 12:19:27.357181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.436306 (+ 79125us) service_pool.cc:224] Handling call
0709 12:19:27.437448 (+  1142us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:27.492384 (+ 54936us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:27.492414 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:27.492459 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:27.492488 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:29.114302 (+1621814us) spinlock_profiling.cc:243] Waited 54.7 ms on lock 0x7b5400243954. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:29.114370 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:29.114523 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125898112}
I20260709 12:19:29.168381 24365 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:29.169785 24317 raft_consensus.cc:2393] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 7: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:19:29.170529 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.142855 24474 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:29.193708 24400 raft_consensus.cc:1240] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:19:29.195343 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:29.206527 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:29.154784 27587 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:29.201313 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 77988.7us
I20260709 12:19:29.211130 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:29.207415 24321 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
W20260709 12:19:29.171342 27529 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.192s	user 0.004s	sys 0.008s
I20260709 12:19:29.205941 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:29.195735 25119 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:29.207656 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:29.167316 27308 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:29.172154 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:29.211812 24325 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:29.167702 27561 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:29.212656 24291 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:29.213207 24473 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:29.160985 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:29.206370 27254 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.273561 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:29.275333 27603 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.214147 26944 consensus_queue.cc:1048] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:19:29.275334 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:29.213647 25082 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.619s (SENT) [suppressed 47 similar messages]
I20260709 12:19:29.275970 27501 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:19:29.277082 27619 log.cc:927] Time spent T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 12:19:29.277776 27599 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:29.273583 27612 consensus_queue.cc:1048] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:19:29.278991 27277 consensus_queue.cc:260] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:29.281898 27519 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:29.282737 24318 raft_consensus.cc:1275] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 2. (term mismatch)
I20260709 12:19:29.332647 24318 pending_rounds.cc:85] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756: Aborting all ops after (but not including) 1
I20260709 12:19:29.332126 24474 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 6: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:29.286926 27600 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.333338 24318 pending_rounds.cc:107] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 12:19:29.287223 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:29.288090 24322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 1784) took 2455 ms. Trace:
I20260709 12:19:29.283555 24394 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:29.295256 27581 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:29.243971 27336 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:29.214973 27472 raft_consensus.cc:2804] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:29.210954 27424 raft_consensus.cc:2749] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:29.297678 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:29.299037 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:29.340399 24321 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:29.340718 25119 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:29.300007 25084 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:29.303303 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1928) took 1011 ms. Trace:
I20260709 12:19:29.342748 24469 rpcz_store.cc:276] 0709 12:19:28.291981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.364295 (+ 72314us) service_pool.cc:224] Handling call
0709 12:19:28.364697 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:28.698270 (+333573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:28.698298 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:28.698340 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:28.698369 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:29.303015 (+604646us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b54000334d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:29.303062 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:29.303229 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":766639488}
W20260709 12:19:29.345500 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 177192us
I20260709 12:19:29.307806 27515 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:29.308768 27308 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:29.208683 27425 raft_consensus.cc:2749] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:29.170792 27256 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:29.172819 27415 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:29.216027 24290 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
W20260709 12:19:29.354900 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 138974us
I20260709 12:19:29.310184 24391 raft_consensus.cc:1240] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 12:19:29.321591 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 109059us
I20260709 12:19:29.315616 24471 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:29.320554 27254 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:29.322932 26956 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:29.207466 27528 raft_consensus.cc:2804] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:29.312506 27516 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:29.311151 27561 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:29.333685 24318 raft_consensus.cc:2889] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:29.369288 24318 pending_rounds.cc:107] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756: Aborting uncommitted NO_OP operation due to leader change: 7.3
I20260709 12:19:29.292585 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:29.288409 27469 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:29.337538 27472 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:29.334043 24322 rpcz_store.cc:276] 0709 12:19:26.832461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.833596 (+  1135us) service_pool.cc:224] Handling call
0709 12:19:29.287858 (+2454262us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b54000a7b54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:29.287987 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":987027840}
I20260709 12:19:29.346375 27164 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:19:29.338131 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 129139us
I20260709 12:19:29.299677 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:29.348186 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:29.362133 27573 raft_consensus.cc:2804] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:29.356559 24291 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:29.369735 24318 raft_consensus.cc:2889] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:29.372124 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:29.374826 24394 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:29.372617 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:29.329738 27603 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:29.328398 27529 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.358s	user 0.009s	sys 0.016s
I20260709 12:19:29.409266 24316 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:29.371043 27528 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:29.353875 27277 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:29.347283 27299 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.331291 27501 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:29.358304 25112 raft_consensus.cc:1275] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:19:29.456355 25112 pending_rounds.cc:85] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281: Aborting all ops after (but not including) 6
I20260709 12:19:29.456743 25112 pending_rounds.cc:107] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:19:29.457003 25112 raft_consensus.cc:2889] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:29.379387 24319 raft_consensus.cc:1275] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:19:29.458851 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:29.460227 24319 raft_consensus.cc:1240] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:29.379585 24317 raft_consensus.cc:1240] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:29.381649 24470 raft_consensus.cc:1240] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:29.461732 27581 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:29.462114 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:29.462776 24470 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:29.371781 27518 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:29.242635 27615 consensus_queue.cc:1048] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 12:19:29.361688 27282 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.411228 27435 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.351807 24325 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:19:29.390177 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:29.364882 27555 raft_consensus.cc:2804] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:29.360562 27574 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:29.369166 27256 raft_consensus.cc:697] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 6 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:29.392513 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:29.393592 27254 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:29.395032 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.491009 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:29.373867 27561 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:29.337260 27600 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:29.397449 24392 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:29.397655 24322 raft_consensus.cc:1275] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:19:29.397848 24474 raft_consensus.cc:1240] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:29.398854 24321 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
W20260709 12:19:29.406695 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.369621 27415 raft_consensus.cc:697] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:29.410480 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:29.504859 24394 raft_consensus.cc:2368] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 6. Current term is 7.
W20260709 12:19:29.505105 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.505659 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:29.411751 24291 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:19:29.506548 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 94919.9us
I20260709 12:19:29.478911 26962 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:19:29.415753 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 202141us
I20260709 12:19:29.415858 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:29.388690 27472 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:29.424834 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:29.521878 25116 raft_consensus.cc:2410] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:19:29.425676 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:29.409380 26956 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:29.432883 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:29.434913 27603 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:29.438562 27587 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:29.416421 27528 raft_consensus.cc:3060] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:29.396477 27164 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:29.421303 27550 consensus_queue.cc:1048] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:19:29.547921 27427 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.548588 27427 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:29.540568 25084 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:29.550040 24474 raft_consensus.cc:1275] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:19:29.507053 27602 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:29.445520 25110 raft_consensus.cc:1275] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:29.447147 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:29.451960 27299 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:29.454468 27501 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:29.455308 27336 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:29.474771 24290 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:29.396663 27573 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:29.390080 24396 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:29.485137 24319 raft_consensus.cc:1240] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:19:29.432878 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:29.496592 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:29.413174 24438 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:29.588514 25119 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
W20260709 12:19:29.589002 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 175889us
I20260709 12:19:29.514889 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:29.515148 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:29.589890 24438 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:29.513015 24440 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:29.519580 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:29.590345 24471 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:29.517831 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.526566 24394 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:19:29.536303 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:29.592965 25117 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:29.500906 27518 raft_consensus.cc:697] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:29.537294 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:29.538470 24470 raft_consensus.cc:1275] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:19:29.536586 27524 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:19:29.443176 27610 log.cc:927] Time spent T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.447s	user 0.003s	sys 0.000s
I20260709 12:19:29.444805 27545 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:29.488513 27435 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:29.515611 27555 raft_consensus.cc:697] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:29.493930 27282 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:29.526125 26956 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:29.531761 27467 raft_consensus.cc:2804] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:29.646627 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:29.590759 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 77839.2us
I20260709 12:19:29.519716 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:29.589931 24393 raft_consensus.cc:1240] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:19:29.548713 26962 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:29.597275 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:29.648351 24440 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:29.591037 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:29.600041 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 125369us
I20260709 12:19:29.650274 24440 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:29.601312 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:29.651710 25119 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:29.622541 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:29.652266 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:29.623416 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:29.623489 24438 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:29.617103 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:29.651065 24290 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:29.653836 24474 raft_consensus.cc:2410] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 9 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:19:29.589826 27573 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:29.634995 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 140605us
I20260709 12:19:29.547921 27164 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:29.589552 27489 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.608215 25113 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:29.595314 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:29.670238 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:29.652868 24470 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:19:29.608132 27603 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:29.677433 24395 raft_consensus.cc:2393] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:29.671072 24400 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:29.562636 27499 consensus_queue.cc:1048] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:19:29.656838 24324 raft_consensus.cc:1275] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:19:29.657387 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:29.658630 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.608533 27575 raft_consensus.cc:2804] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:29.608140 27595 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:29.639696 27425 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:29.664541 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:29.664834 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:29.675470 25119 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:29.675628 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:29.680351 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:29.613087 27581 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:29.652869 26956 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:29.596355 27602 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:29.692541 24392 raft_consensus.cc:1240] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:29.677740 27603 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:29.656196 27551 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:29.659458 27588 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:29.676829 27287 consensus_queue.cc:1059] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:19:29.704968 26962 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:29.699703 27289 consensus_queue.cc:1059] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
W20260709 12:19:29.707013 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 166495us
I20260709 12:19:29.851617 27336 raft_consensus.cc:3055] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:29.852033 27336 raft_consensus.cc:740] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:29.852921 27336 consensus_queue.cc:260] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:29.853641 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2352) took 1693 ms. Trace:
I20260709 12:19:29.853987 27427 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:29.854753 27636 consensus_queue.cc:1048] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:29.707434 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:29.707535 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 125184us
I20260709 12:19:29.714804 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:29.856914 24396 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:29.857388 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:29.707350 27424 consensus_queue.cc:1048] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.109s
I20260709 12:19:29.860651 27424 consensus_queue.cc:1243] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer 99b8650fa8324ac2ac5f75eee9b1a1e3 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:19:29.854009 24391 rpcz_store.cc:276] 0709 12:19:28.160310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.160499 (+   189us) service_pool.cc:224] Handling call
0709 12:19:28.160985 (+   486us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:29.356230 (+1195245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:29.853376 (+497146us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54001a6654. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:29.853579 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2642259712}
I20260709 12:19:29.703778 27425 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:29.870993 27425 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:29.665131 27565 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:29.670622 27473 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:29.670224 27351 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
W20260709 12:19:29.779500 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.718890 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:29.767913 27299 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:29.747188 25113 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:29.763598 27518 consensus_queue.cc:237] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:29.754439 25116 raft_consensus.cc:1275] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEARNER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:19:29.747331 27566 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:29.706379 27519 consensus_queue.cc:1048] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:19:29.757501 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:29.762296 27600 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:29.745365 27625 log.cc:927] Time spent T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:19:29.766062 27282 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:29.751451 24318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1787) took 2909 ms. Trace:
I20260709 12:19:29.937573 24318 rpcz_store.cc:276] 0709 12:19:26.842245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.856874 (+2014629us) service_pool.cc:224] Handling call
0709 12:19:28.861520 (+  4646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:29.409833 (+548313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:29.751094 (+341261us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b54000d48d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:29.751362 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":967830272}
I20260709 12:19:29.679122 27164 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.682163 27469 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:29.665480 27501 raft_consensus.cc:2804] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:29.769047 27555 consensus_queue.cc:237] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:29.706472 27633 log.cc:927] Time spent T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.060s	user 0.001s	sys 0.001s
I20260709 12:19:29.676955 27522 raft_consensus.cc:2804] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:29.635282 27524 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:29.670231 27254 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.740767 27435 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:29.740465 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:29.702284 27592 consensus_meta.cc:287] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.593s	user 0.012s	sys 0.000s
I20260709 12:19:29.806226 24470 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:19:29.896528 27351 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:29.707093 27467 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:29.964455 24466 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:29.695415 27575 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:29.634012 27256 consensus_queue.cc:237] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:29.710733 27581 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:29.834022 27602 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:29.834132 27579 raft_consensus.cc:3055] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:29.981783 27579 raft_consensus.cc:740] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:29.982846 27579 consensus_queue.cc:260] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:29.983858 27579 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:29.839560 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:29.842036 27587 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:29.984901 24469 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:19:29.986402 27513 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:29.987293 24473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 1833) took 1067 ms. Trace:
I20260709 12:19:29.987692 24473 rpcz_store.cc:276] 0709 12:19:28.949858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.954706 (+  4848us) service_pool.cc:224] Handling call
0709 12:19:29.987090 (+1032384us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b54000fd2d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:29.987200 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":531984640}
I20260709 12:19:29.659891 27415 consensus_queue.cc:237] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:29.988866 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:29.989441 24473 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:29.990294 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:29.990489 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:29.991355 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:29.991897 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:29.702057 27489 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:29.874554 24391 raft_consensus.cc:1275] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:19:29.880163 24471 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
W20260709 12:19:29.845983 27626 log.cc:927] Time spent T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:19:29.995370 24471 raft_consensus.cc:1240] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:29.889654 24316 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
W20260709 12:19:29.885747 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 264749us
I20260709 12:19:29.998767 27469 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.999289 27469 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:29.884574 24396 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
W20260709 12:19:29.900811 25114 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 448) took 1627 ms (client timeout 1607 ms). Trace:
I20260709 12:19:29.816262 27603 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:30.000491 25114 rpcz_store.cc:269] 0709 12:19:28.273188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.274345 (+  1157us) service_pool.cc:224] Handling call
0709 12:19:29.900510 (+1626165us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b54007085d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:29.900728 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":716180864}
W20260709 12:19:30.002125 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.002221 27469 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:29.854077 27336 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:30.004863 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:30.005440 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:29.900997 24400 raft_consensus.cc:1217] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Deduplicated request from leader. Original: 1.1->[4.2-7.3]   Dedup: 4.2->[7.3-7.3]
I20260709 12:19:30.006278 24397 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:30.006654 24400 raft_consensus.cc:1240] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: [4.2-7.3]
W20260709 12:19:29.913949 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 255685us
I20260709 12:19:29.904536 25119 raft_consensus.cc:1275] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:19:29.812338 27449 consensus_queue.cc:1059] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:19:29.909029 25111 raft_consensus.cc:1275] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:19:29.897861 27473 raft_consensus.cc:697] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:29.902608 27440 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:29.954974 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 104216us
W20260709 12:19:29.945451 27516 consensus_meta.cc:287] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.580s	user 0.012s	sys 0.000s
W20260709 12:19:30.047163 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.047335 27516 raft_consensus.cc:2749] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 6. Current term is 7.
I20260709 12:19:29.957379 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:30.048254 24470 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:19:29.679832 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:30.048030 26956 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:29.935230 27566 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:29.956174 27254 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:29.974490 27581 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:29.991973 24473 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:30.010450 24290 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:30.079782 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:30.006726 24218 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54254 (request call id 263) took 23084 ms (client timeout 15000 ms). Trace:
I20260709 12:19:29.934971 24392 raft_consensus.cc:1240] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:30.012351 24220 catalog_manager.cc:5697] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 6 to 8, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 8 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:29.947364 27164 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:29.971136 27575 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:29.968583 27467 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:30.037736 27473 consensus_queue.cc:237] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:30.099082 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 88710.4us
I20260709 12:19:30.038342 27351 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:30.033506 27513 raft_consensus.cc:3055] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:30.038542 24440 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:19:30.137145 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 98674us
I20260709 12:19:29.999760 24289 leader_election.cc:400] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 6. Current term is 7.
W20260709 12:19:30.139256 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 139639us
W20260709 12:19:30.080766 24218 rpcz_store.cc:269] 0709 12:19:06.922158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:06.922439 (+   281us) service_pool.cc:224] Handling call
0709 12:19:30.006445 (+23084006us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:22.833942 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:22.989798 (+155856us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:23.016256 (+ 26458us) write_op.cc:435] Acquired schema lock
0709 12:19:23.022233 (+  5977us) tablet.cc:662] Decoding operations
0709 12:19:23.290531 (+268298us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:23.290662 (+   131us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:23.290690 (+    28us) tablet.cc:685] Acquiring locks for 18 operations
0709 12:19:23.292058 (+  1368us) tablet.cc:701] Row locks acquired
0709 12:19:23.292166 (+   108us) write_op.cc:260] PREPARE: finished
0709 12:19:23.292342 (+   176us) write_op.cc:270] Start()
0709 12:19:23.292514 (+   172us) write_op.cc:276] Timestamp: P: 1783599563292272 usec, L: 0
0709 12:19:23.292542 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:19:23.440852 (+148310us) log.cc:844] Serialized 7207 byte log entry
0709 12:19:25.072571 (+1631719us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b180033a6c0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9425f3f3 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd 0000000000388634 0000000000388479 00007f4a9424283a
0709 12:19:25.166278 (+ 93707us) op_driver.cc:464] REPLICATION: finished
0709 12:19:25.167852 (+  1574us) write_op.cc:301] APPLY: starting
0709 12:19:25.167967 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:25.168500 (+   533us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:25.168532 (+    32us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:25.170760 (+  2228us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:25.171198 (+   438us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 12:19:25.171265 (+    67us) write_op.cc:312] APPLY: finished
0709 12:19:25.171783 (+   518us) log.cc:844] Serialized 125 byte log entry
0709 12:19:25.172851 (+  1068us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:25.173069 (+   218us) write_op.cc:454] Released schema lock
0709 12:19:25.173152 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:25.173623 (+   471us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:25.173662 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":288940,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":1268,"apply.run_cpu_time_us":4878,"apply.run_wall_time_us":5734,"num_ops":18,"prepare.queue_time_us":587954,"prepare.run_cpu_time_us":28660,"prepare.run_wall_time_us":842505,"raft.queue_time_us":90741,"raft.run_cpu_time_us":1107,"raft.run_wall_time_us":4759,"replication_time_us":1873544,"spinlock_wait_cycles":2770176,"thread_start_us":499272,"threads_started":4,"wal-append.queue_time_us":189598,"wal-append.run_cpu_time_us":25618,"wal-append.run_wall_time_us":1101778}]]}
I20260709 12:19:30.038823 27440 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:30.039745 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:30.041066 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:30.143224 24323 raft_consensus.cc:2410] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:19:30.042275 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:30.043371 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:30.035029 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:30.045300 27524 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:30.022388 27640 log.cc:927] Time spent T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:19:30.046489 27612 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.947075 27501 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.053304 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:30.052156 24469 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:30.149415 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:30.058843 25084 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:19:30.069155 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.143433 24220 catalog_manager.cc:5697] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:30.155273 24220 catalog_manager.cc:5697] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 3 to 5, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 5 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:19:30.136782 27513 raft_consensus.cc:740] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:30.092329 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:30.091589 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:30.090773 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:30.076617 27308 consensus_meta.cc:287] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.708s	user 0.006s	sys 0.005s
I20260709 12:19:30.055579 27565 raft_consensus.cc:2749] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:30.088097 27595 raft_consensus.cc:2749] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:30.103833 27603 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:30.106427 27254 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:30.110297 27573 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:30.112648 27528 consensus_meta.cc:287] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.564s	user 0.011s	sys 0.000s
W20260709 12:19:30.112962 27561 consensus_meta.cc:287] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.604s	user 0.006s	sys 0.006s
I20260709 12:19:30.113227 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:30.125976 26956 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:30.205966 27440 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:30.212512 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:30.129851 27566 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:30.135972 25117 consensus_meta.cc:287] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.000s
I20260709 12:19:30.138299 24440 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:30.141703 24289 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:30.219930 25117 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
W20260709 12:19:30.220371 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 82165.4us
W20260709 12:19:30.220917 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 79258.7us
I20260709 12:19:30.221946 24289 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:30.144868 24465 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:30.142650 24471 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:30.145862 24316 raft_consensus.cc:2393] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 8: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:30.223129 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:30.159783 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 101032us
I20260709 12:19:30.142854 27602 raft_consensus.cc:2804] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:30.148214 27501 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:30.140036 27646 raft_consensus.cc:2804] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:30.176126 25114 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:30.077176 24474 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:19:30.171869 24470 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:30.231376 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:30.204428 27629 log.cc:927] Time spent T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.459s	user 0.000s	sys 0.005s
I20260709 12:19:30.177119 27645 raft_consensus.cc:2804] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:30.201946 24400 raft_consensus.cc:1240] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:19:30.202502 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:30.203096 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:30.204104 27561 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:30.204015 27528 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:30.197163 27308 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:30.244760 27602 raft_consensus.cc:697] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
W20260709 12:19:30.245144 27472 consensus_meta.cc:287] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.708s	user 0.013s	sys 0.000s
I20260709 12:19:30.245596 27472 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:30.246274 27528 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:30.246760 27308 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:30.247020 24317 raft_consensus.cc:1240] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:19:30.247871 24467 raft_consensus.cc:2393] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:30.247978 27472 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:30.224762 25084 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:30.248713 27645 raft_consensus.cc:697] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:30.226577 26956 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:30.188665 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:30.228861 24289 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:30.252789 24468 raft_consensus.cc:1240] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:30.253464 24470 raft_consensus.cc:1240] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 8. Ops: []
W20260709 12:19:30.253929 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.254685 24289 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:30.258585 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:30.259972 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:30.233799 27642 raft_consensus.cc:2804] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:30.232203 27254 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.236058 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:30.176935 27579 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:19:30.237969 27545 consensus_meta.cc:287] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.603s	user 0.006s	sys 0.003s
I20260709 12:19:30.241168 24366 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:30.241586 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:30.242036 27573 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:30.243116 27164 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:30.243453 27561 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:30.244300 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:30.245822 27602 consensus_queue.cc:237] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:30.164479 24220 catalog_manager.cc:5697] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:30.260761 24393 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:19:30.254729 24470 raft_consensus.cc:1275] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:19:30.258689 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:30.287329 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:30.229938 27646 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.256327 24289 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:30.265952 24320 raft_consensus.cc:1240] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:30.274142 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 1838) took 1272 ms. Trace:
I20260709 12:19:30.274917 24399 raft_consensus.cc:2410] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:19:30.234057 27351 raft_consensus.cc:2749] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:30.162191 27612 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:30.275027 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:30.234042 27427 consensus_queue.cc:1048] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:19:30.282898 24365 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:30.265259 27354 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.283656 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:30.288012 24393 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:19:30.293951 25117 raft_consensus.cc:1240] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:30.296512 24466 rpcz_store.cc:276] 0709 12:19:28.991459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.096539 (+105080us) service_pool.cc:224] Handling call
0709 12:19:30.264071 (+1167532us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b5400244354. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:30.264181 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1874723200}
I20260709 12:19:30.259222 27469 raft_consensus.cc:2749] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:30.288837 27595 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.304363 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:30.344144 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 61315.3us
I20260709 12:19:30.305073 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:30.262403 27524 raft_consensus.cc:2804] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:30.299917 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:30.348188 24400 raft_consensus.cc:2393] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 6: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:30.280510 24366 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:30.308614 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:30.274513 27254 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:30.249858 27645 consensus_queue.cc:237] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:30.311110 27612 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:30.300513 27646 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:30.306200 27164 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:30.284610 27638 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.313727 24395 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:30.284441 27519 consensus_queue.cc:1059] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:19:30.284655 27587 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:30.314191 24220 catalog_manager.cc:5697] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 1 to 5, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 5 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:30.276887 27579 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:30.317004 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:30.320953 27575 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:30.258601 27528 consensus_queue.cc:1048] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:19:30.325024 24398 raft_consensus.cc:1240] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:30.277300 27336 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:30.300953 24289 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:30.262705 27635 raft_consensus.cc:2749] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:19:30.349524 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 69076.8us
I20260709 12:19:30.351859 24365 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:30.362617 24466 raft_consensus.cc:1275] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:19:30.364199 24470 raft_consensus.cc:1240] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:30.373579 27603 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:30.294561 27472 consensus_queue.cc:1059] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:19:30.386519 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:30.398451 25117 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
W20260709 12:19:30.387403 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.320458 27581 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:30.235208 27513 consensus_queue.cc:260] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:30.361260 27561 raft_consensus.cc:2749] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:30.352967 27518 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:30.412211 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:30.413307 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 112442us
I20260709 12:19:30.395100 24466 pending_rounds.cc:85] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 5
I20260709 12:19:30.418862 24466 pending_rounds.cc:107] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:19:30.419152 24466 raft_consensus.cc:2889] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:30.420387 24289 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:30.421440 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 69684.2us
I20260709 12:19:30.377709 27524 raft_consensus.cc:697] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:30.427778 24472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1933) took 1736 ms. Trace:
I20260709 12:19:30.431034 25117 raft_consensus.cc:1275] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:19:30.429934 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 207696us
I20260709 12:19:30.433109 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:30.436043 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.441812 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:30.436203 24440 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:30.433830 24318 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:30.389642 27336 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.356567 27595 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:30.449730 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:30.415987 27164 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:30.345399 27354 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:30.410015 27473 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:30.497821 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:30.446408 24220 catalog_manager.cc:5697] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:19:30.504122 24322 raft_consensus.cc:1240] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:30.506505 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:30.457543 25117 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:30.459088 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:30.460969 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.431752 24472 rpcz_store.cc:276] 0709 12:19:28.690936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.756775 (+ 65839us) service_pool.cc:224] Handling call
0709 12:19:28.757054 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:28.757257 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:29.994940 (+1237683us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b180028ebe0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a96ef44bc 00007f4a9424248b 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425c455 00007f4a9ad443c7 00007f4a973569a7 00007f4a973660bf
0709 12:19:29.995088 (+   148us) log.cc:844] Serialized 14 byte log entry
0709 12:19:30.423978 (+428890us) log.cc:844] Serialized 14 byte log entry
0709 12:19:30.425967 (+  1989us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:30.426028 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:30.426098 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:30.427571 (+  1473us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:30.427708 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":107688,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":8332,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":158,"spinlock_wait_cycles":26104704,"thread_start_us":537101,"threads_started":3,"wal-append.queue_time_us":335249}
I20260709 12:19:30.416824 27469 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.426267 27566 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:30.434374 27287 raft_consensus.cc:2804] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:30.414855 27545 consensus_queue.cc:1059] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
W20260709 12:19:30.557978 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 60999.8us
I20260709 12:19:30.416464 27600 consensus_queue.cc:1048] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 12:19:30.581127 24470 pending_rounds.cc:85] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 5
I20260709 12:19:30.455719 27336 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:30.454344 27603 raft_consensus.cc:2749] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:30.413949 27587 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:30.382632 27638 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:30.581506 24470 pending_rounds.cc:107] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 5.6
W20260709 12:19:30.583480 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.432351 27256 consensus_queue.cc:1059] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:19:30.588570 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:30.444108 27351 consensus_queue.cc:1048] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:19:30.491932 27513 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:30.562932 27555 raft_consensus.cc:2749] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:19:30.643677 27630 log.cc:927] Time spent T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.897s	user 0.004s	sys 0.006s
I20260709 12:19:30.600886 24470 raft_consensus.cc:2889] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:30.604305 27651 log.cc:927] Time spent T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:19:30.605011 27282 raft_consensus.cc:3055] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:30.606369 27522 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:30.607030 27638 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:30.672580 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:30.607923 27565 raft_consensus.cc:3055] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:30.609330 27254 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:30.610010 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:30.611398 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:30.683562 24324 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:30.613555 24399 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2357) took 2440 ms (client timeout 2793 ms). Trace:
I20260709 12:19:30.615945 27489 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:30.616814 24291 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:30.576325 27473 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:30.617322 25111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 484) took 1215 ms. Trace:
I20260709 12:19:30.618185 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 686) took 1071 ms. Trace:
I20260709 12:19:30.619302 27587 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:30.621280 27354 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:30.622437 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:30.695276 25118 raft_consensus.cc:3060] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:19:30.623703 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.624504 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33198 (request call id 681) took 1099 ms. Trace:
I20260709 12:19:30.696734 24474 rpcz_store.cc:276] 0709 12:19:29.525458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.665025 (+139567us) service_pool.cc:224] Handling call
0709 12:19:30.624346 (+959321us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b5400033ed4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:30.624450 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":799654784}
I20260709 12:19:30.625128 27524 consensus_queue.cc:237] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:30.627578 27467 consensus_meta.cc:287] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.520s	user 0.006s	sys 0.005s
I20260709 12:19:30.627871 24317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1804) took 1071 ms. Trace:
I20260709 12:19:30.723968 24317 rpcz_store.cc:276] 0709 12:19:29.556031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.612975 (+ 56944us) service_pool.cc:224] Handling call
0709 12:19:29.613360 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:30.247524 (+634164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:30.627610 (+380086us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b54002558d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:30.627805 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1456696192}
I20260709 12:19:30.629417 27579 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:30.629645 24467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 1841) took 1637 ms. Trace:
I20260709 12:19:30.630616 27575 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:30.630738 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:30.632267 27581 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:30.580515 27649 log.cc:927] Time spent T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:19:30.495678 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:30.601497 24466 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:30.637384 24473 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:30.593155 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:30.590250 24220 catalog_manager.cc:5697] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:30.731387 24472 raft_consensus.cc:2468] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:30.643780 27164 raft_consensus.cc:3055] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:30.646420 27595 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:30.643782 27635 consensus_queue.cc:1059] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:19:30.741681 24220 catalog_manager.cc:5697] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 3 to 5, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 5 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:19:30.652093 25117 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:19:30.596366 27287 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.673827 24318 raft_consensus.cc:2410] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:19:30.684367 24399 rpcz_store.cc:269] 0709 12:19:28.173327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.182067 (+  8740us) service_pool.cc:224] Handling call
0709 12:19:30.613366 (+2431299us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b5400146754. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:30.613494 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4802005248}
W20260709 12:19:30.686084 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 69359.6us
W20260709 12:19:30.617527 27653 log.cc:927] Time spent T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:19:30.580574 27566 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:30.686645 24469 rpcz_store.cc:276] 0709 12:19:29.547017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:30.157350 (+610333us) service_pool.cc:224] Handling call
0709 12:19:30.225276 (+ 67926us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:30.225486 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:30.225528 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:30.225569 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:30.225601 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:30.225653 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:30.618027 (+392374us) spinlock_profiling.cc:243] Waited 67.6 ms on lock 0x7b54001509d0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:30.618126 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155452672}
I20260709 12:19:30.770952 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:30.773083 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:30.773849 25117 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEARNER]: Advancing to term 8
I20260709 12:19:30.715885 24324 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:30.600699 27469 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:30.680886 27522 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:30.672533 27282 raft_consensus.cc:740] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:30.725342 24467 rpcz_store.cc:276] 0709 12:19:28.992459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.104295 (+111836us) service_pool.cc:224] Handling call
0709 12:19:30.629462 (+1525167us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400243454. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:30.629587 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2626737536}
I20260709 12:19:30.727533 24321 raft_consensus.cc:1240] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:30.681267 27565 raft_consensus.cc:740] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:30.695040 27254 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:19:30.734161 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 311893us
I20260709 12:19:30.650568 24395 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
W20260709 12:19:30.754539 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.727926 27467 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:30.739233 27308 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.772008 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:30.733492 27164 raft_consensus.cc:740] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:30.692875 25111 rpcz_store.cc:276] 0709 12:19:29.401443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.411052 (+  9609us) service_pool.cc:224] Handling call
0709 12:19:29.908517 (+497465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:30.009566 (+101049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:30.617072 (+607506us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b54007085d0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:30.617245 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1038826368}
I20260709 12:19:30.793995 24291 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:30.789173 24220 catalog_manager.cc:5697] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:30.798847 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:30.769009 27287 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:30.798856 24440 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:30.806420 25117 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEARNER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:30.808991 24220 catalog_manager.cc:5697] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 5 to 6, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 6 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:30.796123 27254 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.821115 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:30.827804 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.820796 24220 catalog_manager.cc:5697] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 4 to 5, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 5 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:30.824879 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:30.825924 24440 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:30.835538 25116 raft_consensus.cc:2393] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 7: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:30.836205 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:30.837296 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:30.838611 24440 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:30.819746 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:30.805487 27351 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:30.842463 24440 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:30.846063 24440 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:30.847005 25117 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:30.851797 24291 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:19:30.836864 25115 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.024s	sys 0.014s
I20260709 12:19:30.839159 27599 raft_consensus.cc:2749] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:30.835100 27254 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:30.812014 27516 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:30.801826 27308 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:30.859905 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 439588us
I20260709 12:19:30.819015 27615 consensus_queue.cc:1059] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:19:30.871057 25082 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:30.872607 24220 catalog_manager.cc:5697] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 6 to 7, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 7 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:30.806625 27336 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:30.854897 27595 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:30.822579 27600 consensus_queue.cc:1059] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:19:30.860446 27581 raft_consensus.cc:2749] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:30.883901 27575 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.890038 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:30.920222 24394 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 6: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:30.861171 27579 raft_consensus.cc:2804] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:30.920943 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:30.921288 27579 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:30.921802 27579 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:30.922765 27642 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.923215 27642 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:30.923923 27469 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:30.919579 27573 raft_consensus.cc:2749] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:30.860689 27603 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:30.926569 27603 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:30.926726 27575 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:30.861904 27164 consensus_queue.cc:260] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:30.865427 27599 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.928455 27164 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:30.865211 27351 raft_consensus.cc:697] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:30.884262 27256 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:30.928936 27599 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:30.883467 27516 raft_consensus.cc:697] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:30.929632 27256 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:30.929756 27351 consensus_queue.cc:237] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:30.915316 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:30.930814 27516 consensus_queue.cc:237] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:30.892988 27602 raft_consensus.cc:2749] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:30.929759 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:30.934000 24397 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:30.935760 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1939) took 1443 ms. Trace:
W20260709 12:19:30.897663 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.915455 24220 catalog_manager.cc:5697] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 2 to 7, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 7 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:30.917109 27646 consensus_meta.cc:287] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.516s	user 0.005s	sys 0.007s
W20260709 12:19:30.915470 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 44528.8us
I20260709 12:19:30.889151 24398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1929) took 1489 ms. Trace:
I20260709 12:19:30.839778 27565 consensus_queue.cc:260] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:30.896026 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 492) took 1391 ms. Trace:
I20260709 12:19:30.896440 25083 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:30.945516 24398 rpcz_store.cc:276] 0709 12:19:29.399735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.858402 (+458667us) service_pool.cc:224] Handling call
0709 12:19:29.858709 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:30.386095 (+527386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:30.888882 (+502787us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b5400208fd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:30.889083 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1071969536}
I20260709 12:19:30.951982 25119 rpcz_store.cc:276] 0709 12:19:29.504570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.704740 (+200170us) service_pool.cc:224] Handling call
0709 12:19:29.898231 (+193491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:30.009041 (+110810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:30.895836 (+886795us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b540072f450. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:30.895967 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":443986176}
I20260709 12:19:30.944268 24396 raft_consensus.cc:1275] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:19:30.954330 24399 raft_consensus.cc:2393] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 7: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:30.957643 24220 catalog_manager.cc:5697] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:30.959730 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:30.960652 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 64264.9us
I20260709 12:19:30.961581 25083 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:30.954293 27573 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:30.936312 24468 rpcz_store.cc:276] 0709 12:19:29.492041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.499244 (+  7203us) service_pool.cc:224] Handling call
0709 12:19:29.520329 (+ 21085us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:30.253223 (+732894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:30.935468 (+682245us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b54001437d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:30.935687 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1679575424}
I20260709 12:19:30.966518 25083 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:30.967082 24322 raft_consensus.cc:1240] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:30.941541 27518 raft_consensus.cc:697] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:30.970642 27573 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:30.973395 25083 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:30.945799 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1945) took 1262 ms. Trace:
I20260709 12:19:30.918924 27595 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:30.955549 27473 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:30.986161 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:30.974727 27634 consensus_queue.cc:1048] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:19:30.989912 27336 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:30.968573 27354 raft_consensus.cc:2749] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:30.974864 27427 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:30.992609 27427 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.993029 27427 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:30.978410 27529 consensus_queue.cc:1048] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:19:30.986274 27515 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:30.999388 27515 raft_consensus.cc:697] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:31.000439 27515 consensus_queue.cc:237] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:30.986019 27555 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:31.004571 27555 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:31.006402 27573 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:31.006834 27555 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:31.008808 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:30.952925 27646 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:19:31.013072 24220 catalog_manager.cc:5697] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 3 to 4, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 4 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:31.014582 27646 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:31.015098 24220 catalog_manager.cc:5697] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 4 to 5, leader changed from d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 5 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:19:30.978673 27595 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:31.016947 27501 consensus_meta.cc:287] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.779s	user 0.007s	sys 0.006s
I20260709 12:19:31.017482 27501 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:31.021791 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:31.022743 24467 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:19:31.023870 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:31.026444 24467 raft_consensus.cc:2393] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 7: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:31.016870 24220 catalog_manager.cc:5697] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 5 to 6, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 6 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:30.964511 27489 raft_consensus.cc:2804] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:31.030368 25118 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 3.
I20260709 12:19:31.019748 27501 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:31.055301 24397 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:19:30.976218 24465 rpcz_store.cc:276] 0709 12:19:29.683816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:30.231063 (+547247us) service_pool.cc:224] Handling call
0709 12:19:30.231416 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:30.231632 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:19:30.457467 (+225835us) log.cc:844] Serialized 14 byte log entry
0709 12:19:30.945297 (+487830us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:30.945373 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:30.945446 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:30.945549 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:30.945722 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":508370,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":13220,"raft.queue_time_us":140,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":3384,"thread_start_us":706564,"threads_started":2}
I20260709 12:19:31.091473 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:31.087316 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:31.094316 24468 raft_consensus.cc:2393] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 7: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:31.096230 24465 raft_consensus.cc:1240] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:31.100322 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1851) took 1063 ms. Trace:
I20260709 12:19:31.100796 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:31.100889 24465 rpcz_store.cc:276] 0709 12:19:30.037090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.095640 (+1058550us) service_pool.cc:224] Handling call
0709 12:19:31.095987 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:31.099808 (+  3821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:31.100241 (+   433us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:31.032894 27424 raft_consensus.cc:3055] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:31.032963 27634 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.122133 27522 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:31.122928 27634 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:31.124328 27522 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:31.114480 24467 raft_consensus.cc:1240] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:31.090011 24220 catalog_manager.cc:5697] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 4 to 5, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 5 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:31.117269 24325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44278 (request call id 2220) took 1491 ms. Trace:
I20260709 12:19:31.118471 24473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 1849) took 1107 ms. Trace:
W20260709 12:19:31.147475 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 411159us
I20260709 12:19:31.147791 24473 rpcz_store.cc:276] 0709 12:19:30.011418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:30.079465 (+ 68047us) service_pool.cc:224] Handling call
0709 12:19:31.118307 (+1038842us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54000fe1d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:31.118412 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":343092480}
I20260709 12:19:31.119776 24469 raft_consensus.cc:1240] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:31.032914 27489 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:31.125075 27634 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:31.125422 27575 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:31.126835 27599 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:31.129093 27308 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:31.158485 24469 raft_consensus.cc:1275] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:19:31.129737 27256 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:31.131276 27287 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:31.131716 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:31.108093 27603 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:30.977317 27565 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:31.106070 27424 raft_consensus.cc:740] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:31.122159 27427 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:31.148813 24290 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:31.146795 24325 rpcz_store.cc:276] 0709 12:19:29.625699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.860219 (+234520us) service_pool.cc:224] Handling call
0709 12:19:29.860564 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:29.976272 (+115708us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:29.976315 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:29.976379 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:29.976432 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:31.117032 (+1140600us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54002148d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:31.117079 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:31.117200 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265552640}
I20260709 12:19:31.164960 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:31.189488 24321 raft_consensus.cc:2393] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 5: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:31.116108 27254 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:31.155007 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 309030us
I20260709 12:19:31.028064 27646 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:31.169718 27642 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:31.173197 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:31.173282 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:31.192938 24318 raft_consensus.cc:2393] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 3: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:19:31.173867 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:31.174010 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:31.154687 27489 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:31.184087 27287 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:31.175997 24469 raft_consensus.cc:1275] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:19:31.195387 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 46738.8us
I20260709 12:19:31.196779 24290 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:31.198313 24290 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:31.177013 24467 raft_consensus.cc:1240] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:31.180864 24473 raft_consensus.cc:1275] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:19:31.179656 24220 catalog_manager.cc:5697] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:19:31.204124 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:31.212988 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:31.174685 27579 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:31.215013 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:31.216593 24473 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:31.219105 24467 raft_consensus.cc:1240] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:31.223839 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:31.228447 27675 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.229290 27675 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:31.232573 27675 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:31.244987 24473 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:31.248780 24289 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:31.250443 27469 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:31.257894 25083 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:19:31.255146 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 387047us
I20260709 12:19:31.259086 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:31.202186 27603 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.260371 24473 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:19:31.266804 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:31.270362 24467 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:31.187706 27522 consensus_queue.cc:1059] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:19:31.203035 27308 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.204672 27575 raft_consensus.cc:2804] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:31.204497 27665 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:31.184160 27595 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:31.275085 24316 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:19:31.220533 27501 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:31.261091 24220 catalog_manager.cc:5697] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 4 to 6, leader changed from d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 6 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:19:31.256847 27256 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:31.202538 27646 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:31.268016 27524 raft_consensus.cc:2804] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:31.294672 24220 catalog_manager.cc:5697] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 5 to 6, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 6 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:31.277078 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:31.293128 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 691) took 1335 ms. Trace:
W20260709 12:19:31.299031 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:31.186317 27518 consensus_queue.cc:237] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:31.282902 27665 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:31.281764 27587 consensus_queue.cc:1059] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:19:31.281421 27308 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:31.280251 27603 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:31.282644 27424 consensus_queue.cc:260] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:31.447072 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:31.455466 25118 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:31.440264 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 114406us
I20260709 12:19:31.456940 24290 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:31.349182 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:31.445731 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:31.338302 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:31.460372 24473 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:31.299222 24474 rpcz_store.cc:276] 0709 12:19:29.957818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:30.723299 (+765481us) service_pool.cc:224] Handling call
0709 12:19:30.728540 (+  5241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:30.728746 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:19:31.094896 (+366150us) log.cc:844] Serialized 14 byte log entry
0709 12:19:31.292709 (+197813us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:31.292775 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:31.292822 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:31.292902 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:31.293061 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12309,"prepare.queue_time_us":63110,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":197,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":4871,"thread_start_us":506153,"threads_started":2,"wal-append.queue_time_us":320134}
I20260709 12:19:31.469370 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:31.470329 24472 raft_consensus.cc:2393] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 7: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:31.465819 24290 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:31.415915 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:31.350739 27595 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:31.355665 27469 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:31.329139 27668 consensus_queue.cc:1059] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.144s
W20260709 12:19:31.333273 27667 log.cc:927] Time spent T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 12:19:31.328847 27519 consensus_queue.cc:1048] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.144s
I20260709 12:19:31.329421 27680 consensus_queue.cc:1048] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.144s
I20260709 12:19:31.349189 27642 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:31.332216 27287 consensus_queue.cc:1059] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.142s
I20260709 12:19:31.475513 24474 raft_consensus.cc:1275] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:19:31.461550 27666 consensus_queue.cc:1059] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
W20260709 12:19:31.477329 27689 log.cc:927] Time spent T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:19:31.445290 27575 raft_consensus.cc:697] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:31.478507 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1955) took 1210 ms. Trace:
I20260709 12:19:31.479934 27677 raft_consensus.cc:3055] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:31.479020 24465 rpcz_store.cc:276] 0709 12:19:30.268394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.140816 (+872422us) service_pool.cc:224] Handling call
0709 12:19:31.141419 (+   603us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:31.168121 (+ 26702us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:19:31.168159 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:31.178534 (+ 10375us) log.cc:844] Serialized 26 byte log entry
0709 12:19:31.257405 (+ 78871us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:31.257459 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:31.257531 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:31.478244 (+220713us) raft_consensus.cc:1685] finished
0709 12:19:31.478273 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:31.478429 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5027,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":8670,"thread_start_us":56722,"threads_started":1,"wal-append.queue_time_us":119095}
I20260709 12:19:31.480370 27677 raft_consensus.cc:740] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:31.481050 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:31.481956 24465 raft_consensus.cc:2393] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 6: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:31.481432 27677 consensus_queue.cc:260] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:31.464684 24473 raft_consensus.cc:1240] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:31.483026 27677 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:31.485539 27282 consensus_queue.cc:260] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:31.486548 27282 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:31.487025 27612 raft_consensus.cc:3055] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:31.483026 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:31.487424 27612 raft_consensus.cc:740] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:31.487797 24465 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:31.488359 27612 consensus_queue.cc:260] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:31.488879 27554 raft_consensus.cc:3055] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:31.489275 27554 raft_consensus.cc:740] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:31.490110 27554 consensus_queue.cc:260] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:31.491259 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:31.492210 24466 raft_consensus.cc:2410] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:19:31.492328 27256 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:31.492892 27256 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:31.300254 24220 catalog_manager.cc:5697] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:19:31.497159 24220 catalog_manager.cc:5697] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 2 to 5, leader changed from d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 5 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:31.498065 24320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1803) took 1961 ms. Trace:
I20260709 12:19:31.498728 24320 rpcz_store.cc:276] 0709 12:19:29.536401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.609542 (+ 73141us) service_pool.cc:224] Handling call
0709 12:19:29.642241 (+ 32699us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:30.296510 (+654269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:31.497695 (+1201185us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b54002567d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:31.497966 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1433718656}
I20260709 12:19:31.478883 27575 consensus_queue.cc:237] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:31.504546 24465 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
I20260709 12:19:31.505335 27449 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.505693 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:31.505872 27449 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:31.506541 24465 raft_consensus.cc:2393] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 6: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:31.501623 27164 raft_consensus.cc:2804] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:31.296427 27524 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:31.518646 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 52939.4us
I20260709 12:19:31.525318 25083 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:31.537858 24290 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:31.490515 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:31.539662 24291 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:31.545725 25118 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:19:31.507395 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:31.533828 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 272792us
I20260709 12:19:31.547792 24366 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:31.530634 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:31.548988 24323 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
I20260709 12:19:31.348212 27254 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:31.358269 27579 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:31.558194 24465 raft_consensus.cc:1275] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:19:31.455068 27427 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:31.462508 27665 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:31.293956 27501 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:31.563604 24366 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:31.573107 24291 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:31.571105 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:31.509207 27646 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:31.571790 27587 raft_consensus.cc:2749] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:31.533466 27469 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:31.525641 27164 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:31.588327 25084 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:31.553567 27524 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:31.598528 26956 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:31.327800 27600 consensus_queue.cc:1059] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.245s
W20260709 12:19:31.610562 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 47050.8us
I20260709 12:19:31.570343 27634 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:31.610972 24290 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:31.615561 24467 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:31.627733 24467 raft_consensus.cc:1240] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:31.586967 27415 raft_consensus.cc:2749] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:31.634260 24366 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:31.630487 24472 raft_consensus.cc:1275] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:31.599136 27351 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:31.598920 27693 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:31.615607 27164 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:31.615240 27579 raft_consensus.cc:2804] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:31.624419 27615 raft_consensus.cc:2804] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:31.618738 27565 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:19:31.674660 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 68364.4us
I20260709 12:19:31.679243 24467 raft_consensus.cc:1240] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:31.655316 27289 raft_consensus.cc:2804] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:19:31.682974 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 115368us
I20260709 12:19:31.625645 26956 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:31.659972 27635 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:31.641937 27287 consensus_queue.cc:1048] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:19:31.682868 24291 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:31.664744 27615 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:31.676839 27515 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:31.677762 27565 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:31.656152 27351 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:31.676373 27579 raft_consensus.cc:697] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:19:31.692414 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 81565.2us
W20260709 12:19:31.933355 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 250555us
I20260709 12:19:31.936302 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:31.897339 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 950989us
I20260709 12:19:31.938534 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:31.940042 25082 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:31.686719 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 98518.8us
I20260709 12:19:31.939857 24323 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:31.937252 24320 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
W20260709 12:19:32.009753 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 75560.6us
I20260709 12:19:32.011137 24290 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:32.011790 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 71886.7us
I20260709 12:19:32.013679 24290 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:32.014222 25082 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:31.683917 27289 raft_consensus.cc:697] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:32.030915 24290 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:32.035991 24290 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:32.037127 25082 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:32.037196 24290 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:32.039129 25082 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:32.036049 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:31.871855 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.041754 24320 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
W20260709 12:19:32.042515 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:31.751180 27695 log.cc:927] Time spent T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:19:32.055194 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 411616us
I20260709 12:19:31.751989 27678 raft_consensus.cc:3055] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:31.854810 27472 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.057297 24366 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:31.805548 27668 raft_consensus.cc:3055] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:31.938335 27515 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.749643 27449 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:31.760463 27595 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:31.735273 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 51340.4us
I20260709 12:19:31.690927 27635 raft_consensus.cc:697] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:32.009264 27615 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:32.054523 27575 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:32.061843 24438 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:32.063301 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:32.063702 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:32.066314 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:32.138825 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 77059.9us
I20260709 12:19:31.897526 27524 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:32.061425 27678 raft_consensus.cc:740] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:31.705506 27501 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:31.798180 27634 raft_consensus.cc:697] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
W20260709 12:19:32.046686 27489 consensus_meta.cc:287] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.824s	user 0.009s	sys 0.003s
I20260709 12:19:32.076790 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:32.029907 27693 raft_consensus.cc:2749] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:32.090538 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:32.171631 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 132590us
I20260709 12:19:32.091403 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:32.175312 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:32.091452 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:32.091560 24366 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:32.176180 24391 raft_consensus.cc:2410] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:19:32.035257 27299 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:32.029759 27704 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:32.033942 27664 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.896492 26956 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:32.180335 24440 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:32.113765 27522 raft_consensus.cc:2749] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:32.114748 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:32.054371 27645 raft_consensus.cc:2749] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:32.044339 27415 raft_consensus.cc:2749] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:32.043464 27646 raft_consensus.cc:2804] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:19:31.769764 27698 log.cc:927] Time spent T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 12:19:32.098512 27282 consensus_meta.cc:287] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.612s	user 0.013s	sys 0.000s
I20260709 12:19:32.176805 27501 raft_consensus.cc:2804] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:32.086390 27668 raft_consensus.cc:740] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:32.115653 27515 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:32.157196 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:32.053785 27701 consensus_queue.cc:1048] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 12:19:32.132864 27694 raft_consensus.cc:2749] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:19:32.070614 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.137573 27449 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.093526 24394 raft_consensus.cc:1240] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:32.175930 25082 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:32.176805 25115 raft_consensus.cc:2368] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8.
I20260709 12:19:32.072106 27287 consensus_queue.cc:1048] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:19:31.844477 27256 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:32.142768 27575 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.764954 27703 consensus_queue.cc:1048] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.394s
I20260709 12:19:32.077863 27587 consensus_queue.cc:1048] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:19:32.181371 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:32.179400 27489 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:32.260425 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.096946 27472 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:32.149247 24396 raft_consensus.cc:1275] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:19:32.177608 27692 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.211658 27646 raft_consensus.cc:697] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:32.173136 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:32.203034 27680 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:32.191774 27705 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:32.206084 27713 log.cc:927] Time spent T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.144s	user 0.001s	sys 0.003s
I20260709 12:19:32.154157 27712 consensus_queue.cc:1048] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.059s
W20260709 12:19:32.206768 27710 log.cc:927] Time spent T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
W20260709 12:19:32.207377 27702 log.cc:927] Time spent T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.310s	user 0.000s	sys 0.000s
I20260709 12:19:32.206794 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:32.217681 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:32.221899 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 183691us
I20260709 12:19:32.290378 24395 raft_consensus.cc:2393] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 6: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:32.227331 24320 raft_consensus.cc:1275] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:19:32.196979 27704 raft_consensus.cc:697] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:32.246302 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:32.290164 24397 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6.
I20260709 12:19:32.296893 24317 raft_consensus.cc:2393] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 7: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:32.203202 27289 consensus_queue.cc:237] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:32.199203 27299 raft_consensus.cc:2764] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:19:32.250989 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:32.251834 24392 raft_consensus.cc:1240] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:32.195737 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:32.210997 27513 raft_consensus.cc:2749] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:32.210057 27501 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:32.141172 27595 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:32.192690 27664 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:32.315143 27664 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:32.158603 27579 consensus_queue.cc:237] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:32.222484 25110 raft_consensus.cc:1240] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:19:32.276401 24318 raft_consensus.cc:1240] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:32.256474 27575 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:32.256669 27449 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:32.293840 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:32.267181 27717 raft_consensus.cc:2749] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:19:32.290477 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 110388us
I20260709 12:19:32.333022 24440 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:32.334203 24440 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:32.336210 27587 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.278774 27693 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.336813 27587 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:32.337165 27693 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:32.339053 27587 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:32.298558 24317 raft_consensus.cc:1240] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 12:19:32.246667 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 70881.8us
W20260709 12:19:32.303143 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 211701us
I20260709 12:19:32.303798 27513 raft_consensus.cc:2804] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:32.262538 27635 consensus_queue.cc:237] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:32.307902 27665 consensus_meta.cc:287] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.709s	user 0.007s	sys 0.005s
I20260709 12:19:32.308241 27501 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:32.358485 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:32.358754 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:32.309916 27489 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:32.220923 27678 consensus_queue.cc:260] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:32.311389 27472 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:32.276093 27692 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:32.313282 27595 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:32.284817 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 189109us
I20260709 12:19:32.294968 27565 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:32.357898 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:32.359738 25114 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:32.383227 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:32.493291 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:32.301863 27718 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:32.318490 27351 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:32.493536 25116 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
W20260709 12:19:32.425014 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 67451us
I20260709 12:19:32.494383 25117 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6.
I20260709 12:19:32.356212 27513 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.275611 27634 consensus_queue.cc:237] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:32.356428 27701 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.502236 24366 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:32.502902 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:32.527884 24393 raft_consensus.cc:1275] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:19:32.355279 27665 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:32.538302 24399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2386) took 1663 ms. Trace:
I20260709 12:19:32.542310 24399 rpcz_store.cc:276] 0709 12:19:30.836896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:30.837069 (+   173us) service_pool.cc:224] Handling call
0709 12:19:32.499596 (+1662527us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54002085d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:32.500364 (+   768us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260654464}
I20260709 12:19:32.543465 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:32.546404 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 44248.9us
I20260709 12:19:32.548352 25119 raft_consensus.cc:1275] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:19:32.564158 24366 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:32.289594 27668 consensus_queue.cc:260] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:32.572376 24366 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:32.287531 27705 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:32.583438 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:32.493698 27524 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:32.584823 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 444961us
I20260709 12:19:32.529265 27595 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:32.538633 27565 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.591019 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:32.591892 24438 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:32.589222 24321 raft_consensus.cc:1240] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:32.589298 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:32.538276 27513 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:32.495224 27287 consensus_queue.cc:1048] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.125s
I20260709 12:19:32.529461 27726 raft_consensus.cc:2804] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:32.606809 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:32.606967 24465 raft_consensus.cc:1275] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:19:32.610576 24397 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:32.358892 27646 consensus_queue.cc:237] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:19:32.571018 27727 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:32.580744 27680 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:32.581934 27693 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:32.624323 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:32.611898 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:32.590795 27472 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.590585 27518 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.610138 27726 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:32.591507 27694 raft_consensus.cc:2749] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:32.605125 27678 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:32.591003 27595 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.581615 27587 consensus_queue.cc:1059] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:19:32.538738 27718 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:32.622568 27668 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:32.646318 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 52534.2us
I20260709 12:19:32.547688 27701 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:32.653388 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 238530us
I20260709 12:19:32.609086 27282 consensus_queue.cc:1059] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
W20260709 12:19:32.669652 27656 log.cc:927] Time spent T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 1.851s	user 0.006s	sys 0.004s
I20260709 12:19:32.670789 27467 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:32.636574 27472 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:32.674075 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:32.606736 27565 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
W20260709 12:19:32.656726 27469 consensus_meta.cc:287] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.052s	user 0.009s	sys 0.005s
I20260709 12:19:32.599011 27711 consensus_queue.cc:1059] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:19:32.649060 27595 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:32.639786 27726 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:32.678892 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:32.655356 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:32.697208 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:32.698038 24474 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:32.639829 27518 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:32.700208 24469 raft_consensus.cc:1240] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:32.682324 27723 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.707962 27665 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:32.708173 27723 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:32.709256 27518 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:32.590693 27704 consensus_queue.cc:237] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:32.705672 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:32.695741 27615 consensus_meta.cc:287] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.548s	user 0.012s	sys 0.000s
I20260709 12:19:32.720157 27615 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:32.722532 27615 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:32.717963 24467 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:32.680539 27469 raft_consensus.cc:2749] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:32.724105 24319 raft_consensus.cc:1240] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:32.694715 25112 raft_consensus.cc:1275] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:19:32.732087 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 74231.5us
W20260709 12:19:32.737188 27725 log.cc:927] Time spent T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
W20260709 12:19:32.737360 27729 log.cc:927] Time spent T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:19:32.741191 24438 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:32.738955 27705 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:32.717290 27741 raft_consensus.cc:2749] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:32.747795 27449 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:32.717409 27722 log.cc:927] Time spent T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 12:19:32.748934 27692 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:32.759840 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:32.749298 25110 raft_consensus.cc:2368] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 8. Current term is 9.
I20260709 12:19:32.715886 27723 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:32.768800 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:32.770550 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:32.758440 27719 log.cc:927] Time spent T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:19:32.766673 24440 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:32.773209 24391 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:32.781296 24440 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:32.759416 27472 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:32.785377 24397 raft_consensus.cc:1275] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:19:32.765129 27449 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.790390 24440 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:32.789072 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 258108us
I20260709 12:19:32.777994 27738 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:32.779031 27718 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:32.797962 27472 raft_consensus.cc:2804] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:32.801599 27472 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:32.802018 27472 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:32.811491 27308 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:32.812177 27308 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:32.808359 24470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1953) took 2873 ms. Trace:
I20260709 12:19:32.814502 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1952) took 1896 ms. Trace:
I20260709 12:19:32.813805 24470 rpcz_store.cc:276] 0709 12:19:29.934704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:30.396417 (+461713us) service_pool.cc:224] Handling call
0709 12:19:30.396909 (+   492us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:30.673699 (+276790us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:30.673730 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:30.674488 (+   758us) log.cc:844] Serialized 52 byte log entry
0709 12:19:31.100671 (+426183us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:31.100707 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:32.807878 (+1707171us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b540010fc54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:32.807937 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:32.807989 (+    52us) raft_consensus.cc:1685] finished
0709 12:19:32.808005 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:32.808267 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1283,"raft.queue_time_us":2385,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":10606,"spinlock_wait_cycles":423040768,"thread_start_us":374263,"threads_started":1,"wal-append.queue_time_us":566156,"wal-append.run_cpu_time_us":2006,"wal-append.run_wall_time_us":1098611}
I20260709 12:19:32.814836 24392 rpcz_store.cc:276] 0709 12:19:30.918209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:30.918336 (+   127us) service_pool.cc:224] Handling call
0709 12:19:30.918775 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:32.300952 (+1382177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:32.814282 (+513330us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540027f454. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:32.814446 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3065301760}
I20260709 12:19:32.812588 27308 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:32.816859 27308 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:32.817799 27677 raft_consensus.cc:3055] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:32.818222 27677 raft_consensus.cc:740] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:19:32.818336 27515 consensus_meta.cc:287] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.000s
I20260709 12:19:32.818619 27726 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:32.818888 27515 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:32.814922 27164 consensus_meta.cc:287] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.152s	user 0.011s	sys 0.002s
I20260709 12:19:32.829078 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:32.764392 27741 consensus_queue.cc:1048] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:19:32.831862 24392 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:32.820760 27256 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:32.826333 27743 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:19:32.834791 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 45227.1us
I20260709 12:19:32.793494 27449 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:32.838922 27745 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:32.840554 27277 raft_consensus.cc:3055] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:32.841145 27277 raft_consensus.cc:740] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:32.765107 27732 consensus_queue.cc:1059] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 12:19:32.812386 27513 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:32.843416 24440 leader_election.cc:400] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 8. Current term is 9.
I20260709 12:19:32.851393 24440 leader_election.cc:403] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:19:32.857684 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:32.859198 24392 raft_consensus.cc:2393] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 7: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:32.800469 27738 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:32.850694 27745 consensus_queue.cc:1048] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:19:32.842108 27277 consensus_queue.cc:260] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:32.863907 24465 raft_consensus.cc:2393] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 8: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:32.835561 27164 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:32.858049 27565 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:32.849128 27743 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:32.874740 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:32.905942 24392 raft_consensus.cc:2410] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:19:32.906364 27566 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:32.909521 27566 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:32.910138 27737 log.cc:927] Time spent T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.227s	user 0.003s	sys 0.000s
I20260709 12:19:32.910071 27566 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:19:32.906739 27701 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:32.897085 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 53803.7us
I20260709 12:19:32.913802 27449 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:32.917918 27336 raft_consensus.cc:3055] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:32.918388 27336 raft_consensus.cc:740] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:32.919247 27336 consensus_queue.cc:260] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:32.911564 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:32.903468 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:32.863102 27726 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:32.925413 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:32.928761 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:32.929752 25110 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:32.930362 27513 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:32.930709 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:32.928980 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:32.934311 27308 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:32.935181 25118 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:32.936319 27753 raft_consensus.cc:3055] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:32.936784 27753 raft_consensus.cc:740] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:32.937369 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:32.937623 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:32.938001 24392 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6.
I20260709 12:19:32.938593 27472 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:32.939790 27738 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:32.941066 27743 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:32.941699 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:32.942982 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:32.942821 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:32.948092 24440 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:32.943326 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:32.955329 24391 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:32.954901 24392 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:32.972479 27164 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:32.976490 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:32.977245 24473 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:32.977681 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:32.928890 27566 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:19:32.967962 27308 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:32.859580 27746 consensus_queue.cc:1048] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 12:19:32.969871 27472 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:32.970193 27726 raft_consensus.cc:2749] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:32.990790 27282 consensus_queue.cc:1243] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Peer c711faa13ead43ebbea0192cb74a4756 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:19:32.876360 27732 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:32.967010 24440 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:32.984826 27701 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:32.987385 27555 consensus_queue.cc:1059] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:32.987442 24319 raft_consensus.cc:1240] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:32.971431 27515 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:32.995159 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:32.997275 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.993578 27718 consensus_queue.cc:1048] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
W20260709 12:19:33.002100 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.982105 27646 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:33.005151 27575 consensus_meta.cc:287] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.649s	user 0.013s	sys 0.000s
W20260709 12:19:33.006362 27501 consensus_meta.cc:287] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.564s	user 0.002s	sys 0.010s
I20260709 12:19:32.985018 27635 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.006099 27595 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:33.012247 25115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35188 (request call id 1020) took 1567 ms. Trace:
I20260709 12:19:33.154112 24391 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:33.214339 24392 raft_consensus.cc:1240] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:33.157596 24473 raft_consensus.cc:2410] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:19:33.087007 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:33.215658 24316 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
W20260709 12:19:33.216202 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 108450us
I20260709 12:19:33.217005 24290 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:33.217635 24321 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:33.181773 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:33.218470 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 251532us
I20260709 12:19:33.219409 24440 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:33.212989 25115 rpcz_store.cc:276] 0709 12:19:31.444506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.445213 (+   707us) service_pool.cc:224] Handling call
0709 12:19:33.011955 (+1566742us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b5400709ed4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:33.012159 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1642108672}
I20260709 12:19:32.985847 27164 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:33.221972 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 600672us
I20260709 12:19:33.223464 24366 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:33.224819 24320 raft_consensus.cc:1275] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:33.085984 24322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 475) took 1572 ms. Trace:
I20260709 12:19:33.226046 24322 rpcz_store.cc:276] 0709 12:19:31.513829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.535972 (+ 22143us) service_pool.cc:224] Handling call
0709 12:19:31.536396 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:31.624281 (+ 87885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:31.624317 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:31.624373 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:31.624420 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:33.085626 (+1461206us) spinlock_profiling.cc:243] Waited 87.6 ms on lock 0x7b5400103954. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:33.085686 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:33.085906 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201411328}
I20260709 12:19:33.057473 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:33.099924 27733 log.cc:927] Time spent T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.426s	user 0.000s	sys 0.001s
I20260709 12:19:33.234768 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:33.227231 24317 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:33.228860 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:33.211419 27720 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:33.233314 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:33.233489 24290 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:33.237931 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:33.238502 24465 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:33.227067 27308 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:33.243413 24473 raft_consensus.cc:1275] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:19:33.240873 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:33.244931 25115 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:33.239817 24321 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
I20260709 12:19:33.005223 27612 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:33.245370 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.245959 24290 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:33.087253 27726 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.155660 27642 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:33.097015 27731 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:33.247928 24366 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:33.230131 27555 consensus_queue.cc:1243] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer c855242ec9d34a5397741ef20db9de8a log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 12:19:33.331627 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 83824.9us
I20260709 12:19:33.085319 27756 raft_consensus.cc:2749] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:33.317836 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:33.336185 25119 raft_consensus.cc:1240] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:33.188894 27565 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:33.320328 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:33.339637 24396 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:33.321148 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:33.139369 27524 consensus_queue.cc:1048] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.146s
I20260709 12:19:33.346529 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:33.096740 27721 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.247386 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:33.328759 24399 raft_consensus.cc:1240] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:33.329620 24398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 494) took 1238 ms. Trace:
I20260709 12:19:33.351831 24393 raft_consensus.cc:2393] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:33.340896 24467 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:33.349704 24398 rpcz_store.cc:276] 0709 12:19:32.090742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.090871 (+   129us) service_pool.cc:224] Handling call
0709 12:19:32.141310 (+ 50439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:32.141636 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:32.141674 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:32.143881 (+  2207us) log.cc:844] Serialized 26 byte log entry
0709 12:19:32.571483 (+427602us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:32.609731 (+ 38248us) log.cc:844] Serialized 14 byte log entry
0709 12:19:32.969751 (+360020us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b180036fac0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a941d9c0a 00007f4a9d919219 00007f4a94261a40 00007f4a9425c4e4 00007f4a9425c455 00007f4a97344060 00007f4a97356716 00007f4a97367287 00007f4a97367208
0709 12:19:33.253234 (+283483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:33.253341 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:33.253400 (+    59us) raft_consensus.cc:1685] finished
0709 12:19:33.329333 (+ 75933us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:33.329525 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":246343,"prepare.queue_time_us":36367,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":367941,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":4870,"spinlock_wait_cycles":4545408,"thread_start_us":704408,"threads_started":2,"wal-append.queue_time_us":514483}
I20260709 12:19:33.249627 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:33.355793 24474 raft_consensus.cc:2410] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:19:33.359575 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:33.342442 24465 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:33.363627 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:33.243266 27704 raft_consensus.cc:2804] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:33.361935 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:33.385941 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:33.385720 24393 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:33.371256 24320 raft_consensus.cc:1240] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:19:33.312590 27469 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:33.229020 27680 consensus_queue.cc:1048] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.117s
I20260709 12:19:33.227658 27701 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:33.317879 27600 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:33.222772 27575 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:33.387698 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:33.227473 27635 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:33.382269 24396 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:33.251246 27308 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:33.246847 27717 consensus_queue.cc:1048] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.113s
I20260709 12:19:33.364059 27721 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:33.223534 27501 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:33.387055 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 247373us
I20260709 12:19:33.389488 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:33.353852 27287 raft_consensus.cc:2749] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:33.231516 27646 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:19:33.416018 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:33.409901 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 181512us
I20260709 12:19:33.344929 27254 consensus_queue.cc:1059] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:19:33.411103 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:33.318435 27351 consensus_queue.cc:1059] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 12:19:33.402949 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:33.234293 27164 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:33.411105 24366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:33.423353 24366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.252368 27720 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:33.360365 27555 raft_consensus.cc:2804] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:33.411270 25114 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:33.363529 27587 consensus_queue.cc:1059] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:19:33.407467 27308 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:33.368870 27565 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:33.351071 27726 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:33.424140 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:33.425237 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:33.398128 27662 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:33.341315 27642 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:33.393848 27469 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:33.402830 27615 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.405714 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:33.430723 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:33.464376 24396 raft_consensus.cc:1275] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:19:33.344309 27731 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:33.470357 27731 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:33.471112 27731 consensus_queue.cc:1059] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:33.436446 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:33.473250 25118 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:33.238925 27734 consensus_queue.cc:1048] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.174s
I20260709 12:19:33.438090 24325 raft_consensus.cc:1275] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:19:33.448870 24320 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:33.400270 27704 raft_consensus.cc:697] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:33.479066 27704 consensus_queue.cc:237] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:33.480662 27734 consensus_queue.cc:1048] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:33.472354 27731 raft_consensus.cc:3055] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:33.484803 27731 raft_consensus.cc:740] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:33.486135 27731 consensus_queue.cc:260] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:33.489185 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:33.489921 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:33.489957 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 244039us
I20260709 12:19:33.491117 24398 raft_consensus.cc:2410] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:19:33.491369 24290 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:33.494635 24366 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:33.504350 24470 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:33.428681 27555 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:33.497437 24324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1815) took 1269 ms. Trace:
W20260709 12:19:33.499955 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 107976us
I20260709 12:19:33.429064 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:33.505981 24316 raft_consensus.cc:1240] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:33.453749 25110 raft_consensus.cc:1240] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:33.547969 24316 raft_consensus.cc:1240] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:33.506719 24317 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
W20260709 12:19:33.550783 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 56253.4us
I20260709 12:19:33.551435 25118 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:33.555898 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:33.507671 24469 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:33.507836 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:33.557998 24398 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:19:33.557090 25118 raft_consensus.cc:2393] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 9: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:33.563555 24289 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:33.546813 24324 rpcz_store.cc:276] 0709 12:19:32.228397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.228551 (+   154us) service_pool.cc:224] Handling call
0709 12:19:32.228957 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:32.249004 (+ 20047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:32.249050 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:32.257873 (+  8823us) log.cc:844] Serialized 26 byte log entry
0709 12:19:32.563591 (+305718us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:32.587813 (+ 24222us) log.cc:844] Serialized 14 byte log entry
0709 12:19:32.588150 (+   337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:32.588230 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:33.099182 (+510952us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:19:33.103790 (+  4608us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b18000cc2e0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9425f3f3 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd 0000000000388634 0000000000388479 00007f4a9424283a
0709 12:19:33.497187 (+393397us) raft_consensus.cc:1685] finished
0709 12:19:33.497211 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:33.497359 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26317,"prepare.queue_time_us":26993,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":60,"raft.queue_time_us":24525,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":22427,"spinlock_wait_cycles":17389056,"thread_start_us":271420,"threads_started":1,"wal-append.queue_time_us":345960}
I20260709 12:19:33.462606 27469 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:33.579669 24316 raft_consensus.cc:1240] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 9. Ops: []
I20260709 12:19:33.580202 24398 raft_consensus.cc:1240] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:33.584024 24470 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:33.525630 25111 raft_consensus.cc:1240] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:33.555459 27555 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:33.518985 27734 raft_consensus.cc:2749] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:33.578269 24366 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:33.586921 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:33.527864 27603 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:33.559582 27518 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:33.492245 27662 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:33.623730 27726 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:33.573331 25113 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:33.624578 27662 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:33.582487 27731 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:33.625988 27501 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:33.626699 27501 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:33.627079 27501 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:33.627462 27501 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:33.574206 27756 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:19:33.633143 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 55025.6us
I20260709 12:19:33.575183 27427 consensus_queue.cc:1048] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:19:33.523413 25114 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d"
dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
mode: GRACEFUL
new_leader_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:47070
I20260709 12:19:33.636701 25114 raft_consensus.cc:606] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Received request to transfer leadership to TS c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:33.587764 27587 consensus_queue.cc:1059] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:19:33.637639 27635 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:33.638587 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:33.639021 27646 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:33.577021 27705 consensus_queue.cc:1059] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:19:33.589960 27595 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:33.645740 27760 log.cc:927] Time spent T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 12:19:33.646552 27701 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:33.648185 27565 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:33.648974 25113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c"
dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
mode: GRACEFUL
new_leader_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:47070
I20260709 12:19:33.649639 25113 raft_consensus.cc:606] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Received request to transfer leadership to TS c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:33.650007 25113 raft_consensus.cc:614] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:19:33.651213 27759 log.cc:927] Time spent T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 12:19:33.653723 27711 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:33.654124 27587 raft_consensus.cc:3055] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:33.654253 27711 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:33.654616 27587 raft_consensus.cc:740] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:33.654726 27711 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:33.655620 27587 consensus_queue.cc:260] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:33.657435 27587 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:33.498189 27615 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:33.662833 27615 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:33.650974 27756 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:33.664732 27721 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:33.665154 27756 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:33.666488 27501 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:33.668525 27501 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:33.669059 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:33.669461 27575 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:33.630697 24473 raft_consensus.cc:2393] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:33.634289 24366 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:19:33.681413 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 47257.7us
W20260709 12:19:33.649984 27740 log.cc:927] Time spent T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.854s	user 0.001s	sys 0.002s
I20260709 12:19:33.681600 25115 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:33.691437 25119 raft_consensus.cc:1240] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7. Ops: [5.6-6.7]
W20260709 12:19:33.695590 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 274307us
I20260709 12:19:33.649983 27720 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:33.714001 27565 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.720412 27662 consensus_queue.cc:1059] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:19:33.721887 24366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.722659 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:33.685914 27732 consensus_meta.cc:287] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.611s	user 0.012s	sys 0.000s
I20260709 12:19:33.726611 24440 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:19:33.734653 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 317303us
I20260709 12:19:33.726517 25084 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:33.736279 25084 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:33.688791 27615 raft_consensus.cc:2804] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:33.745054 27778 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:33.745783 27778 raft_consensus.cc:697] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:33.746905 27778 consensus_queue.cc:237] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:33.752086 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:33.755218 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.729986 27427 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:33.739537 27732 raft_consensus.cc:2749] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 8. Current term is 9.
I20260709 12:19:33.690495 27758 consensus_queue.cc:1059] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
W20260709 12:19:33.758142 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.710850 26944 consensus_queue.cc:1059] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:19:33.750468 27678 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.739346 27720 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:33.760787 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:33.735054 27529 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:33.796375 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.760016 24290 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:33.744213 27573 raft_consensus.cc:2804] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:33.828811 26944 raft_consensus.cc:3055] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:33.829365 27573 raft_consensus.cc:697] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:33.830710 27573 consensus_queue.cc:237] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:33.768097 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 204647us
I20260709 12:19:33.768935 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:33.815689 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 55795.6us
I20260709 12:19:33.834553 24290 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:33.836393 27764 raft_consensus.cc:2749] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:33.836934 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:33.837949 24472 raft_consensus.cc:2410] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:19:33.829381 26944 raft_consensus.cc:740] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:33.839112 26944 consensus_queue.cc:260] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:33.734952 27565 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:33.841094 27287 consensus_queue.cc:1175] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c711faa13ead43ebbea0192cb74a4756" responder_term: 5 status { last_received { term: 3 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 4. Current term is 5. Ops: [4.6-4.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:19:33.844445 27694 raft_consensus.cc:3055] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:33.739923 27765 consensus_queue.cc:1059] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:19:33.844858 27694 raft_consensus.cc:740] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:33.845495 27720 raft_consensus.cc:697] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:33.845865 27694 consensus_queue.cc:260] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:33.846522 27720 consensus_queue.cc:237] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:33.752374 27615 raft_consensus.cc:697] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:33.848438 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:33.849125 24465 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:19:33.848783 27615 consensus_queue.cc:237] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:33.850071 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:33.763764 27427 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:33.778841 27774 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:33.757256 25112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "400165817fe74ada9a4793982993a5e3"
dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
mode: GRACEFUL
new_leader_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:47070
I20260709 12:19:33.850670 24465 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:33.839063 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:33.866900 25115 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:33.837908 24290 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:34.043511 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 205675us
I20260709 12:19:34.044463 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:34.045002 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:34.045774 24465 raft_consensus.cc:2393] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:33.776297 24393 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:33.987529 24472 raft_consensus.cc:2393] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:33.864117 27427 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:34.048094 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:34.041167 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 297947us
I20260709 12:19:34.075444 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:34.075635 24366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.076956 24473 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:34.070365 24290 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
W20260709 12:19:33.866101 27612 consensus_meta.cc:287] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.532s	user 0.005s	sys 0.005s
I20260709 12:19:34.081420 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:33.839078 27769 log.cc:927] Time spent T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:19:34.104996 24465 raft_consensus.cc:1240] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:19:33.861502 27308 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:33.857002 26944 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:33.852999 27704 raft_consensus.cc:2804] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:34.134087 24395 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
W20260709 12:19:34.140753 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.005843 27604 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.036185 27587 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.993840 27773 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:33.937249 27732 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.170897 25082 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:34.082046 27694 raft_consensus.cc:3060] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:34.128866 27575 raft_consensus.cc:2804] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:34.133008 27721 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.007628 27555 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:33.851591 27678 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:34.262161 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:34.284376 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:34.293284 24440 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.155.193:36951 timed out after 1.954s (SENT) [suppressed 22 similar messages]
I20260709 12:19:34.132797 27755 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:34.173226 27726 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:33.938345 27529 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:34.203547 25112 raft_consensus.cc:606] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 LEADER]: Received request to transfer leadership to TS c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:34.161154 27704 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.168953 27545 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.202744 27554 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:34.202636 27604 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:34.132382 27501 consensus_queue.cc:1059] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.190s
I20260709 12:19:33.865674 27774 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:34.340226 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 47002.9us
W20260709 12:19:34.340530 27469 consensus_meta.cc:287] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.727s	user 0.011s	sys 0.000s
I20260709 12:19:34.225857 27575 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.130909 27756 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:34.346052 27731 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.327176 27773 raft_consensus.cc:697] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:34.515532 24396 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:34.514168 27469 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:34.517449 26956 raft_consensus.cc:3055] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:34.518785 24318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 478) took 2988 ms. Trace:
I20260709 12:19:34.541174 24318 rpcz_store.cc:276] 0709 12:19:31.530043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.531297 (+  1254us) service_pool.cc:224] Handling call
0709 12:19:31.563102 (+ 31805us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:32.326566 (+763464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:34.518500 (+2191934us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b5400102a54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:34.518720 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1639972608}
I20260709 12:19:34.520113 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:34.544116 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:34.545033 24322 raft_consensus.cc:2410] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:19:34.207741 27732 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:34.382735 27726 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:34.202710 27587 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:34.424230 27704 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:34.559974 24324 raft_consensus.cc:1240] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:34.503216 27779 raft_consensus.cc:2749] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:34.515892 27575 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:34.345016 27721 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:34.499142 27545 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:34.552309 27565 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:34.552771 27732 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:34.541049 26956 raft_consensus.cc:740] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:19:34.554436 27776 log.cc:927] Time spent T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 12:19:34.555032 27726 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:34.572883 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:34.553303 27782 log.cc:927] Time spent T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
I20260709 12:19:34.523384 27256 consensus_queue.cc:1059] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:19:34.359853 27755 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:34.596968 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 717) took 1514 ms. Trace:
I20260709 12:19:34.536204 27756 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:34.537539 27731 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:34.649216 27773 consensus_queue.cc:237] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:34.650305 27731 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:34.651122 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.646898 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 1880) took 1413 ms. Trace:
W20260709 12:19:34.636065 27785 log.cc:927] Time spent T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:19:34.636868 27786 log.cc:927] Time spent T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:19:34.636667 27254 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:19:34.637349 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.588766 27565 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:34.641785 27792 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.643317 27587 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:34.643491 27774 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:34.644698 27555 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:34.645071 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 502) took 1286 ms. Trace:
I20260709 12:19:34.702167 25119 rpcz_store.cc:276] 0709 12:19:33.358950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.359525 (+   575us) service_pool.cc:224] Handling call
0709 12:19:33.691070 (+331545us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:33.711073 (+ 20003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:34.644864 (+933791us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b54007085d0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:34.645002 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":716942080}
I20260709 12:19:34.646948 26956 consensus_queue.cc:260] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:34.635152 27781 log.cc:927] Time spent T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:19:34.652323 24469 rpcz_store.cc:276] 0709 12:19:33.233589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.234547 (+   958us) service_pool.cc:224] Handling call
0709 12:19:34.646732 (+1412185us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b54002017d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:34.646835 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":625543936}
W20260709 12:19:34.622110 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 451326us
I20260709 12:19:34.664659 27677 consensus_queue.cc:260] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:34.666038 24391 raft_consensus.cc:1240] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:34.585736 27635 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.639835 24398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1977) took 1224 ms. Trace:
I20260709 12:19:34.715056 24398 rpcz_store.cc:276] 0709 12:19:33.415081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.583314 (+168233us) service_pool.cc:224] Handling call
0709 12:19:33.583748 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:33.584231 (+   483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:33.584263 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:33.584906 (+   643us) log.cc:844] Serialized 26 byte log entry
0709 12:19:34.043475 (+458569us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:34.043517 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:34.043596 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:34.639583 (+595987us) raft_consensus.cc:1685] finished
0709 12:19:34.639607 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:34.639766 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13459,"raft.queue_time_us":97,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":24104,"thread_start_us":176339,"threads_started":1,"wal-append.queue_time_us":620533}
W20260709 12:19:34.631798 27711 consensus_meta.cc:287] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.976s	user 0.012s	sys 0.001s
I20260709 12:19:34.685559 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1972) took 3205 ms. Trace:
I20260709 12:19:34.700436 24397 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:19:34.685099 27472 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:34.717432 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 1973) took 3230 ms. Trace:
I20260709 12:19:34.732038 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:34.719660 27796 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.731758 24471 rpcz_store.cc:276] 0709 12:19:31.487389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.609073 (+121684us) service_pool.cc:224] Handling call
0709 12:19:31.609488 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:31.609788 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:19:31.628116 (+ 18328us) log.cc:844] Serialized 14 byte log entry
0709 12:19:32.311530 (+683414us) spinlock_profiling.cc:243] Waited 8.51 ms on lock 0x7b180034c5a0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9425f3f3 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd 0000000000388634 0000000000388479 00007f4a9424283a
0709 12:19:32.903140 (+591610us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b180034c5a0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9422d2a6 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9c275aa1 00007f4a9c26cb37 00007f4a9c26c9ca 00007f4a9c36426f
0709 12:19:33.004543 (+101403us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b48001a01d8. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9c275aa1 00007f4a9c26cb37 00007f4a9c26c9ca 00007f4a9c36426f 00007f4a9c363f37 00007f4a9c37855c 00007f4a9c378508 00007f4a9c378488 00007f4a9c378443 00007f4a9c3776ec 00007f4a9b2a1a96
0709 12:19:34.074965 (+1070422us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b180034c5a0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a941d9c0a 00007f4a9d919219 00007f4a94261a40 00007f4a9425c4e4 00007f4a9425c455 00007f4a9ad443c7 00007f4a973569a7 00007f4a973660bf 00007f4a97366038
0709 12:19:34.075242 (+   277us) log.cc:844] Serialized 14 byte log entry
0709 12:19:34.716725 (+641483us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:34.716797 (+    72us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:34.716857 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:34.716935 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:34.717355 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1871601,"prepare.queue_time_us":2776751,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":98,"raft.queue_time_us":85446,"raft.run_cpu_time_us":28895,"raft.run_wall_time_us":1410337,"spinlock_wait_cycles":77223680,"thread_start_us":640918,"threads_started":2,"wal-append.queue_time_us":510003}
I20260709 12:19:34.755028 24398 raft_consensus.cc:2393] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:34.723294 24466 rpcz_store.cc:276] 0709 12:19:31.480324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.560171 (+ 79847us) service_pool.cc:224] Handling call
0709 12:19:31.597595 (+ 37424us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:31.607431 (+  9836us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:31.607481 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:31.608291 (+   810us) log.cc:844] Serialized 52 byte log entry
0709 12:19:31.790584 (+182293us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:34.395704 (+2605120us) log.cc:844] Serialized 14 byte log entry
0709 12:19:34.684908 (+289204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:34.685044 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:34.685091 (+    47us) raft_consensus.cc:1685] finished
0709 12:19:34.685102 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:34.685478 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2293979,"prepare.queue_time_us":2378929,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":10286,"raft.queue_time_us":15772,"raft.run_cpu_time_us":505,"raft.run_wall_time_us":39594,"thread_start_us":674788,"threads_started":3,"wal-append.queue_time_us":215622,"wal-append.run_cpu_time_us":4027,"wal-append.run_wall_time_us":1763590}
I20260709 12:19:34.756453 27744 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:34.756161 27472 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:34.723702 27282 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.756749 27604 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:34.757416 27780 log.cc:927] Time spent T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.886s	user 0.000s	sys 0.037s
I20260709 12:19:34.685189 27254 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:34.778205 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:34.756465 27678 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:34.786515 24398 raft_consensus.cc:2393] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 6: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:34.794173 24398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2422) took 1062 ms. Trace:
I20260709 12:19:34.794694 24398 rpcz_store.cc:276] 0709 12:19:33.731453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:34.777927 (+1046474us) service_pool.cc:224] Handling call
0709 12:19:34.794086 (+ 16159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:34.798074 24320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 1827) took 1425 ms. Trace:
I20260709 12:19:34.798717 24320 rpcz_store.cc:276] 0709 12:19:33.372839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.402683 (+ 29844us) service_pool.cc:224] Handling call
0709 12:19:34.797794 (+1395111us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b54002134d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:34.797984 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55815424}
I20260709 12:19:34.693475 27565 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:34.699141 27792 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:34.772677 27282 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:34.865993 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.803421 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:34.754858 27635 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:34.815423 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.875133 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:34.806013 27529 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:34.884533 27528 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:34.894995 25119 raft_consensus.cc:1240] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:34.800414 27604 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.895319 27528 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:34.896052 27604 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:34.897027 27778 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:34.897673 27778 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:34.898204 27528 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:34.898566 27604 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:34.888902 27808 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:34.898962 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:34.890040 24366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.902304 27808 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:34.903121 25111 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:34.892808 27677 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:34.907091 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:34.907351 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:34.830919 24320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1834) took 1132 ms. Trace:
I20260709 12:19:34.907850 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:34.882907 24398 raft_consensus.cc:2376] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7. Re-sending same reply.
I20260709 12:19:34.901158 27778 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:34.908989 25082 leader_election.cc:336] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.589s (SENT)
I20260709 12:19:34.909409 27778 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:34.900656 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:34.893388 27804 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:34.908389 24320 rpcz_store.cc:276] 0709 12:19:33.698263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:34.811255 (+1112992us) service_pool.cc:224] Handling call
0709 12:19:34.811720 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:34.830417 (+ 18697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:34.830463 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:34.830527 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:34.830593 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:34.830679 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:34.830831 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:34.911376 25119 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:34.912292 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:34.913830 27604 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:34.914372 27604 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:34.915519 24398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 1982) took 1079 ms. Trace:
I20260709 12:19:34.916046 24398 rpcz_store.cc:276] 0709 12:19:33.835716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:34.803063 (+967347us) service_pool.cc:224] Handling call
0709 12:19:34.915446 (+112383us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:34.917891 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:34.909427 25082 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:34.923799 24320 raft_consensus.cc:1275] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:19:34.931231 24320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1835) took 1232 ms. Trace:
I20260709 12:19:34.934244 24320 rpcz_store.cc:276] 0709 12:19:33.698663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:34.922966 (+1224303us) service_pool.cc:224] Handling call
0709 12:19:34.923400 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:34.930875 (+  7475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:34.931160 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:34.937933 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:34.939049 24471 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:34.952616 27809 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.754774 27711 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:34.955670 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:34.975170 24469 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:34.805135 27587 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.910015 27778 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:34.982765 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:34.828313 27519 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.987437 24467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1885) took 1429 ms. Trace:
I20260709 12:19:34.824776 27755 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:34.988005 24467 rpcz_store.cc:276] 0709 12:19:33.559492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.559771 (+   279us) service_pool.cc:224] Handling call
0709 12:19:33.585960 (+ 26189us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:33.586344 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:33.586375 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:33.613236 (+ 26861us) log.cc:844] Serialized 26 byte log entry
0709 12:19:33.739991 (+126755us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:33.740045 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:33.740142 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:34.647442 (+907300us) spinlock_profiling.cc:243] Waited 7.42 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:19:34.953212 (+305770us) raft_consensus.cc:1685] finished
0709 12:19:34.953236 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:34.987337 (+ 34101us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":99,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":24393,"spinlock_wait_cycles":17073920,"thread_start_us":89629,"threads_started":1,"wal-append.queue_time_us":130413}
I20260709 12:19:34.926702 26956 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:34.953725 27718 raft_consensus.cc:3055] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:34.977006 27615 consensus_queue.cc:1059] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:19:34.969441 27809 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:35.018683 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:34.979424 27721 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:35.022060 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 113097us
I20260709 12:19:35.028999 27803 raft_consensus.cc:2749] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:35.001577 27718 raft_consensus.cc:740] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:35.008448 27809 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:35.040952 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:34.992726 27587 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:35.012470 27808 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:34.997398 27519 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:35.036019 27756 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:35.048688 27565 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:35.075644 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:34.776966 27796 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:35.082564 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 195109us
I20260709 12:19:35.053907 27778 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:35.053609 27809 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:35.090129 24290 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:35.090941 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:35.091482 24320 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:35.071712 27808 raft_consensus.cc:3055] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:35.093297 24290 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:35.094303 24290 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:35.109499 24395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 1969) took 1786 ms. Trace:
I20260709 12:19:35.110144 24395 rpcz_store.cc:276] 0709 12:19:33.322962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.437033 (+114071us) service_pool.cc:224] Handling call
0709 12:19:35.109303 (+1672270us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b54002a5154. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:35.109433 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1481203968}
I20260709 12:19:35.089888 27792 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:35.089530 27254 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:35.098811 27808 raft_consensus.cc:740] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:35.101331 27555 raft_consensus.cc:2804] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:35.092916 27721 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:35.144917 24466 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:35.119558 24320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1836) took 1408 ms. Trace:
I20260709 12:19:35.104475 27774 raft_consensus.cc:2804] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:35.017839 27804 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:35.102660 27797 raft_consensus.cc:2804] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:19:35.122224 27694 consensus_meta.cc:287] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.909s	user 0.006s	sys 0.007s
I20260709 12:19:35.149331 24320 rpcz_store.cc:276] 0709 12:19:33.711284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:35.100121 (+1388837us) service_pool.cc:224] Handling call
0709 12:19:35.118820 (+ 18699us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:35.119071 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:35.119111 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:35.119189 (+    78us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:35.119238 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:35.119318 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:35.119473 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:35.156924 27805 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.157771 27805 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:35.131237 26944 consensus_meta.cc:287] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.963s	user 0.012s	sys 0.002s
I20260709 12:19:35.163372 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:35.163553 27704 consensus_meta.cc:287] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.607s	user 0.011s	sys 0.003s
W20260709 12:19:35.166610 24395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 1985) took 1330 ms (client timeout 1714 ms). Trace:
W20260709 12:19:35.171979 24395 rpcz_store.cc:269] 0709 12:19:33.836541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:35.129285 (+1292744us) service_pool.cc:224] Handling call
0709 12:19:35.166525 (+ 37240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:35.099714 27809 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:35.168323 24393 raft_consensus.cc:2410] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:19:35.168453 27814 log.cc:927] Time spent T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:19:35.084883 27718 consensus_queue.cc:260] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:35.177297 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:35.181313 24471 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:35.134662 27555 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.179593 24398 raft_consensus.cc:2410] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:19:35.186115 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:35.151760 27774 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:35.153959 27797 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.154517 27721 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:35.168517 27753 consensus_queue.cc:260] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:35.335177 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 431260us
W20260709 12:19:35.433359 24438 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.018s	sys 0.085s
W20260709 12:19:35.751510 24438 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.019s	sys 0.123s
W20260709 12:19:35.701833 25082 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.005s	sys 0.009s
W20260709 12:19:35.752925 25082 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.006s	sys 0.009s
I20260709 12:19:35.199175 24320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 487) took 1127 ms. Trace:
W20260709 12:19:35.753633 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 728870us
I20260709 12:19:35.753767 24320 rpcz_store.cc:276] 0709 12:19:34.071773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:35.160193 (+1088420us) service_pool.cc:224] Handling call
0709 12:19:35.198454 (+ 38261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:35.198720 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:35.198757 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:35.198813 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:35.198868 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:35.198940 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:35.199095 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:35.474010 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:35.327672 24440 leader_election.cc:336] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Timed out: RequestConsensusVote RPC to 127.22.155.193:36951 timed out after 1.665s (SENT)
I20260709 12:19:35.187275 24466 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:35.417227 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:35.754591 25082 leader_election.cc:336] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.813s (SENT)
I20260709 12:19:35.845495 25082 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:35.845695 24395 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:36.146569 24400 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 1986) took 2309 ms (client timeout 1743 ms). Trace:
W20260709 12:19:36.147270 24400 rpcz_store.cc:269] 0709 12:19:33.836848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.145864 (+2309016us) service_pool.cc:211] Skipping call since client already timed out
0709 12:19:36.146129 (+   265us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:19:36.129989 24323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2234) took 4064 ms (client timeout 1905 ms). Trace:
W20260709 12:19:36.148846 24323 rpcz_store.cc:269] 0709 12:19:32.065201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.066010 (+   809us) service_pool.cc:224] Handling call
0709 12:19:36.128779 (+4062769us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b540030b454. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:36.129483 (+   704us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1671923072}
W20260709 12:19:35.601347 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 471175us
W20260709 12:19:35.595518 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:36.159075 24321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 1824) took 2799 ms (client timeout 2129 ms). Trace:
W20260709 12:19:36.159845 24321 rpcz_store.cc:269] 0709 12:19:33.359126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.359291 (+   165us) service_pool.cc:224] Handling call
0709 12:19:36.158476 (+2799185us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b540025b2d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:36.158792 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":856728832}
I20260709 12:19:36.137876 24324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1831) took 2744 ms. Trace:
I20260709 12:19:36.162906 24324 rpcz_store.cc:276] 0709 12:19:33.393228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.565994 (+172766us) service_pool.cc:224] Handling call
0709 12:19:33.566459 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:34.560458 (+993999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.136866 (+1576408us) spinlock_profiling.cc:243] Waited 993 ms on lock 0x7b5400338954. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:36.137464 (+   598us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2284372864}
I20260709 12:19:36.165678 24324 raft_consensus.cc:1240] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:36.166734 24324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1839) took 1316 ms. Trace:
I20260709 12:19:36.167407 24319 raft_consensus.cc:1275] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:19:36.161546 24325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 482) took 3160 ms. Trace:
I20260709 12:19:36.168272 24319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 492) took 1277 ms. Trace:
I20260709 12:19:36.179356 24319 rpcz_store.cc:276] 0709 12:19:34.891227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.165755 (+1274528us) service_pool.cc:224] Handling call
0709 12:19:36.166468 (+   713us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:36.167962 (+  1494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.168203 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:36.181620 24316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 494) took 1185 ms. Trace:
I20260709 12:19:36.186525 24316 rpcz_store.cc:276] 0709 12:19:34.996382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.179838 (+1183456us) service_pool.cc:224] Handling call
0709 12:19:36.180360 (+   522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:36.180909 (+   549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:36.180965 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:36.181063 (+    98us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:36.181108 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.181196 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:36.181359 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:36.161073 24400 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 1989) took 2112 ms (client timeout 1555 ms). Trace:
W20260709 12:19:36.192834 24400 rpcz_store.cc:269] 0709 12:19:34.048248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.160816 (+2112568us) service_pool.cc:211] Skipping call since client already timed out
0709 12:19:36.160968 (+   152us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:19:36.193749 24473 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 1886) took 2443 ms (client timeout 1505 ms). Trace:
W20260709 12:19:36.194316 24400 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 505) took 2504 ms (client timeout 1924 ms). Trace:
W20260709 12:19:36.195377 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 440604us
W20260709 12:19:36.195292 24400 rpcz_store.cc:269] 0709 12:19:33.689379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.193987 (+2504608us) service_pool.cc:211] Skipping call since client already timed out
0709 12:19:36.194221 (+   234us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:19:36.041019 26956 consensus_meta.cc:287] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.035s	user 0.009s	sys 0.006s
W20260709 12:19:36.170001 24397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2412) took 3237 ms (client timeout 1793 ms). Trace:
I20260709 12:19:36.171576 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:36.178126 24396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 497) took 2492 ms (client timeout 1626 ms). Trace:
W20260709 12:19:36.281965 24396 rpcz_store.cc:269] 0709 12:19:33.685425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:34.081085 (+395660us) service_pool.cc:224] Handling call
0709 12:19:36.177595 (+2096510us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b54000ce754. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:36.177845 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":987986688}
W20260709 12:19:36.183735 24393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 503) took 2494 ms (client timeout 1589 ms). Trace:
I20260709 12:19:36.185954 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1957) took 2871 ms. Trace:
I20260709 12:19:36.167189 24324 rpcz_store.cc:276] 0709 12:19:34.850229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.164397 (+1314168us) service_pool.cc:224] Handling call
0709 12:19:36.165173 (+   776us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:36.166361 (+  1188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.166632 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:36.188774 24398 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 504) took 2499 ms (client timeout 1813 ms). Trace:
W20260709 12:19:35.902607 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:35.844270 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 516623us
I20260709 12:19:35.859678 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:36.283422 24391 rpcz_store.cc:276] 0709 12:19:33.313892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.314021 (+   129us) service_pool.cc:224] Handling call
0709 12:19:33.314296 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:34.714581 (+1400285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.185200 (+1470619us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400207bd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:36.185681 (+   481us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3108131072}
W20260709 12:19:36.322535 24391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 1984) took 2486 ms (client timeout 1930 ms). Trace:
W20260709 12:19:36.323097 24391 rpcz_store.cc:269] 0709 12:19:33.836280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.322244 (+2485964us) service_pool.cc:211] Skipping call since client already timed out
0709 12:19:36.322435 (+   191us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:19:35.846575 24465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.009s	sys 0.010s
W20260709 12:19:36.326287 24465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.304s	user 0.010s	sys 0.011s
I20260709 12:19:36.328045 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1897) took 1354 ms. Trace:
I20260709 12:19:36.329058 24317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1830) took 2939 ms. Trace:
I20260709 12:19:36.169941 24318 raft_consensus.cc:1240] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:36.332274 24318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 490) took 1632 ms. Trace:
I20260709 12:19:36.332711 24318 rpcz_store.cc:276] 0709 12:19:34.699706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.147683 (+1447977us) service_pool.cc:224] Handling call
0709 12:19:36.148597 (+   914us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:36.331906 (+183309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.332171 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:36.168394 24325 rpcz_store.cc:276] 0709 12:19:33.000810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.000995 (+   185us) service_pool.cc:224] Handling call
0709 12:19:33.002767 (+  1772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:33.478066 (+475299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.161017 (+2682951us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b54000d34d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:36.161369 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":975530240}
I20260709 12:19:35.187072 27555 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:35.173297 27604 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:36.336262 27604 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.337057 27604 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:35.497478 27575 consensus_meta.cc:287] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.910s	user 0.007s	sys 0.007s
I20260709 12:19:36.341694 27575 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:19:35.660382 27587 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:35.599020 27677 consensus_meta.cc:287] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.694s	user 0.005s	sys 0.006s
I20260709 12:19:35.184909 27704 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:35.186522 27635 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:36.354914 27794 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.356846 27711 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:36.045471 27721 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:35.890528 27753 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:36.359028 27575 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:35.591679 27764 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:35.750614 27774 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:36.361984 24290 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:35.695632 27796 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:36.364403 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.355790 27794 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:36.364995 27796 raft_consensus.cc:2804] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:36.365628 25112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47070 (request call id 5) took 2615 ms. Trace:
I20260709 12:19:36.365803 27796 raft_consensus.cc:697] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:36.366115 27289 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.366211 25112 rpcz_store.cc:276] 0709 12:19:33.741294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.743083 (+  1789us) service_pool.cc:224] Handling call
0709 12:19:36.356155 (+2613072us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b540075e754. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a97346853 00007f4a9c31460a 00007f4a9589a7d4 00007f4a9589a762 00007f4a9589a691 00007f4a9589a60c 00007f4a958998c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:36.356343 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":481988992}
I20260709 12:19:36.366978 27289 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:35.761971 27797 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:35.859587 27809 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:36.367944 27794 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:35.595873 27803 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.759850 27804 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:35.271624 27808 consensus_queue.cc:260] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:35.194809 27810 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.399521 27282 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:36.030711 27811 log.cc:927] Time spent T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.347s	user 0.000s	sys 0.001s
W20260709 12:19:35.353037 27812 log.cc:927] Time spent T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:19:35.946992 27817 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.402133 27817 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:36.031349 27815 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.405468 27815 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:36.328482 24465 rpcz_store.cc:276] 0709 12:19:34.973294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:34.973517 (+   223us) service_pool.cc:224] Handling call
0709 12:19:34.973974 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:34.974257 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:35.021866 (+ 47609us) log.cc:844] Serialized 14 byte log entry
0709 12:19:36.327264 (+1305398us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:36.327397 (+   133us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:36.327543 (+   146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.327677 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:36.327938 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47241,"prepare.queue_time_us":48129,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":188,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":305,"spinlock_wait_cycles":790912,"thread_start_us":1304681,"threads_started":1,"wal-append.queue_time_us":999184}
I20260709 12:19:36.083151 27827 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:36.415890 25115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35194 (request call id 509) took 2716 ms (client timeout 1569 ms). Trace:
I20260709 12:19:36.415695 27827 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:36.085841 27828 raft_consensus.cc:2749] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:19:36.242193 24400 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 1990) took 2150 ms (client timeout 1585 ms). Trace:
W20260709 12:19:36.439023 24400 rpcz_store.cc:269] 0709 12:19:34.048549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.196475 (+2147926us) service_pool.cc:211] Skipping call since client already timed out
0709 12:19:36.198868 (+  2393us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:19:36.247493 27832 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.251798 24395 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
I20260709 12:19:36.262482 27424 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:36.088240 27727 consensus_queue.cc:1059] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.176s
I20260709 12:19:36.271661 27825 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.272874 24291 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:36.274122 27663 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:36.194494 24473 rpcz_store.cc:269] 0709 12:19:33.749755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.750210 (+   455us) service_pool.cc:224] Handling call
0709 12:19:36.192955 (+2442745us) spinlock_profiling.cc:243] Waited 88.5 ms on lock 0x7b5400244354. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:36.193306 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203595648}
W20260709 12:19:36.283278 24393 rpcz_store.cc:269] 0709 12:19:33.688721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:34.075115 (+386394us) service_pool.cc:224] Handling call
0709 12:19:36.183081 (+2107966us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54001e96d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:36.183446 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2510371072}
W20260709 12:19:36.290400 24470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 1878) took 3057 ms (client timeout 1586 ms). Trace:
W20260709 12:19:36.446476 24470 rpcz_store.cc:269] 0709 12:19:33.232986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.233088 (+   102us) service_pool.cc:224] Handling call
0709 12:19:36.287245 (+3054157us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54001432d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:36.290101 (+  2856us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":616849280}
W20260709 12:19:36.447054 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 90048.9us
W20260709 12:19:36.281193 24397 rpcz_store.cc:269] 0709 12:19:32.932420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.941425 (+  9005us) service_pool.cc:224] Handling call
0709 12:19:36.169440 (+3228015us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b54001b8d54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:36.169745 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4043062016}
W20260709 12:19:36.290856 24438 connection.cc:256] RPC call timeout handler was delayed by -1.5280584140000428s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
I20260709 12:19:36.292101 27336 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:36.448302 24438 connection.cc:256] RPC call timeout handler was delayed by -1.4808797230000437s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
W20260709 12:19:36.448884 24438 connection.cc:256] RPC call timeout handler was delayed by -1.440496463000045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
I20260709 12:19:36.449204 27825 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:36.296945 24366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.007s	sys 0.011s
I20260709 12:19:36.298549 24289 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:36.301493 24396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 498) took 2615 ms (client timeout 2064 ms). Trace:
W20260709 12:19:36.448690 24397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 502) took 2760 ms (client timeout 2254 ms). Trace:
W20260709 12:19:36.305404 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 108758us
W20260709 12:19:36.451313 24397 rpcz_store.cc:269] 0709 12:19:33.688448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.448405 (+2759957us) service_pool.cc:211] Skipping call since client already timed out
0709 12:19:36.448580 (+   175us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:19:36.309702 27666 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:36.451066 24396 rpcz_store.cc:269] 0709 12:19:33.685691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.301211 (+2615520us) service_pool.cc:211] Skipping call since client already timed out
0709 12:19:36.301387 (+   176us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:19:36.452860 24395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 499) took 2766 ms (client timeout 1881 ms). Trace:
W20260709 12:19:36.284138 24398 rpcz_store.cc:269] 0709 12:19:33.689013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:34.917585 (+1228572us) service_pool.cc:224] Handling call
0709 12:19:36.188028 (+1270443us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b54001a7554. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:36.188484 (+   456us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":571706240}
I20260709 12:19:36.307819 27763 consensus_queue.cc:1059] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:19:36.450484 24366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.007s	sys 0.012s
I20260709 12:19:36.257527 27831 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:36.330610 24322 raft_consensus.cc:1275] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:19:36.169075 24323 raft_consensus.cc:1275] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:19:36.453933 24400 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2420) took 2759 ms (client timeout 2153 ms). Trace:
W20260709 12:19:36.455857 24400 rpcz_store.cc:269] 0709 12:19:33.687702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.443826 (+2756124us) service_pool.cc:211] Skipping call since client already timed out
0709 12:19:36.446735 (+  2909us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:19:36.324388 24391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 1988) took 2276 ms (client timeout 1772 ms). Trace:
W20260709 12:19:36.457029 24391 rpcz_store.cc:269] 0709 12:19:34.047890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.324112 (+2276222us) service_pool.cc:211] Skipping call since client already timed out
0709 12:19:36.324296 (+   184us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:19:36.361316 27164 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:36.372926 27803 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:36.361357 27764 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:34.630158 24468 rpcz_store.cc:276] 0709 12:19:33.083201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.083414 (+   213us) service_pool.cc:224] Handling call
0709 12:19:33.094089 (+ 10675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:33.094303 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:19:34.356310 (+1262007us) log.cc:844] Serialized 14 byte log entry
0709 12:19:34.589865 (+233555us) log.cc:844] Serialized 14 byte log entry
0709 12:19:34.590062 (+   197us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:34.596492 (+  6430us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:34.596565 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:34.596681 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:34.596869 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1075290,"prepare.queue_time_us":1341534,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":95,"raft.queue_time_us":29007,"thread_start_us":377964,"threads_started":2}
I20260709 12:19:36.386863 27703 raft_consensus.cc:3055] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:36.388653 27289 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:36.388162 27796 consensus_queue.cc:237] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:36.395084 27642 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:36.396574 27600 raft_consensus.cc:3055] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:36.397392 25112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915"
dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
mode: GRACEFUL
new_leader_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:47070
I20260709 12:19:36.400279 27808 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:36.411151 24290 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
W20260709 12:19:36.416597 25115 rpcz_store.cc:269] 0709 12:19:33.699158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.722197 (+ 23039us) service_pool.cc:224] Handling call
0709 12:19:36.415324 (+2693127us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54007d0354. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:36.415545 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":307056000}
I20260709 12:19:36.345219 24317 rpcz_store.cc:276] 0709 12:19:33.389405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.551592 (+162187us) service_pool.cc:224] Handling call
0709 12:19:33.552049 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:33.552321 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:19:33.694940 (+142619us) log.cc:844] Serialized 14 byte log entry
0709 12:19:36.143085 (+2448145us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b18000ad260. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a96ef44bc 00007f4a9424248b 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425ec02 00007f4a96ee620b 00007f4a96eebd23 00007f4a96eec23a
0709 12:19:36.304934 (+161849us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b18000ad260. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9425f3f3 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd 0000000000388634 0000000000388479 00007f4a9424283a
0709 12:19:36.310566 (+  5632us) log.cc:844] Serialized 14 byte log entry
0709 12:19:36.318040 (+  7474us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:36.328272 (+ 10232us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:36.328418 (+   146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.328551 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:36.328832 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16447,"prepare.queue_time_us":366156,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":95,"raft.queue_time_us":99209,"raft.run_cpu_time_us":481,"raft.run_wall_time_us":12902,"spinlock_wait_cycles":65983744,"thread_start_us":315021,"threads_started":3,"wal-append.queue_time_us":50844}
I20260709 12:19:36.411762 27704 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:36.408447 27815 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:36.400336 27810 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:36.449849 25084 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:36.309885 27472 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:36.320397 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:36.453366 24395 rpcz_store.cc:269] 0709 12:19:33.685968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:35.292774 (+1606806us) service_pool.cc:224] Handling call
0709 12:19:36.446414 (+1153640us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:35.731727 27561 raft_consensus.cc:3055] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:36.502426 27561 raft_consensus.cc:740] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:36.464459 24323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 491) took 1756 ms. Trace:
I20260709 12:19:36.455204 24322 pending_rounds.cc:85] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756: Aborting all ops after (but not including) 3
I20260709 12:19:36.503474 24322 pending_rounds.cc:107] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:19:36.504086 24322 raft_consensus.cc:2889] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:36.503965 27561 consensus_queue.cc:260] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:36.505759 27561 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:36.506112 27828 raft_consensus.cc:3055] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:36.506656 27828 raft_consensus.cc:740] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
W20260709 12:19:36.488384 25082 leader_election.cc:336] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.924s (SENT)
W20260709 12:19:36.512835 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 149572us
I20260709 12:19:36.513137 25082 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:36.515738 24290 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:36.517025 27717 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:19:36.466424 24397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2421) took 2735 ms (client timeout 2220 ms). Trace:
W20260709 12:19:36.468127 24396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 507) took 2494 ms (client timeout 2098 ms). Trace:
W20260709 12:19:36.469600 24400 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 1987) took 2422 ms (client timeout 2103 ms). Trace:
W20260709 12:19:36.465965 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 705785us
I20260709 12:19:36.474465 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:36.477202 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 179008us
I20260709 12:19:36.478967 27528 raft_consensus.cc:2749] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:36.480690 27289 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.462494 27604 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:36.479861 27663 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:36.485865 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:36.465749 27703 raft_consensus.cc:740] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:36.467779 27817 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:36.469405 27600 raft_consensus.cc:740] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:36.492267 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:36.492583 27254 raft_consensus.cc:2749] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:19:36.494427 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 316047us
I20260709 12:19:36.490080 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:36.499768 27803 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:36.503273 24323 rpcz_store.cc:276] 0709 12:19:34.701925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.150653 (+1448728us) service_pool.cc:224] Handling call
0709 12:19:36.168470 (+ 17817us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:36.455425 (+286955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.458281 (+  2856us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:36.533092 27703 consensus_queue.cc:260] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:36.535820 24366 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:36.536307 27703 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:36.519192 24396 rpcz_store.cc:269] 0709 12:19:33.973990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.465218 (+2491228us) service_pool.cc:211] Skipping call since client already timed out
0709 12:19:36.468054 (+  2836us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:19:36.519385 24400 rpcz_store.cc:269] 0709 12:19:34.047104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.463823 (+2416719us) service_pool.cc:211] Skipping call since client already timed out
0709 12:19:36.469525 (+  5702us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:19:36.518445 24397 rpcz_store.cc:269] 0709 12:19:33.727410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.455852 (+2728442us) service_pool.cc:211] Skipping call since client already timed out
0709 12:19:36.462795 (+  6943us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:19:36.486479 27666 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
W20260709 12:19:36.524792 24391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 1991) took 2447 ms (client timeout 2423 ms). Trace:
W20260709 12:19:36.529450 24393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2425) took 1821 ms (client timeout 1962 ms). Trace:
W20260709 12:19:36.540405 24391 rpcz_store.cc:269] 0709 12:19:34.075925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.464419 (+2388494us) service_pool.cc:224] Handling call
0709 12:19:36.522740 (+ 58321us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:36.532128 27744 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:36.537364 27704 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:19:36.539445 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 89809us
W20260709 12:19:36.540489 24393 rpcz_store.cc:269] 0709 12:19:34.707598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.477999 (+1770401us) service_pool.cc:224] Handling call
0709 12:19:36.529392 (+ 51393us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:36.508203 27828 consensus_queue.cc:260] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:36.544198 24398 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2418) took 2930 ms (client timeout 3105 ms). Trace:
W20260709 12:19:36.544704 24398 rpcz_store.cc:269] 0709 12:19:33.610052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.465045 (+2854993us) service_pool.cc:224] Handling call
0709 12:19:36.540223 (+ 75178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:36.519843 27831 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:36.546516 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:36.528311 27529 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:36.547748 24366 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:36.553966 27545 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:36.528879 27827 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:36.551080 24289 leader_election.cc:336] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 12:19:36.547389 24468 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:19:36.550415 27744 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:36.544265 27704 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:36.565256 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:36.566800 24395 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:19:36.566927 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:36.566689 27289 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:36.587483 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.587945 25117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 503) took 3160 ms. Trace:
I20260709 12:19:36.588719 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:36.589641 27529 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:36.568099 24395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2423) took 1866 ms (client timeout 2042 ms). Trace:
W20260709 12:19:36.597779 24395 rpcz_store.cc:269] 0709 12:19:34.701426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.488941 (+1787515us) service_pool.cc:224] Handling call
0709 12:19:36.568034 (+ 79093us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:36.516952 27832 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:36.592800 27790 raft_consensus.cc:2804] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:36.594682 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:36.569072 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:36.618852 24396 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:36.619516 24396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2424) took 1912 ms. Trace:
I20260709 12:19:36.619885 24396 rpcz_store.cc:276] 0709 12:19:34.707264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.543321 (+1836057us) service_pool.cc:224] Handling call
0709 12:19:36.619442 (+ 76121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11648}
I20260709 12:19:36.602169 24467 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:36.602552 27828 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:36.604502 27837 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:36.605099 27792 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:36.605710 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:36.602568 25116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 504) took 3221 ms. Trace:
W20260709 12:19:36.614425 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 80111.5us
I20260709 12:19:36.606388 27825 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:36.611114 25113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48252 (request call id 488) took 2937 ms. Trace:
I20260709 12:19:36.611480 27289 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:36.612495 24465 raft_consensus.cc:1275] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:36.613258 24366 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:36.595395 25117 rpcz_store.cc:276] 0709 12:19:33.365217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.365412 (+   195us) service_pool.cc:224] Handling call
0709 12:19:33.367601 (+  2189us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:33.385408 (+ 17807us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:19:33.620015 (+234607us) log.cc:844] Serialized 14 byte log entry
0709 12:19:33.737456 (+117441us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:33.744295 (+  6839us) log.cc:844] Serialized 52 byte log entry
0709 12:19:33.744466 (+   171us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:33.762494 (+ 18028us) log.cc:844] Serialized 14 byte log entry
0709 12:19:36.362821 (+2600327us) spinlock_profiling.cc:243] Waited 7.88 ms on lock 0x7b1800305620. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9425f3f3 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd 0000000000388634 0000000000388479 00007f4a9424283a
0709 12:19:36.404613 (+ 41792us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b1800305620. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a941d9c0a 00007f4a9d919219 00007f4a94261a40 00007f4a9425c4e4 00007f4a9425c455 00007f4a9ad443c7 00007f4a973569a7 00007f4a973660bf 00007f4a97366038
0709 12:19:36.405082 (+   469us) log.cc:844] Serialized 14 byte log entry
0709 12:19:36.490067 (+ 84985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.520333 (+ 30266us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:36.522944 (+  2611us) raft_consensus.cc:1685] finished
0709 12:19:36.522954 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:36.525318 (+  2364us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2602968,"prepare.queue_time_us":2691686,"prepare.run_cpu_time_us":155,"prepare.run_wall_time_us":156,"raft.queue_time_us":99045,"raft.run_cpu_time_us":776,"raft.run_wall_time_us":9445,"spinlock_wait_cycles":284516096,"thread_start_us":351920,"threads_started":3,"wal-append.queue_time_us":749765,"wal-append.run_cpu_time_us":5703,"wal-append.run_wall_time_us":1694644}
I20260709 12:19:36.616235 27717 consensus_queue.cc:1048] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:19:36.623003 27469 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:36.569350 27704 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:36.623978 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.564395 27663 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:36.623936 27287 raft_consensus.cc:2804] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:36.635874 24397 raft_consensus.cc:2393] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:36.600595 27777 raft_consensus.cc:2804] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:19:36.629931 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 71163.5us
I20260709 12:19:36.637930 27287 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.641371 27287 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:36.629011 27837 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.617942 27790 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:36.646077 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:36.646916 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.629182 25116 rpcz_store.cc:276] 0709 12:19:33.381515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.382025 (+   510us) service_pool.cc:224] Handling call
0709 12:19:33.382576 (+   551us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:19:34.702541 (+1319965us) spinlock_profiling.cc:243] Waited 5.5 ms on lock 0x7b1800149500. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a96ef44bc 00007f4a9424248b 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425c455 00007f4a97344060 00007f4a97344bfb 00007f4a9734f64b
0709 12:19:34.702690 (+   149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:34.702714 (+    24us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:19:34.713486 (+ 10772us) log.cc:844] Serialized 78 byte log entry
0709 12:19:34.893205 (+179719us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:36.491736 (+1598531us) log.cc:844] Serialized 14 byte log entry
0709 12:19:36.567445 (+ 75709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.597840 (+ 30395us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:36.597929 (+    89us) raft_consensus.cc:1685] finished
0709 12:19:36.598011 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:36.602369 (+  4358us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1541299,"prepare.queue_time_us":1519921,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":105,"raft.queue_time_us":145941,"raft.run_cpu_time_us":405,"raft.run_wall_time_us":28592,"spinlock_wait_cycles":12653824,"thread_start_us":344159,"threads_started":3,"wal-append.queue_time_us":319814}
I20260709 12:19:36.651245 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:36.626422 27831 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:36.638144 27777 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.661974 27777 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:36.662477 24393 raft_consensus.cc:1275] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:19:36.676745 27792 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:36.676769 27774 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:36.682163 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:36.683329 25111 raft_consensus.cc:2393] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 7: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:36.683544 27774 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:36.683578 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:36.686601 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:36.684520 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:36.688722 25112 raft_consensus.cc:606] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Received request to transfer leadership to TS c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:36.689195 25112 raft_consensus.cc:614] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:36.690107 24291 leader_election.cc:400] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8.
I20260709 12:19:36.690435 24291 leader_election.cc:403] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:19:36.691695 27718 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:36.657805 27837 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:36.695847 24396 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:36.698534 24397 raft_consensus.cc:1240] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
W20260709 12:19:36.693138 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 80086.9us
I20260709 12:19:36.686623 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:36.660133 27790 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:36.694443 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1978) took 3210 ms. Trace:
I20260709 12:19:36.697732 27773 raft_consensus.cc:2749] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8.
I20260709 12:19:36.650375 27797 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:36.695660 24400 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:19:36.701838 24393 rpcz_store.cc:276] 0709 12:19:33.456580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.633664 (+3177084us) service_pool.cc:224] Handling call
0709 12:19:36.662127 (+ 28463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:36.662915 (+   788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.666714 (+  3799us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:36.703393 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 57701.5us
I20260709 12:19:36.705178 25115 raft_consensus.cc:1275] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:19:36.706344 27754 log.cc:927] Time spent T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928: Append to log took a long time: real 3.499s	user 0.029s	sys 0.054s
I20260709 12:19:36.707074 25115 raft_consensus.cc:1275] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:19:36.708949 24397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 496) took 3016 ms. Trace:
I20260709 12:19:36.709527 24397 rpcz_store.cc:276] 0709 12:19:33.685131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.688229 (+3003098us) service_pool.cc:224] Handling call
0709 12:19:36.693471 (+  5242us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:36.700695 (+  7224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.700939 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:36.700698 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:36.711654 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.666036 27764 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:36.718295 24395 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:36.711236 27803 consensus_queue.cc:1048] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:19:36.715032 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:19:36.716893 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 44838.9us
W20260709 12:19:36.720189 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.724030 25115 raft_consensus.cc:1240] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:36.729766 27732 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:19:36.730217 24438 connection.cc:256] RPC call timeout handler was delayed by -1.275804780000044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23690000000000003s for a response
W20260709 12:19:36.730670 24438 connection.cc:256] RPC call timeout handler was delayed by -1.2659042100001443s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2663s for a response
I20260709 12:19:36.730599 27732 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:36.732666 27666 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:19:36.732862 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:36.733381 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:36.734202 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:36.735037 24470 raft_consensus.cc:2393] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 7: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:36.633440 25113 rpcz_store.cc:276] 0709 12:19:33.673810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.675095 (+  1285us) service_pool.cc:224] Handling call
0709 12:19:33.690818 (+ 15723us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:33.737821 (+ 47003us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:19:33.777458 (+ 39637us) log.cc:844] Serialized 14 byte log entry
0709 12:19:36.407544 (+2630086us) log.cc:844] Serialized 14 byte log entry
0709 12:19:36.529964 (+122420us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:36.530066 (+   102us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:36.558776 (+ 28710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.597164 (+ 38388us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:36.610826 (+ 13662us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5163587,"prepare.queue_time_us":2606518,"prepare.run_cpu_time_us":144,"prepare.run_wall_time_us":138,"raft.queue_time_us":21269,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":8591,"thread_start_us":81279,"threads_started":1,"wal-append.queue_time_us":150361}
I20260709 12:19:36.737232 27797 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:36.731146 24438 connection.cc:256] RPC call timeout handler was delayed by -1.2014140930000394s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
W20260709 12:19:36.738461 24438 connection.cc:256] RPC call timeout handler was delayed by -1.0318020600000182s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
I20260709 12:19:36.738965 24465 raft_consensus.cc:1275] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:36.761679 25114 raft_consensus.cc:2393] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:36.824921 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:36.703063 27825 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:36.720600 27831 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:36.848948 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:36.853663 24396 raft_consensus.cc:1275] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:19:36.856441 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.859468 24397 raft_consensus.cc:1275] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:19:36.860231 24397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 500) took 3172 ms. Trace:
I20260709 12:19:36.860749 25117 raft_consensus.cc:1275] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:36.861637 27555 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:36.857360 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:36.864199 27555 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:36.859308 27753 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:36.859174 27825 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:36.860575 24397 rpcz_store.cc:276] 0709 12:19:33.687907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.723170 (+3035263us) service_pool.cc:224] Handling call
0709 12:19:36.854841 (+131671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:36.859968 (+  5127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.860166 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:36.858057 24396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 506) took 3164 ms. Trace:
I20260709 12:19:36.840126 27831 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:36.854571 27336 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.890731 24469 raft_consensus.cc:1240] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:36.889747 24396 rpcz_store.cc:276] 0709 12:19:33.689618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.720696 (+3031078us) service_pool.cc:224] Handling call
0709 12:19:36.847929 (+127233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:36.854108 (+  6179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.854317 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:36.880072 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:36.897213 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 71335.1us
I20260709 12:19:36.874655 24395 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6.
I20260709 12:19:36.892211 27831 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:36.857303 27832 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:36.911819 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 53934.4us
I20260709 12:19:36.909001 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:36.914309 25115 raft_consensus.cc:1275] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:19:36.916029 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:36.891947 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:36.912714 24465 raft_consensus.cc:2376] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7. Re-sending same reply.
W20260709 12:19:36.918715 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:36.918458 24291 connection.cc:256] RPC call timeout handler was delayed by -3.0188856699999178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
W20260709 12:19:36.920594 24291 connection.cc:256] RPC call timeout handler was delayed by -2.944185669999797s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
W20260709 12:19:36.921115 24291 connection.cc:256] RPC call timeout handler was delayed by -2.9252856699997665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
W20260709 12:19:36.921423 24291 connection.cc:256] RPC call timeout handler was delayed by -2.88568566999993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
W20260709 12:19:36.921711 24291 connection.cc:256] RPC call timeout handler was delayed by -2.7857856699997683s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17620000000000002s for a response
W20260709 12:19:36.922094 24291 connection.cc:256] RPC call timeout handler was delayed by -2.7767856699997537s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
W20260709 12:19:36.922446 24291 connection.cc:256] RPC call timeout handler was delayed by -2.7551856699997188s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
W20260709 12:19:36.922711 24291 connection.cc:256] RPC call timeout handler was delayed by -2.7308856699999069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18230000000000002s for a response
W20260709 12:19:36.922981 24291 connection.cc:256] RPC call timeout handler was delayed by -2.5544856699998491s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20190000000000002s for a response
W20260709 12:19:36.923239 24291 connection.cc:256] RPC call timeout handler was delayed by -2.4635856699999295s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21200000000000002s for a response
W20260709 12:19:36.923519 24291 connection.cc:256] RPC call timeout handler was delayed by -2.1134856699998181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2509s for a response
I20260709 12:19:36.923599 24397 raft_consensus.cc:1275] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:19:36.925246 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:36.926012 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:36.918130 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:36.841223 27600 consensus_queue.cc:260] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:36.918130 24399 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:19:36.919027 24438 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:36.924831 24397 pending_rounds.cc:85] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a: Aborting all ops after (but not including) 4
I20260709 12:19:36.933887 24473 raft_consensus.cc:1240] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9. Ops: []
W20260709 12:19:36.934383 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.936682 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:36.937112 24397 pending_rounds.cc:107] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:19:36.899430 27336 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:36.939532 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.939101 24397 raft_consensus.cc:2889] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:36.931950 24396 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:36.921649 27555 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.946080 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:36.946761 24465 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:19:36.942281 24468 raft_consensus.cc:2468] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:36.953372 24320 raft_consensus.cc:1240] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:19:36.957731 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:36.958015 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:36.958840 27554 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.931178 27796 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:36.966681 24395 raft_consensus.cc:1275] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:19:36.967082 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:36.967485 24395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1992) took 2888 ms. Trace:
I20260709 12:19:36.967780 24395 rpcz_store.cc:276] 0709 12:19:34.079016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.917894 (+2838878us) service_pool.cc:224] Handling call
0709 12:19:36.955181 (+ 37287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:36.967210 (+ 12029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.967429 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:36.969048 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:36.920030 27753 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:36.939147 27732 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:36.973086 25115 raft_consensus.cc:2393] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 7: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
W20260709 12:19:36.974447 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.971781 24466 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:36.976763 25116 raft_consensus.cc:2393] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEARNER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:36.980091 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:36.980793 24468 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:36.983220 24317 raft_consensus.cc:2393] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 9: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:36.978143 24396 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
W20260709 12:19:36.972131 27424 consensus_meta.cc:287] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.004s
I20260709 12:19:36.993297 24397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1981) took 3149 ms. Trace:
I20260709 12:19:36.993716 24397 rpcz_store.cc:276] 0709 12:19:33.835374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.893536 (+3058162us) service_pool.cc:224] Handling call
0709 12:19:36.907346 (+ 13810us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:36.984248 (+ 76902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.984460 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:36.995174 24325 raft_consensus.cc:1240] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 5. Current term is 6. Ops: []
W20260709 12:19:36.998978 27845 log.cc:927] Time spent T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
W20260709 12:19:37.000174 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 126076us
I20260709 12:19:37.002247 27753 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:37.002976 27753 consensus_queue.cc:1048] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:37.003345 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:37.005084 27753 consensus_queue.cc:1048] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:37.007275 27600 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:37.009125 24470 raft_consensus.cc:1240] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:36.976568 27827 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.010571 27827 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:37.017011 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:36.969476 27554 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:36.982728 27832 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:37.020537 27832 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.020967 27832 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:37.021941 27554 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:37.025988 27336 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:37.029409 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:37.031569 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:37.032049 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:37.032867 24469 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:19:37.032979 24472 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:37.033897 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:37.034447 24320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 488) took 2957 ms. Trace:
I20260709 12:19:37.035310 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:37.036007 24474 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:37.035055 24320 rpcz_store.cc:276] 0709 12:19:34.076911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.136994 (+2060083us) service_pool.cc:224] Handling call
0709 12:19:36.157859 (+ 20865us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:36.956298 (+798439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:37.034101 (+ 77803us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b54000d52d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:37.034332 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1625345408}
I20260709 12:19:37.034546 24469 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:19:37.037921 27792 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:37.040143 27529 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:37.041301 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:37.042014 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.043133 24471 raft_consensus.cc:1275] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:19:36.991881 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:37.056986 24473 raft_consensus.cc:2410] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:19:37.063535 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:37.074494 25118 raft_consensus.cc:2468] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:37.087545 24467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 1899) took 1917 ms. Trace:
I20260709 12:19:37.088049 24467 rpcz_store.cc:276] 0709 12:19:35.169736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:35.169884 (+   148us) service_pool.cc:224] Handling call
0709 12:19:37.032413 (+1862529us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b540029ed54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:37.087425 (+ 55012us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":558633728}
W20260709 12:19:37.088759 24399 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 1963) took 3767 ms (client timeout 2103 ms). Trace:
I20260709 12:19:37.048751 27519 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:37.104900 24322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1833) took 3414 ms. Trace:
W20260709 12:19:37.097123 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 113023us
I20260709 12:19:37.090469 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:37.089347 24399 rpcz_store.cc:269] 0709 12:19:33.321457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.424780 (+103323us) service_pool.cc:224] Handling call
0709 12:19:37.088435 (+3663655us) spinlock_profiling.cc:243] Waited 3.39 s on lock 0x7b54001b8854. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:37.088617 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7791336576}
I20260709 12:19:37.105456 24322 rpcz_store.cc:276] 0709 12:19:33.690652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:34.625361 (+934709us) service_pool.cc:224] Handling call
0709 12:19:34.635113 (+  9752us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:36.505001 (+1869888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.984566 (+479565us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b540001de54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:37.104816 (+120250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3897232256}
I20260709 12:19:37.122788 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:37.133162 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:37.133419 24397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1994) took 2309 ms. Trace:
I20260709 12:19:37.133869 24391 raft_consensus.cc:2376] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8. Re-sending same reply.
I20260709 12:19:37.133776 24397 rpcz_store.cc:276] 0709 12:19:34.824515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.102340 (+2277825us) service_pool.cc:224] Handling call
0709 12:19:37.132795 (+ 30455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:37.133039 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:37.133065 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:37.133125 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:37.133179 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:37.133234 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:37.133363 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:37.134872 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:37.134938 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:37.128641 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:37.143381 24394 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:37.144261 27788 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.152514 24469 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:19:37.154454 24472 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:37.050683 27810 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:37.150067 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:37.159868 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.163133 24438 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:37.165688 24474 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
W20260709 12:19:37.170356 24289 leader_election.cc:336] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 12:19:37.149432 24366 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:37.175212 27277 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:37.176973 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:37.177894 24396 raft_consensus.cc:2410] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:19:37.054659 27555 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:37.169772 24470 raft_consensus.cc:2376] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5. Re-sending same reply.
W20260709 12:19:37.188484 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 59712.9us
I20260709 12:19:37.188898 24400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1993) took 3030 ms. Trace:
I20260709 12:19:37.189420 24400 rpcz_store.cc:276] 0709 12:19:34.158689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.062202 (+2903513us) service_pool.cc:224] Handling call
0709 12:19:37.149055 (+ 86853us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:37.165145 (+ 16090us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:37.165184 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:37.179635 (+ 14451us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:37.188584 (+  8949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:37.188694 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:37.188833 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:37.199602 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 110048us
I20260709 12:19:37.205747 24468 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:37.207849 24471 raft_consensus.cc:2393] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 8: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
W20260709 12:19:37.188066 24394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2398) took 4938 ms (client timeout 1556 ms). Trace:
I20260709 12:19:37.209501 24391 raft_consensus.cc:2393] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 9: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
W20260709 12:19:37.208534 24394 rpcz_store.cc:269] 0709 12:19:32.250083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.250736 (+   653us) service_pool.cc:224] Handling call
0709 12:19:37.187764 (+4937028us) spinlock_profiling.cc:243] Waited 4.8 s on lock 0x7b5400208ad4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:37.187953 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11029306240}
I20260709 12:19:37.217690 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:37.185562 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:37.144780 27788 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:37.225024 24400 raft_consensus.cc:1275] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:19:37.218468 24470 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:37.227960 24317 raft_consensus.cc:1275] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:19:37.227691 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:37.228909 24320 raft_consensus.cc:2393] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:37.229769 27308 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:37.198601 27732 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:37.242892 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:37.202185 27825 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:37.179752 27796 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:37.253778 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 116326us
I20260709 12:19:37.254794 24289 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:37.237277 27732 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:37.257128 27732 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:37.257658 24438 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:37.258173 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:37.259753 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:37.260010 27805 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:37.260232 24470 raft_consensus.cc:1240] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:37.260464 24473 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:37.260788 27805 raft_consensus.cc:2749] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:37.261806 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:37.262696 27827 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:37.250980 24290 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
W20260709 12:19:37.239508 27704 consensus_meta.cc:287] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.589s	user 0.016s	sys 0.009s
I20260709 12:19:37.274367 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:37.227787 27801 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:19:37.276966 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 52147.3us
I20260709 12:19:37.277083 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:37.278649 27774 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:37.279129 27774 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.279178 24290 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:37.279608 27774 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:37.280160 25116 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:19:37.280982 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:37.281069 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:37.281901 24317 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:37.282418 24469 raft_consensus.cc:1240] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:37.283027 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:37.283577 24440 leader_election.cc:336] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Timed out: RequestConsensusVote RPC to 127.22.155.193:36951 timed out after 1.556s (SENT)
I20260709 12:19:37.284081 24440 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:37.284415 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:37.285022 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:37.285894 24325 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 7: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:37.281903 24319 raft_consensus.cc:2393] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 8: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:19:37.245071 27287 consensus_meta.cc:287] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.603s	user 0.008s	sys 0.018s
I20260709 12:19:37.285280 24316 raft_consensus.cc:2393] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 8: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
W20260709 12:19:37.291965 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.242476 27424 raft_consensus.cc:2804] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:37.275924 27801 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:37.304373 24290 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:37.304503 24467 raft_consensus.cc:1275] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:19:37.307201 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:37.316620 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:37.317571 24470 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:19:37.316377 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:37.318841 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:37.261737 27501 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:37.322635 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:37.325232 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:37.325618 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:37.327185 24474 raft_consensus.cc:2410] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:19:37.334679 24323 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:37.334681 24472 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:19:37.343463 24469 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:37.343885 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:37.347872 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:37.348479 27555 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:37.350111 27744 consensus_meta.cc:287] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.757s	user 0.008s	sys 0.006s
I20260709 12:19:37.350606 27744 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:37.351214 24321 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:19:37.317451 27554 consensus_queue.cc:1059] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:19:37.303653 27287 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:37.325419 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:37.356829 24473 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:37.362936 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:37.302922 27825 raft_consensus.cc:2749] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:37.363298 24322 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:37.366230 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:37.364228 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 60665.2us
I20260709 12:19:37.308437 27424 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.365159 24399 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
W20260709 12:19:37.376151 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 92695.3us
I20260709 12:19:37.380878 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:37.365965 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:37.384369 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:37.380935 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:37.386284 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:37.387287 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:37.387940 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.347224 27664 consensus_queue.cc:1048] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 12:19:37.301702 27704 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:37.390050 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:37.402283 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.404747 24470 raft_consensus.cc:2410] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:19:37.306980 27575 consensus_queue.cc:1048] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 12:19:37.412978 24395 raft_consensus.cc:2368] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 6. Current term is 7.
I20260709 12:19:37.415002 24469 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:37.381827 27424 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:37.424131 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:37.426308 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 159842us
I20260709 12:19:37.422783 24472 raft_consensus.cc:2393] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:37.430836 24316 raft_consensus.cc:2410] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:19:37.408180 27808 raft_consensus.cc:3055] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:37.434265 27808 raft_consensus.cc:740] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:37.435107 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:37.436048 24319 raft_consensus.cc:2393] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:19:37.424885 24440 leader_election.cc:336] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Timed out: RequestConsensusVote RPC to 127.22.155.193:36951 timed out after 1.905s (SENT)
I20260709 12:19:37.437721 24474 raft_consensus.cc:2410] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:19:37.441073 24470 raft_consensus.cc:1240] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:19:37.380606 27773 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:37.356200 27727 consensus_queue.cc:1048] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.106s
W20260709 12:19:37.446300 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.419134 27555 raft_consensus.cc:2804] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:37.342767 27519 consensus_queue.cc:1048] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 12:19:37.469020 24320 raft_consensus.cc:1275] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:19:37.472177 24474 raft_consensus.cc:1240] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:37.464459 24467 raft_consensus.cc:1240] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:37.465073 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:37.449806 24469 raft_consensus.cc:1240] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:37.463951 24289 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:37.480600 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:37.429625 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:37.397562 27831 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:37.491888 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:37.495581 24321 raft_consensus.cc:2393] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 9: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:37.496476 24392 raft_consensus.cc:1275] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:19:37.499022 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.447765 27808 consensus_queue.cc:260] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:37.501062 27773 raft_consensus.cc:697] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:37.501941 27287 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:37.502838 27501 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:37.502384 27773 consensus_queue.cc:237] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:37.504858 24438 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:37.511559 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:37.517498 24469 raft_consensus.cc:1275] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:19:37.517838 25112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47070 (request call id 6) took 1121 ms. Trace:
I20260709 12:19:37.518358 25112 rpcz_store.cc:276] 0709 12:19:36.396841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.397115 (+   274us) service_pool.cc:224] Handling call
0709 12:19:37.517587 (+1120472us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54006bc1d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a97346853 00007f4a9c31460a 00007f4a9589a7d4 00007f4a9589a762 00007f4a9589a691 00007f4a9589a60c 00007f4a958998c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:37.517745 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":413260032}
I20260709 12:19:37.518782 27469 consensus_queue.cc:1048] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:37.521153 24472 raft_consensus.cc:1275] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:19:37.521520 24472 pending_rounds.cc:85] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 6
I20260709 12:19:37.521747 24472 pending_rounds.cc:107] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:19:37.522114 24472 raft_consensus.cc:2889] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:37.473343 27555 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:37.470048 27744 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:37.529953 24393 raft_consensus.cc:1240] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:37.503353 27501 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:37.535884 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 72704.8us
I20260709 12:19:37.536434 24323 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6.
I20260709 12:19:37.536871 24474 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
W20260709 12:19:37.541703 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 129259us
I20260709 12:19:37.548243 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:37.549590 24474 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
W20260709 12:19:37.527401 27600 consensus_meta.cc:287] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.519s	user 0.014s	sys 0.000s
I20260709 12:19:37.553004 25113 raft_consensus.cc:2410] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:37.553414 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:37.555282 27847 log.cc:927] Time spent T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.203s	user 0.002s	sys 0.000s
I20260709 12:19:37.559247 24365 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:37.560823 27810 raft_consensus.cc:2749] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:37.561262 27796 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:37.552132 27777 consensus_meta.cc:287] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.889s	user 0.007s	sys 0.013s
I20260709 12:19:37.531577 27555 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:37.575416 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:37.578770 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:37.537523 27501 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:37.572474 24289 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:37.582190 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:37.583031 24472 raft_consensus.cc:2393] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:37.583374 24438 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:37.586680 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:37.593878 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 49154us
I20260709 12:19:37.575837 27825 raft_consensus.cc:2804] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:37.596670 27825 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.597143 27825 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:37.596872 27810 consensus_queue.cc:1059] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:37.598048 27810 raft_consensus.cc:3055] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:37.598450 27810 raft_consensus.cc:740] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:37.598812 24440 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:37.599449 27810 consensus_queue.cc:260] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:37.601091 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 53817.4us
I20260709 12:19:37.601944 24438 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:37.602660 27805 consensus_queue.cc:1048] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:37.602911 27803 consensus_queue.cc:1059] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:37.604007 27803 raft_consensus.cc:3055] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:37.604408 27744 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:37.576311 27777 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:37.604346 27803 raft_consensus.cc:740] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:37.605973 27803 consensus_queue.cc:260] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:37.606647 27777 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:37.609133 27427 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.607188 25111 raft_consensus.cc:2393] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 7: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:37.609658 27427 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:37.610793 27718 consensus_meta.cc:287] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.918s	user 0.011s	sys 0.009s
I20260709 12:19:37.611714 27731 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.612514 27731 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:37.613891 24322 raft_consensus.cc:2410] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:19:37.611655 27810 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:37.609125 27803 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:37.616948 27788 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:37.618852 25083 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:37.619665 25110 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:37.619944 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:37.620607 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:37.620991 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:37.621289 25110 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 491) took 2714 ms (client timeout 2000 ms). Trace:
W20260709 12:19:37.621678 25110 rpcz_store.cc:269] 0709 12:19:34.906970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:34.907087 (+   117us) service_pool.cc:224] Handling call
0709 12:19:37.621055 (+2713968us) spinlock_profiling.cc:243] Waited 2.71 s on lock 0x7b5400501c54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:37.621220 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6235880192}
W20260709 12:19:37.622393 27828 consensus_meta.cc:287] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.998s	user 0.009s	sys 0.009s
I20260709 12:19:37.622707 27827 consensus_queue.cc:1048] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:37.623250 27779 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:37.623656 27779 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.623508 27732 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:37.624058 27779 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:37.626747 27837 consensus_meta.cc:287] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.909s	user 0.015s	sys 0.002s
I20260709 12:19:37.628144 24473 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:37.624531 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:37.620622 24321 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:19:37.604305 27805 raft_consensus.cc:2804] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:37.618904 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:37.583173 27832 consensus_meta.cc:287] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.560s	user 0.022s	sys 0.002s
W20260709 12:19:37.641992 24465 consensus_meta.cc:287] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.678s	user 0.005s	sys 0.009s
I20260709 12:19:37.637104 24325 raft_consensus.cc:2368] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 7. Current term is 8.
I20260709 12:19:37.618073 27777 consensus_queue.cc:1059] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:37.640457 27308 raft_consensus.cc:2804] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:37.627535 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:37.642659 24465 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:37.627218 27837 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:37.643460 27831 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:37.644141 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:37.680609 27427 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:37.682837 27837 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:37.683532 27575 consensus_queue.cc:1048] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:37.685367 24398 raft_consensus.cc:1240] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:19:37.644714 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:37.686661 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1999) took 1149 ms. Trace:
I20260709 12:19:37.604914 27744 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.646574 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:37.686525 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:37.637136 24474 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:37.649806 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:37.638762 27805 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.687107 24393 rpcz_store.cc:276] 0709 12:19:36.500096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.997039 (+496943us) service_pool.cc:224] Handling call
0709 12:19:36.997355 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:37.530835 (+533480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:37.649332 (+118497us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b540027ea54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:37.649500 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1224391936}
I20260709 12:19:37.714795 24320 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:37.715867 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:37.638139 27796 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:19:37.645748 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 349695us
I20260709 12:19:37.731735 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:37.765169 25116 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:37.725910 25117 raft_consensus.cc:1275] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:19:37.650344 27790 consensus_meta.cc:287] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.933s	user 0.016s	sys 0.002s
I20260709 12:19:37.772595 24323 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:37.652307 27308 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:37.779820 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:37.784607 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.785051 24325 raft_consensus.cc:2393] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:37.783573 24317 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
W20260709 12:19:37.784018 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:37.787606 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 139021us
I20260709 12:19:37.788431 24365 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:37.789776 24365 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:37.793186 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 78541.5us
I20260709 12:19:37.725425 27744 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:37.792320 24365 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:37.761180 27805 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:37.776072 27796 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.803313 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:37.771693 27704 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:37.646258 27718 consensus_queue.cc:1048] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.126s
I20260709 12:19:37.802618 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:37.809247 25118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "daeed7cb347a434082488f5c5807424b"
dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
mode: GRACEFUL
new_leader_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:47070
I20260709 12:19:37.810331 25116 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 3.
I20260709 12:19:37.793401 27308 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:37.815097 27600 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:37.815402 27825 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:37.762840 27837 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:37.815107 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:37.649060 27832 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:37.821921 25118 raft_consensus.cc:606] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Received request to transfer leadership to TS c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:37.810665 27287 raft_consensus.cc:2749] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:19:37.843750 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.793160 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:37.818028 24397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2000) took 1317 ms. Trace:
I20260709 12:19:37.829404 27600 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.804194 27831 raft_consensus.cc:2749] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:37.835225 24366 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:37.832960 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:37.784350 27790 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:37.813297 27796 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:37.839987 27837 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:37.837061 27727 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.806357 27801 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:37.862834 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 264073us
I20260709 12:19:37.850800 24471 raft_consensus.cc:2393] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 6: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:37.835850 25110 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
W20260709 12:19:37.833606 27774 consensus_meta.cc:287] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.553s	user 0.000s	sys 0.012s
I20260709 12:19:37.851543 24325 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:37.850781 27600 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:37.855068 24467 raft_consensus.cc:1240] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:19:37.860000 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:37.871974 24366 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:37.872222 24321 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:37.841091 27788 consensus_queue.cc:1048] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:37.847710 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:37.822422 25119 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:37.874856 24323 raft_consensus.cc:2376] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6. Re-sending same reply.
I20260709 12:19:37.846303 24397 rpcz_store.cc:276] 0709 12:19:36.500427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.190759 (+690332us) service_pool.cc:224] Handling call
0709 12:19:37.213350 (+ 22591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:37.233866 (+ 20516us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:37.531394 (+297528us) log.cc:844] Serialized 14 byte log entry
0709 12:19:37.817532 (+286138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:37.817607 (+    75us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:37.817684 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:37.817783 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:37.817951 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":374335,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":92,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":8162,"thread_start_us":417586,"threads_started":2}
I20260709 12:19:37.865515 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:37.854779 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:37.876240 24317 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:19:37.873603 24324 raft_consensus.cc:2393] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:37.877219 24290 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:37.879669 24320 raft_consensus.cc:2393] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 8: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:37.879932 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:37.876438 24366 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:19:37.885381 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 283522us
I20260709 12:19:37.889081 24317 raft_consensus.cc:2393] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 8: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:37.879674 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:37.878116 27831 raft_consensus.cc:2804] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:19:37.908844 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.875597 27732 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:37.878762 27287 raft_consensus.cc:2749] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:37.918139 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:37.915721 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:37.873391 27774 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:37.902030 27575 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:37.867630 27727 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:37.931824 24320 raft_consensus.cc:2393] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 8: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:37.939651 24290 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:37.935611 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:37.959410 24317 raft_consensus.cc:2393] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:37.898530 27554 raft_consensus.cc:2804] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:37.880194 27519 consensus_queue.cc:1048] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:19:37.975562 27575 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.976245 27575 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:37.977819 27727 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:37.982511 27774 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:37.975687 27554 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.983768 27554 raft_consensus.cc:3060] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:37.930807 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:38.033741 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:19:38.023551 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 84002.1us
W20260709 12:19:38.041200 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 212756us
I20260709 12:19:38.035627 27555 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:37.916613 27831 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:38.043080 24365 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:38.039197 24290 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:38.044539 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.049178 24320 raft_consensus.cc:2393] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 9: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:38.043865 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1956) took 4698 ms. Trace:
I20260709 12:19:38.054531 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.055363 24320 raft_consensus.cc:2393] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:38.036901 27774 raft_consensus.cc:2804] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:38.050411 24392 rpcz_store.cc:276] 0709 12:19:33.312805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.313135 (+   330us) service_pool.cc:224] Handling call
0709 12:19:37.224514 (+3911379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:37.496915 (+272401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:37.935802 (+438887us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b5400208ad4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:37.962356 (+ 26554us) spinlock_profiling.cc:243] Waited 3.87 s on lock 0x7b5400208ad0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:38.010889 (+ 48533us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8993047168}
I20260709 12:19:38.058211 24365 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:38.058593 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:37.921284 27773 consensus_queue.cc:1048] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.124s
I20260709 12:19:38.057389 24290 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:38.063349 24319 raft_consensus.cc:2393] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 7: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:38.067178 24290 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:38.068704 27857 log.cc:927] Time spent T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:19:38.048034 27831 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:38.074216 24365 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:38.078955 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:38.062549 27718 raft_consensus.cc:2804] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:38.078011 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.085176 24365 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:38.087417 27727 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:38.087900 27727 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:38.088268 27727 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:38.088821 27256 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:38.063266 27287 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:38.096858 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.097621 24321 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 4.
I20260709 12:19:38.098606 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.099833 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.100623 24323 raft_consensus.cc:2393] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 7: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:38.100826 27837 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:38.101430 24469 raft_consensus.cc:1275] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:19:38.101570 27837 raft_consensus.cc:2804] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:38.102144 27837 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:38.102569 27837 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:38.102672 27790 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:38.092465 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.072154 27774 raft_consensus.cc:697] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:38.108672 24365 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:38.109457 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:38.081336 27519 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:38.110139 24465 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:38.059973 27779 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:38.114274 27424 consensus_meta.cc:287] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.657s	user 0.008s	sys 0.006s
I20260709 12:19:38.084208 27825 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:38.095674 27718 raft_consensus.cc:697] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 6 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:38.091557 27832 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:38.095408 27287 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:38.117108 24469 raft_consensus.cc:1275] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:38.116369 24365 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:38.103924 27704 raft_consensus.cc:2804] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:38.129252 27704 raft_consensus.cc:697] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:38.130402 27704 consensus_queue.cc:237] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:38.131286 24398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 1980) took 4646 ms. Trace:
I20260709 12:19:38.131804 24398 rpcz_store.cc:276] 0709 12:19:33.484466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.658549 (+3174083us) service_pool.cc:224] Handling call
0709 12:19:36.668152 (+  9603us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:37.685766 (+1017614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:38.130952 (+445186us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54001e9bd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:38.131181 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2338779392}
W20260709 12:19:38.132934 27849 log.cc:927] Time spent T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 12:19:38.134936 25114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48252 (request call id 494) took 1286 ms. Trace:
I20260709 12:19:38.135320 25114 rpcz_store.cc:276] 0709 12:19:36.848159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.848318 (+   159us) service_pool.cc:224] Handling call
0709 12:19:37.009415 (+161097us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b5800004598. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227eee 000000000036eb39 00007f4a9c29b1e0 00007f4a9c3640c4 00007f4a9c364131 00007f4a9c325fc0 00007f4a9c310929 00007f4a9c3103d2 00007f4a95887bd4
0709 12:19:37.009946 (+   531us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:37.011206 (+  1260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:37.011265 (+    59us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:37.031208 (+ 19943us) log.cc:844] Serialized 52 byte log entry
0709 12:19:37.308291 (+277083us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:37.308337 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:37.308403 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:38.134571 (+826168us) raft_consensus.cc:1685] finished
0709 12:19:38.134597 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:38.134844 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13166,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"spinlock_wait_cycles":5711616,"thread_start_us":143954,"threads_started":1,"wal-append.queue_time_us":602620}
W20260709 12:19:38.137607 25119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35188 (request call id 1024) took 1458 ms (client timeout 1586 ms). Trace:
W20260709 12:19:38.138101 25119 rpcz_store.cc:269] 0709 12:19:36.679260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.714570 (+ 35310us) service_pool.cc:224] Handling call
0709 12:19:38.137383 (+1422813us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b540044e8d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:38.137515 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2088234752}
I20260709 12:19:38.059353 27852 consensus_queue.cc:1059] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.217s
I20260709 12:19:38.112682 27519 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:38.118368 24474 raft_consensus.cc:1275] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:19:38.120715 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.143314 24320 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:19:38.143730 24323 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
W20260709 12:19:38.120098 24440 leader_election.cc:336] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Timed out: RequestConsensusVote RPC to 127.22.155.193:36951 timed out after 1.556s (SENT)
I20260709 12:19:38.125106 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:38.145223 24440 leader_election.cc:336] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Timed out: RequestConsensusVote RPC to 127.22.155.193:36951 timed out after 1.655s (SENT)
I20260709 12:19:38.119876 27858 raft_consensus.cc:2749] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:38.156123 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.164399 24325 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:38.139590 27287 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:38.173990 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 106850us
I20260709 12:19:38.175662 24290 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:38.151335 27519 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:38.181471 24290 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
W20260709 12:19:38.157132 27501 consensus_meta.cc:287] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.559s	user 0.011s	sys 0.003s
W20260709 12:19:38.187520 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 71233.6us
I20260709 12:19:38.187534 24317 raft_consensus.cc:2368] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 6. Current term is 7.
I20260709 12:19:38.189921 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.192997 24290 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:38.186316 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:38.207413 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:38.208560 24469 raft_consensus.cc:2393] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 6: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
W20260709 12:19:38.196797 27803 consensus_meta.cc:287] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.581s	user 0.013s	sys 0.000s
I20260709 12:19:38.191732 27773 raft_consensus.cc:2804] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:38.214711 27718 consensus_queue.cc:237] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:38.218607 25111 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35188 (request call id 1029) took 1537 ms (client timeout 1762 ms). Trace:
W20260709 12:19:38.219177 25111 rpcz_store.cc:269] 0709 12:19:36.681285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.684166 (+  2881us) service_pool.cc:224] Handling call
0709 12:19:38.218350 (+1534184us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b540065d1d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:38.218542 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2113080192}
I20260709 12:19:38.221601 27779 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:38.220450 25115 raft_consensus.cc:1240] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:38.226733 27555 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:38.226454 27744 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:38.227411 27555 consensus_queue.cc:1048] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:38.227708 24470 raft_consensus.cc:1240] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:19:38.228859 27555 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:38.212990 27774 consensus_queue.cc:237] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:38.229243 27555 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:38.229692 27427 raft_consensus.cc:3055] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:38.230237 27427 raft_consensus.cc:740] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:38.231451 27858 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:38.231986 27858 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:38.232489 27858 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:38.234855 27773 raft_consensus.cc:697] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:38.199309 27501 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:38.211724 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.218652 27859 raft_consensus.cc:2804] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:38.141654 27424 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:38.150887 27575 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:38.231194 27427 consensus_queue.cc:260] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:38.243745 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:38.245083 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:38.260794 27859 raft_consensus.cc:697] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:38.261126 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:38.261814 24392 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:19:38.261946 27859 consensus_queue.cc:237] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:38.262907 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 1990) took 1006 ms. Trace:
I20260709 12:19:38.263240 27790 raft_consensus.cc:3055] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:38.263759 27790 raft_consensus.cc:740] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:38.263422 24471 rpcz_store.cc:276] 0709 12:19:37.257009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.261235 (+  4226us) service_pool.cc:224] Handling call
0709 12:19:37.649658 (+388423us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b58001c3e98. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c3120a0 00007f4a9c311984 00007f4a9588c6d4 00007f4a9588c662
0709 12:19:38.262684 (+613026us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400244354. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:38.262835 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":291581440}
I20260709 12:19:38.247946 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.229660 27555 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:38.280323 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:38.281770 24325 raft_consensus.cc:2393] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 8: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:38.282579 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:38.283567 24398 raft_consensus.cc:2393] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 8: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:38.284543 27427 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:38.260038 27810 consensus_meta.cc:287] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.637s	user 0.007s	sys 0.004s
I20260709 12:19:38.289713 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:38.294885 25119 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:38.236965 27744 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:38.291759 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:38.284457 24393 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:19:38.308336 24366 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:38.279651 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:38.236125 27788 consensus_queue.cc:1059] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:19:38.321266 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:38.322623 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:38.323403 25116 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:38.293489 27501 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:38.240902 27600 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:38.326196 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:38.329145 25117 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:38.339005 25119 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:38.277958 27554 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:38.350423 27554 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:38.325868 27256 raft_consensus.cc:697] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:38.353463 27810 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:38.354033 27810 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:38.353845 27256 consensus_queue.cc:237] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:38.355167 27864 raft_consensus.cc:3055] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:38.329859 25111 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:19:38.355581 27864 raft_consensus.cc:740] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:38.356542 27864 consensus_queue.cc:260] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:38.361097 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.362373 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.362952 27731 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:38.363592 27805 consensus_meta.cc:287] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.529s	user 0.011s	sys 0.000s
I20260709 12:19:38.364419 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.365218 24324 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:38.366334 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.367069 27808 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:38.280655 27727 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:38.345419 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:38.372809 24400 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:19:38.354573 27810 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:38.370857 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:38.373476 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:38.377389 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.378621 24319 raft_consensus.cc:2410] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:19:38.396442 25119 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:38.399832 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:38.401050 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.402148 24324 raft_consensus.cc:2393] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:38.236250 27773 consensus_queue.cc:237] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
W20260709 12:19:38.377286 27796 consensus_meta.cc:287] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.005s
I20260709 12:19:38.419471 27796 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:38.420912 27802 consensus_queue.cc:1048] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:38.421773 27796 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:38.422801 27802 consensus_queue.cc:1048] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:38.423285 24325 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 7: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:38.424844 27801 consensus_queue.cc:1048] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:38.426570 25111 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:38.427258 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:38.429312 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.364099 27805 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:38.445061 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.448196 24366 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:38.450212 25117 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:19:38.452255 27863 raft_consensus.cc:2749] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:38.452863 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:38.453539 25119 raft_consensus.cc:3060] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:38.457298 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:38.458307 25111 raft_consensus.cc:2410] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:19:38.459260 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:38.459824 25111 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:38.450059 27554 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.462363 27554 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:38.398516 27803 consensus_queue.cc:1048] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 12:19:38.482281 25119 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 4.
I20260709 12:19:38.483546 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:38.484429 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:38.488094 27575 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:38.488806 27308 consensus_meta.cc:287] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.642s	user 0.003s	sys 0.012s
I20260709 12:19:38.469406 27554 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:38.489249 27308 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:38.490077 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.491078 24317 raft_consensus.cc:2410] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:19:38.492406 24473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 2010) took 1139 ms. Trace:
I20260709 12:19:38.492929 24473 rpcz_store.cc:276] 0709 12:19:37.353447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.403426 (+ 49979us) service_pool.cc:224] Handling call
0709 12:19:38.492246 (+1088820us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b540030e154. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:38.492345 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":467266432}
W20260709 12:19:38.484009 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 291068us
W20260709 12:19:38.500087 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:38.502559 24440 leader_election.cc:336] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Timed out: RequestConsensusVote RPC to 127.22.155.193:36951 timed out after 1.787s (SENT)
I20260709 12:19:38.503942 24322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2255) took 1060 ms. Trace:
I20260709 12:19:38.504611 24322 rpcz_store.cc:276] 0709 12:19:37.435018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.448873 (+ 13855us) service_pool.cc:224] Handling call
0709 12:19:38.474096 (+1025223us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b540033a254. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:38.495585 (+ 21489us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":304014080}
W20260709 12:19:38.517396 24440 leader_election.cc:336] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Timed out: RequestConsensusVote RPC to 127.22.155.193:36951 timed out after 1.793s (SENT)
W20260709 12:19:38.523005 24440 leader_election.cc:336] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Timed out: RequestConsensusVote RPC to 127.22.155.193:36951 timed out after 1.937s (SENT)
I20260709 12:19:38.523645 24440 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:38.524984 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:38.527655 25116 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:19:38.398344 27790 consensus_queue.cc:260] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:38.541977 24468 raft_consensus.cc:1240] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:38.542845 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.477211 27863 consensus_queue.cc:1048] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:19:38.550331 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:38.551271 24474 raft_consensus.cc:2393] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 8: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:38.546965 25083 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:38.545948 24466 raft_consensus.cc:1240] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:38.553560 24322 raft_consensus.cc:2393] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 10: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:38.529534 27704 consensus_queue.cc:1048] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:19:38.559029 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:38.559773 24469 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:38.560465 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.561206 24317 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
W20260709 12:19:38.571995 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 53735.5us
I20260709 12:19:38.573308 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:38.524016 27718 consensus_queue.cc:1048] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:19:38.578905 24471 raft_consensus.cc:2393] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
W20260709 12:19:38.583560 24440 leader_election.cc:336] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Timed out: RequestConsensusVote RPC to 127.22.155.193:36951 timed out after 1.954s (SENT)
W20260709 12:19:38.584585 24440 leader_election.cc:336] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Timed out: RequestConsensusVote RPC to 127.22.155.193:36951 timed out after 1.981s (SENT)
I20260709 12:19:38.554147 27854 raft_consensus.cc:2749] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:38.578346 27308 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:38.602522 24323 raft_consensus.cc:1240] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:38.602697 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.604559 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.606144 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.606959 24319 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:38.608068 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.609727 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.610769 24321 raft_consensus.cc:2393] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 9: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:38.540940 27427 consensus_queue.cc:1048] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:19:38.618954 27427 raft_consensus.cc:2804] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:38.619565 27427 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:38.626300 27803 consensus_queue.cc:1059] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:38.632901 27865 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.633296 24470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 732) took 1111 ms. Trace:
I20260709 12:19:38.633951 24470 rpcz_store.cc:276] 0709 12:19:37.521502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.582947 (+ 61445us) service_pool.cc:224] Handling call
0709 12:19:37.636226 (+ 53279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:38.228110 (+591884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:38.632951 (+404841us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b540029e354. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:38.633210 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1359723392}
I20260709 12:19:38.638159 24323 raft_consensus.cc:1240] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:38.639427 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:38.641278 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 154385us
I20260709 12:19:38.641610 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:38.642668 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:38.643833 25118 raft_consensus.cc:2393] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 7: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:19:38.649350 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 64791.9us
W20260709 12:19:38.652180 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 230475us
I20260709 12:19:38.661695 25082 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:38.662004 27865 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:38.596694 27831 consensus_meta.cc:287] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.505s	user 0.005s	sys 0.009s
I20260709 12:19:38.620038 27427 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:38.669683 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.670743 24322 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:19:38.672920 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.673775 24320 raft_consensus.cc:1240] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 6. Current term is 8. Ops: []
I20260709 12:19:38.678300 24323 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:38.679490 24320 raft_consensus.cc:1240] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:38.681618 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.660154 27779 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:38.682554 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 92607.2us
I20260709 12:19:38.683754 24469 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:19:38.697863 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:38.703145 25084 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:38.665555 27600 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:38.672971 27424 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:38.714954 25111 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:19:38.733100 24323 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:19:38.718622 27256 consensus_queue.cc:1048] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:38.719825 27718 consensus_queue.cc:1048] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:38.720832 27774 consensus_queue.cc:1048] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:19:38.726315 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 73352.6us
I20260709 12:19:38.715561 27865 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:38.741153 27858 consensus_meta.cc:287] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.004s
I20260709 12:19:38.741641 27858 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:38.742194 25082 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:38.743883 27858 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:38.737114 24319 raft_consensus.cc:1240] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 12:19:38.745464 27868 log.cc:927] Time spent T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:19:38.706175 27876 raft_consensus.cc:3055] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:38.757681 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:38.710747 27554 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.676914 27831 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:38.773392 27336 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:38.774199 27336 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:38.776278 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:38.777195 24393 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 7: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:38.777580 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:38.778429 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:38.776399 27336 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:38.779079 24392 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:38.779626 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:38.780319 24397 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:38.782588 24366 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:19:38.783749 24365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.007s	sys 0.019s
W20260709 12:19:38.784118 24365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.007s	sys 0.019s
I20260709 12:19:38.784832 27554 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:38.753940 27805 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:38.731420 27837 consensus_meta.cc:287] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.628s	user 0.018s	sys 0.000s
I20260709 12:19:38.771282 24440 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
W20260709 12:19:38.784411 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 593351us
I20260709 12:19:38.792824 27424 raft_consensus.cc:2749] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:38.795101 24400 raft_consensus.cc:1275] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:38.796588 27831 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:38.797024 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:38.704854 27779 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:38.798298 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:38.798785 24318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2247) took 1519 ms. Trace:
I20260709 12:19:38.799065 24317 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 7: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:38.799552 27779 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:38.799872 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:38.800803 27873 consensus_queue.cc:1059] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:38.801646 27744 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.802002 27873 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:38.802278 27744 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:38.802704 27810 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:38.804559 27837 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:38.786737 27877 raft_consensus.cc:2804] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:38.765354 27876 raft_consensus.cc:740] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:38.730786 27854 consensus_queue.cc:1048] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 12:19:38.799181 24318 rpcz_store.cc:276] 0709 12:19:37.278948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.302371 (+ 23423us) service_pool.cc:224] Handling call
0709 12:19:38.247793 (+945422us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b5800003698. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227e9c 00007f4a94227a5b 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c3120a0 00007f4a9c311984 00007f4a9588c6d4 00007f4a9588c662
0709 12:19:38.798586 (+550793us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b5400338954. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:38.798723 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":656387840}
W20260709 12:19:38.812601 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 109575us
I20260709 12:19:38.814278 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:38.823200 24399 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 7: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:38.823738 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.807668 24395 raft_consensus.cc:1240] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 7. Ops: [5.5-5.5]
I20260709 12:19:38.825459 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:38.820194 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.826326 25114 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:38.828934 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:38.829751 25116 raft_consensus.cc:2393] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 7: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:38.823938 24365 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:38.823796 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:38.852229 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 81023.7us
I20260709 12:19:38.852118 24366 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:38.854417 24440 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:38.836263 24317 raft_consensus.cc:2393] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 7: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:38.861191 24393 raft_consensus.cc:1275] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:38.859661 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:38.871332 24394 raft_consensus.cc:2393] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:38.871402 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:38.872179 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:38.874495 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 177977us
I20260709 12:19:38.875943 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:38.877420 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:38.879675 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:38.884258 24440 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:38.886039 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:38.870800 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:38.888365 25115 raft_consensus.cc:2393] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 7: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:38.890237 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:38.890797 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 148661us
I20260709 12:19:38.805550 27790 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:38.891780 25082 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:38.891093 25116 raft_consensus.cc:2393] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEARNER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:38.890583 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.806864 27837 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:38.897358 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 69791.4us
I20260709 12:19:38.904193 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:38.904728 24366 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:38.905040 24468 raft_consensus.cc:2393] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 8: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:38.898777 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:38.897650 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:38.907423 24469 raft_consensus.cc:2393] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 7: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:38.897408 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:38.909001 24470 raft_consensus.cc:2410] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:19:38.897454 25083 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:38.804610 27744 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:38.899816 24471 raft_consensus.cc:1240] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:38.806102 27877 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:19:38.906579 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:38.832895 27779 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.912392 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.925463 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:38.883139 27854 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:38.873916 27805 raft_consensus.cc:2749] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:38.893635 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:38.936766 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:38.933544 24366 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:38.938983 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:38.938625 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:38.947698 25116 raft_consensus.cc:2393] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:38.929901 25084 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:38.851662 27704 consensus_queue.cc:1048] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:19:38.913283 27831 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:38.946209 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:38.950095 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:38.955128 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:38.955821 24472 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:38.956314 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 64643.7us
I20260709 12:19:38.925866 27336 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:38.881228 27308 consensus_queue.cc:1048] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:19:38.954345 25117 raft_consensus.cc:1240] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:19:38.924526 27256 consensus_queue.cc:1059] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:19:38.955847 25118 raft_consensus.cc:2376] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8. Re-sending same reply.
I20260709 12:19:38.961889 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:38.944264 27555 consensus_meta.cc:287] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.652s	user 0.011s	sys 0.004s
I20260709 12:19:38.932863 27424 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:38.968681 24466 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:38.929056 27600 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.950939 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:38.937397 27744 raft_consensus.cc:2749] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:38.925213 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:38.951748 25115 raft_consensus.cc:2410] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:19:38.933405 27854 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:38.993643 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:38.808691 27876 consensus_queue.cc:260] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:38.988554 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:39.000782 24317 raft_consensus.cc:2393] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 9: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:38.993772 25118 raft_consensus.cc:1240] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 12:19:38.996083 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 111942us
I20260709 12:19:39.003602 24440 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:38.955035 27858 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:38.930534 27877 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:38.966073 27882 raft_consensus.cc:3055] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:38.964898 27336 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:38.958539 27861 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:38.994519 27796 raft_consensus.cc:3055] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:39.008329 24366 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:19:39.007444 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 110097us
I20260709 12:19:39.008359 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:39.009984 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:39.011051 25117 raft_consensus.cc:1275] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:19:38.938380 27779 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:38.953552 25111 raft_consensus.cc:2376] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7. Re-sending same reply.
I20260709 12:19:39.013286 24394 raft_consensus.cc:1240] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:19:38.980418 27810 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:38.995256 27287 consensus_meta.cc:287] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.791s	user 0.006s	sys 0.010s
W20260709 12:19:39.057119 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 48890.6us
I20260709 12:19:39.017335 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:39.021953 24397 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:39.059047 24366 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:39.008772 27600 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:39.050638 27805 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:39.032665 24316 raft_consensus.cc:1240] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:39.061221 24318 raft_consensus.cc:1240] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:39.061853 27779 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:39.062000 27600 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:39.062238 27424 raft_consensus.cc:2749] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:39.062601 27779 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:39.063520 27876 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:38.981297 27555 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:39.032744 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:39.066958 27727 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:39.067147 24468 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:39.068498 24324 raft_consensus.cc:1240] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:19:39.071509 27803 consensus_queue.cc:1059] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:39.033659 24472 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:39.055932 27861 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:39.004734 25082 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:39.059610 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:39.075927 24394 raft_consensus.cc:2393] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 7: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:39.076761 25110 raft_consensus.cc:2376] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7. Re-sending same reply.
I20260709 12:19:39.083330 24391 raft_consensus.cc:1240] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 12:19:39.039086 27427 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:39.044468 27336 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:39.094501 24397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2004) took 1168 ms. Trace:
I20260709 12:19:39.095148 24397 rpcz_store.cc:276] 0709 12:19:37.891290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.779322 (+888032us) service_pool.cc:224] Handling call
0709 12:19:39.059250 (+279928us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:39.046365 24325 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:39.048861 24467 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 7: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:19:39.051184 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:39.006242 27854 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:39.054914 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:39.016292 27882 raft_consensus.cc:740] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:39.049459 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:39.100159 24366 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:39.065752 24393 raft_consensus.cc:1240] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:19:39.103783 24395 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:39.101018 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:39.102701 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:39.104967 24399 raft_consensus.cc:2368] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 7. Current term is 8.
I20260709 12:19:39.046882 27796 raft_consensus.cc:740] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:19:39.105723 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 102212us
I20260709 12:19:39.106778 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:39.015830 27837 consensus_queue.cc:1059] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 12:19:39.109037 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:39.113844 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 114438us
I20260709 12:19:39.110507 24440 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:39.116755 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:39.117434 24394 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:39.091125 27864 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:39.111675 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:39.110069 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:39.123694 24391 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:39.110497 24397 raft_consensus.cc:2376] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7. Re-sending same reply.
I20260709 12:19:39.131745 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:39.146091 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:39.200721 24399 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:39.168150 25114 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
W20260709 12:19:39.169184 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 58764.4us
W20260709 12:19:39.201287 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 219280us
I20260709 12:19:39.237262 25116 raft_consensus.cc:1240] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:19:39.237622 24440 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:39.175426 27554 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:39.175042 27882 consensus_queue.cc:260] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:39.176334 27796 consensus_queue.cc:260] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:39.181064 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:39.181466 24289 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
W20260709 12:19:39.128320 27519 consensus_meta.cc:287] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.919s	user 0.016s	sys 0.000s
I20260709 12:19:39.185456 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:39.191496 27810 raft_consensus.cc:3055] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:39.198770 27861 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:39.143321 24468 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:39.122483 27888 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:39.247040 24393 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:39.173452 25082 leader_election.cc:400] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 6. Current term is 7.
I20260709 12:19:39.249095 24470 raft_consensus.cc:2468] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
W20260709 12:19:39.255123 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 73726.6us
I20260709 12:19:39.255182 25082 leader_election.cc:403] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:39.129289 27802 raft_consensus.cc:2804] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:39.125917 25113 raft_consensus.cc:1275] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:19:39.271271 27802 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:39.271795 27802 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:39.269788 25083 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:39.126915 27805 raft_consensus.cc:2749] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:39.273059 27886 raft_consensus.cc:2804] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:39.273447 27886 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:39.273770 27886 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:39.274433 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:39.276363 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:39.276985 24470 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:19:39.253357 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:39.261154 27424 consensus_queue.cc:1059] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:39.261258 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:39.285459 27424 raft_consensus.cc:3055] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:39.285857 27424 raft_consensus.cc:740] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:39.286036 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:39.286759 27424 consensus_queue.cc:260] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:39.287325 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:39.288007 24397 raft_consensus.cc:2368] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 6. Current term is 7.
I20260709 12:19:39.288110 27424 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:39.288961 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:39.261861 27837 consensus_queue.cc:1059] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:39.262105 27427 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:39.264904 27892 raft_consensus.cc:3055] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:39.264776 27554 consensus_queue.cc:1059] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:39.265692 27803 raft_consensus.cc:2804] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:39.290396 27892 raft_consensus.cc:740] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:39.290921 27803 raft_consensus.cc:697] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:39.291392 27892 consensus_queue.cc:260] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:39.292842 27892 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:39.293391 27554 raft_consensus.cc:3055] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:39.293846 27554 raft_consensus.cc:740] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:39.294683 27554 consensus_queue.cc:260] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:39.295210 27882 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:39.295879 27554 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:39.117293 27866 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:39.267948 25084 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:39.127821 27555 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:39.269794 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:39.270051 27895 raft_consensus.cc:2749] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 6. Current term is 7.
I20260709 12:19:39.301867 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:39.302671 24395 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 7: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:39.302814 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:39.303467 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:39.254500 27810 raft_consensus.cc:740] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:39.126189 27878 consensus_queue.cc:1059] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.196s
I20260709 12:19:39.304965 27810 consensus_queue.cc:260] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:39.305684 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:39.270757 27888 raft_consensus.cc:697] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 10 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:39.306365 24468 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:39.289945 27788 raft_consensus.cc:3055] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:39.307080 27788 raft_consensus.cc:740] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:39.307379 27888 consensus_queue.cc:237] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:39.308007 27788 consensus_queue.cc:260] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:39.297761 27881 raft_consensus.cc:2804] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:39.309399 27881 raft_consensus.cc:697] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:39.309619 25116 raft_consensus.cc:1275] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:19:39.309394 27788 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:39.311573 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:39.270955 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 155912us
I20260709 12:19:39.310036 25116 pending_rounds.cc:85] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281: Aborting all ops after (but not including) 6
I20260709 12:19:39.306387 27427 raft_consensus.cc:3055] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:39.306265 27810 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:39.321586 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:39.322140 24394 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:19:39.322593 24473 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:39.292044 27803 consensus_queue.cc:237] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:39.103199 27287 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:39.312582 25116 pending_rounds.cc:107] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:19:39.325052 25116 raft_consensus.cc:2889] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:39.297031 24391 raft_consensus.cc:2393] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 9: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:39.313385 25082 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:39.267198 27896 consensus_queue.cc:1059] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:39.277144 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:39.330616 24393 raft_consensus.cc:2393] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 7: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:39.259794 24366 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:39.314309 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:39.331599 24468 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:39.331642 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 71964.8us
I20260709 12:19:39.333518 24291 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:39.334532 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:39.335881 27837 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:39.336076 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:39.336483 27837 raft_consensus.cc:697] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:39.320679 24470 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
I20260709 12:19:39.339074 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:39.117759 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:39.323787 24466 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
W20260709 12:19:39.321668 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 64739.9us
W20260709 12:19:39.328943 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:39.323416 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:39.349164 24394 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:39.346863 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:39.321165 27427 raft_consensus.cc:740] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:39.300384 27779 raft_consensus.cc:2749] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:39.349855 24320 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:39.351753 24438 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:39.352768 24398 raft_consensus.cc:2393] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 10: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:39.298707 27831 raft_consensus.cc:2749] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:39.360405 24399 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:19:39.364650 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:39.365339 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:39.365799 27896 raft_consensus.cc:3055] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:39.366487 27896 raft_consensus.cc:740] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:39.366569 27881 consensus_queue.cc:237] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:39.367547 27555 raft_consensus.cc:2749] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:39.368732 25116 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 LEARNER]: Advancing to term 7
W20260709 12:19:39.369019 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:39.330478 27790 raft_consensus.cc:2804] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:39.333364 27727 raft_consensus.cc:2749] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:39.380959 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:39.381834 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:39.384949 24322 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:39.338764 27308 raft_consensus.cc:2749] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:39.396108 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:39.396503 24321 raft_consensus.cc:2393] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 9: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:39.386330 24438 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:39.387876 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:39.388439 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:39.399117 24468 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:39.399896 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:39.390256 24394 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:19:39.382774 24366 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:39.391714 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 78391.1us
I20260709 12:19:39.401671 24393 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:19:39.402150 25082 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:39.402527 25116 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEARNER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
W20260709 12:19:39.403386 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 165802us
I20260709 12:19:39.404930 24440 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:39.394873 27886 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:39.413975 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 74557.1us
I20260709 12:19:39.415021 25083 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:39.257861 27519 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:39.284504 27877 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:39.373346 27878 raft_consensus.cc:2749] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:39.330318 27731 consensus_queue.cc:1048] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:19:39.417865 25114 raft_consensus.cc:1275] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEARNER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:19:39.419013 24366 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:39.442838 27831 raft_consensus.cc:2804] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:39.443253 27831 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:39.443207 27907 raft_consensus.cc:2804] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:19:39.420704 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 71660.3us
I20260709 12:19:39.420761 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:39.421815 27287 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:39.444933 27907 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:39.402072 27744 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:39.445669 27907 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:39.446060 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:39.446621 24289 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:39.446996 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:39.447680 24393 raft_consensus.cc:2393] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 7: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:39.447489 27718 consensus_queue.cc:1048] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:39.448117 24289 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:39.448416 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:39.425282 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 91875.1us
I20260709 12:19:39.337742 27837 consensus_queue.cc:237] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:39.449996 27704 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:39.451740 24289 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:39.384996 27790 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:39.429005 24396 raft_consensus.cc:2368] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 9. Current term is 10.
I20260709 12:19:39.401502 27858 raft_consensus.cc:2749] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:39.452566 27790 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:39.397219 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:39.452677 27861 raft_consensus.cc:2749] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:39.453425 25111 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:39.435576 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:39.457499 24399 raft_consensus.cc:2410] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:19:39.458213 24291 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:39.458900 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:39.459702 24291 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:39.460577 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:39.460964 27859 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:39.427099 27519 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:39.465158 24399 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:39.444238 27831 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:39.466042 27704 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:39.467694 27501 consensus_queue.cc:1059] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:39.448923 27718 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:39.470029 27575 raft_consensus.cc:3055] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:39.470762 27575 raft_consensus.cc:740] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:39.314760 27802 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:39.473269 27802 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:39.481387 24289 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:39.474524 27831 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:39.489418 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48252 (request call id 503) took 1171 ms. Trace:
I20260709 12:19:39.444033 24440 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
W20260709 12:19:39.490442 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 46470.4us
I20260709 12:19:39.493877 24440 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:39.475347 24366 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:39.472344 27575 consensus_queue.cc:260] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:39.465700 24291 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:39.501448 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 99400.2us
I20260709 12:19:39.501358 24399 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:39.489915 25119 rpcz_store.cc:276] 0709 12:19:38.317695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.529697 (+212002us) service_pool.cc:224] Handling call
0709 12:19:38.543814 (+ 14117us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:19:38.666385 (+122571us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:38.666407 (+    22us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:19:38.689898 (+ 23491us) log.cc:844] Serialized 78 byte log entry
0709 12:19:38.926156 (+236258us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:39.108114 (+181958us) log.cc:844] Serialized 14 byte log entry
0709 12:19:39.423457 (+315343us) log.cc:844] Serialized 14 byte log entry
0709 12:19:39.489039 (+ 65582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:39.489131 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:39.489179 (+    48us) raft_consensus.cc:1685] finished
0709 12:19:39.489193 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:39.489351 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69702,"prepare.queue_time_us":400746,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":4362,"raft.queue_time_us":223724,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":192,"thread_start_us":724897,"threads_started":4,"wal-append.queue_time_us":283435}
I20260709 12:19:39.496109 24366 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:39.419783 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:39.505734 24394 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 7: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:39.404059 27866 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:39.374723 25112 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:39.401378 27805 consensus_queue.cc:1059] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 12:19:39.502254 25082 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
W20260709 12:19:39.502710 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 116450us
I20260709 12:19:39.476460 27865 consensus_queue.cc:1059] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:19:39.465193 25111 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:39.482682 27308 raft_consensus.cc:2764] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:19:39.517855 24438 leader_election.cc:400] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 7. Current term is 8.
I20260709 12:19:39.524513 24366 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:39.528677 25082 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:39.544054 25082 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:39.545068 24395 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6.
I20260709 12:19:39.548143 24393 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:19:39.534850 27575 raft_consensus.cc:3060] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:39.496598 27873 raft_consensus.cc:2749] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:39.551520 24398 raft_consensus.cc:1275] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:19:39.551538 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 85920.7us
I20260709 12:19:39.516928 27519 raft_consensus.cc:2804] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:39.497144 27892 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:39.558950 24438 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:39.513139 27779 raft_consensus.cc:2804] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:39.502756 27905 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.525166 27858 raft_consensus.cc:2804] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:39.409229 27427 consensus_queue.cc:260] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:39.541915 25113 raft_consensus.cc:1240] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:39.547816 27424 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:39.546466 27802 raft_consensus.cc:2804] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:39.542522 25112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35194 (request call id 518) took 1891 ms. Trace:
I20260709 12:19:39.550894 27888 raft_consensus.cc:2749] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:39.590951 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:39.593050 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 178120us
I20260709 12:19:39.558426 27866 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.597532 24438 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:39.560783 27774 raft_consensus.cc:2749] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:39.595276 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:39.571863 27900 raft_consensus.cc:2764] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:19:39.601487 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:39.586171 27865 raft_consensus.cc:3055] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:39.576892 27891 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:39.586694 27519 raft_consensus.cc:697] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:39.602299 24398 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:39.585551 27308 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:39.589269 27779 raft_consensus.cc:697] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:39.589093 27802 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:39.606731 24400 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:39.578346 27910 raft_consensus.cc:2749] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:39.557175 27336 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:39.620575 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:39.598218 27858 raft_consensus.cc:697] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:39.627069 24438 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
W20260709 12:19:39.610479 27876 consensus_meta.cc:287] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.546s	user 0.017s	sys 0.000s
I20260709 12:19:39.631942 24438 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:39.605341 27906 raft_consensus.cc:3055] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:39.606124 27891 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:39.604785 27865 raft_consensus.cc:740] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:39.610579 27308 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:39.588207 27905 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:39.623528 27802 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:39.602466 27866 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:39.654260 27913 raft_consensus.cc:2749] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:39.655222 27913 raft_consensus.cc:2804] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:39.655620 27913 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:39.656018 27913 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:39.627729 27805 raft_consensus.cc:2749] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:39.657106 27858 consensus_queue.cc:237] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:39.633962 27779 consensus_queue.cc:237] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:39.670889 27336 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:39.647763 27308 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:39.672693 24392 raft_consensus.cc:1275] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 12:19:39.673189 24392 pending_rounds.cc:85] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a: Aborting all ops after (but not including) 5
I20260709 12:19:39.673475 24392 pending_rounds.cc:107] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.6
I20260709 12:19:39.673930 24392 raft_consensus.cc:2917] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Aborting config change with OpId 5.6: Aborted: Op aborted by new leader
I20260709 12:19:39.674492 24392 raft_consensus.cc:2889] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:39.675294 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:39.677496 27519 consensus_queue.cc:237] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:39.678346 24395 raft_consensus.cc:1275] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:19:39.681100 24399 raft_consensus.cc:1240] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:39.654400 27866 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:39.590755 25112 rpcz_store.cc:276] 0709 12:19:37.643963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.687709 (+ 43746us) service_pool.cc:224] Handling call
0709 12:19:39.105663 (+1417954us) spinlock_profiling.cc:243] Waited 6.98 ms on lock 0x7b5800004598. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c3120a0 00007f4a9c311984 00007f4a9588c6d4 00007f4a9588c662
0709 12:19:39.535189 (+429526us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16052608}
I20260709 12:19:39.648684 24397 raft_consensus.cc:2368] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 8. Current term is 9.
I20260709 12:19:39.655335 27865 consensus_queue.cc:260] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:39.683861 27865 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:39.685338 24397 raft_consensus.cc:1240] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:19:39.683873 24399 raft_consensus.cc:1240] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 7. Current term is 8. Ops: [4.3-7.4]
I20260709 12:19:39.638514 27427 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:39.691103 24394 raft_consensus.cc:1240] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:19:39.697829 24320 raft_consensus.cc:2410] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:19:39.698864 24394 raft_consensus.cc:1240] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:19:39.636502 27906 raft_consensus.cc:740] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:39.643757 27891 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:39.694203 24322 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:39.680200 27831 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:39.679448 27704 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:39.701884 24398 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
W20260709 12:19:39.692459 27854 consensus_meta.cc:287] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.571s	user 0.011s	sys 0.000s
I20260709 12:19:39.715823 24365 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:19:39.712381 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 150716us
I20260709 12:19:39.720009 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:39.732697 24391 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:39.733232 24365 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:19:39.731835 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 250512us
W20260709 12:19:39.735081 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:39.735579 24289 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:39.738286 24289 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:39.739513 24365 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:39.707826 27744 raft_consensus.cc:2749] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:39.744863 24365 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:39.740525 24291 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:39.742074 27600 raft_consensus.cc:2749] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:39.746184 27501 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:39.722141 27854 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:39.759439 27886 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:39.760313 27796 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:39.761082 24465 raft_consensus.cc:1240] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:19:39.761746 27896 consensus_queue.cc:260] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:39.763096 27896 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:39.742744 27866 consensus_queue.cc:1059] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:19:39.765872 27859 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:39.748525 27864 raft_consensus.cc:2749] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:39.777751 25110 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:39.785763 27905 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:39.764551 27906 consensus_queue.cc:260] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:39.794227 27906 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:39.801095 27914 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:39.805261 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:39.806129 25111 raft_consensus.cc:2368] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 7. Current term is 8.
I20260709 12:19:39.815474 27501 raft_consensus.cc:697] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:19:39.807394 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 175538us
W20260709 12:19:39.828248 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:39.828470 24438 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:39.831585 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:39.822273 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 329263us
I20260709 12:19:39.832818 24320 raft_consensus.cc:2393] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 10: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:39.833140 24440 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
W20260709 12:19:39.835566 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 90790.2us
I20260709 12:19:39.836472 24365 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:39.841203 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:39.842269 25110 raft_consensus.cc:2410] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:19:39.857996 24440 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:39.841275 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:39.908725 24321 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:39.931449 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:39.932982 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:39.933821 24318 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:39.934666 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:39.936360 27790 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:39.939699 27790 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:39.836380 27774 raft_consensus.cc:2749] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:19:39.953208 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 211507us
I20260709 12:19:39.831456 27854 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:39.989681 24289 leader_election.cc:400] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 9. Current term is 10.
I20260709 12:19:39.841674 27600 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:39.830842 27918 raft_consensus.cc:2749] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:39.993270 24289 leader_election.cc:403] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 12:19:39.991164 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 162775us
I20260709 12:19:40.066350 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2016) took 1196 ms. Trace:
I20260709 12:19:39.841826 27424 raft_consensus.cc:697] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:19:39.998864 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 184327us
I20260709 12:19:39.931807 27805 raft_consensus.cc:2804] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:40.066867 24465 rpcz_store.cc:276] 0709 12:19:38.869556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.869741 (+   185us) service_pool.cc:224] Handling call
0709 12:19:38.870205 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:39.761528 (+891323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.066068 (+304540us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b5400143cd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:40.066282 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2048128256}
I20260709 12:19:40.067528 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:40.068392 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:39.931922 27914 raft_consensus.cc:697] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:40.081378 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:40.069108 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:40.072367 24391 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:40.085167 24366 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:40.080673 24468 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:19:40.084192 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 247790us
I20260709 12:19:40.086560 24365 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:40.079023 24438 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:40.080840 24473 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:40.089459 24366 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:40.109305 27895 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.109157 27501 consensus_queue.cc:237] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:40.110118 27895 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:40.113241 27881 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.113916 27881 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:40.117204 27287 raft_consensus.cc:2804] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:40.117873 27287 raft_consensus.cc:697] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:40.118633 27923 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:40.119614 27923 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:40.118834 27287 consensus_queue.cc:237] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:40.120380 27923 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:40.120847 27519 raft_consensus.cc:2804] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:40.121505 27519 raft_consensus.cc:697] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:40.122386 27519 consensus_queue.cc:237] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:40.117892 24318 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:19:40.126959 24366 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:40.128794 27727 raft_consensus.cc:2764] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:19:40.129746 27727 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:40.130892 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:40.131711 24394 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
I20260709 12:19:40.134367 25110 raft_consensus.cc:1275] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:19:40.136370 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 49971.8us
I20260709 12:19:40.137480 24365 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:40.139003 24365 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:40.140965 27866 raft_consensus.cc:2749] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:40.142010 27916 raft_consensus.cc:2764] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:19:40.081429 27876 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.143621 27876 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:40.144447 25112 raft_consensus.cc:1240] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:40.091638 27600 raft_consensus.cc:697] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:40.152493 27600 consensus_queue.cc:237] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:40.079735 27854 raft_consensus.cc:2749] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:19:40.156332 27922 log.cc:927] Time spent T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:19:40.159068 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:40.162918 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 64185.2us
I20260709 12:19:40.167346 25082 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:40.169414 24365 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:40.176993 24365 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:40.068670 27917 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.182367 24365 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:40.164438 24366 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:40.187369 24321 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
W20260709 12:19:40.190672 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 212576us
I20260709 12:19:40.180373 24468 raft_consensus.cc:2468] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
W20260709 12:19:40.201546 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:40.089993 27810 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:19:40.225967 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 505572us
I20260709 12:19:40.116511 27881 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:40.235788 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:40.250067 24325 raft_consensus.cc:1275] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:19:40.189911 27858 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:40.183766 27925 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:40.253842 24289 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:40.222118 27774 raft_consensus.cc:2749] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 9. Current term is 10.
I20260709 12:19:40.255679 24396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2034) took 1075 ms. Trace:
I20260709 12:19:40.181169 27805 raft_consensus.cc:697] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:40.190107 27727 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:40.223608 27905 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:40.226749 27876 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:40.098207 27802 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:40.236008 27916 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:40.119383 27308 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:40.231294 27854 raft_consensus.cc:2804] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:40.231585 27731 consensus_queue.cc:1048] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:19:40.278337 27805 consensus_queue.cc:237] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:40.285084 27929 consensus_queue.cc:1048] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:19:40.257769 27831 raft_consensus.cc:2749] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:40.228771 27865 consensus_queue.cc:1048] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
W20260709 12:19:40.288609 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 430729us
I20260709 12:19:40.250639 27790 consensus_queue.cc:1059] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:19:40.250242 27837 consensus_queue.cc:1048] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 12:19:40.279688 27907 consensus_meta.cc:287] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.833s	user 0.004s	sys 0.006s
I20260709 12:19:40.275622 27727 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:40.273002 27895 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:40.271644 27796 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:40.281023 27905 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:40.288453 27859 raft_consensus.cc:2764] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:19:40.262526 24396 rpcz_store.cc:276] 0709 12:19:39.180202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.633959 (+453757us) service_pool.cc:224] Handling call
0709 12:19:39.716194 (+ 82235us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:39.731731 (+ 15537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:39.731761 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:39.746829 (+ 15068us) log.cc:844] Serialized 26 byte log entry
0709 12:19:40.000044 (+253215us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:40.225267 (+225223us) log.cc:844] Serialized 14 byte log entry
0709 12:19:40.255146 (+ 29879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.255322 (+   176us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:40.255385 (+    63us) raft_consensus.cc:1685] finished
0709 12:19:40.255405 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:40.255591 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":119578,"raft.queue_time_us":75523,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":9863,"thread_start_us":312380,"threads_started":2,"wal-append.queue_time_us":382205}
W20260709 12:19:40.310334 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 56593.9us
W20260709 12:19:40.312107 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 55318.1us
W20260709 12:19:40.312378 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 122237us
I20260709 12:19:40.279528 27910 consensus_queue.cc:1059] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:19:40.338291 24440 leader_election.cc:400] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 6. Current term is 7.
I20260709 12:19:40.353775 24440 leader_election.cc:403] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:40.231760 27917 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:40.299904 27854 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:40.194664 27914 consensus_queue.cc:237] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:40.286687 27810 consensus_queue.cc:1059] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:19:40.291693 27931 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:40.346443 27727 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:40.280167 27925 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:40.312804 27858 raft_consensus.cc:697] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:40.347610 27907 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:40.385720 27858 consensus_queue.cc:237] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:40.386879 27925 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:40.388386 27907 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:40.389616 27308 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:40.390707 27877 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:40.392777 24291 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:40.393151 27555 consensus_queue.cc:1048] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:40.393721 27925 raft_consensus.cc:2804] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:40.373775 27918 raft_consensus.cc:2749] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 6. Current term is 7.
I20260709 12:19:40.394973 27877 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:40.395535 27877 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:40.397185 27802 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:40.398699 27877 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:40.395010 27727 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:40.400606 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:40.401507 27731 consensus_queue.cc:1048] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:40.402546 24395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2445) took 1128 ms. Trace:
I20260709 12:19:40.403036 27731 consensus_queue.cc:1048] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:40.403683 25113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 1065) took 1093 ms. Trace:
I20260709 12:19:40.404150 25113 rpcz_store.cc:276] 0709 12:19:39.310340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.310768 (+   428us) service_pool.cc:224] Handling call
0709 12:19:39.311064 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:39.597431 (+286367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.365259 (+767828us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b540048ce54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:40.403610 (+ 38351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":441442048}
I20260709 12:19:40.409098 27727 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:40.369352 24396 raft_consensus.cc:1275] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:40.290866 27424 consensus_queue.cc:237] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:40.376444 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:40.376842 24366 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:40.350739 27905 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:40.357803 27891 consensus_meta.cc:287] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.652s	user 0.010s	sys 0.000s
I20260709 12:19:40.369932 27854 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:40.382138 25112 raft_consensus.cc:1275] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:19:40.388759 27931 raft_consensus.cc:697] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:40.394423 27925 raft_consensus.cc:697] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:19:40.409279 27913 consensus_meta.cc:287] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.753s	user 0.010s	sys 0.003s
I20260709 12:19:40.365329 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:40.368443 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 47937.5us
I20260709 12:19:40.301023 27916 raft_consensus.cc:697] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:40.402948 24395 rpcz_store.cc:276] 0709 12:19:39.273676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.679224 (+405548us) service_pool.cc:224] Handling call
0709 12:19:39.679577 (+   353us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:19:39.680017 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:39.680049 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:19:39.693000 (+ 12951us) log.cc:844] Serialized 78 byte log entry
0709 12:19:39.895014 (+202014us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:39.947040 (+ 52026us) log.cc:844] Serialized 14 byte log entry
0709 12:19:40.401436 (+454396us) spinlock_profiling.cc:243] Waited 7.11 ms on lock 0x7b18004a6140. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a941d9c0a 00007f4a9d919219 00007f4a94261a40 00007f4a9425c4e4 00007f4a9425c455 00007f4a9ad443c7 00007f4a973569a7 00007f4a973660bf 00007f4a97366038
0709 12:19:40.401640 (+   204us) log.cc:844] Serialized 14 byte log entry
0709 12:19:40.402015 (+   375us) log.cc:844] Serialized 14 byte log entry
0709 12:19:40.402152 (+   137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.402306 (+   154us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:40.402350 (+    44us) raft_consensus.cc:1685] finished
0709 12:19:40.402362 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:40.402489 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":450816,"prepare.queue_time_us":377479,"prepare.run_cpu_time_us":8740,"prepare.run_wall_time_us":65978,"raft.queue_time_us":140353,"raft.run_cpu_time_us":388,"raft.run_wall_time_us":12798,"spinlock_wait_cycles":29593088,"thread_start_us":172390,"threads_started":1,"wal-append.queue_time_us":372913}
W20260709 12:19:40.421026 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:40.378785 27427 consensus_meta.cc:287] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.678s	user 0.011s	sys 0.007s
I20260709 12:19:40.417006 24392 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
W20260709 12:19:40.424261 24290 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.926s (SENT) [suppressed 61 similar messages]
W20260709 12:19:40.428156 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 51414.3us
I20260709 12:19:40.351545 27796 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:40.442808 24440 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:40.451300 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:40.452577 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:40.402588 27929 consensus_queue.cc:1048] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:19:40.457299 25082 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:40.435509 27519 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:19:40.452951 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 373997us
I20260709 12:19:40.485330 24438 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:40.453271 24392 raft_consensus.cc:2393] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 7: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
W20260709 12:19:40.490779 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 48061.4us
W20260709 12:19:40.503531 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 321261us
W20260709 12:19:40.577370 27901 log.cc:927] Time spent T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:19:40.558346 24440 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:40.531914 27519 raft_consensus.cc:697] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:40.552101 24318 raft_consensus.cc:1275] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:19:40.592469 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:40.539520 24394 raft_consensus.cc:1240] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:40.572283 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:40.592522 24318 pending_rounds.cc:85] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756: Aborting all ops after (but not including) 4
I20260709 12:19:40.594400 24318 pending_rounds.cc:107] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:19:40.430402 27891 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:40.529309 27865 consensus_queue.cc:1059] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:19:40.532313 27918 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:40.455957 27837 consensus_queue.cc:1048] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 12:19:40.593232 24473 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:40.572530 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 87292.9us
I20260709 12:19:40.442307 27913 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:40.594990 24318 raft_consensus.cc:2889] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:40.598671 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:40.606892 24466 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:40.604197 24468 raft_consensus.cc:1240] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9. Ops: []
W20260709 12:19:40.604807 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:40.609545 24438 leader_election.cc:400] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 6. Current term is 7.
I20260709 12:19:40.610654 24438 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:40.612978 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:40.613596 24468 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:40.613943 27938 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.614741 27938 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:40.616971 27934 log.cc:927] Time spent T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:19:40.618211 27915 raft_consensus.cc:2804] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:40.618777 27915 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:40.619202 27915 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:40.620716 27937 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:40.621546 27308 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:40.622783 27744 raft_consensus.cc:2749] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:40.629359 24438 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:40.629885 27938 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:40.630712 27308 raft_consensus.cc:2749] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:40.630600 24438 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:40.631657 27744 raft_consensus.cc:2804] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:40.621085 24468 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:19:40.632285 27744 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:40.632406 27308 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:40.632874 27744 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:40.633231 27308 raft_consensus.cc:697] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:40.634260 27308 consensus_queue.cc:237] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:40.605479 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:40.641983 24468 raft_consensus.cc:1240] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:40.643774 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:40.653576 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 95319.9us
I20260709 12:19:40.649710 24466 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:19:40.657573 24469 raft_consensus.cc:2393] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 10: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
W20260709 12:19:40.657562 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 233323us
I20260709 12:19:40.659807 27948 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.660256 24440 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:40.661263 24365 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:40.663575 27287 consensus_queue.cc:1059] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:19:40.665308 27950 log.cc:927] Time spent T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:19:40.575924 27925 consensus_queue.cc:237] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:40.535630 27931 consensus_queue.cc:237] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:40.670284 24466 raft_consensus.cc:1275] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:19:40.688088 24438 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:40.676364 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:40.677011 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:40.680027 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:40.660454 27949 log.cc:927] Time spent T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:19:40.692991 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:40.699599 27936 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.700233 27936 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:40.701892 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:40.576328 27916 consensus_queue.cc:237] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:40.717133 24400 raft_consensus.cc:1275] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
W20260709 12:19:40.682447 27923 consensus_meta.cc:287] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.561s	user 0.011s	sys 0.001s
I20260709 12:19:40.706379 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:40.666851 27918 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:40.717681 24400 pending_rounds.cc:85] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a: Aborting all ops after (but not including) 7
W20260709 12:19:40.682982 27906 consensus_meta.cc:287] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.888s	user 0.009s	sys 0.005s
W20260709 12:19:40.679915 27896 consensus_meta.cc:287] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.916s	user 0.008s	sys 0.005s
W20260709 12:19:40.680755 27943 log.cc:927] Time spent T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:19:40.696854 27907 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:40.661823 24440 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:40.668713 27911 log.cc:927] Time spent T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:19:40.667362 27942 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:40.727363 24400 pending_rounds.cc:107] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:19:40.831770 24400 raft_consensus.cc:2889] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:40.670099 27796 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:40.669982 27864 raft_consensus.cc:3055] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:40.694092 27858 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.681042 24217 catalog_manager.cc:5697] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 4 to 5, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 5 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:40.737959 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:40.739264 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:40.718703 24438 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:40.725759 27936 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:40.765122 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:40.841341 24397 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:19:40.772184 25116 raft_consensus.cc:1275] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:19:40.761792 24316 raft_consensus.cc:1275] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:19:40.846976 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 128377us
I20260709 12:19:40.848107 24438 leader_election.cc:400] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 8. Current term is 9.
I20260709 12:19:40.742985 27914 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.779426 27907 raft_consensus.cc:697] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:40.718309 27810 consensus_queue.cc:1059] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 8.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:19:40.698921 27917 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:40.825088 25084 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:40.660473 27948 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:40.769411 27906 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:40.848476 24438 leader_election.cc:403] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 12:19:40.899318 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 51392.3us
I20260709 12:19:40.853331 24391 raft_consensus.cc:1240] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:40.742643 27727 consensus_queue.cc:1048] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
W20260709 12:19:40.887612 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 62694.4us
I20260709 12:19:40.732895 27923 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:40.906608 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:40.921151 25084 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:40.845983 27864 raft_consensus.cc:740] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:40.856334 27942 raft_consensus.cc:697] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:40.890522 27936 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:40.897487 27896 raft_consensus.cc:2749] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:40.950567 24289 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:40.897354 27805 raft_consensus.cc:2749] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:40.953604 24466 raft_consensus.cc:1240] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9. Ops: []
W20260709 12:19:40.963670 27953 log.cc:927] Time spent T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.060s	user 0.001s	sys 0.001s
I20260709 12:19:40.963948 27942 consensus_queue.cc:237] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:40.965138 27954 log.cc:927] Time spent T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:19:40.815877 27519 consensus_queue.cc:237] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:40.857501 27858 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:40.977062 24319 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
W20260709 12:19:40.954838 27945 log.cc:927] Time spent T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 12:19:40.937713 27888 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:40.887434 27914 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:40.971642 27790 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:40.931780 27906 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:40.960140 27774 consensus_queue.cc:1048] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 12:19:41.061956 27858 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:41.063292 27957 log.cc:927] Time spent T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:19:41.066541 27914 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:41.068892 27937 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:41.069662 24470 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:41.070451 27964 raft_consensus.cc:2749] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 8. Current term is 9.
I20260709 12:19:41.071743 27964 consensus_queue.cc:1059] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:40.961493 27936 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.048571 27790 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:41.042936 27424 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:41.055033 27805 raft_consensus.cc:2804] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:41.059691 27913 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:41.089648 27913 raft_consensus.cc:3055] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:41.090135 27913 raft_consensus.cc:740] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:41.091234 27913 consensus_queue.cc:260] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.051337 27907 consensus_queue.cc:237] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:41.094807 27951 log.cc:927] Time spent T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 12:19:41.096786 27961 log.cc:927] Time spent T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:19:41.083547 27790 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:41.054668 27864 consensus_queue.cc:260] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.106029 27864 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:41.108879 27805 raft_consensus.cc:697] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:41.110188 27805 consensus_queue.cc:237] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:41.085003 27896 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.113564 27896 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.116442 27896 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:41.118816 27906 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:41.120105 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 526) took 1568 ms. Trace:
I20260709 12:19:41.116374 24323 raft_consensus.cc:3055] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:41.122278 24323 raft_consensus.cc:740] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:41.120510 24393 rpcz_store.cc:276] 0709 12:19:39.551984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.576292 (+ 24308us) service_pool.cc:224] Handling call
0709 12:19:41.119886 (+1543594us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54001e9bd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:41.120031 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2685098752}
I20260709 12:19:41.125459 24473 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:19:41.072840 27937 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:41.112510 27947 log.cc:927] Time spent T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.382s	user 0.001s	sys 0.000s
I20260709 12:19:41.134378 24473 raft_consensus.cc:1275] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:19:41.097018 27923 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:41.131270 24323 consensus_queue.cc:260] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.139657 24323 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:41.144454 27788 raft_consensus.cc:3055] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:41.144948 27788 raft_consensus.cc:740] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:41.145834 27788 consensus_queue.cc:260] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.147053 27788 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:41.149566 27930 raft_consensus.cc:3055] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:41.150054 27930 raft_consensus.cc:740] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:41.150904 27930 consensus_queue.cc:260] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:41.152180 27930 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:41.153074 27914 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:19:41.155682 27960 log.cc:927] Time spent T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:19:41.154642 27914 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.160902 25111 raft_consensus.cc:1240] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 10 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:19:41.162096 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:41.162768 25116 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:19:41.163573 27948 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:41.165202 27936 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:41.165979 27914 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:41.168202 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:41.168448 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.122462 27424 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.173033 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:41.173331 25116 raft_consensus.cc:1240] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:41.174726 24318 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:41.178894 24323 raft_consensus.cc:1275] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:19:41.188004 24212 maintenance_manager.cc:419] P 68b836feee894afe8d95b23bdf764928: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033393
W20260709 12:19:41.168462 27915 consensus_meta.cc:287] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.004s
I20260709 12:19:41.175676 27929 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.226039 27929 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:41.230052 27929 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:41.197270 27946 raft_consensus.cc:3055] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:41.230810 27946 raft_consensus.cc:740] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:41.197515 27704 raft_consensus.cc:1064] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:19:41.201905 24291 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:41.234139 27941 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:19:41.203254 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 301757us
W20260709 12:19:41.179786 27744 consensus_meta.cc:287] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.546s	user 0.009s	sys 0.003s
W20260709 12:19:41.206449 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 255973us
I20260709 12:19:41.198997 27424 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:41.176605 27920 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.179991 27718 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.134455 27937 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.186926 27600 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:41.225060 27915 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.224198 24323 pending_rounds.cc:85] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756: Aborting all ops after (but not including) 8
I20260709 12:19:41.257150 24323 pending_rounds.cc:107] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:19:41.257864 24323 raft_consensus.cc:2889] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:41.242935 24365 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
W20260709 12:19:41.236656 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.259732 25083 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
W20260709 12:19:41.244994 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.259902 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:41.261798 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:41.223666 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 561877us
I20260709 12:19:41.262071 24395 raft_consensus.cc:1240] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:19:41.262964 24440 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:41.220615 27854 consensus_meta.cc:287] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.783s	user 0.012s	sys 0.000s
I20260709 12:19:41.237931 24438 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:41.260854 24473 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:19:41.271484 27308 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:41.272657 27308 raft_consensus.cc:2804] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:41.273286 27308 raft_consensus.cc:697] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:41.274475 27308 consensus_queue.cc:237] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.279196 25083 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:41.252838 27744 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:41.283424 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:41.284257 24472 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:19:41.285333 27744 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:41.277931 27854 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.266716 27600 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:41.289142 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:41.285362 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:41.290822 24472 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:41.235916 27941 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:41.295428 27942 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:19:41.270465 27925 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.006s	sys 0.017s
W20260709 12:19:41.249779 27704 raft_consensus.cc:1068] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756: Unable to promote non-voter d99d5d772cfe4a96afcab3d3b009a281: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:19:41.297082 24474 raft_consensus.cc:1275] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:41.297322 27744 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.266578 27802 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.307730 24468 raft_consensus.cc:1240] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: []
W20260709 12:19:41.296329 27940 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:19:41.269867 27427 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:41.321012 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 59080.1us
I20260709 12:19:41.277820 27774 consensus_queue.cc:1059] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:19:41.292856 27896 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.327298 25113 raft_consensus.cc:1240] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: []
W20260709 12:19:41.328454 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 49386.9us
I20260709 12:19:41.249506 27907 consensus_queue.cc:1059] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:19:41.331955 24468 raft_consensus.cc:1275] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:41.301568 27941 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:41.309748 27925 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.006s	sys 0.018s
I20260709 12:19:41.333334 25084 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:41.296864 27892 raft_consensus.cc:2804] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:41.266521 27920 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.231865 27946 consensus_queue.cc:260] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.2, Last appended by leader: 2, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:41.308166 27600 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:41.344409 27918 consensus_meta.cc:287] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.603s	user 0.011s	sys 0.000s
I20260709 12:19:41.236092 27790 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:41.332264 27744 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.345556 27854 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:41.331212 27802 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.326717 27917 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:41.305235 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 67391.5us
I20260709 12:19:41.382308 24472 raft_consensus.cc:1275] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:19:41.359174 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 86964.8us
I20260709 12:19:41.443126 24440 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:41.268457 27718 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.414429 27942 raft_consensus.cc:697] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:41.419070 24396 raft_consensus.cc:1275] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:41.249876 27914 consensus_queue.cc:1059] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:19:41.326570 27424 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:41.424188 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 155686us
I20260709 12:19:41.357769 27427 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.428809 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:41.479779 24323 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 4.
W20260709 12:19:41.371270 27905 consensus_meta.cc:287] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.944s	user 0.007s	sys 0.007s
I20260709 12:19:41.435500 24394 raft_consensus.cc:1275] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 12:19:41.436813 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:41.416079 27892 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:41.313570 27971 consensus_queue.cc:1059] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.128s
I20260709 12:19:41.352424 27913 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:41.422310 27878 raft_consensus.cc:2804] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:19:41.476176 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:41.483793 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.427398 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:41.439733 27918 raft_consensus.cc:2749] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:41.448909 27888 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.492183 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:41.474591 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 84496.3us
I20260709 12:19:41.485494 24397 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:41.484822 24365 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:41.493942 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 50896.4us
I20260709 12:19:41.494798 24440 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:41.414108 27896 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.433378 27916 consensus_queue.cc:1048] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:19:41.500255 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:41.505802 24397 raft_consensus.cc:2410] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:19:41.502718 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:41.460913 27907 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.493453 25083 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:41.511803 25083 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:41.512081 24396 raft_consensus.cc:1275] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:19:41.507944 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:41.502092 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:41.504321 27854 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:41.510071 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:41.510164 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:41.484390 27892 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:41.525775 24440 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:41.530351 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:41.527096 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:41.545120 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:41.545554 24397 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:41.551872 24440 leader_election.cc:400] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 7. Current term is 8.
I20260709 12:19:41.551692 24472 raft_consensus.cc:1275] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:41.556999 24440 leader_election.cc:403] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:41.557660 27993 raft_consensus.cc:2749] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:41.557809 27970 raft_consensus.cc:3055] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:19:41.559240 27965 log.cc:927] Time spent T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 12:19:41.458886 27917 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.508700 27878 raft_consensus.cc:697] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:41.483604 27424 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:41.521436 27988 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:41.529306 27918 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:41.544292 27936 raft_consensus.cc:2749] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:41.522869 27971 consensus_queue.cc:1243] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer c855242ec9d34a5397741ef20db9de8a log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:19:41.490299 27905 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.504966 27888 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:41.603957 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 149458us
I20260709 12:19:41.550554 27854 raft_consensus.cc:697] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:41.523593 27907 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:41.583748 27970 raft_consensus.cc:740] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:41.601837 27915 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:41.628487 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:41.617736 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:41.629396 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:41.629707 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:19:41.619990 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 286747us
I20260709 12:19:41.617421 25111 raft_consensus.cc:1240] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:41.623430 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:41.606098 27937 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:41.632114 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:41.630036 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:41.624120 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 112369us
I20260709 12:19:41.631495 24400 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:19:41.686173 24467 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:41.616933 27993 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:41.696741 27975 consensus_queue.cc:1048] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 12:19:41.700541 27774 raft_consensus.cc:3055] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:41.701048 27774 raft_consensus.cc:740] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:41.701344 27896 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:41.702015 27774 consensus_queue.cc:260] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:41.703004 27896 consensus_queue.cc:1048] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:41.705461 27802 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:41.706334 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:41.707549 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:41.708222 24473 raft_consensus.cc:2393] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 7: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:41.708812 27976 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:41.709338 27976 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:41.709746 27976 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:41.713316 27970 consensus_queue.cc:260] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:41.714465 27970 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:41.715687 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.690634 24468 raft_consensus.cc:1240] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:19:41.697362 27555 raft_consensus.cc:3055] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:41.716836 27555 raft_consensus.cc:740] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:41.718124 27555 consensus_queue.cc:260] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.720778 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:41.721441 27985 log.cc:927] Time spent T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 12:19:41.721668 24468 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 7: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:41.722693 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:41.723124 27974 log.cc:927] Time spent T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 12:19:41.723430 24468 raft_consensus.cc:2393] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 10: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
W20260709 12:19:41.724778 27973 log.cc:927] Time spent T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:19:41.725975 27790 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:41.727255 27986 log.cc:927] Time spent T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 12:19:41.728797 27937 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:19:41.729378 27980 log.cc:927] Time spent T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 12:19:41.729429 27937 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.730438 27718 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:41.732070 27937 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:41.732944 27905 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:41.724327 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:41.687390 24438 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:41.619918 27918 raft_consensus.cc:697] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:41.753301 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:41.754065 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:41.755295 24400 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
W20260709 12:19:41.740585 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 53336.6us
I20260709 12:19:41.755626 24467 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:19:41.746851 24397 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:19:41.749246 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:41.750787 24472 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:41.746555 24466 raft_consensus.cc:2468] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:41.759502 24395 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:41.763706 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.765206 24466 raft_consensus.cc:1275] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:19:41.767519 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:41.768155 25116 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEARNER]: Advancing to term 9
I20260709 12:19:41.738967 27920 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:41.774834 25114 raft_consensus.cc:1240] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:41.782959 24395 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:19:41.630513 27972 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 7. Current term is 8.
I20260709 12:19:41.603837 27942 consensus_queue.cc:237] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:41.696199 27993 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:19:41.790815 24469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 2031) took 1194 ms (client timeout 1547 ms). Trace:
I20260709 12:19:41.695703 27915 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:41.747742 27936 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:41.753365 27916 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.793664 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:41.794893 24400 raft_consensus.cc:1240] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 7. Current term is 8. Ops: [4.3-7.4]
W20260709 12:19:41.769448 27982 log.cc:927] Time spent T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.336s	user 0.001s	sys 0.000s
W20260709 12:19:41.793256 24469 rpcz_store.cc:269] 0709 12:19:40.596327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.596505 (+   178us) service_pool.cc:224] Handling call
0709 12:19:41.790587 (+1194082us) spinlock_profiling.cc:243] Waited 6.26 ms on lock 0x7b54002cf1d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:41.790750 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14406528}
I20260709 12:19:41.761535 27774 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:41.757087 27937 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:41.757328 27866 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.774721 27929 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.774911 27744 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:41.822067 25117 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:41.784861 27718 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:41.803226 27905 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.807150 27916 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:41.825182 27892 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.807479 27427 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:41.814563 27925 consensus_queue.cc:1048] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:19:41.827207 27977 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:41.814623 27788 consensus_meta.cc:287] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.667s	user 0.011s	sys 0.002s
I20260709 12:19:41.802582 25116 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 LEARNER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:19:41.802893 27997 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.799232 27993 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:41.817526 27937 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:41.757011 27878 consensus_queue.cc:237] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:41.855506 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 181936us
W20260709 12:19:41.875190 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 75410.3us
I20260709 12:19:41.876545 24289 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:41.877822 24289 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:41.881537 25116 raft_consensus.cc:1240] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:41.693962 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:41.804008 27936 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:41.806960 27915 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.887391 25084 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:41.901816 24366 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:41.902318 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:41.831936 27866 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:41.911482 24316 raft_consensus.cc:1275] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:19:41.912066 24316 pending_rounds.cc:85] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756: Aborting all ops after (but not including) 4
I20260709 12:19:41.912348 24316 pending_rounds.cc:107] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:19:41.912653 24316 raft_consensus.cc:2889] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:41.914415 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:41.915349 24318 raft_consensus.cc:2468] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:19:41.917930 24322 raft_consensus.cc:1275] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:19:41.836098 27929 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:41.850143 27718 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:41.887845 27971 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:41.883474 27937 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:41.937718 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:41.913902 27910 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.851454 27994 consensus_queue.cc:1048] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.085s
W20260709 12:19:41.940326 27958 log.cc:927] Time spent T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.889s	user 0.006s	sys 0.000s
I20260709 12:19:41.952525 27910 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:41.957593 27916 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:41.940567 27972 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.958437 25115 raft_consensus.cc:1275] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:41.958701 27972 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.960489 27907 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:41.941735 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.961244 27915 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:41.963534 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:41.963958 27866 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:41.940583 27998 log.cc:927] Time spent T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:19:41.853119 27905 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.939556 25116 raft_consensus.cc:1240] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:41.952491 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:41.975087 25119 raft_consensus.cc:2393] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 6: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:41.830127 27854 consensus_queue.cc:237] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.899768 27575 raft_consensus.cc:2804] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:41.904879 27810 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.901252 27788 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:41.874854 27977 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:41.907490 27779 raft_consensus.cc:2804] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:41.905681 27864 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
W20260709 12:19:41.968900 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 67893.3us
I20260709 12:19:42.006560 25084 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:41.905102 27600 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.888002 27790 consensus_queue.cc:1059] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:19:41.965245 25114 raft_consensus.cc:1275] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:19:41.920368 27931 consensus_queue.cc:1048] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 12:19:41.950484 27971 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:41.971524 27991 log.cc:927] Time spent T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:19:41.883774 27918 consensus_queue.cc:237] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:42.004145 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:42.018370 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:42.018851 25117 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
W20260709 12:19:42.025992 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:42.004060 28000 log.cc:927] Time spent T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:19:41.994530 27888 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:42.051551 24322 raft_consensus.cc:2393] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 7: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:41.966020 27424 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:41.918936 27996 consensus_queue.cc:1048] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.116s
I20260709 12:19:41.890554 27997 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:41.994325 27575 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.002673 27866 raft_consensus.cc:2804] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:42.035755 27790 consensus_queue.cc:1243] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer c855242ec9d34a5397741ef20db9de8a log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:19:42.064355 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 97208.2us
I20260709 12:19:42.038602 27718 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:42.039469 27959 log.cc:927] Time spent T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.977s	user 0.005s	sys 0.000s
I20260709 12:19:42.030685 27864 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:42.049233 24400 raft_consensus.cc:2393] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 9: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:42.011656 27779 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.029826 27427 raft_consensus.cc:2804] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:42.063090 24440 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:42.013219 27600 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:42.036288 27971 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:42.012208 27788 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:42.068729 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:42.008859 27810 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:42.062280 27866 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.062523 27925 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.063902 27575 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:42.074795 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 63706.3us
I20260709 12:19:42.070202 27427 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:42.095489 28002 log.cc:927] Time spent T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 12:19:42.095816 27427 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:42.097391 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:42.098371 24396 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:19:42.099757 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:42.066383 27744 consensus_queue.cc:1059] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:19:42.095213 27907 consensus_queue.cc:1059] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:42.101159 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:42.065056 27859 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:42.095400 28001 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.103045 27859 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:42.104002 27988 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:42.105299 27859 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:42.105310 27929 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:42.106273 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:42.106841 24398 raft_consensus.cc:1275] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:19:42.106979 24325 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:42.108225 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:42.109167 28004 log.cc:927] Time spent T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:19:42.110286 27946 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:42.111635 24319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 1885) took 2281 ms (client timeout 1856 ms). Trace:
W20260709 12:19:42.112068 24319 rpcz_store.cc:269] 0709 12:19:39.830396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.830532 (+   136us) service_pool.cc:224] Handling call
0709 12:19:42.111427 (+2280895us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54000d4dd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:42.111547 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2402209152}
I20260709 12:19:42.113337 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:42.114660 24319 raft_consensus.cc:3055] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:42.114977 24319 raft_consensus.cc:740] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:42.116039 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:42.117606 24317 raft_consensus.cc:1275] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:19:42.117952 24317 pending_rounds.cc:85] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756: Aborting all ops after (but not including) 5
I20260709 12:19:42.118161 24317 pending_rounds.cc:107] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:19:42.118439 24317 raft_consensus.cc:2889] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:42.119107 24470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 2036) took 1475 ms (client timeout 1617 ms). Trace:
W20260709 12:19:42.119527 24470 rpcz_store.cc:269] 0709 12:19:40.643384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.643544 (+   160us) service_pool.cc:224] Handling call
0709 12:19:42.118930 (+1475386us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b5400243e54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:42.119033 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":959943936}
I20260709 12:19:42.120757 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:42.122308 24316 raft_consensus.cc:1275] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:19:42.124063 27913 consensus_meta.cc:287] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.627s	user 0.008s	sys 0.000s
I20260709 12:19:42.127138 24319 consensus_queue.cc:260] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:42.128369 24319 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:42.132757 25112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 1071) took 1594 ms. Trace:
I20260709 12:19:42.100281 27905 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:42.070030 27779 raft_consensus.cc:3060] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:42.137904 24391 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:42.151762 25084 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:42.119956 24317 raft_consensus.cc:1275] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:19:42.145916 24465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33198 (request call id 752) took 1980 ms (client timeout 2199 ms). Trace:
W20260709 12:19:42.154856 24465 rpcz_store.cc:269] 0709 12:19:40.169255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.169411 (+   156us) service_pool.cc:224] Handling call
0709 12:19:42.145653 (+1976242us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b540010e354. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:42.145850 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320146688}
I20260709 12:19:42.074579 27964 raft_consensus.cc:2749] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:42.159763 24319 raft_consensus.cc:1275] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:19:42.065558 27424 consensus_queue.cc:1048] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:19:42.161373 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:42.167750 24319 pending_rounds.cc:85] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756: Aborting all ops after (but not including) 5
I20260709 12:19:42.168087 24319 pending_rounds.cc:107] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:19:42.168359 24319 raft_consensus.cc:2889] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:42.103940 28001 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:42.093189 27866 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:42.133172 25112 rpcz_store.cc:276] 0709 12:19:40.538379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.540005 (+  1626us) service_pool.cc:224] Handling call
0709 12:19:40.638894 (+ 98889us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:40.693149 (+ 54255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:40.693213 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:40.696517 (+  3304us) log.cc:844] Serialized 26 byte log entry
0709 12:19:41.347774 (+651257us) spinlock_profiling.cc:243] Waited 5.58 ms on lock 0x7b18004930c0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a94241e07 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425ec02 00007f4a96ee620b 00007f4a96eebd23 00007f4a96eec0d1 00007f4a97307a0f
0709 12:19:41.494104 (+146330us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:41.494143 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:41.494214 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:42.132397 (+638183us) raft_consensus.cc:1685] finished
0709 12:19:42.132421 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:42.132685 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20083,"raft.queue_time_us":22336,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":20061,"spinlock_wait_cycles":12832512,"thread_start_us":146126,"threads_started":1,"wal-append.queue_time_us":1094308}
I20260709 12:19:42.080497 27888 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
W20260709 12:19:42.188998 28007 log.cc:927] Time spent T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:19:42.189720 27600 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:42.190246 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:42.191154 24465 raft_consensus.cc:2393] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:42.191000 27888 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:42.191654 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:42.192524 24399 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:19:42.193305 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:42.193941 24466 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:19:42.194475 24321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 521) took 1458 ms. Trace:
I20260709 12:19:42.194793 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:42.194871 24321 rpcz_store.cc:276] 0709 12:19:40.736250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.736369 (+   119us) service_pool.cc:224] Handling call
0709 12:19:42.113692 (+1377323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:42.150668 (+ 36976us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:42.150702 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:42.150753 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:42.150795 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:42.150870 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:42.194311 (+ 43441us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54000d4dd0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:42.194417 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36575,"raft.queue_time_us":39567,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":17485,"spinlock_wait_cycles":3166719360}
I20260709 12:19:42.195931 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:42.198828 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:42.200055 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:42.205451 28006 log.cc:927] Time spent T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:19:42.207230 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:42.208333 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:42.208895 24473 raft_consensus.cc:2376] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6. Re-sending same reply.
I20260709 12:19:42.211225 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:42.212167 24474 raft_consensus.cc:2393] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:42.212693 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:42.212946 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:42.213452 25111 raft_consensus.cc:2393] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:42.213778 24474 raft_consensus.cc:2393] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 7: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:42.214618 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:42.091501 27891 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:42.215804 24472 raft_consensus.cc:1240] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:19:42.213196 25113 raft_consensus.cc:1240] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:42.212440 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:42.217062 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:42.218694 24473 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:19:42.217988 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:42.219075 24467 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:42.192279 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:42.215152 24474 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
W20260709 12:19:42.225550 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.196461 24466 raft_consensus.cc:2376] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7. Re-sending same reply.
W20260709 12:19:42.218818 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:42.237051 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:42.237524 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:42.319247 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 80767.8us
I20260709 12:19:42.245865 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:42.334631 24473 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:42.319511 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:42.336354 24469 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:42.338517 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:42.341630 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.343189 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:42.349810 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:42.350445 24469 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:42.269618 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:42.352576 24474 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:19:42.353588 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:42.250249 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:42.170908 27896 raft_consensus.cc:2804] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:42.178747 27931 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.370018 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:42.374780 24467 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:42.376127 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:42.377003 24467 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:42.382302 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:42.382927 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:42.383651 24474 raft_consensus.cc:2393] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:42.243937 27600 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.244398 27892 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:42.150298 27925 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:42.440068 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:42.399202 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:42.400655 24398 raft_consensus.cc:2393] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:42.451301 24391 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
W20260709 12:19:42.453505 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 72612.7us
I20260709 12:19:42.461021 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:42.403241 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:42.445572 24474 raft_consensus.cc:1240] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:19:42.215721 27910 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:42.443465 27941 consensus_meta.cc:287] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.013s	user 0.012s	sys 0.001s
I20260709 12:19:42.347340 27948 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:42.473285 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:42.445331 27942 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:42.443363 27976 consensus_meta.cc:287] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.733s	user 0.011s	sys 0.003s
I20260709 12:19:42.367379 27891 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.385448 27896 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.321403 28012 consensus_queue.cc:1048] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.237s
I20260709 12:19:42.481621 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:42.277209 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:42.522974 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.386185 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:42.484333 24474 raft_consensus.cc:1275] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:42.473964 24469 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:19:42.488814 24471 raft_consensus.cc:1240] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:42.490536 27977 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:42.491631 27774 consensus_meta.cc:287] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.674s	user 0.009s	sys 0.000s
I20260709 12:19:42.439657 27994 consensus_queue.cc:1059] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:19:42.491796 27864 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:42.492277 27993 consensus_meta.cc:287] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.586s	user 0.009s	sys 0.000s
W20260709 12:19:42.495810 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 398355us
I20260709 12:19:42.220914 27929 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.506217 27999 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:42.513208 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 378004us
I20260709 12:19:42.542009 24469 raft_consensus.cc:1275] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:19:42.518232 24465 raft_consensus.cc:1275] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:19:42.244230 27972 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:42.471112 27936 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:42.520511 27896 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:42.561203 28019 consensus_queue.cc:1048] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:19:42.563366 28008 log.cc:927] Time spent T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.400s	user 0.000s	sys 0.001s
W20260709 12:19:42.567921 27970 consensus_meta.cc:287] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.853s	user 0.008s	sys 0.001s
I20260709 12:19:42.530239 24323 raft_consensus.cc:1275] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:42.530694 24471 raft_consensus.cc:1275] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:19:42.531477 24474 raft_consensus.cc:1240] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:42.490257 27948 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:42.507512 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 143148us
I20260709 12:19:42.357765 27790 consensus_queue.cc:1059] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.161s
I20260709 12:19:42.532317 27888 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:42.491812 27788 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:42.516542 27942 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:42.527415 24473 raft_consensus.cc:1240] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:42.567602 27971 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:42.521139 24399 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:19:42.575433 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:42.586982 27915 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:42.481112 27931 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:42.586287 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:42.658160 25119 raft_consensus.cc:2393] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 8: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:42.589404 24365 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:42.485380 27941 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:42.595899 24469 raft_consensus.cc:1240] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:42.535990 27993 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:42.611970 24465 raft_consensus.cc:1275] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:42.446203 27600 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:42.609270 27864 consensus_queue.cc:1048] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:19:42.521628 27891 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:42.515909 27976 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:42.575209 27999 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:42.616070 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:42.625070 24468 raft_consensus.cc:2410] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:19:42.489759 24467 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:19:42.614492 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:42.628279 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:42.634382 25113 raft_consensus.cc:2410] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:19:42.584959 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:42.603441 28019 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:42.609396 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:42.575546 27929 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:42.612005 27424 consensus_queue.cc:1048] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
W20260709 12:19:42.663949 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 74673.3us
W20260709 12:19:42.649291 24440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.609544 27744 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.626281 27972 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.624245 28016 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.681737 24290 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:42.622520 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:42.624960 27925 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:42.736296 24474 raft_consensus.cc:2393] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 8: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:42.737350 24324 raft_consensus.cc:1240] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:42.716851 24320 raft_consensus.cc:2393] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 7: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:42.737219 24471 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:19:42.774025 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:42.736795 25112 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:42.735474 24322 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
W20260709 12:19:42.702363 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 66630.7us
I20260709 12:19:42.731778 24317 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:42.776957 25083 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:19:42.777060 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 95460.8us
I20260709 12:19:42.778296 24290 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:42.754879 25114 raft_consensus.cc:1240] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:42.761670 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:42.762840 24399 raft_consensus.cc:1275] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:19:42.662029 27997 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:42.669938 27994 raft_consensus.cc:3055] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:19:42.743881 27946 consensus_meta.cc:287] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.633s	user 0.011s	sys 0.002s
I20260709 12:19:42.680923 27916 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:42.778738 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:42.668881 27888 consensus_queue.cc:1059] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 12:19:42.784957 24290 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:42.743036 27892 consensus_queue.cc:1048] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:19:42.809993 24474 raft_consensus.cc:1240] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: []
W20260709 12:19:42.782292 27427 consensus_meta.cc:287] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.686s	user 0.008s	sys 0.004s
I20260709 12:19:42.672485 27915 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:42.787160 27916 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.785259 27994 raft_consensus.cc:740] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:42.799621 27970 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:19:42.820123 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.784875 28001 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:42.750167 28019 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:42.802251 27925 raft_consensus.cc:2804] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:42.769490 27744 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:42.823575 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:42.772786 27972 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:42.799561 27905 raft_consensus.cc:2804] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:19:42.842840 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 57984.1us
I20260709 12:19:42.816044 28029 raft_consensus.cc:2749] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:42.806178 28024 consensus_queue.cc:1048] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:19:42.781558 28016 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:42.858520 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 403943us
I20260709 12:19:42.834563 27916 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:42.871897 24290 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:42.874359 24471 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
I20260709 12:19:42.858961 27987 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:42.825393 27427 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:42.867094 27925 raft_consensus.cc:697] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 6 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:42.882579 27718 raft_consensus.cc:2804] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:42.913175 27718 raft_consensus.cc:697] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:42.914352 27718 consensus_queue.cc:237] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:42.916200 27999 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:42.881914 24290 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:42.917860 24290 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:42.848424 27977 consensus_queue.cc:1059] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:19:42.846073 27970 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:42.940483 24290 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:42.940814 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 256330us
I20260709 12:19:42.904502 27910 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.913256 27993 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:42.869978 27905 raft_consensus.cc:697] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
W20260709 12:19:42.924294 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.928573 24393 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:19:42.936115 24474 raft_consensus.cc:1275] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:19:42.959606 24366 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:42.967216 24366 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:42.939395 27779 consensus_meta.cc:287] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.761s	user 0.005s	sys 0.006s
I20260709 12:19:42.882045 27987 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:42.954320 28029 raft_consensus.cc:2749] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:42.944883 28031 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:42.937273 28019 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:42.949576 27989 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:42.984962 28029 consensus_queue.cc:1048] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
W20260709 12:19:42.989238 27575 consensus_meta.cc:287] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.825s	user 0.012s	sys 0.000s
I20260709 12:19:42.963447 27910 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:42.965864 27424 consensus_queue.cc:1048] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:19:42.976238 27896 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:42.990870 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 239169us
I20260709 12:19:42.989763 27575 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:43.019028 24365 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:19:43.022421 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 69866.7us
I20260709 12:19:42.983229 27987 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:43.028416 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 62969.2us
I20260709 12:19:43.032492 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:42.985138 27941 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:42.987613 28031 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.985786 27948 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:42.966068 27864 consensus_queue.cc:1048] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:19:42.985307 27891 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:43.015534 28019 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:43.017882 28024 raft_consensus.cc:2804] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:43.042790 24316 raft_consensus.cc:1240] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:19:42.879582 27994 consensus_queue.cc:260] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:43.046758 27774 consensus_queue.cc:1048] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:43.046161 24290 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:42.979810 28027 consensus_queue.cc:1048] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:19:43.055545 27704 raft_consensus.cc:3055] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:43.033236 27942 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:42.978682 28040 consensus_queue.cc:1048] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:19:42.984465 27779 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:43.038343 28031 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:43.056173 27704 raft_consensus.cc:740] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:43.043373 27929 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:43.041060 27600 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:42.975663 27905 consensus_queue.cc:237] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:43.043012 28019 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.065398 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:43.050719 28024 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.048846 27972 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:43.094152 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:43.054358 27931 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:43.086876 25119 raft_consensus.cc:1240] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 4. Current term is 5. Ops: [4.5-4.5]
W20260709 12:19:43.095868 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 76889.3us
I20260709 12:19:43.085703 27600 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:43.099748 27600 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:19:43.102346 27600 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:19:43.064203 27704 consensus_queue.cc:260] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:43.103981 27704 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:43.094262 28024 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:43.105520 27987 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:43.107838 28031 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:43.108878 27744 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:43.074170 27941 consensus_queue.cc:1048] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:19:43.110024 27427 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:43.042301 28037 consensus_queue.cc:1048] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:19:43.090642 28016 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:43.091111 28049 consensus_queue.cc:1048] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:19:43.091987 28041 consensus_queue.cc:1048] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.121s
I20260709 12:19:43.093341 27970 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:43.061326 28045 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:43.087422 28019 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:43.088562 28034 consensus_queue.cc:1059] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.107s
I20260709 12:19:43.050107 27948 consensus_queue.cc:1048] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:19:43.082870 27994 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:43.085372 27865 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:43.082717 27915 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:43.036319 27925 consensus_queue.cc:237] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:43.089653 27866 consensus_meta.cc:287] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.845s	user 0.007s	sys 0.005s
I20260709 12:19:43.119144 27987 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:43.135413 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:43.121441 27942 consensus_queue.cc:1048] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:19:43.160567 24323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1896) took 1279 ms. Trace:
I20260709 12:19:43.161108 24323 rpcz_store.cc:276] 0709 12:19:41.880712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:41.880901 (+   189us) service_pool.cc:224] Handling call
0709 12:19:41.905170 (+ 24269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:42.613226 (+708056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:43.160296 (+547070us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b54002567d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:43.160495 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1436704512}
I20260709 12:19:43.127579 27864 consensus_queue.cc:1048] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:19:43.177386 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:43.170575 28031 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:43.174484 27937 consensus_meta.cc:287] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 1.199s	user 0.012s	sys 0.000s
W20260709 12:19:43.184685 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 74890.2us
I20260709 12:19:43.180192 27555 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:43.175832 28046 raft_consensus.cc:3055] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:43.188429 28046 raft_consensus.cc:740] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:43.189311 28046 consensus_queue.cc:260] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:43.190619 28046 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:43.163782 27865 raft_consensus.cc:697] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:43.192499 24365 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:43.194176 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:43.144093 27866 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:43.205602 24440 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:43.206301 24316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 529) took 1197 ms. Trace:
I20260709 12:19:43.183337 27910 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:43.207908 27916 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:43.210870 27917 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:43.213163 24318 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:43.218556 28019 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:43.200968 27575 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:43.229441 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:43.225917 24323 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 7: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:43.232981 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:43.252982 25113 raft_consensus.cc:2393] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 LEARNER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:43.232939 24316 rpcz_store.cc:276] 0709 12:19:42.008726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:42.123056 (+114330us) service_pool.cc:224] Handling call
0709 12:19:42.123358 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:43.045488 (+922130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:43.205949 (+160461us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b54000a7154. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:43.206219 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2113799424}
I20260709 12:19:43.235030 24365 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:43.237002 27931 raft_consensus.cc:2804] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:43.246002 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:43.251777 24471 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:19:43.271525 28037 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:43.275141 28037 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:43.275619 28037 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:43.275923 28019 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:43.277877 27916 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:43.273264 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:43.281208 24323 raft_consensus.cc:2393] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 10: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:43.282235 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:43.282902 24323 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:19:43.273579 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:43.284333 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:43.285470 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:43.286542 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:43.287045 24316 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:43.246748 27975 raft_consensus.cc:2749] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:43.291115 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:43.260053 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:43.298578 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 56634.7us
I20260709 12:19:43.296618 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:43.300333 24290 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:43.246966 27969 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.300196 24471 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
W20260709 12:19:43.303057 24440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.303517 24365 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:43.304229 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:43.225847 27937 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:43.305179 24471 raft_consensus.cc:2393] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 10: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:43.306164 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:43.259881 27931 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:43.307761 24440 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:43.309864 27865 consensus_queue.cc:237] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:43.296051 28052 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:43.318696 27866 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:43.319226 27937 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:43.319044 28052 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:43.307832 27969 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:43.322309 27969 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:43.309360 28056 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:43.323391 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:43.323321 28056 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:43.324167 24465 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:43.325941 28056 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:43.327497 27975 raft_consensus.cc:2749] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:43.328469 24466 raft_consensus.cc:2393] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 10: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:43.307425 27916 raft_consensus.cc:2804] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:43.329003 27916 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:43.318734 28024 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:43.329566 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33198 (request call id 767) took 1214 ms. Trace:
I20260709 12:19:43.330017 24397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2472) took 1567 ms. Trace:
I20260709 12:19:43.329922 24466 rpcz_store.cc:276] 0709 12:19:42.114636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:42.385814 (+271178us) service_pool.cc:224] Handling call
0709 12:19:43.329373 (+943559us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b54000339d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:43.329512 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1848196864}
I20260709 12:19:43.331123 28024 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:43.330714 24397 rpcz_store.cc:276] 0709 12:19:41.762481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:41.763521 (+  1040us) service_pool.cc:224] Handling call
0709 12:19:41.790596 (+ 27075us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:41.791027 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:41.791060 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:43.094572 (+1303512us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b2c00000de8. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a95c45a11 00007f4a95c55372 00007f4a97387a01 00007f4a9734c43a 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2
0709 12:19:43.118144 (+ 23572us) log.cc:844] Serialized 52 byte log entry
0709 12:19:43.180808 (+ 62664us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:43.180864 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:43.180962 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:43.329655 (+148693us) raft_consensus.cc:1685] finished
0709 12:19:43.329688 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:43.329948 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":172,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":9245,"spinlock_wait_cycles":11906432,"thread_start_us":44673,"threads_started":1,"wal-append.queue_time_us":176981}
W20260709 12:19:43.333392 28015 log.cc:927] Time spent T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.741s	user 0.002s	sys 0.000s
I20260709 12:19:43.334542 27915 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.335202 24316 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:19:43.336035 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:43.304880 27925 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:43.337143 27925 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.337519 27925 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:43.316335 25116 raft_consensus.cc:1240] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:19:43.340591 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:43.341325 24466 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:43.315337 24440 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:43.317154 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:43.329461 27916 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:43.342322 24471 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:43.346357 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:43.347491 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:43.348493 27906 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:43.348918 27906 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.349272 27906 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:43.352911 28045 raft_consensus.cc:2749] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:43.335059 27915 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:43.357837 27915 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:43.309185 27931 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:43.361503 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 46256.5us
I20260709 12:19:43.362498 25112 raft_consensus.cc:1240] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:43.367334 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:43.368161 24471 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:43.369513 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:43.380585 24466 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:43.377440 27975 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.382172 24365 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:43.382747 27975 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:43.383167 28041 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:43.384084 28041 raft_consensus.cc:697] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:43.385314 27975 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:43.385651 24465 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:19:43.389328 28052 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:43.396028 27810 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:43.396703 24397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:19:43.397312 24397 raft_consensus.cc:606] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:43.397684 24397 raft_consensus.cc:614] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:43.387090 24365 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:43.403663 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:43.405812 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:43.385413 28041 consensus_queue.cc:237] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:43.430572 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:43.459024 24465 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:43.445060 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:43.442396 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:43.460367 24323 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:43.461501 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:43.461872 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:43.463248 24321 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:43.463536 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:43.463711 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:43.425846 27975 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.464890 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:43.438165 27896 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:43.446424 27992 log.cc:927] Time spent T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 1.750s	user 0.005s	sys 0.001s
I20260709 12:19:43.468897 27975 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:43.429581 27810 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:19:43.448496 28054 log.cc:927] Time spent T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:19:43.468993 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:43.435896 28009 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
W20260709 12:19:43.472339 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.476384 27975 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:43.479250 24323 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:43.480803 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:43.483225 24323 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:43.462167 28021 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.486495 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:43.429409 28037 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:43.448590 27916 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:19:43.482270 27810 raft_consensus.cc:697] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:43.491299 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:43.493525 24323 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:19:43.496343 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:43.498272 24323 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 6.
I20260709 12:19:43.500893 24471 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:43.502111 24365 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:43.504437 27975 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.505328 27975 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:43.507571 27975 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:43.507740 27976 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:43.505327 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:43.508401 27976 raft_consensus.cc:2804] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:43.508739 24471 raft_consensus.cc:2393] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:43.508898 27976 raft_consensus.cc:697] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:43.509749 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:43.510406 24471 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:43.509944 27976 consensus_queue.cc:237] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:43.512068 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:43.515025 24470 raft_consensus.cc:2368] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 8. Current term is 9.
W20260709 12:19:43.504344 25082 connection.cc:256] RPC call timeout handler was delayed by -1.0954624839998814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3175s for a response
I20260709 12:19:43.516191 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:43.516613 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:43.516937 24470 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:43.519644 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:43.520483 25110 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:19:43.539088 25113 raft_consensus.cc:1240] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:19:43.543231 24470 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:19:43.544297 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:43.540107 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:43.545764 25110 raft_consensus.cc:1275] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:19:43.488850 28021 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:43.490949 27925 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:43.551344 25114 raft_consensus.cc:1240] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:43.550064 24470 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:43.566949 24365 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:43.548583 24471 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:43.569695 24365 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:43.571367 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:43.572314 24471 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:43.575858 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:43.575966 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:43.577412 24321 raft_consensus.cc:2368] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
I20260709 12:19:43.584879 27810 consensus_queue.cc:237] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:43.585775 27916 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:19:43.586905 24466 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:19:43.589092 24470 raft_consensus.cc:2410] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:19:43.550261 25110 pending_rounds.cc:85] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281: Aborting all ops after (but not including) 6
I20260709 12:19:43.590818 25110 pending_rounds.cc:107] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:19:43.591187 25110 raft_consensus.cc:2889] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:43.549005 28037 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:43.594777 24472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1935) took 1846 ms. Trace:
I20260709 12:19:43.595400 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:43.574317 27942 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:43.574592 27837 raft_consensus.cc:2804] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:43.597311 24470 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:43.595218 24472 rpcz_store.cc:276] 0709 12:19:41.748372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:41.767733 (+ 19361us) service_pool.cc:224] Handling call
0709 12:19:42.215523 (+447790us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:42.216297 (+   774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:43.594563 (+1378266us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b54001509d0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:43.594719 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1029028608}
I20260709 12:19:43.604596 24472 raft_consensus.cc:1240] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:43.611302 25115 raft_consensus.cc:1275] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:19:43.614624 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2066) took 1258 ms. Trace:
I20260709 12:19:43.615037 24391 rpcz_store.cc:276] 0709 12:19:42.355989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:42.452237 (+ 96248us) service_pool.cc:224] Handling call
0709 12:19:42.460052 (+  7815us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:42.470591 (+ 10539us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:19:43.359886 (+889295us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b180016c360. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a941d9c0a 00007f4a9d919219 00007f4a94261a40 00007f4a9425c4e4 00007f4a9425c455 00007f4a9ad443c7 00007f4a973569a7 00007f4a973660bf 00007f4a97366038
0709 12:19:43.377121 (+ 17235us) log.cc:844] Serialized 14 byte log entry
0709 12:19:43.529904 (+152783us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:43.530523 (+   619us) log.cc:844] Serialized 26 byte log entry
0709 12:19:43.530794 (+   271us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:43.530850 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:43.530929 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:43.610165 (+ 79236us) raft_consensus.cc:1685] finished
0709 12:19:43.614391 (+  4226us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:43.614552 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7661,"prepare.queue_time_us":960160,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":17205,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":14929,"spinlock_wait_cycles":11906432,"thread_start_us":86871,"threads_started":2,"wal-append.queue_time_us":147351}
I20260709 12:19:43.617651 24471 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:19:43.619360 24365 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:43.614128 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:43.601329 27942 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:43.626662 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:43.627329 25115 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:43.625984 27942 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:43.632336 24470 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:43.634335 24365 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:43.622028 27837 raft_consensus.cc:697] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:43.635499 25114 raft_consensus.cc:1240] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:43.628178 27424 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:43.640955 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:43.644395 25114 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:43.653616 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:43.654368 25082 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:43.656538 27896 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:43.657120 27837 consensus_queue.cc:237] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:43.655009 27996 consensus_queue.cc:1048] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:19:43.634582 28021 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:43.637001 28037 raft_consensus.cc:2804] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:43.656224 25082 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:43.689759 25082 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:43.695067 25082 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:43.696528 24325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1914) took 1095 ms. Trace:
I20260709 12:19:43.692206 25114 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:19:43.671602 27424 raft_consensus.cc:697] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:43.702848 24323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1913) took 1102 ms. Trace:
I20260709 12:19:43.703516 27424 consensus_queue.cc:237] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:43.703228 24323 rpcz_store.cc:276] 0709 12:19:42.600787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:43.500004 (+899217us) service_pool.cc:224] Handling call
0709 12:19:43.500436 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:43.502643 (+  2207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:43.502689 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:43.503400 (+   711us) log.cc:844] Serialized 26 byte log entry
0709 12:19:43.600892 (+ 97492us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:43.600930 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:43.601002 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:43.702628 (+101626us) raft_consensus.cc:1685] finished
0709 12:19:43.702646 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:43.702789 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":331,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":134,"thread_start_us":72539,"threads_started":1,"wal-append.queue_time_us":131156}
I20260709 12:19:43.705513 24323 raft_consensus.cc:1240] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 7. Current term is 8. Ops: [4.3-7.4]
I20260709 12:19:43.706707 24323 raft_consensus.cc:1240] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:43.707948 24323 raft_consensus.cc:1275] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:19:43.708249 24323 pending_rounds.cc:85] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756: Aborting all ops after (but not including) 3
I20260709 12:19:43.708473 24323 pending_rounds.cc:107] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:19:43.708832 27925 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:43.708741 24323 raft_consensus.cc:2889] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:43.711241 24323 raft_consensus.cc:1275] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:19:43.698035 24325 rpcz_store.cc:276] 0709 12:19:42.601011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:43.550867 (+949856us) service_pool.cc:224] Handling call
0709 12:19:43.551355 (+   488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:43.551793 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:19:43.672374 (+120581us) log.cc:844] Serialized 14 byte log entry
0709 12:19:43.695606 (+ 23232us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:43.695910 (+   304us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:43.696035 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:43.696178 (+   143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:43.696403 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":153,"thread_start_us":116651,"threads_started":2}
I20260709 12:19:43.687204 27996 raft_consensus.cc:2749] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:43.698864 27905 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:43.695874 28037 raft_consensus.cc:697] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:43.720567 27906 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:43.696163 27915 consensus_queue.cc:1048] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:19:43.733968 27905 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.738101 24472 raft_consensus.cc:1240] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:43.739741 27905 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:43.739135 28037 consensus_queue.cc:237] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:19:43.741775 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:43.746349 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.748553 27971 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:43.749364 27996 raft_consensus.cc:2764] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:19:43.759939 24472 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:43.749547 28012 raft_consensus.cc:3055] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:43.750268 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:43.750655 27915 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.768194 27859 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.768500 27915 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:43.768822 27859 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:43.751282 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:43.751981 27913 raft_consensus.cc:3055] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:43.752205 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:43.752938 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:43.753597 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:43.755510 24396 raft_consensus.cc:1240] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:43.756090 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:43.756918 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:43.721177 27931 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:43.757853 27997 raft_consensus.cc:3055] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:19:43.736797 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.738663 27906 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:43.766234 24323 raft_consensus.cc:1240] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:43.789091 24399 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:43.802805 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:43.759486 27424 consensus_queue.cc:1059] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 12:19:43.876189 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:43.880137 24319 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:43.881425 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:43.883024 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:43.883759 24319 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:19:43.870793 27942 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:43.897598 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 202631us
I20260709 12:19:43.899188 25082 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:43.896710 27997 raft_consensus.cc:740] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
W20260709 12:19:43.976912 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.990818 24472 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
I20260709 12:19:43.975216 27796 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:43.996542 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:43.785012 27913 raft_consensus.cc:740] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:43.996307 27424 raft_consensus.cc:3055] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:43.763904 28012 raft_consensus.cc:740] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:44.153237 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:44.155612 24472 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:44.007030 27796 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:44.026379 27424 raft_consensus.cc:740] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:19:44.151474 28075 log.cc:927] Time spent T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:19:44.232177 27906 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.975396 27997 consensus_queue.cc:260] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:44.241437 27906 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:44.294603 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 303374us
I20260709 12:19:44.295070 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:44.296591 24399 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:19:44.191495 27859 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:44.297214 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 764) took 2183 ms. Trace:
W20260709 12:19:44.330351 25083 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.001s	sys 0.005s
W20260709 12:19:44.330896 25083 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.001s	sys 0.006s
W20260709 12:19:44.331955 25117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35194 (request call id 545) took 2394 ms (client timeout 1629 ms). Trace:
W20260709 12:19:44.332505 25117 rpcz_store.cc:269] 0709 12:19:41.937074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:41.937330 (+   256us) service_pool.cc:224] Handling call
0709 12:19:44.331713 (+2394383us) spinlock_profiling.cc:243] Waited 73.2 ms on lock 0x7b540072f454. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:44.331875 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168273152}
I20260709 12:19:44.331872 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:44.322151 24474 rpcz_store.cc:276] 0709 12:19:42.113873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:42.813877 (+700004us) service_pool.cc:224] Handling call
0709 12:19:42.814206 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:42.958791 (+144585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:44.296901 (+1338110us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54000fdcd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:44.297135 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279497472}
I20260709 12:19:44.334077 24323 raft_consensus.cc:3060] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:44.261237 27996 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:44.324258 27931 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:44.339877 27796 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:44.343393 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 444295us
I20260709 12:19:44.347003 25082 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:44.337922 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:44.343079 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 47582.2us
I20260709 12:19:44.349212 24474 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:44.323334 27997 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:44.338455 25083 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:19:44.357260 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:44.208361 28012 consensus_queue.cc:260] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:44.368618 28012 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:44.351346 27996 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.373338 27996 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:44.387497 27905 consensus_meta.cc:287] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.647s	user 0.003s	sys 0.006s
I20260709 12:19:44.350817 27915 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:44.390401 27915 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:44.390911 27915 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:44.391531 27915 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:44.320045 27424 consensus_queue.cc:260] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:44.393893 27424 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:44.399041 27427 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:44.399621 27427 raft_consensus.cc:697] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
W20260709 12:19:44.401934 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:44.406548 27906 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:44.407613 27942 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:44.407971 24473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1941) took 2616 ms. Trace:
I20260709 12:19:44.359294 24289 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:44.363739 24472 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
W20260709 12:19:44.413379 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 54178.9us
I20260709 12:19:44.414058 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:44.365615 25083 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:19:44.415469 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 49986.8us
I20260709 12:19:44.376295 27996 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:44.367641 24323 raft_consensus.cc:2410] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:19:44.414712 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:44.406567 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:44.408361 24473 rpcz_store.cc:276] 0709 12:19:41.792088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:42.480121 (+688033us) service_pool.cc:224] Handling call
0709 12:19:42.527161 (+ 47040us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:42.629597 (+102436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:44.407768 (+1778171us) spinlock_profiling.cc:243] Waited 46.4 ms on lock 0x7b54002017d0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:44.407909 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":106620288}
I20260709 12:19:44.422704 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:44.222466 27913 consensus_queue.cc:260] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:44.420279 24322 raft_consensus.cc:2393] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 8: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:19:44.425392 24322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2302) took 1551 ms (client timeout 1617 ms). Trace:
W20260709 12:19:44.425876 24322 rpcz_store.cc:269] 0709 12:19:42.873572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:44.406231 (+1532659us) service_pool.cc:224] Handling call
0709 12:19:44.425307 (+ 19076us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:44.416266 24289 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:44.415040 24472 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:19:44.420248 27788 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.415026 27859 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:44.400563 27427 consensus_queue.cc:237] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:44.388188 27905 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:44.441428 24465 raft_consensus.cc:1240] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:44.442327 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1970) took 1074 ms. Trace:
I20260709 12:19:44.442709 24465 rpcz_store.cc:276] 0709 12:19:43.367604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:44.440715 (+1073111us) service_pool.cc:224] Handling call
0709 12:19:44.441180 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:44.442023 (+   843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:44.442261 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:44.432126 27788 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:44.462328 27913 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:44.458508 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:44.462291 24474 raft_consensus.cc:2468] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
I20260709 12:19:44.444911 27931 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:44.453985 27925 raft_consensus.cc:2804] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:44.458586 27878 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:19:44.487958 25084 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.025s	sys 0.044s
W20260709 12:19:44.488499 25084 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.025s	sys 0.044s
I20260709 12:19:44.491698 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:44.492594 24465 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:44.478286 24474 raft_consensus.cc:1240] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:19:44.497486 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1971) took 1129 ms. Trace:
I20260709 12:19:44.502025 24474 rpcz_store.cc:276] 0709 12:19:43.367836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:44.477474 (+1109638us) service_pool.cc:224] Handling call
0709 12:19:44.477987 (+   513us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:44.497086 (+ 19099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:44.497407 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:44.490594 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 742349us
I20260709 12:19:44.485030 28081 consensus_queue.cc:1048] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 12:19:44.504994 28037 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.015s	sys 0.055s
I20260709 12:19:44.482115 27925 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:44.492187 28009 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.484381 27931 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:44.529320 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:44.529325 25112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 1087) took 1587 ms. Trace:
W20260709 12:19:44.519832 28037 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.015s	sys 0.055s
I20260709 12:19:44.508692 27878 raft_consensus.cc:697] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:44.533998 25112 rpcz_store.cc:276] 0709 12:19:42.942167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:42.942326 (+   159us) service_pool.cc:224] Handling call
0709 12:19:42.949318 (+  6992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:43.363107 (+413789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:44.529007 (+1165900us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b540042f754. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:44.529245 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":949708672}
I20260709 12:19:44.536875 24465 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:44.537719 24474 raft_consensus.cc:1240] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:19:44.538378 24391 raft_consensus.cc:1240] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:44.531291 27996 consensus_queue.cc:1059] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:19:44.526367 27925 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:44.533061 28009 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:44.555408 28009 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:44.555493 27779 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:44.534860 27788 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:44.557013 27964 raft_consensus.cc:3055] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:19:44.558652 24440 connection.cc:256] RPC call timeout handler was delayed by -1.0736703969998871s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
I20260709 12:19:44.533582 27905 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:44.562777 27964 raft_consensus.cc:740] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:44.580006 24465 raft_consensus.cc:1240] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 12:19:44.580669 24318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 1901) took 2678 ms (client timeout 1737 ms). Trace:
I20260709 12:19:44.580832 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1976) took 1211 ms. Trace:
I20260709 12:19:44.581189 24465 rpcz_store.cc:276] 0709 12:19:43.369263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:44.544087 (+1174824us) service_pool.cc:224] Handling call
0709 12:19:44.579718 (+ 35631us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:44.580546 (+   828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:44.580776 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:44.581110 24318 rpcz_store.cc:269] 0709 12:19:41.902232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:41.952513 (+ 50281us) service_pool.cc:224] Handling call
0709 12:19:44.580441 (+2627928us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400339354. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:44.580577 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2682514688}
W20260709 12:19:44.613637 24320 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 1900) took 2711 ms (client timeout 1884 ms). Trace:
W20260709 12:19:44.614274 24320 rpcz_store.cc:269] 0709 12:19:41.901923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:41.902052 (+   129us) service_pool.cc:224] Handling call
0709 12:19:44.613300 (+2711248us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b540019fd54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:44.613534 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1801464704}
I20260709 12:19:44.582645 28081 raft_consensus.cc:3055] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:44.627789 24465 raft_consensus.cc:1240] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:19:44.637852 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2074) took 1179 ms. Trace:
I20260709 12:19:44.644775 24465 rpcz_store.cc:276] 0709 12:19:43.458062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:44.624077 (+1166015us) service_pool.cc:224] Handling call
0709 12:19:44.627530 (+  3453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:44.628389 (+   859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:44.637772 (+  9383us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:44.627342 28081 raft_consensus.cc:740] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
W20260709 12:19:44.749408 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:44.668025 27931 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:44.757804 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 220761us
I20260709 12:19:44.759831 24290 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:44.763000 24290 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:44.768250 24290 leader_election.cc:400] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Vote denied by peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453) with higher term. Message: Invalid argument: T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 8. Current term is 9.
I20260709 12:19:44.768576 24290 leader_election.cc:403] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:19:44.773118 24365 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:44.780937 24465 raft_consensus.cc:1275] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:19:44.781853 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2075) took 1323 ms. Trace:
I20260709 12:19:44.782245 24465 rpcz_store.cc:276] 0709 12:19:43.458313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:44.754402 (+1296089us) service_pool.cc:224] Handling call
0709 12:19:44.780434 (+ 26032us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:44.781489 (+  1055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:44.781774 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:44.788852 24290 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:44.628906 27878 consensus_queue.cc:237] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:44.775115 27931 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:44.785367 27519 raft_consensus.cc:2804] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:19:44.801461 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:44.799242 28076 log.cc:927] Time spent T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
I20260709 12:19:44.743652 27964 consensus_queue.cc:260] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:44.799927 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:44.817869 25083 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:44.819446 25083 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:19:44.805007 28074 log.cc:927] Time spent T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
W20260709 12:19:44.799068 28078 log.cc:927] Time spent T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.279s	user 0.001s	sys 0.001s
I20260709 12:19:44.820317 25083 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:44.821205 25112 raft_consensus.cc:1275] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:19:44.795653 28009 raft_consensus.cc:2804] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:19:44.873206 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 313787us
W20260709 12:19:44.829126 28014 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.365s	user 0.009s	sys 0.023s
I20260709 12:19:44.819883 27788 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:44.875147 24440 connection.cc:256] RPC call timeout handler was delayed by -1.0459422829999312s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
I20260709 12:19:44.824265 27519 raft_consensus.cc:697] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:19:44.876519 24440 connection.cc:256] RPC call timeout handler was delayed by -1.0340703970000504s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2114s for a response
W20260709 12:19:44.858949 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 405812us
W20260709 12:19:44.879624 24440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:44.829996 28009 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.824318 28083 raft_consensus.cc:2804] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:44.856670 27905 raft_consensus.cc:2804] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:44.828953 28079 raft_consensus.cc:2804] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:19:44.877418 28014 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.430s	user 0.009s	sys 0.025s
I20260709 12:19:44.880473 27906 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.872138 27964 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:44.807679 27931 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:19:44.794472 28081 consensus_queue.cc:260] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:44.875504 27914 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:19:44.896199 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 107482us
I20260709 12:19:44.906525 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2065) took 1648 ms. Trace:
I20260709 12:19:44.884595 28009 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:44.907049 24471 rpcz_store.cc:276] 0709 12:19:43.258311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:43.619167 (+360856us) service_pool.cc:224] Handling call
0709 12:19:43.619498 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:43.622592 (+  3094us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:43.622692 (+   100us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:43.625607 (+  2915us) log.cc:844] Serialized 26 byte log entry
0709 12:19:43.976253 (+350646us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:43.976330 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:43.993224 (+ 16894us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:44.906208 (+912984us) raft_consensus.cc:1685] finished
0709 12:19:44.906235 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:44.906441 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1811,"raft.queue_time_us":2561,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":1201,"thread_start_us":338506,"threads_started":1,"wal-append.queue_time_us":848388}
I20260709 12:19:44.882735 27788 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:44.918720 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 250814us
I20260709 12:19:44.893932 28083 raft_consensus.cc:697] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:44.897473 27905 raft_consensus.cc:697] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:44.925690 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:44.891227 28079 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:44.947759 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 1931) took 3317 ms. Trace:
I20260709 12:19:44.948455 24468 rpcz_store.cc:276] 0709 12:19:41.630216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:41.724027 (+ 93811us) service_pool.cc:224] Handling call
0709 12:19:44.947435 (+3223408us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b54002008d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:44.947661 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2031545216}
I20260709 12:19:44.950371 24440 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:44.913290 28096 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:44.967231 24398 raft_consensus.cc:1275] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:19:44.895571 27906 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:45.001579 24321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2306) took 2126 ms (client timeout 2450 ms). Trace:
W20260709 12:19:45.005215 24321 rpcz_store.cc:269] 0709 12:19:42.875321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:43.464080 (+588759us) service_pool.cc:224] Handling call
0709 12:19:44.958497 (+1494417us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b540025ab54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:45.001497 (+ 43000us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":256653184}
I20260709 12:19:44.950618 24469 raft_consensus.cc:1275] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 3. (term mismatch)
I20260709 12:19:45.006371 24469 pending_rounds.cc:85] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 2
I20260709 12:19:45.006659 24469 pending_rounds.cc:107] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:19:45.006897 24469 raft_consensus.cc:2889] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:45.007228 24469 pending_rounds.cc:107] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:19:45.007449 24469 raft_consensus.cc:2889] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:44.971742 24217 catalog_manager.cc:5697] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:19:45.011408 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:45.004546 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:45.015754 24398 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:45.015898 24394 raft_consensus.cc:1240] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: []
W20260709 12:19:45.016877 28085 log.cc:927] Time spent T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 12:19:45.019268 27788 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:45.048187 24394 raft_consensus.cc:1240] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:44.886034 27519 consensus_queue.cc:237] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:45.021047 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:44.933452 28079 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:45.050609 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2071) took 1301 ms. Trace:
I20260709 12:19:45.051043 24391 rpcz_store.cc:276] 0709 12:19:43.748908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:43.751405 (+  2497us) service_pool.cc:224] Handling call
0709 12:19:43.751733 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:44.539273 (+787540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:45.050359 (+511086us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b54002a3354. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:45.050543 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1808493824}
I20260709 12:19:44.931066 28098 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:45.029865 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:45.031008 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:45.057478 24397 raft_consensus.cc:2410] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 12:19:45.052258 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 170834us
I20260709 12:19:45.053953 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:45.009208 28084 log.cc:927] Time spent T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.241s	user 0.001s	sys 0.001s
I20260709 12:19:45.068245 24471 raft_consensus.cc:2393] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 7: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:45.069496 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:45.070223 24471 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:19:45.071211 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:45.072814 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:45.075292 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:44.986217 24395 raft_consensus.cc:1275] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:19:45.077193 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:45.079253 24471 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:45.085465 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:45.088094 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:45.091240 24289 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:45.030223 27859 consensus_meta.cc:287] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.004s
W20260709 12:19:44.986869 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:45.059547 24399 raft_consensus.cc:2410] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:19:44.957985 24393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2461) took 3462 ms (client timeout 1989 ms). Trace:
I20260709 12:19:44.978048 25116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 1086) took 2040 ms. Trace:
W20260709 12:19:45.106904 24393 rpcz_store.cc:269] 0709 12:19:41.495363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:41.507678 (+ 12315us) service_pool.cc:224] Handling call
0709 12:19:44.957695 (+3450017us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54002a4254. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:44.957875 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2934418304}
I20260709 12:19:45.107125 25116 rpcz_store.cc:276] 0709 12:19:42.938009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:42.938224 (+   215us) service_pool.cc:224] Handling call
0709 12:19:42.938649 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:43.339015 (+400366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:44.977599 (+1638584us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b540075fdd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:44.977945 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":867929344}
W20260709 12:19:44.982815 24466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 1975) took 1614 ms (client timeout 1994 ms). Trace:
W20260709 12:19:45.108777 24466 rpcz_store.cc:269] 0709 12:19:43.368886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:43.463487 (+ 94601us) service_pool.cc:224] Handling call
0709 12:19:44.982580 (+1519093us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54001220d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:44.982733 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281587968}
I20260709 12:19:45.110327 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:45.111419 24466 raft_consensus.cc:2393] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 7: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:44.981478 24324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1899) took 3079 ms. Trace:
I20260709 12:19:45.112076 24324 rpcz_store.cc:276] 0709 12:19:41.901618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:41.901721 (+   103us) service_pool.cc:224] Handling call
0709 12:19:41.941642 (+ 39921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:42.771679 (+830037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:44.981120 (+2209441us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b5400167454. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:44.981389 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1829450112}
I20260709 12:19:45.075747 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1973) took 1707 ms. Trace:
I20260709 12:19:45.092655 24398 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:19:45.073901 24400 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:45.113790 24474 rpcz_store.cc:276] 0709 12:19:43.368352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:44.508964 (+1140612us) service_pool.cc:224] Handling call
0709 12:19:44.537482 (+ 28518us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:44.539199 (+  1717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:45.075433 (+536234us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b5400201cd0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:45.075651 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64651520}
I20260709 12:19:45.099018 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1960) took 3051 ms. Trace:
I20260709 12:19:45.114686 24469 rpcz_store.cc:276] 0709 12:19:42.043187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:42.802182 (+758995us) service_pool.cc:224] Handling call
0709 12:19:44.950087 (+2147905us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:45.025529 (+ 75442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:45.094561 (+ 69032us) spinlock_profiling.cc:243] Waited 2.14 s on lock 0x7b54002008d0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:45.094708 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4928498944}
I20260709 12:19:45.115095 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:45.116120 24474 raft_consensus.cc:2393] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 10: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:44.979817 24366 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:44.999295 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:45.119284 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:45.120157 24469 raft_consensus.cc:2368] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 9. Current term is 10.
I20260709 12:19:45.125247 24468 raft_consensus.cc:2393] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 5: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
W20260709 12:19:45.129055 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:45.129657 24438 connection.cc:256] RPC call timeout handler was delayed by -1.6866886529999192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19890000000000002s for a response
I20260709 12:19:45.133994 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:45.135689 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:45.056356 28057 log.cc:927] Time spent T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 1.778s	user 0.013s	sys 0.012s
W20260709 12:19:45.142597 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:45.143110 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:45.144174 24466 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
W20260709 12:19:45.145638 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:45.146456 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 777) took 1422 ms. Trace:
I20260709 12:19:45.148429 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 774) took 1425 ms. Trace:
I20260709 12:19:45.149152 24468 rpcz_store.cc:276] 0709 12:19:43.723024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:45.126177 (+1403153us) service_pool.cc:224] Handling call
0709 12:19:45.147749 (+ 21572us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:45.147990 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:45.148029 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:45.148102 (+    73us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:45.148152 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:45.148226 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:45.148353 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:45.153388 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 173712us
I20260709 12:19:45.154309 24366 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:45.162140 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:45.126631 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:45.163749 24391 raft_consensus.cc:2410] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 9 because replica has last-logged OpId of term: 8 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:19:45.170047 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:45.173628 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 265814us
I20260709 12:19:45.197400 24319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 538) took 1431 ms. Trace:
I20260709 12:19:45.198113 24319 rpcz_store.cc:276] 0709 12:19:43.766001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:43.978445 (+212444us) service_pool.cc:224] Handling call
0709 12:19:43.978936 (+   491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:44.331681 (+352745us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:19:44.761905 (+430224us) log.cc:844] Serialized 14 byte log entry
0709 12:19:45.192489 (+430584us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:45.192549 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:45.192601 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:45.197134 (+  4533us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:45.197311 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":145213,"prepare.queue_time_us":216513,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":509492,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":26584,"thread_start_us":839364,"threads_started":3,"wal-append.queue_time_us":192556}
I20260709 12:19:45.201233 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:45.202561 24468 raft_consensus.cc:2393] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 10: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
W20260709 12:19:45.254510 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:45.269089 24397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:19:45.270288 24397 raft_consensus.cc:606] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:45.202154 24466 rpcz_store.cc:276] 0709 12:19:43.723782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:45.145329 (+1421547us) service_pool.cc:224] Handling call
0709 12:19:45.145727 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:45.145989 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:45.146031 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:45.146118 (+    87us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:45.146172 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:45.146248 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:45.146384 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:45.272334 24466 raft_consensus.cc:1240] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:45.273100 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 782) took 1548 ms. Trace:
I20260709 12:19:45.273653 24466 rpcz_store.cc:276] 0709 12:19:43.725031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:45.271663 (+1546632us) service_pool.cc:224] Handling call
0709 12:19:45.272096 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:45.272802 (+   706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:45.273037 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:45.272872 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:45.279367 24392 raft_consensus.cc:2410] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:19:45.120687 27859 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:19:45.153582 28093 log.cc:927] Time spent T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.282s	user 0.000s	sys 0.002s
I20260709 12:19:45.203152 27977 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:45.311846 24466 raft_consensus.cc:1275] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:19:45.178869 27788 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:45.300961 28084 log.cc:927] Time spent T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
W20260709 12:19:45.208498 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:45.155476 28090 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:45.284672 28013 raft_consensus.cc:2749] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:45.370278 24468 raft_consensus.cc:1275] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:45.383533 27931 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:45.385480 28102 log.cc:927] Time spent T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 12:19:45.386727 28035 log.cc:927] Time spent T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 2.359s	user 0.010s	sys 0.017s
W20260709 12:19:45.387001 27925 consensus_meta.cc:287] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.839s	user 0.010s	sys 0.001s
W20260709 12:19:45.388522 28012 consensus_meta.cc:287] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 1.019s	user 0.011s	sys 0.002s
I20260709 12:19:45.349318 27859 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:19:45.378334 27913 consensus_meta.cc:287] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.915s	user 0.012s	sys 0.002s
W20260709 12:19:45.393626 28108 log.cc:927] Time spent T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:19:45.410997 28103 log.cc:927] Time spent T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.385s	user 0.001s	sys 0.000s
I20260709 12:19:45.411218 27996 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.412832 27906 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:45.179822 28100 consensus_queue.cc:1059] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.198s
I20260709 12:19:45.168500 24471 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
W20260709 12:19:45.431253 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 340085us
I20260709 12:19:45.493948 24289 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:45.495941 24471 raft_consensus.cc:1240] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: []
W20260709 12:19:45.434508 24473 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.007s	sys 0.017s
I20260709 12:19:45.153316 27905 consensus_queue.cc:237] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:45.453275 24467 raft_consensus.cc:2410] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:19:45.377502 27864 consensus_queue.cc:1059] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:19:45.351711 27788 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:45.508663 24473 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.008s	sys 0.017s
W20260709 12:19:45.510329 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 379459us
W20260709 12:19:45.525599 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:45.431365 28111 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.181205 28083 consensus_queue.cc:237] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:45.531766 24468 raft_consensus.cc:1275] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:45.402657 28090 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:45.547518 24325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 534) took 1785 ms. Trace:
I20260709 12:19:45.435186 27925 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:45.555413 24325 rpcz_store.cc:276] 0709 12:19:43.762372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:43.762573 (+   201us) service_pool.cc:224] Handling call
0709 12:19:43.763053 (+   480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:43.763932 (+   879us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:19:43.893146 (+129214us) log.cc:844] Serialized 14 byte log entry
0709 12:19:44.472205 (+579059us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:44.472846 (+   641us) log.cc:844] Serialized 26 byte log entry
0709 12:19:44.473014 (+   168us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:44.473063 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:44.473159 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:44.548000 (+ 74841us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b1800489520. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9425f3f3 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd 0000000000388634 0000000000388479 00007f4a9424283a
0709 12:19:45.461132 (+913132us) raft_consensus.cc:1685] finished
0709 12:19:45.547206 (+ 86074us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:45.547428 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":348718,"prepare.queue_time_us":129420,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":10407,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":89024,"spinlock_wait_cycles":35834624,"thread_start_us":409733,"threads_started":1,"wal-append.queue_time_us":661410}
W20260709 12:19:45.560082 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:45.560907 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 67054us
I20260709 12:19:45.564181 24289 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:45.558866 24440 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.052s	sys 0.078s
W20260709 12:19:45.564981 24440 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.052s	sys 0.078s
I20260709 12:19:45.556308 28112 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:45.568565 28109 log.cc:927] Time spent T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:19:45.570021 27925 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:45.571095 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:45.571900 24397 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:45.574203 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:45.574816 24397 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
W20260709 12:19:45.571362 28106 log.cc:927] Time spent T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:19:45.554404 28115 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:45.577783 28115 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:45.580133 28115 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:45.581452 24468 raft_consensus.cc:1275] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:19:45.583304 28112 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:45.584272 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:45.585081 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:45.585716 24325 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:45.587108 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:45.587707 24325 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:19:45.588392 24468 raft_consensus.cc:1240] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:45.589309 24400 raft_consensus.cc:1240] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:45.590991 24398 raft_consensus.cc:1240] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:45.592947 28119 raft_consensus.cc:2804] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:45.595999 27941 consensus_queue.cc:1059] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:45.596328 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:45.597805 28091 consensus_queue.cc:1059] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:45.598107 24324 raft_consensus.cc:3055] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:45.598630 24324 raft_consensus.cc:740] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:45.599354 24324 consensus_queue.cc:260] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:45.600239 24324 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:45.600965 24467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33198 (request call id 773) took 1878 ms (client timeout 2199 ms). Trace:
W20260709 12:19:45.601372 24467 rpcz_store.cc:269] 0709 12:19:43.722707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:44.414442 (+691735us) service_pool.cc:224] Handling call
0709 12:19:45.600746 (+1186304us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540010e354. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:45.600899 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2375646592}
I20260709 12:19:45.602890 24467 raft_consensus.cc:1275] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:19:45.603986 24467 raft_consensus.cc:3055] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:45.604295 24467 raft_consensus.cc:740] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:45.605430 27941 consensus_queue.cc:1243] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer c855242ec9d34a5397741ef20db9de8a log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:19:45.607533 27941 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:45.608052 27941 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:45.608893 27914 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.609732 28029 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.610342 28100 raft_consensus.cc:3055] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:45.620404 24467 consensus_queue.cc:260] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:45.610967 28115 raft_consensus.cc:2749] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:19:45.613026 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 662701us
I20260709 12:19:45.613437 24473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2067) took 2354 ms. Trace:
I20260709 12:19:45.614084 27788 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:45.616750 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1978) took 2151 ms. Trace:
I20260709 12:19:45.617867 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:45.618433 28114 log.cc:927] Time spent T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.304s	user 0.002s	sys 0.000s
I20260709 12:19:45.618803 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:45.619692 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 52005.7us
W20260709 12:19:45.621097 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:45.622437 24392 raft_consensus.cc:1275] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:45.628451 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:45.619949 24289 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:45.643977 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:45.707942 24440 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:45.653429 25082 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.149s (SENT) [suppressed 27 similar messages]
W20260709 12:19:45.778115 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 158243us
I20260709 12:19:45.779126 24289 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:45.648729 24391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:19:45.706748 24473 rpcz_store.cc:276] 0709 12:19:43.258889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:44.446803 (+1187914us) service_pool.cc:224] Handling call
0709 12:19:44.447165 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:44.447422 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:19:44.761486 (+314064us) log.cc:844] Serialized 14 byte log entry
0709 12:19:45.570729 (+809243us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:19:45.612872 (+ 42143us) spinlock_profiling.cc:243] Waited 8.07 ms on lock 0x7b1800047aa0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a96ef44bc 00007f4a9424248b 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425c455 00007f4a97344060 00007f4a97356716 00007f4a97367287
0709 12:19:45.613076 (+   204us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:45.613136 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:45.613192 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:45.613261 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:45.613379 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13579,"prepare.queue_time_us":364239,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":5436,"raft.queue_time_us":557489,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":94610,"spinlock_wait_cycles":27139712,"thread_start_us":1080049,"threads_started":3,"wal-append.queue_time_us":642069}
I20260709 12:19:45.780510 24391 raft_consensus.cc:606] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Received request to transfer leadership to TS c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:45.706732 24467 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:45.765408 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:45.779935 24400 raft_consensus.cc:2393] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
W20260709 12:19:45.786494 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 78621.3us
W20260709 12:19:45.778735 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 125360us
I20260709 12:19:45.459683 27996 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:45.780232 24465 rpcz_store.cc:276] 0709 12:19:43.465041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:44.788496 (+1323455us) service_pool.cc:224] Handling call
0709 12:19:44.806355 (+ 17859us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:44.810741 (+  4386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:44.810775 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:44.811302 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 12:19:44.984820 (+173518us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:45.025072 (+ 40252us) log.cc:844] Serialized 14 byte log entry
0709 12:19:45.427155 (+402083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:45.427283 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:45.616491 (+189208us) raft_consensus.cc:1685] finished
0709 12:19:45.616518 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:45.616686 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":62326,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":27906,"raft.queue_time_us":544951,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":23579,"thread_start_us":530455,"threads_started":2,"wal-append.queue_time_us":280241}
I20260709 12:19:45.552995 27859 consensus_queue.cc:1059] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.154s
W20260709 12:19:45.619869 28103 log.cc:927] Time spent T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:19:45.788574 27906 raft_consensus.cc:2749] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:45.808735 28113 raft_consensus.cc:1064] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:19:45.808851 24398 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:19:45.810673 24289 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:45.815347 28122 consensus_queue.cc:1048] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:45.817039 28081 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:45.817250 28118 consensus_queue.cc:1059] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:45.817903 24438 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:45.818969 28112 raft_consensus.cc:3055] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:45.819351 28112 raft_consensus.cc:740] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:45.820472 28090 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:45.817001 28122 consensus_queue.cc:1048] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:19:45.821154 28090 consensus_queue.cc:1048] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:45.821614 28118 consensus_queue.cc:1048] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:19:45.821944 27915 consensus_meta.cc:287] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 1.430s	user 0.010s	sys 0.006s
I20260709 12:19:45.820176 28112 consensus_queue.cc:260] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:45.822428 27915 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:45.823170 28112 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:45.826486 24438 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:45.643340 28100 raft_consensus.cc:740] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:45.795116 27997 raft_consensus.cc:3055] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:45.846498 24440 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:45.846395 24438 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:45.859161 24366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.009s	sys 0.023s
W20260709 12:19:45.859552 24366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.009s	sys 0.023s
I20260709 12:19:45.859412 24400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:19:45.860195 24400 raft_consensus.cc:606] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
W20260709 12:19:45.861249 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 706977us
I20260709 12:19:45.705554 27913 consensus_queue.cc:1048] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.145s
I20260709 12:19:45.643496 27914 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:45.800767 27896 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.844794 24467 raft_consensus.cc:1275] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:45.705307 28029 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:45.850185 27915 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:45.621591 28080 consensus_queue.cc:1048] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.291s
I20260709 12:19:45.881176 24397 raft_consensus.cc:1240] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: []
W20260709 12:19:45.883670 24469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.034s	sys 0.042s
I20260709 12:19:45.885758 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:45.925829 25116 raft_consensus.cc:2376] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 LEARNER]: Leader election vote request: Already granted yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9. Re-sending same reply.
W20260709 12:19:45.926832 24469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.034s	sys 0.042s
W20260709 12:19:45.886646 24291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.015s	sys 0.068s
W20260709 12:19:45.886487 24440 connection.cc:256] RPC call timeout handler was delayed by -1.3058629590000237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3274s for a response
W20260709 12:19:45.932220 24291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.015s	sys 0.068s
W20260709 12:19:45.932919 24440 connection.cc:256] RPC call timeout handler was delayed by -1.0842316850000771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2384s for a response
W20260709 12:19:45.887357 24470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.008s	sys 0.017s
I20260709 12:19:45.890019 28120 consensus_queue.cc:1059] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:45.933086 24291 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:45.897225 28130 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.934228 28120 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:45.934326 28130 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:45.934993 28120 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:45.902026 28132 raft_consensus.cc:2804] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:45.937230 28132 raft_consensus.cc:697] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:45.937758 28120 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:45.891481 28129 consensus_queue.cc:1059] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:19:45.938112 24365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.011s	sys 0.010s
I20260709 12:19:45.938798 28129 consensus_queue.cc:1243] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer c855242ec9d34a5397741ef20db9de8a log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:19:45.860935 28115 raft_consensus.cc:2804] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:45.938421 28132 consensus_queue.cc:237] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:45.862221 24366 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
W20260709 12:19:45.911942 28107 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.021s	sys 0.055s
W20260709 12:19:45.939306 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 369571us
W20260709 12:19:45.939718 28107 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.021s	sys 0.055s
I20260709 12:19:45.940150 28129 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:45.940279 25084 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:19:45.938905 24365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.011s	sys 0.010s
I20260709 12:19:45.857295 27997 raft_consensus.cc:740] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:45.941062 27915 raft_consensus.cc:2804] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:45.941520 27915 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.939415 28115 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:45.941463 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 749574us
I20260709 12:19:45.942305 27915 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:45.942502 28115 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:45.868302 24472 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.002s	sys 0.017s
I20260709 12:19:45.903367 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:45.946767 24472 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.012s	user 0.003s	sys 0.017s
I20260709 12:19:45.561312 28111 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:45.947965 24472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1967) took 2581 ms. Trace:
W20260709 12:19:45.948451 24470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.008s	sys 0.017s
W20260709 12:19:45.948735 24440 connection.cc:256] RPC call timeout handler was delayed by -1.0473698789999162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
W20260709 12:19:45.949239 24440 connection.cc:256] RPC call timeout handler was delayed by -1.008669879000081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
I20260709 12:19:45.941973 27997 consensus_queue.cc:260] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:45.949904 24440 connection.cc:256] RPC call timeout handler was delayed by -1.0032698790000723s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1666s for a response
W20260709 12:19:45.914336 27971 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.015s	sys 0.015s
I20260709 12:19:45.950999 24440 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:45.883441 28098 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.000s	sys 0.025s
I20260709 12:19:45.948341 24472 rpcz_store.cc:276] 0709 12:19:43.366767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:44.445546 (+1078779us) service_pool.cc:224] Handling call
0709 12:19:44.446017 (+   471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:44.446287 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:44.618208 (+171921us) log.cc:844] Serialized 14 byte log entry
0709 12:19:45.947590 (+1329382us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:45.947655 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:45.947703 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:45.947766 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:45.947900 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15846,"prepare.queue_time_us":328387,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":526212,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":27811,"thread_start_us":1485285,"threads_started":3,"wal-append.queue_time_us":438466}
W20260709 12:19:45.923998 27964 consensus_meta.cc:287] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 1.026s	user 0.012s	sys 0.000s
W20260709 12:19:45.953078 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 90939.9us
I20260709 12:19:45.974160 24366 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:45.954676 24290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.015s	sys 0.034s
I20260709 12:19:45.959690 24365 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:45.975823 24290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.015s	sys 0.034s
W20260709 12:19:45.976229 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 801337us
I20260709 12:19:45.973133 25084 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:45.938448 28120 raft_consensus.cc:3055] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:45.978957 28120 raft_consensus.cc:740] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:45.979281 25084 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:45.971879 27997 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:45.912889 28121 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:19:45.952353 28009 consensus_meta.cc:287] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.035s	user 0.008s	sys 0.005s
I20260709 12:19:45.903473 27896 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:45.980494 28091 raft_consensus.cc:2804] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:19:45.978103 27977 consensus_meta.cc:287] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.667s	user 0.013s	sys 0.000s
W20260709 12:19:45.954540 28098 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.000s	sys 0.026s
W20260709 12:19:45.953504 27971 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.015s	sys 0.016s
I20260709 12:19:45.948671 28117 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:45.981945 28092 raft_consensus.cc:2749] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:45.977698 24290 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:45.997174 27925 raft_consensus.cc:3055] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:45.996395 28132 consensus_queue.cc:1059] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:45.972277 28119 raft_consensus.cc:697] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:45.872020 28124 consensus_queue.cc:1048] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.101s
W20260709 12:19:45.999070 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 65897.1us
W20260709 12:19:46.006336 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 160036us
I20260709 12:19:45.990896 28009 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:46.012096 28029 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:46.013770 25118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a"
dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:47070
I20260709 12:19:45.984076 27931 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:46.039780 25118 raft_consensus.cc:606] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:46.014376 28116 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:45.990952 28091 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:46.029165 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 73059.1us
I20260709 12:19:46.041265 25112 raft_consensus.cc:1240] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:46.023499 27977 raft_consensus.cc:2749] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:46.020294 27915 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:45.985221 28125 raft_consensus.cc:2804] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:46.000675 28128 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.999222 27427 raft_consensus.cc:2804] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:45.975626 27519 consensus_queue.cc:1048] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:19:46.014231 28111 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:45.988034 28126 raft_consensus.cc:2804] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:46.042109 24440 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:46.029490 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 51876.4us
I20260709 12:19:46.001678 28098 raft_consensus.cc:697] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:46.027662 28117 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:46.039009 28112 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.024686 27913 raft_consensus.cc:2804] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:45.987253 27964 consensus_queue.cc:1048] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:19:46.108357 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2078) took 2431 ms. Trace:
I20260709 12:19:46.019200 28115 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:46.024971 28121 raft_consensus.cc:697] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:46.044449 24325 raft_consensus.cc:3055] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:46.130793 24325 raft_consensus.cc:740] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:19:46.072906 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 409712us
I20260709 12:19:46.073212 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 775) took 2350 ms. Trace:
I20260709 12:19:46.132367 24474 rpcz_store.cc:276] 0709 12:19:43.723296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:45.131685 (+1408389us) service_pool.cc:224] Handling call
0709 12:19:45.132196 (+   511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:45.452125 (+319929us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:45.452156 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:45.528709 (+ 76553us) log.cc:844] Serialized 26 byte log entry
0709 12:19:45.931062 (+402353us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:45.931102 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:45.931174 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:46.072984 (+141810us) raft_consensus.cc:1685] finished
0709 12:19:46.073005 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:46.073150 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":482575,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":84,"thread_start_us":653512,"threads_started":2,"wal-append.queue_time_us":413974}
I20260709 12:19:46.134037 25112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 1096) took 1106 ms. Trace:
I20260709 12:19:46.134485 25112 rpcz_store.cc:276] 0709 12:19:45.028170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:45.028349 (+   179us) service_pool.cc:224] Handling call
0709 12:19:45.048252 (+ 19903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:46.041790 (+993538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:46.121626 (+ 79836us) spinlock_profiling.cc:243] Waited 991 ms on lock 0x7b54006301d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:46.133972 (+ 12346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2279034752}
W20260709 12:19:46.044080 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 60839.2us
I20260709 12:19:46.095971 24290 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:46.137042 24290 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:46.040957 27931 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:19:46.138115 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 96064.8us
I20260709 12:19:46.138770 24290 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:46.104076 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 67350us
I20260709 12:19:46.043067 28091 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:46.074203 27427 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:46.073737 28132 raft_consensus.cc:2749] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:46.044206 28130 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:46.028995 27925 raft_consensus.cc:740] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:46.109119 24469 rpcz_store.cc:276] 0709 12:19:43.676912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:45.151035 (+1474123us) service_pool.cc:224] Handling call
0709 12:19:45.151426 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:45.151673 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:19:45.267883 (+116210us) log.cc:844] Serialized 14 byte log entry
0709 12:19:46.107960 (+840077us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:46.108025 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:46.108075 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:46.108152 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:46.108294 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38465,"prepare.queue_time_us":131283,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":17412,"raft.queue_time_us":101274,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":8552,"thread_start_us":787327,"threads_started":2,"wal-append.queue_time_us":760910}
I20260709 12:19:46.084138 28116 raft_consensus.cc:697] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:45.952557 28100 consensus_queue.cc:260] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:19:46.139335 24440 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:46.113950 28147 log.cc:927] Time spent T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:19:46.148378 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:46.148744 24467 raft_consensus.cc:1275] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:19:46.052143 28092 consensus_queue.cc:1048] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
W20260709 12:19:46.169193 28131 log.cc:927] Time spent T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:19:46.103433 27913 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:46.169770 27913 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:46.170436 28116 consensus_queue.cc:237] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:46.173062 27996 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:46.174571 27996 consensus_queue.cc:1048] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:46.175196 27996 consensus_queue.cc:1243] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer 99b8650fa8324ac2ac5f75eee9b1a1e3 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:19:46.103240 28117 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:46.105636 28112 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:46.183444 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:46.151499 27427 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:46.116340 28148 raft_consensus.cc:3055] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:46.166038 28029 raft_consensus.cc:2804] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:46.163920 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:46.202070 24316 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:46.164170 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:46.050912 28125 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:46.043056 28136 consensus_queue.cc:1048] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.100s
I20260709 12:19:46.168006 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:46.180580 28132 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:46.163111 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:46.105125 28111 consensus_queue.cc:1059] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
W20260709 12:19:46.168496 28142 log.cc:927] Time spent T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:19:46.142916 27878 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.213790 24323 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:19:46.183043 28157 raft_consensus.cc:2749] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:46.149703 27931 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:46.157234 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:46.186347 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:46.184034 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:46.073468 28128 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:46.178429 27914 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:46.163316 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:46.210209 28152 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.180233 24440 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:46.183061 28122 raft_consensus.cc:2749] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:46.184746 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:46.298707 24318 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:46.296366 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 485749us
I20260709 12:19:46.197557 28148 raft_consensus.cc:740] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:46.288154 24321 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 7: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:46.290357 24322 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:19:46.291262 24324 raft_consensus.cc:2410] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:19:46.215814 27964 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:46.212618 28153 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.233791 24316 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 5.
I20260709 12:19:46.211947 28132 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:46.181510 28107 consensus_queue.cc:1059] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.059s
W20260709 12:19:46.306766 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 126623us
I20260709 12:19:46.315826 24318 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:19:46.316991 28160 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:46.317351 28138 log.cc:927] Time spent T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:19:46.207126 28029 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:46.321067 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 785) took 1289 ms. Trace:
I20260709 12:19:46.318452 28116 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:46.332839 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 355524us
I20260709 12:19:46.322469 27964 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:46.343231 28132 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:46.347539 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:46.344434 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:46.148180 28119 consensus_queue.cc:237] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:46.294938 28111 consensus_queue.cc:1243] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer d99d5d772cfe4a96afcab3d3b009a281 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:19:46.416915 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 46633.7us
I20260709 12:19:46.216614 27925 consensus_queue.cc:260] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:46.354003 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:46.343245 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 153646us
I20260709 12:19:46.358860 24440 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:46.435457 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 76719.3us
W20260709 12:19:46.323060 28133 log.cc:927] Time spent T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 12:19:46.325732 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:46.362721 24471 rpcz_store.cc:276] 0709 12:19:45.031909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:45.545664 (+513755us) service_pool.cc:224] Handling call
0709 12:19:45.546096 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:45.566413 (+ 20317us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:19:45.800126 (+233713us) log.cc:844] Serialized 14 byte log entry
0709 12:19:46.032360 (+232234us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:46.033571 (+  1211us) log.cc:844] Serialized 26 byte log entry
0709 12:19:46.034243 (+   672us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:46.320389 (+286146us) log.cc:844] Serialized 14 byte log entry
0709 12:19:46.320744 (+   355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:46.320826 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:46.320865 (+    39us) raft_consensus.cc:1685] finished
0709 12:19:46.320878 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:46.321006 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56888,"prepare.queue_time_us":261870,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":91,"raft.queue_time_us":175133,"raft.run_cpu_time_us":481,"raft.run_wall_time_us":63282,"thread_start_us":372511,"threads_started":2,"wal-append.queue_time_us":168207}
I20260709 12:19:46.322716 28156 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.238386 28110 consensus_queue.cc:1059] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.111s
I20260709 12:19:46.322300 27906 raft_consensus.cc:2749] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:46.213894 28125 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:46.374958 28127 log.cc:927] Time spent T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
W20260709 12:19:46.375316 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:46.341382 28153 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:46.375593 28143 log.cc:927] Time spent T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.279s	user 0.001s	sys 0.001s
W20260709 12:19:46.379554 28149 log.cc:927] Time spent T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 12:19:46.365821 28029 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:46.373768 27915 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:46.362655 28155 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:46.297868 27977 consensus_queue.cc:1059] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:19:46.345709 28146 raft_consensus.cc:2764] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:19:46.288048 27878 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:46.388767 24318 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:46.358873 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 196348us
I20260709 12:19:46.348778 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:46.185987 28098 consensus_queue.cc:237] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:46.362567 28122 consensus_queue.cc:1048] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.134s
I20260709 12:19:46.305930 28152 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:46.667685 24322 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:19:46.673292 24440 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:46.649966 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:46.623284 24319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 548) took 1032 ms. Trace:
W20260709 12:19:46.647140 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 212367us
I20260709 12:19:46.677642 24323 raft_consensus.cc:2376] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9. Re-sending same reply.
I20260709 12:19:46.298211 28121 consensus_queue.cc:237] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.2, Last appended by leader: 2, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:46.416085 28012 raft_consensus.cc:3055] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:46.384402 27964 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:46.370908 28009 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:46.416447 28124 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:46.561806 27997 consensus_meta.cc:287] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.575s	user 0.007s	sys 0.002s
W20260709 12:19:46.571564 28081 consensus_meta.cc:287] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.754s	user 0.010s	sys 0.000s
W20260709 12:19:46.558881 28096 consensus_meta.cc:287] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.533s	user 0.010s	sys 0.004s
W20260709 12:19:46.433481 28147 log.cc:927] Time spent T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:19:46.693852 27941 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:46.363091 28160 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:46.374485 28116 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:46.718124 28169 log.cc:927] Time spent T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:19:46.718981 28163 log.cc:927] Time spent T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 12:19:46.729409 28162 raft_consensus.cc:993] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a: : Instructing follower 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
W20260709 12:19:46.650238 28123 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.004s	sys 0.004s
I20260709 12:19:46.499725 28159 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:46.727327 28124 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:46.720047 28146 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.679623 28115 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:46.678965 28080 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:46.495841 28111 consensus_queue.cc:1048] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.228s
I20260709 12:19:46.416401 28150 consensus_queue.cc:1059] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.366s
I20260709 12:19:46.694931 28012 raft_consensus.cc:740] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:19:46.720096 28117 consensus_meta.cc:287] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.521s	user 0.012s	sys 0.000s
I20260709 12:19:46.783375 28153 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:46.783828 28117 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:46.559670 27913 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:46.728624 28096 raft_consensus.cc:2749] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453) with higher term. Message: Invalid argument: T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 8. Current term is 9.
I20260709 12:19:46.708088 28130 consensus_queue.cc:1059] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:19:46.788877 28130 consensus_queue.cc:1243] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer c855242ec9d34a5397741ef20db9de8a log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:19:46.789198 27913 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:46.708962 28128 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:46.786909 28117 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:46.764556 28080 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:46.792362 28120 consensus_queue.cc:260] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:46.793445 28120 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:46.793630 28080 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:46.777316 28171 log.cc:927] Time spent T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:19:46.686830 28156 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:46.794729 27878 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:46.795873 28156 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:46.752983 28159 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:46.797062 28159 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:46.797569 28159 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:46.798161 27931 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:46.800328 27931 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:46.763849 28151 raft_consensus.cc:1081] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Signalling peer 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
I20260709 12:19:46.568753 28148 consensus_queue.cc:260] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:46.749814 28123 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.004s	sys 0.004s
I20260709 12:19:46.770182 28152 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:46.687487 28155 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:46.784473 28150 raft_consensus.cc:3055] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:46.789225 28126 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:46.756174 28146 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:46.793895 28116 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:46.802995 28125 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:46.805097 28160 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:46.770015 28113 consensus_queue.cc:237] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:46.737036 28158 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.812991 28158 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:46.813450 28124 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:46.814532 28146 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:46.681219 24319 rpcz_store.cc:276] 0709 12:19:45.590793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:45.591719 (+   926us) service_pool.cc:224] Handling call
0709 12:19:45.591987 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:45.592213 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:45.592238 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:45.592779 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 12:19:45.955148 (+362369us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:45.955188 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:45.955262 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:46.619514 (+664252us) raft_consensus.cc:1685] finished
0709 12:19:46.619546 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:46.623202 (+  3656us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":361947,"threads_started":1,"wal-append.queue_time_us":546755}
W20260709 12:19:46.734014 25084 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.020s	sys 0.026s
I20260709 12:19:46.718712 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:46.733799 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:46.728852 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:46.754262 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:46.994794 27977 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.054718 25117 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:47.055033 27977 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:46.783440 28012 consensus_queue.cc:260] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:46.776225 28079 consensus_meta.cc:287] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 1.676s	user 0.007s	sys 0.005s
I20260709 12:19:47.061049 28107 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:47.062103 28079 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:47.062528 28107 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:46.994154 24468 raft_consensus.cc:2368] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 8. Current term is 9.
I20260709 12:19:46.889623 24320 raft_consensus.cc:2368] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 8. Current term is 9.
I20260709 12:19:47.045105 28136 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.049916 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:47.049785 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:47.051293 28164 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:47.052403 28179 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:47.053440 28154 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.000s	sys 0.018s
I20260709 12:19:46.935858 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:46.926034 24398 raft_consensus.cc:1240] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:19:46.911558 24397 raft_consensus.cc:1240] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 6. Current term is 7. Ops: []
W20260709 12:19:46.994354 27796 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.005s	sys 0.030s
I20260709 12:19:46.915963 24396 raft_consensus.cc:1240] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:46.910957 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:46.899500 24366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:47.087991 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:47.088948 24396 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:47.090905 25113 raft_consensus.cc:2410] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:19:47.092813 28129 consensus_queue.cc:1048] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:19:47.092160 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:46.889001 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:46.950471 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 1985) took 2055 ms. Trace:
I20260709 12:19:47.073628 28079 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:47.102809 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:47.104817 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.109320 25110 raft_consensus.cc:2393] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 9: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:47.110242 27864 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.110352 28136 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:47.111094 27864 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:47.114494 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 441075us
W20260709 12:19:47.116369 28154 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.000s	sys 0.019s
I20260709 12:19:46.837922 28158 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:46.912011 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:46.811888 28126 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:47.098589 27796 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.007s	sys 0.037s
W20260709 12:19:46.888078 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 213873us
I20260709 12:19:47.124221 24440 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:47.126582 24366 connection.cc:256] RPC call timeout handler was delayed by -3.240309846999935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
I20260709 12:19:46.811122 28150 raft_consensus.cc:740] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:47.150017 24399 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:47.152616 27914 consensus_queue.cc:1059] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:19:47.154816 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.108259 28111 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:19:47.155547 28132 consensus_meta.cc:287] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.691s	user 0.012s	sys 0.003s
I20260709 12:19:47.155910 28111 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:47.156872 28164 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:47.159402 25117 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:19:47.158644 24399 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:47.162925 25119 raft_consensus.cc:2393] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 10: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:47.146726 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:47.156112 28132 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:47.164981 28185 log.cc:927] Time spent T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:19:47.160619 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:47.166162 24366 connection.cc:256] RPC call timeout handler was delayed by -3.1080098469999484s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
I20260709 12:19:46.817523 28125 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:47.179378 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:47.180765 25114 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
W20260709 12:19:47.186251 25084 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.087s	user 0.021s	sys 0.034s
I20260709 12:19:47.171685 25112 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:47.197093 28121 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:47.198097 28121 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.198740 28121 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:47.199817 24438 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:47.161334 28179 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:47.200682 28124 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:47.201068 28116 consensus_queue.cc:1059] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:47.201979 28124 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:19:47.202739 28116 consensus_queue.cc:1059] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:47.204035 28116 raft_consensus.cc:3055] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:47.205034 24394 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:47.206593 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.207510 24289 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:47.207556 24394 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
W20260709 12:19:47.209558 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 93271.9us
I20260709 12:19:47.211304 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:47.212702 24288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.011s	sys 0.006s
W20260709 12:19:47.212922 28091 consensus_meta.cc:287] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 1.027s	user 0.017s	sys 0.000s
W20260709 12:19:47.213179 24288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.011s	sys 0.007s
I20260709 12:19:47.213444 28091 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:47.214303 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:47.214829 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:47.215327 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:47.214676 24394 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
W20260709 12:19:47.215870 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:47.193398 28190 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:19:47.217907 24366 connection.cc:256] RPC call timeout handler was delayed by -2.2163658289998693s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2106s for a response
I20260709 12:19:47.217711 28190 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:47.218279 28184 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:47.218400 24366 connection.cc:256] RPC call timeout handler was delayed by -2.0433589799999936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
I20260709 12:19:47.214103 28124 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:19:47.186116 24290 leader_election.cc:400] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Vote denied by peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453) with higher term. Message: Invalid argument: T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 9. Current term is 10.
I20260709 12:19:47.195493 24316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2331) took 1002 ms. Trace:
W20260709 12:19:47.232981 24366 connection.cc:256] RPC call timeout handler was delayed by -1.8264589799998703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2097s for a response
W20260709 12:19:47.233543 24366 connection.cc:256] RPC call timeout handler was delayed by -1.1190589799998634s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2883s for a response
I20260709 12:19:47.186803 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:47.216346 28091 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:47.184175 28029 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:47.204496 28116 raft_consensus.cc:740] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
W20260709 12:19:47.244455 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 1.26146e+06us
I20260709 12:19:47.232491 24316 rpcz_store.cc:276] 0709 12:19:46.164886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:46.675307 (+510421us) service_pool.cc:224] Handling call
0709 12:19:47.162444 (+487137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:47.256840 28009 raft_consensus.cc:2804] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:47.263782 28146 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.264166 27859 raft_consensus.cc:1027] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: attempt to promote peer d99d5d772cfe4a96afcab3d3b009a281: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 12:19:47.263818 28009 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.265793 28009 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:47.266108 28136 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:47.264856 28146 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:47.234321 27977 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:47.268734 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 69309.1us
I20260709 12:19:47.217900 27931 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:19:47.278393 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:47.290194 25115 raft_consensus.cc:2393] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 8: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:47.291671 28122 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.292196 28181 raft_consensus.cc:2804] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:47.292938 28181 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.293438 28181 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:47.293851 24317 raft_consensus.cc:2393] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 10: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:47.294726 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:47.295662 28190 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:47.295960 24323 raft_consensus.cc:2368] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
I20260709 12:19:47.301458 28179 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:47.277772 28124 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.101105 24466 rpcz_store.cc:276] 0709 12:19:44.921535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:45.313892 (+392357us) service_pool.cc:224] Handling call
0709 12:19:45.314356 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:45.790509 (+476153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:45.790544 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:45.791135 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 12:19:46.371236 (+580101us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:46.493461 (+122225us) log.cc:844] Serialized 14 byte log entry
0709 12:19:46.626116 (+132655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:46.626224 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:46.786769 (+160545us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b18003961c0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9425f3f3 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd 0000000000388634 0000000000388479 00007f4a9424283a
0709 12:19:46.949411 (+162642us) raft_consensus.cc:1685] finished
0709 12:19:46.949620 (+   209us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:46.950070 (+   450us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":144935,"prepare.queue_time_us":125204,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":56,"raft.queue_time_us":438297,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":184,"spinlock_wait_cycles":33669376,"thread_start_us":971047,"threads_started":2,"wal-append.queue_time_us":872483}
I20260709 12:19:47.233245 28184 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:47.365388 27906 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.366353 27906 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:47.367048 28184 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:47.368494 28132 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:47.369619 28111 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:47.372052 28100 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:47.335319 28156 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:19:47.373389 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:47.373593 28112 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:47.336309 28096 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.339071 28190 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:47.341315 28150 consensus_queue.cc:260] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:47.342340 28116 consensus_queue.cc:260] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:47.347049 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.350584 24470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2066) took 4091 ms. Trace:
W20260709 12:19:47.352849 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 167045us
I20260709 12:19:47.357115 27878 consensus_queue.cc:1048] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:47.358248 28146 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:47.363600 27896 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:47.292610 28122 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:47.373224 28156 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:19:47.335496 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:47.371273 28009 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:47.323145 28164 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:47.288192 27931 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:47.396552 28194 log.cc:927] Time spent T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:19:47.383618 27964 consensus_meta.cc:287] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.009s
I20260709 12:19:47.422654 24319 raft_consensus.cc:2393] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 9: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:47.422097 24392 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:47.396090 28132 consensus_queue.cc:1059] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:19:47.403644 28107 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:47.450237 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.453739 28124 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:47.456713 28146 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:47.500154 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:47.458679 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.451566 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47070 (request call id 8) took 1438 ms. Trace:
I20260709 12:19:47.463263 28190 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:47.457479 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:47.460888 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:47.464126 28096 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:47.457636 28156 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:47.453500 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33198 (request call id 790) took 1306 ms. Trace:
I20260709 12:19:47.400035 24470 rpcz_store.cc:276] 0709 12:19:43.258622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:43.633593 (+374971us) service_pool.cc:224] Handling call
0709 12:19:44.983656 (+1350063us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:45.127481 (+143825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:45.127534 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:45.215206 (+ 87672us) log.cc:844] Serialized 26 byte log entry
0709 12:19:45.949007 (+733801us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:45.949045 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:45.949115 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:45.949169 (+    54us) raft_consensus.cc:1685] finished
0709 12:19:45.949178 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:47.350057 (+1400879us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54001220d0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:47.350375 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":570380,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":3350,"spinlock_wait_cycles":3100626304,"thread_start_us":772553,"threads_started":2,"wal-append.queue_time_us":602290,"wal-append.run_cpu_time_us":2495,"wal-append.run_wall_time_us":1196023}
I20260709 12:19:47.333545 28155 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:47.455111 28110 raft_consensus.cc:3055] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:47.494656 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:47.422205 24290 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:47.496040 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:47.496176 24392 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:47.500912 25118 rpcz_store.cc:276] 0709 12:19:46.013439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:46.013608 (+   169us) service_pool.cc:224] Handling call
0709 12:19:47.450826 (+1437218us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b5400162c20. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a972c9520 00007f4a97346652 00007f4a9c31460a 00007f4a9589a7d4 00007f4a9589a762 00007f4a9589a691 00007f4a9589a60c 00007f4a958998c2 00007f4a9568748c 00007f4a956868c6
0709 12:19:47.451300 (+   474us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9659264}
I20260709 12:19:47.510133 24322 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:47.511650 24474 pending_rounds.cc:85] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 7
I20260709 12:19:47.512697 28146 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:47.513489 24217 catalog_manager.cc:5697] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 2 to 5, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 5 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:19:47.514961 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:47.515340 24471 raft_consensus.cc:1240] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:47.504812 24468 rpcz_store.cc:276] 0709 12:19:46.147236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:46.148109 (+   873us) service_pool.cc:224] Handling call
0709 12:19:47.453270 (+1305161us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b540010e854. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:47.453419 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1816636672}
I20260709 12:19:47.523723 24398 raft_consensus.cc:1275] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:19:47.521595 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:47.504344 24320 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2323) took 1337 ms (client timeout 1617 ms). Trace:
I20260709 12:19:47.518657 24474 pending_rounds.cc:107] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:19:47.532099 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:47.517289 28132 consensus_queue.cc:1243] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer d99d5d772cfe4a96afcab3d3b009a281 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:19:47.527844 28009 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:47.533011 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:47.570817 24322 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:47.500232 27864 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:47.549902 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:47.531744 24325 consensus_queue.cc:260] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:47.568140 24474 raft_consensus.cc:2889] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:47.573681 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.574930 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.575076 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.575615 28012 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:47.575980 24399 raft_consensus.cc:2393] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 10: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:47.576331 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.576880 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:47.580286 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.517117 28110 raft_consensus.cc:740] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:19:47.568005 24320 rpcz_store.cc:269] 0709 12:19:46.162685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:46.162841 (+   156us) service_pool.cc:224] Handling call
0709 12:19:47.469463 (+1306622us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b540001de54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:47.499997 (+ 30534us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1554904448}
I20260709 12:19:47.585206 24391 raft_consensus.cc:2393] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 10: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:47.352308 28121 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:47.526312 28122 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:47.594808 24392 raft_consensus.cc:2393] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 8: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:47.594238 24396 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:19:47.500785 27964 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:47.597548 24325 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:47.604928 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:47.593778 24316 raft_consensus.cc:3055] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:47.609606 24316 raft_consensus.cc:740] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:47.628460 25118 raft_consensus.cc:1240] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 6. Current term is 7. Ops: []
W20260709 12:19:47.631443 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 209393us
I20260709 12:19:47.617272 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.633152 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.637573 24400 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:47.646364 24471 raft_consensus.cc:1240] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:47.647251 28096 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:47.647552 24392 raft_consensus.cc:2410] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:19:47.648741 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.650202 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.651019 24392 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:47.651919 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:47.652947 24392 raft_consensus.cc:2368] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 8. Current term is 9.
I20260709 12:19:47.634881 28181 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:47.653836 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.654996 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.655344 28181 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:47.655790 24392 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
I20260709 12:19:47.625735 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.660596 24400 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:19:47.670639 24472 raft_consensus.cc:2393] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:47.612401 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.626593 28190 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:47.629217 24318 consensus_meta.cc:287] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.924s	user 0.023s	sys 0.006s
I20260709 12:19:47.671629 24391 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:19:47.679001 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.679926 24396 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:47.645955 27906 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:47.601724 28156 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.626467 28124 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:47.683660 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:47.611272 28029 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:47.684234 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.682459 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.673478 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:47.689066 24392 raft_consensus.cc:2368] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 8. Current term is 9.
I20260709 12:19:47.630012 27931 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:47.692728 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 115621us
I20260709 12:19:47.694964 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.691679 24400 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:19:47.626718 28157 raft_consensus.cc:2749] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:19:47.702306 28200 log.cc:927] Time spent T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:19:47.704901 27788 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.705665 27788 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:47.707000 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:47.708467 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:47.710752 28177 raft_consensus.cc:3055] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:47.711288 28177 raft_consensus.cc:740] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:47.714284 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:47.693425 24318 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:19:47.716248 24290 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:47.717103 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:47.734508 24400 raft_consensus.cc:1240] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:19:47.734632 24396 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:47.718182 27964 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:47.718395 28110 consensus_queue.cc:260] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:47.721696 25115 raft_consensus.cc:1240] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:19:47.708850 24316 consensus_queue.cc:260] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:47.727401 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:47.715965 27427 consensus_meta.cc:287] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 1.380s	user 0.007s	sys 0.017s
I20260709 12:19:47.743242 27427 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:47.744521 25116 raft_consensus.cc:2393] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 8: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
W20260709 12:19:47.744815 24317 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2329) took 1580 ms (client timeout 1892 ms). Trace:
I20260709 12:19:47.745220 24438 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:47.745393 24317 rpcz_store.cc:269] 0709 12:19:46.164333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:46.164454 (+   121us) service_pool.cc:224] Handling call
0709 12:19:47.744538 (+1580084us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54002567d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:47.744748 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2358146944}
I20260709 12:19:47.746814 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:47.749971 28159 consensus_meta.cc:287] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.952s	user 0.015s	sys 0.005s
I20260709 12:19:47.750600 28159 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:47.751252 28146 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:47.730981 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:47.731935 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:47.748356 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:47.752435 25111 raft_consensus.cc:2368] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 8. Current term is 9.
I20260709 12:19:47.752506 24317 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
I20260709 12:19:47.715382 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:47.753517 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:47.753652 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:47.754554 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:47.754806 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:47.755378 25115 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:47.756870 27427 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:47.757225 28119 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:47.730384 28120 consensus_meta.cc:287] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.936s	user 0.016s	sys 0.000s
I20260709 12:19:47.758116 24319 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:47.742252 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.728793 27796 raft_consensus.cc:3055] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:47.762704 27796 raft_consensus.cc:740] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:47.762764 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:47.763949 24220 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54252 (request call id 254) took 26145 ms (client timeout 15000 ms). Trace:
I20260709 12:19:47.746677 27864 consensus_queue.cc:1048] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:47.764318 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:47.764072 27796 consensus_queue.cc:260] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:47.764845 24366 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:19:47.732858 24318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2336) took 1566 ms (client timeout 1989 ms). Trace:
I20260709 12:19:47.755439 25111 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:19:47.737371 25110 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:47.745743 25116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35194 (request call id 559) took 1017 ms. Trace:
I20260709 12:19:47.757802 28119 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:19:47.737210 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.752342 25114 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:47.754590 24317 raft_consensus.cc:2393] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 10: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:47.753569 25113 raft_consensus.cc:2393] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:47.756529 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:47.765090 24395 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:19:47.771122 24366 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:47.766465 24318 rpcz_store.cc:269] 0709 12:19:46.166099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:46.344164 (+178065us) service_pool.cc:224] Handling call
0709 12:19:47.732778 (+1388614us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:47.734151 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.771335 25115 raft_consensus.cc:1275] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEARNER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:19:47.773140 24398 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
I20260709 12:19:47.708797 28156 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:47.779904 24440 connection.cc:256] RPC call timeout handler was delayed by -1.3081650799999807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2822s for a response
I20260709 12:19:47.712489 28177 consensus_queue.cc:260] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:47.767270 25116 rpcz_store.cc:276] 0709 12:19:46.728235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:46.728447 (+   212us) service_pool.cc:224] Handling call
0709 12:19:47.745527 (+1017080us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b540065de54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:47.745688 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1607381248}
I20260709 12:19:47.766090 27796 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:47.708496 27788 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:47.787084 24392 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
I20260709 12:19:47.784936 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:47.789390 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:47.799431 24316 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:47.796160 24320 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:47.801712 25110 raft_consensus.cc:1217] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Deduplicated request from leader. Original: 3.6->[6.7-6.7]   Dedup: 6.7->[]
I20260709 12:19:47.802238 25110 raft_consensus.cc:1240] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:19:47.802595 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:47.803175 24392 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:47.803339 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 58233.6us
I20260709 12:19:47.779458 27931 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:47.805498 24325 raft_consensus.cc:1275] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:19:47.807104 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:47.808043 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.807639 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:47.811810 24438 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:47.813145 24318 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:47.815167 24317 pending_rounds.cc:85] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756: Aborting all ops after (but not including) 8
I20260709 12:19:47.815500 24317 pending_rounds.cc:107] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:19:47.815775 24317 raft_consensus.cc:2889] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:47.813313 24440 leader_election.cc:336] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Timed out: RequestConsensusVote RPC to 127.22.155.193:36951 timed out after 1.617s (SENT)
I20260709 12:19:47.819417 24440 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:47.821013 24393 raft_consensus.cc:2410] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:19:47.817988 24289 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:47.823510 24325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 547) took 2224 ms. Trace:
I20260709 12:19:47.825655 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:47.823863 24325 rpcz_store.cc:276] 0709 12:19:45.590042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:45.590145 (+   103us) service_pool.cc:224] Handling call
0709 12:19:45.590393 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:46.044330 (+453937us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54004cff20. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a972c3dc0 00007f4a9734e1c0 00007f4a9734f231 00007f4a9734bd8f 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c
0709 12:19:47.470841 (+1426511us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b54004cff20. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a972ca06f 00007f4a97342f60 00007f4a973447de 00007f4a9734eb49 00007f4a9734f416 00007f4a9734bd8f 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62
0709 12:19:47.805857 (+335016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:47.814519 (+  8662us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1306526976}
I20260709 12:19:47.827706 25118 raft_consensus.cc:2393] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:47.816831 27427 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.811883 28121 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:47.821367 25113 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:47.831499 24325 raft_consensus.cc:1240] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:47.833163 24400 raft_consensus.cc:1275] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:47.821014 28177 raft_consensus.cc:3060] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:47.837769 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:47.840866 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 148541us
W20260709 12:19:47.841742 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:47.830523 28146 raft_consensus.cc:2804] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:19:47.842622 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 71662us
W20260709 12:19:47.843430 28135 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:19:47.843559 27964 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:47.844702 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:47.854907 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.855446 24400 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:19:47.845196 28113 raft_consensus.cc:2749] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:47.838564 27925 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:47.861522 28156 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:47.861682 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:47.863158 24290 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:47.864197 28139 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:47.836006 28157 consensus_queue.cc:1048] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:19:47.867089 24394 raft_consensus.cc:1240] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:47.868465 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.869590 24290 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:47.872009 28183 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:47.872582 28183 raft_consensus.cc:697] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:47.872885 28100 consensus_queue.cc:1059] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:47.873564 28129 consensus_queue.cc:1048] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:47.873647 28183 consensus_queue.cc:237] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:47.875425 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 69311.6us
W20260709 12:19:47.876112 24440 leader_election.cc:336] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Timed out: RequestConsensusVote RPC to 127.22.155.193:36951 timed out after 1.660s (SENT)
I20260709 12:19:47.876504 24440 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:47.878389 28167 raft_consensus.cc:3055] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:47.878952 28167 raft_consensus.cc:740] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:47.881471 25110 raft_consensus.cc:1275] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:47.896391 24395 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:19:47.901734 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:47.846277 28120 raft_consensus.cc:2804] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:47.844431 28146 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.845443 28125 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:47.925874 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.929917 24395 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:19:47.851612 27964 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.930781 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:47.900916 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 60047.2us
I20260709 12:19:47.851433 28121 raft_consensus.cc:2749] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:47.853829 28159 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:47.934720 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 62210.9us
I20260709 12:19:47.935635 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:47.937877 24396 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:19:47.939018 24319 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:47.841713 27427 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:47.945348 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 80416.8us
I20260709 12:19:47.941181 24466 raft_consensus.cc:1275] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:19:47.910984 28120 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.952078 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.930218 28146 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:47.955166 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:47.957427 24400 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:19:47.764398 24220 rpcz_store.cc:269] 0709 12:19:21.618060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.647636 (+ 29576us) service_pool.cc:224] Handling call
0709 12:19:47.763621 (+26115985us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:32.148035 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:32.208159 (+ 60124us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:32.208218 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:19:32.208239 (+    21us) tablet.cc:662] Decoding operations
0709 12:19:32.218170 (+  9931us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:32.218254 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:32.218283 (+    29us) tablet.cc:685] Acquiring locks for 23 operations
0709 12:19:32.711255 (+492972us) tablet.cc:701] Row locks acquired
0709 12:19:32.711315 (+    60us) write_op.cc:260] PREPARE: finished
0709 12:19:32.711510 (+   195us) write_op.cc:270] Start()
0709 12:19:32.711692 (+   182us) write_op.cc:276] Timestamp: P: 1783599572711439 usec, L: 0
0709 12:19:32.711716 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:19:32.793072 (+ 81356us) log.cc:844] Serialized 9157 byte log entry
0709 12:19:36.601229 (+3808157us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:19:36.994754 (+393525us) op_driver.cc:464] REPLICATION: finished
0709 12:19:37.841530 (+846776us) write_op.cc:301] APPLY: starting
0709 12:19:37.841663 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:37.842266 (+   603us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:37.842305 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:38.098644 (+256339us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:38.099395 (+   751us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=23
0709 12:19:38.099449 (+    54us) write_op.cc:312] APPLY: finished
0709 12:19:38.100069 (+   620us) log.cc:844] Serialized 158 byte log entry
0709 12:19:38.316402 (+216333us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:38.345376 (+ 28974us) write_op.cc:454] Released schema lock
0709 12:19:38.345478 (+   102us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:38.345977 (+   499us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:38.346006 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":190137,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":846429,"apply.run_cpu_time_us":82379,"apply.run_wall_time_us":504458,"num_ops":23,"prepare.queue_time_us":369514,"prepare.run_cpu_time_us":57802,"prepare.run_wall_time_us":893500,"raft.queue_time_us":255216,"raft.run_cpu_time_us":47748,"raft.run_wall_time_us":242442,"replication_time_us":4282818,"spinlock_wait_cycles":2925952,"thread_start_us":817689,"threads_started":5,"wal-append.queue_time_us":697642,"wal-append.run_cpu_time_us":134797,"wal-append.run_wall_time_us":5871181}]]}
I20260709 12:19:47.937484 27964 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:47.962456 24392 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:19:47.964951 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:47.966563 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:47.971652 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:47.960242 27906 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:47.975581 28119 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:47.975874 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:47.976336 27427 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:47.977694 25082 leader_election.cc:336] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.624s (SENT)
W20260709 12:19:47.981570 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:47.982051 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:47.982724 28111 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.983289 28111 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:47.985216 28126 consensus_meta.cc:287] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.793s	user 0.013s	sys 0.001s
I20260709 12:19:47.985715 28126 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:47.986536 28111 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:47.986730 24393 raft_consensus.cc:1275] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:19:47.987874 28126 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:47.993129 24393 raft_consensus.cc:1240] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:19:47.997798 24395 raft_consensus.cc:1275] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:19:47.998982 28116 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:48.002857 28150 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:48.005045 25082 leader_election.cc:336] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.149s (SENT)
W20260709 12:19:48.006219 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 46231.1us
I20260709 12:19:48.007743 24438 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:48.008853 24366 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:48.011669 28159 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:19:48.012094 28206 log.cc:927] Time spent T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
W20260709 12:19:48.012790 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 136721us
I20260709 12:19:48.013311 28159 raft_consensus.cc:697] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
W20260709 12:19:48.013691 24440 leader_election.cc:336] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Timed out: RequestConsensusVote RPC to 127.22.155.193:36951 timed out after 1.666s (SENT)
I20260709 12:19:48.014298 24440 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:48.015996 24440 connection.cc:256] RPC call timeout handler was delayed by -1.0950877630000377s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
I20260709 12:19:48.020608 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:48.021934 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:48.033504 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:48.033703 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 64701.2us
I20260709 12:19:48.035208 24438 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:48.006225 25082 leader_election.cc:336] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.168s (SENT)
I20260709 12:19:48.036943 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:48.038020 24400 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:19:47.957545 28120 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:48.042037 25082 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:48.043016 24440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:48.035532 24289 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:48.046597 25114 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
W20260709 12:19:48.046885 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 153159us
I20260709 12:19:48.049515 25084 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:48.032115 28110 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:48.014461 28159 consensus_queue.cc:237] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:48.053352 24438 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:48.041497 28012 raft_consensus.cc:2764] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:19:48.062983 24472 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 5.
I20260709 12:19:48.048554 28029 consensus_queue.cc:1048] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:19:48.078433 24318 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:19:48.047438 27859 raft_consensus.cc:2804] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:48.081513 24391 raft_consensus.cc:1240] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:19:48.073184 27931 raft_consensus.cc:2749] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:48.083201 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:48.085131 25084 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:48.085595 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:48.085858 24324 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:48.086464 24469 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:19:47.963683 24392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:19:48.053769 27906 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:48.088675 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:48.097373 24392 raft_consensus.cc:606] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Received request to transfer leadership to TS c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:48.109395 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:48.113570 24319 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:19:48.115994 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:48.118440 27941 consensus_queue.cc:1059] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:19:48.119522 27941 raft_consensus.cc:3055] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:48.119910 27941 raft_consensus.cc:740] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:48.120467 28122 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.120776 24465 raft_consensus.cc:1240] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:19:48.121181 28122 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:48.123881 28122 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:48.124104 24366 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:48.125253 28125 raft_consensus.cc:2764] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:19:48.052742 28157 consensus_queue.cc:1048] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:19:48.129398 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:48.130730 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:48.116894 24394 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:19:48.087596 28121 raft_consensus.cc:2749] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:48.091250 28155 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:48.097739 28079 raft_consensus.cc:2749] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:48.104857 27896 raft_consensus.cc:2804] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:48.099237 27859 raft_consensus.cc:697] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:48.142961 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:48.141964 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:19:48.106267 27906 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:48.111689 28181 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:48.143644 25084 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:48.146257 24325 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
W20260709 12:19:48.149346 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:48.163651 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:48.142338 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:48.167194 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:48.167620 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 53102.6us
W20260709 12:19:48.170710 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 164527us
I20260709 12:19:48.171164 24465 raft_consensus.cc:1240] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:48.174392 24471 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:48.174098 27941 consensus_queue.cc:260] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:48.174835 27859 consensus_queue.cc:237] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:48.175662 27941 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:48.178433 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:48.190455 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:48.194438 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:48.195873 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:48.197214 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:48.197832 24465 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:48.161283 27896 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:48.164301 27906 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:48.162971 28181 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:48.206748 24321 raft_consensus.cc:2393] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 7: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:48.186480 24438 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:48.215880 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:48.218829 24440 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:48.177999 28155 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:48.220120 24318 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:48.222380 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:48.223789 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:48.223075 28156 raft_consensus.cc:2804] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:48.234635 25110 raft_consensus.cc:1240] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:48.143682 28125 consensus_queue.cc:1059] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 12:19:48.238695 25112 raft_consensus.cc:2410] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:19:48.242547 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:48.209937 27896 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:48.252940 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:48.253750 25114 raft_consensus.cc:1240] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:19:48.257699 24465 raft_consensus.cc:1275] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:48.257884 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:48.262743 24400 raft_consensus.cc:2410] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:19:48.221167 28181 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:48.229349 28155 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:48.267935 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:48.269615 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:48.224511 28079 consensus_queue.cc:1048] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:19:48.204933 28112 consensus_queue.cc:1059] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:19:48.303545 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:48.306838 24316 raft_consensus.cc:1275] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:19:48.314265 24316 pending_rounds.cc:85] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756: Aborting all ops after (but not including) 6
I20260709 12:19:48.274137 28155 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:48.314924 24316 pending_rounds.cc:107] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:19:48.317672 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:48.320899 24316 raft_consensus.cc:2889] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:48.318403 25113 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:19:48.325484 25082 leader_election.cc:400] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 8. Current term is 9.
I20260709 12:19:48.325843 25082 leader_election.cc:403] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:19:48.300838 28125 consensus_queue.cc:1243] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer c711faa13ead43ebbea0192cb74a4756 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:19:48.268379 27427 consensus_queue.cc:1059] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:19:48.383524 24467 raft_consensus.cc:1240] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 12:19:48.391954 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:48.411514 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:48.449726 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 244536us
W20260709 12:19:48.453699 24324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2335) took 2282 ms (client timeout 1932 ms). Trace:
W20260709 12:19:48.455550 28191 log.cc:927] Time spent T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:19:48.454160 24324 rpcz_store.cc:269] 0709 12:19:46.165856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:46.320493 (+154637us) service_pool.cc:224] Handling call
0709 12:19:48.408322 (+2087829us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b540025b2d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:48.447767 (+ 39445us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3564880640}
W20260709 12:19:48.473913 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 148553us
W20260709 12:19:48.474570 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 205456us
I20260709 12:19:48.404764 28146 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:48.485747 25084 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:48.503659 25084 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:48.505625 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:48.506426 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:48.481961 28156 raft_consensus.cc:697] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:48.501149 28079 raft_consensus.cc:2749] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 8. Current term is 9.
I20260709 12:19:48.518859 24324 raft_consensus.cc:2393] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 7: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:48.516889 24291 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:48.532933 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:48.525614 25082 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:48.519162 28222 log.cc:927] Time spent T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928: Append to log took a long time: real 0.128s	user 0.000s	sys 0.002s
I20260709 12:19:48.619689 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:48.605546 28112 raft_consensus.cc:3055] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:48.622673 28112 raft_consensus.cc:740] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:48.526784 27427 raft_consensus.cc:2804] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:19:48.635812 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 138128us
I20260709 12:19:48.641721 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:48.629951 27427 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:48.605767 28113 consensus_queue.cc:1048] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:19:48.666036 24366 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:48.663127 24324 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:19:48.618741 28227 raft_consensus.cc:2804] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:19:48.672930 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 138840us
I20260709 12:19:48.673966 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:48.621371 28145 consensus_queue.cc:1059] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:19:48.644034 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:48.663385 28213 log.cc:927] Time spent T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.340s	user 0.000s	sys 0.001s
I20260709 12:19:48.635787 28148 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:48.681322 24291 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:48.682721 28220 log.cc:927] Time spent T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 12:19:48.683418 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 798) took 1081 ms. Trace:
I20260709 12:19:48.661264 28236 raft_consensus.cc:2804] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:48.665611 27427 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:48.690131 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:48.697160 24319 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:19:48.691924 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:48.688714 28129 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:48.693377 24366 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:48.679093 28177 raft_consensus.cc:2749] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:48.707994 27931 raft_consensus.cc:3055] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:48.709717 27905 raft_consensus.cc:3055] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:19:48.711882 28218 log.cc:927] Time spent T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
W20260709 12:19:48.712868 28235 log.cc:927] Time spent T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:19:48.714669 28112 consensus_queue.cc:260] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:48.715548 28156 consensus_queue.cc:237] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:48.704936 28227 raft_consensus.cc:697] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:48.717128 28233 raft_consensus.cc:2749] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:48.715606 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:48.719326 28236 raft_consensus.cc:697] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:48.719916 28172 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:19:48.720918 28221 log.cc:927] Time spent T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 12:19:48.769528 24473 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:48.771219 28110 consensus_meta.cc:287] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.714s	user 0.010s	sys 0.003s
W20260709 12:19:48.772388 28150 consensus_meta.cc:287] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.769s	user 0.007s	sys 0.007s
I20260709 12:19:48.749087 28146 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:48.772895 28227 consensus_queue.cc:237] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:48.776553 24400 raft_consensus.cc:3055] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:48.777006 24400 raft_consensus.cc:740] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:48.777827 24400 consensus_queue.cc:260] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:48.778716 24400 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:48.725142 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:48.781266 24398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 555) took 1481 ms. Trace:
I20260709 12:19:48.782015 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:48.781749 24398 rpcz_store.cc:276] 0709 12:19:47.300137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:47.783985 (+483848us) service_pool.cc:224] Handling call
0709 12:19:47.791522 (+  7537us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:48.070643 (+279121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:48.070680 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:48.071253 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 12:19:48.266131 (+194878us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:48.266168 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:48.665287 (+399119us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54001b9754. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:48.665337 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:48.780900 (+115563us) raft_consensus.cc:1685] finished
0709 12:19:48.780923 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:48.781195 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3334,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":10679,"spinlock_wait_cycles":640751488,"thread_start_us":194418,"threads_started":1,"wal-append.queue_time_us":323965}
I20260709 12:19:48.726068 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:48.785034 24324 raft_consensus.cc:2376] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8. Re-sending same reply.
I20260709 12:19:48.786098 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:48.788148 27896 consensus_meta.cc:287] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.502s	user 0.007s	sys 0.000s
I20260709 12:19:48.723960 27931 raft_consensus.cc:740] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:19:48.734989 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:48.738090 24471 consensus_meta.cc:287] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.004s
I20260709 12:19:48.644538 28167 consensus_queue.cc:260] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:48.724684 28214 log.cc:927] Time spent T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.326s	user 0.001s	sys 0.000s
I20260709 12:19:48.746918 27427 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:48.761816 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 68584us
W20260709 12:19:48.762429 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:48.724148 27905 raft_consensus.cc:740] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:48.738616 28228 consensus_queue.cc:1048] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:19:48.767457 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:48.765250 28172 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:48.747709 28129 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.689616 24468 rpcz_store.cc:276] 0709 12:19:47.609521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:47.891883 (+282362us) service_pool.cc:224] Handling call
0709 12:19:47.892325 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:47.958358 (+ 66033us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:47.958410 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:48.054044 (+ 95634us) log.cc:844] Serialized 26 byte log entry
0709 12:19:48.403440 (+349396us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:48.403481 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:48.403546 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:48.683174 (+279628us) raft_consensus.cc:1685] finished
0709 12:19:48.683201 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:48.683353 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41291,"raft.queue_time_us":48684,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":15250,"thread_start_us":273946,"threads_started":1,"wal-append.queue_time_us":399149}
I20260709 12:19:48.735019 28012 raft_consensus.cc:2749] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:48.801403 24323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1920) took 1319 ms. Trace:
W20260709 12:19:48.841347 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:48.841804 24471 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
I20260709 12:19:48.842396 24316 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
W20260709 12:19:48.788992 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 271398us
I20260709 12:19:48.808912 24473 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:19:48.857143 25082 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:48.857520 24321 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
W20260709 12:19:48.800819 28181 consensus_meta.cc:287] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.003s
W20260709 12:19:48.804198 28116 consensus_meta.cc:287] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.804s	user 0.011s	sys 0.003s
W20260709 12:19:48.798540 28139 consensus_meta.cc:287] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.934s	user 0.012s	sys 0.001s
W20260709 12:19:48.820025 27964 consensus_meta.cc:287] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.779s	user 0.011s	sys 0.000s
I20260709 12:19:48.861578 24324 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:48.799451 28112 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:48.795012 27906 consensus_meta.cc:287] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.541s	user 0.006s	sys 0.002s
I20260709 12:19:48.844269 24323 rpcz_store.cc:276] 0709 12:19:47.506358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:47.546817 (+ 40459us) service_pool.cc:224] Handling call
0709 12:19:47.547320 (+   503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:47.667311 (+119991us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:47.667345 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:47.692044 (+ 24699us) log.cc:844] Serialized 26 byte log entry
0709 12:19:48.024384 (+332340us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b1800421f60. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a94241e07 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425ec02 00007f4a96ee620b 00007f4a96eebd23 00007f4a96eec0d1 00007f4a97307a0f
0709 12:19:48.245939 (+221555us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:48.245994 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:48.246084 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:48.800971 (+554887us) raft_consensus.cc:1685] finished
0709 12:19:48.801002 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:48.801301 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28984,"raft.queue_time_us":74318,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":41235,"spinlock_wait_cycles":37437824,"thread_start_us":221321,"threads_started":1,"wal-append.queue_time_us":620373}
I20260709 12:19:48.886739 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:48.796868 27941 consensus_meta.cc:287] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.621s	user 0.006s	sys 0.007s
I20260709 12:19:48.880929 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:48.843185 28172 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:48.850669 28120 consensus_meta.cc:287] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.793s	user 0.009s	sys 0.003s
I20260709 12:19:48.882601 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:48.808938 28219 log.cc:927] Time spent T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.305s	user 0.001s	sys 0.001s
I20260709 12:19:48.858964 27427 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:48.880414 28124 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.884321 27905 consensus_queue.cc:260] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:48.884701 24366 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:48.882000 28167 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:48.885322 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 130866us
I20260709 12:19:48.888614 28139 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:48.887148 24470 raft_consensus.cc:2410] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:19:48.888188 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:48.962299 24473 raft_consensus.cc:2393] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 6: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:48.895264 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:48.859587 24319 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:19:48.963704 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:48.883834 28118 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:48.901633 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:48.788533 28155 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:48.946637 24468 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
W20260709 12:19:48.958245 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:48.958009 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:48.794193 24400 raft_consensus.cc:1275] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:19:48.968303 24400 pending_rounds.cc:85] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a: Aborting all ops after (but not including) 5
I20260709 12:19:48.851209 27896 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:48.968641 24400 pending_rounds.cc:107] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:19:48.969022 24400 raft_consensus.cc:2889] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:48.969581 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:48.894583 28146 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:48.959187 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:48.888159 28247 raft_consensus.cc:2804] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:48.963711 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:48.897405 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:48.858428 28129 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:48.970690 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:48.970479 24317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 558) took 1263 ms. Trace:
I20260709 12:19:48.971487 24323 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
W20260709 12:19:48.973055 24211 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.467s	user 0.000s	sys 0.000s
W20260709 12:19:48.976156 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 113887us
I20260709 12:19:48.887385 28181 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:48.975210 24317 rpcz_store.cc:276] 0709 12:19:47.706880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:47.786923 (+ 80043us) service_pool.cc:224] Handling call
0709 12:19:47.806865 (+ 19942us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:47.849500 (+ 42635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:47.849530 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:47.880584 (+ 31054us) log.cc:844] Serialized 26 byte log entry
0709 12:19:48.045261 (+164677us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:48.045305 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:48.045387 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:48.970085 (+924698us) raft_consensus.cc:1685] finished
0709 12:19:48.970120 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:48.970389 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":152079,"threads_started":1,"wal-append.queue_time_us":393765}
I20260709 12:19:48.818459 28236 consensus_queue.cc:237] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:48.986974 24320 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:48.892416 27906 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:48.999517 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:48.975582 25082 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:48.894179 28079 consensus_queue.cc:1059] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:19:48.983103 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:48.983981 24316 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:48.984584 24319 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:19:49.004030 24324 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
W20260709 12:19:48.987376 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:49.004444 24397 raft_consensus.cc:1275] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:19:49.004894 24397 pending_rounds.cc:85] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a: Aborting all ops after (but not including) 5
I20260709 12:19:49.005167 24397 pending_rounds.cc:107] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:19:49.005462 24397 raft_consensus.cc:2889] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:48.958704 28124 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:48.888417 27964 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:48.988960 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 108375us
I20260709 12:19:48.989507 24467 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:19:49.024516 24365 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:48.989928 27896 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:48.974227 28247 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:48.992470 25083 leader_election.cc:400] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Vote denied by peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453) with higher term. Message: Invalid argument: T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 8. Current term is 9.
W20260709 12:19:49.045941 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 153109us
I20260709 12:19:48.969033 28156 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.899863 28120 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:49.007791 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:49.007838 28079 raft_consensus.cc:3055] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:49.011469 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:49.014005 27906 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:48.973739 28118 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:49.021196 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:49.024667 28125 consensus_queue.cc:1059] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:48.987795 27931 consensus_queue.cc:260] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:49.028589 28215 log.cc:927] Time spent T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.579s	user 0.004s	sys 0.008s
I20260709 12:19:49.029275 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:49.029057 28240 consensus_queue.cc:1048] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:19:49.034243 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 146810us
I20260709 12:19:48.991556 28181 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:48.978524 27905 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:48.987016 28012 raft_consensus.cc:2749] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:48.976526 28111 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.027990 27864 consensus_queue.cc:1059] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:49.046015 24325 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:19:49.001099 25119 raft_consensus.cc:1240] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9. Ops: []
W20260709 12:19:49.069777 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 116408us
I20260709 12:19:49.047411 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:49.048892 24319 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:49.050727 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:49.052728 25083 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:49.006224 28146 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:49.162196 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 58804.6us
I20260709 12:19:49.164105 25082 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:49.050289 28079 raft_consensus.cc:740] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:49.082191 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:49.080734 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:49.079571 24366 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
W20260709 12:19:49.092885 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:49.025653 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:49.103617 24323 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:19:49.166214 27427 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:49.168958 24471 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:49.171511 25082 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:49.166615 24472 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:49.056952 24465 raft_consensus.cc:2393] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 11: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:49.084543 28124 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:49.101915 24324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2345) took 1123 ms. Trace:
I20260709 12:19:49.177389 24324 rpcz_store.cc:276] 0709 12:19:47.978019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.028962 (+1050943us) service_pool.cc:224] Handling call
0709 12:19:49.101831 (+ 72869us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.103030 24322 raft_consensus.cc:2368] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7.
I20260709 12:19:49.103977 24400 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:49.047340 24316 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:19:49.049108 28247 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:49.160437 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:49.102802 28157 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:49.161808 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 114934us
I20260709 12:19:49.183853 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:49.184723 24324 raft_consensus.cc:2410] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:19:49.097990 28183 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.095589 27896 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:49.192378 24321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 1934) took 1205 ms. Trace:
W20260709 12:19:49.191990 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 137606us
I20260709 12:19:49.049769 28126 consensus_queue.cc:1048] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.128s
I20260709 12:19:49.192845 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:49.193723 24365 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:49.195550 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:49.192845 24321 rpcz_store.cc:276] 0709 12:19:47.980033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.248932 (+268899us) service_pool.cc:224] Handling call
0709 12:19:49.185621 (+936689us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b540001e354. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:49.185762 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1162289536}
I20260709 12:19:49.164582 28146 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:49.050087 28156 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:49.208793 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:49.209795 24324 raft_consensus.cc:2410] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:19:49.175810 28233 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:49.210458 27427 raft_consensus.cc:2749] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:49.215611 24324 raft_consensus.cc:1240] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:19:49.216655 24324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1928) took 1332 ms. Trace:
I20260709 12:19:49.217175 24324 rpcz_store.cc:276] 0709 12:19:47.884272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.214762 (+1330490us) service_pool.cc:224] Handling call
0709 12:19:49.215229 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:49.216309 (+  1080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.216566 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.219684 24316 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:49.221566 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:49.189635 28012 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:49.186652 28229 raft_consensus.cc:2804] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:49.225553 24322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 1951) took 1007 ms. Trace:
I20260709 12:19:49.227861 24324 raft_consensus.cc:1240] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:19:49.227095 24322 rpcz_store.cc:276] 0709 12:19:48.218315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.513859 (+295544us) service_pool.cc:224] Handling call
0709 12:19:49.225222 (+711363us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b54000a8554. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:49.225459 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1102241664}
I20260709 12:19:49.193465 27896 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.237207 24324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1930) took 1278 ms. Trace:
I20260709 12:19:49.237757 24324 rpcz_store.cc:276] 0709 12:19:47.950643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.227079 (+1276436us) service_pool.cc:224] Handling call
0709 12:19:49.227541 (+   462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:49.228437 (+   896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.228737 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.244272 24323 raft_consensus.cc:1240] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9. Ops: []
W20260709 12:19:49.244987 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 195039us
W20260709 12:19:49.249537 24440 connection.cc:256] RPC call timeout handler was delayed by -1.23771366699998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
I20260709 12:19:49.174196 28111 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:49.270881 24440 connection.cc:256] RPC call timeout handler was delayed by -1.1846136669998941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1915s for a response
W20260709 12:19:49.271473 24440 connection.cc:256] RPC call timeout handler was delayed by -1.1693136669998694s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
W20260709 12:19:49.271850 24440 connection.cc:256] RPC call timeout handler was delayed by -1.1531136669998432s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.195s for a response
W20260709 12:19:49.272243 24440 connection.cc:256] RPC call timeout handler was delayed by -1.1180136670000138s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19890000000000002s for a response
I20260709 12:19:49.190079 28157 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:49.165722 28079 consensus_queue.cc:260] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:49.372589 28079 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:49.373288 24467 raft_consensus.cc:1275] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:19:49.373538 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:49.375108 24467 raft_consensus.cc:1275] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:19:49.233850 28229 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.376992 28229 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:49.378085 24317 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
W20260709 12:19:49.378551 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:49.379092 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:49.379231 24317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2341) took 1428 ms. Trace:
I20260709 12:19:49.379607 24317 rpcz_store.cc:276] 0709 12:19:47.950896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.020877 (+1069981us) service_pool.cc:224] Handling call
0709 12:19:49.379088 (+358211us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b540019fd54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:49.379177 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":673318272}
I20260709 12:19:49.380017 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:49.380856 24469 raft_consensus.cc:2393] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 10: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:49.278882 24468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:33278
I20260709 12:19:49.381204 24366 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:49.235802 27896 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:49.381806 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:49.382654 24469 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:49.382853 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 568) took 1189 ms. Trace:
W20260709 12:19:49.383169 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 189539us
I20260709 12:19:49.383522 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:49.295336 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 85131us
I20260709 12:19:49.385432 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:49.386334 24469 raft_consensus.cc:2368] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 8. Current term is 9.
I20260709 12:19:49.386663 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:49.386911 24325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 1932) took 1407 ms (client timeout 1731 ms). Trace:
I20260709 12:19:49.387243 24317 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:49.387444 24325 rpcz_store.cc:269] 0709 12:19:47.979389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.182715 (+203326us) service_pool.cc:224] Handling call
0709 12:19:49.386712 (+1203997us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b54000a7654. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:49.386836 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1845209472}
I20260709 12:19:49.383315 25119 rpcz_store.cc:276] 0709 12:19:48.193040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.193741 (+   701us) service_pool.cc:224] Handling call
0709 12:19:48.194061 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:49.159704 (+965643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.382590 (+222886us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b54007d0354. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:49.382768 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1850781056}
I20260709 12:19:49.389065 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:49.389808 24325 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:49.387593 24469 raft_consensus.cc:1275] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:19:49.391877 28263 consensus_queue.cc:1048] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:19:49.342089 28252 log.cc:927] Time spent T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.245s	user 0.006s	sys 0.000s
I20260709 12:19:49.392707 24469 raft_consensus.cc:1240] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:49.345034 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:49.393400 25110 raft_consensus.cc:2393] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:49.395159 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 806) took 1311 ms. Trace:
I20260709 12:19:49.395714 24466 rpcz_store.cc:276] 0709 12:19:48.083858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.085253 (+  1395us) service_pool.cc:224] Handling call
0709 12:19:48.085661 (+   408us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:48.086234 (+   573us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:19:48.842493 (+756259us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b1800289ae0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a96ef44bc 00007f4a9424248b 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425c455 00007f4a9ad443c7 00007f4a973569a7 00007f4a973660bf
0709 12:19:48.842649 (+   156us) log.cc:844] Serialized 14 byte log entry
0709 12:19:49.024995 (+182346us) log.cc:844] Serialized 14 byte log entry
0709 12:19:49.025215 (+   220us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:49.025942 (+   727us) log.cc:844] Serialized 52 byte log entry
0709 12:19:49.026119 (+   177us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:49.026168 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.026266 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:49.394796 (+368530us) raft_consensus.cc:1685] finished
0709 12:19:49.394827 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:49.395067 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71389,"prepare.queue_time_us":494281,"prepare.run_cpu_time_us":120,"prepare.run_wall_time_us":5652,"raft.queue_time_us":12883,"raft.run_cpu_time_us":435,"raft.run_wall_time_us":15572,"spinlock_wait_cycles":5286784,"thread_start_us":461826,"threads_started":2,"wal-append.queue_time_us":93015}
I20260709 12:19:49.386361 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:49.344005 28120 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:49.349023 28129 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:49.408532 24470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33198 (request call id 796) took 1840 ms (client timeout 2017 ms). Trace:
W20260709 12:19:49.409653 24470 rpcz_store.cc:269] 0709 12:19:47.567851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:47.581479 (+ 13628us) service_pool.cc:224] Handling call
0709 12:19:49.408274 (+1826795us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400150ed4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:49.408453 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2937776512}
I20260709 12:19:49.412261 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:49.413065 25111 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 5.
I20260709 12:19:49.349476 24318 raft_consensus.cc:1275] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:19:49.350513 24472 raft_consensus.cc:1240] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 8. Ops: []
W20260709 12:19:49.356473 24320 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2342) took 1396 ms (client timeout 1559 ms). Trace:
I20260709 12:19:49.419240 24468 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:49.419952 24468 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:49.424942 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:49.419173 24320 rpcz_store.cc:269] 0709 12:19:47.959820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.021690 (+ 61870us) service_pool.cc:224] Handling call
0709 12:19:49.356259 (+1334569us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b5400256cd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:49.356404 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2198137728}
I20260709 12:19:49.358474 24323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1926) took 1474 ms. Trace:
I20260709 12:19:49.358883 24321 raft_consensus.cc:1240] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:19:49.361093 24322 raft_consensus.cc:1240] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:19:49.362588 24324 raft_consensus.cc:1275] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:49.366081 28156 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:49.428081 28111 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:49.438206 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:49.439710 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 251166us
I20260709 12:19:49.439913 24318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1937) took 1437 ms. Trace:
I20260709 12:19:49.274065 27427 consensus_queue.cc:1048] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:19:49.196511 28183 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:49.344044 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:49.440608 24318 rpcz_store.cc:276] 0709 12:19:47.981108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.301979 (+1320871us) service_pool.cc:224] Handling call
0709 12:19:49.349147 (+ 47168us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:49.418474 (+ 69327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.418748 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.435025 24323 rpcz_store.cc:276] 0709 12:19:47.883672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.213847 (+1330175us) service_pool.cc:224] Handling call
0709 12:19:49.244037 (+ 30190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:49.254679 (+ 10642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.358410 (+103731us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.440075 24322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44278 (request call id 2343) took 1470 ms. Trace:
I20260709 12:19:49.442046 24322 rpcz_store.cc:276] 0709 12:19:47.969290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.231945 (+1262655us) service_pool.cc:224] Handling call
0709 12:19:49.360733 (+128788us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:49.439751 (+ 79018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.440018 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.370769 27964 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:49.434392 24321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1923) took 1551 ms. Trace:
I20260709 12:19:49.448040 24321 rpcz_store.cc:276] 0709 12:19:47.882765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.210629 (+1327864us) service_pool.cc:224] Handling call
0709 12:19:49.210980 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:49.358621 (+147641us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b5400422d20. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a972c3dc0 00007f4a9734e1c0 00007f4a9734f231 00007f4a9734bd8f 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c
0709 12:19:49.434006 (+ 75385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.434303 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8177920}
I20260709 12:19:49.438545 28118 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:49.457844 24316 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:19:49.439428 24289 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:49.465401 25082 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:49.477058 24325 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
W20260709 12:19:49.477488 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 93493.2us
W20260709 12:19:49.479691 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 100127us
I20260709 12:19:49.478114 28122 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:49.479414 28263 consensus_queue.cc:1048] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:19:49.464547 28111 consensus_queue.cc:1048] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:19:49.481055 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:49.355258 28247 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:49.487500 28247 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:49.488574 25115 raft_consensus.cc:1240] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6. Ops: []
W20260709 12:19:49.488665 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 46508.5us
W20260709 12:19:49.489354 28167 consensus_meta.cc:287] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.005s
I20260709 12:19:49.490391 24319 raft_consensus.cc:2410] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:19:49.490939 24318 raft_consensus.cc:1275] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:19:49.481015 28122 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:49.491709 24318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1938) took 1510 ms. Trace:
I20260709 12:19:49.492400 27427 raft_consensus.cc:2804] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:49.492942 27427 raft_consensus.cc:697] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:49.493835 27427 consensus_queue.cc:237] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:49.494606 28233 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:49.492086 24318 rpcz_store.cc:276] 0709 12:19:47.981371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.490170 (+1508799us) service_pool.cc:224] Handling call
0709 12:19:49.490564 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:49.491478 (+   914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.491658 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.497987 24318 raft_consensus.cc:1275] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:49.498454 28183 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:49.500113 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 119075us
I20260709 12:19:49.501076 24366 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:49.503351 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:49.505342 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:49.498648 24318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1943) took 1515 ms. Trace:
I20260709 12:19:49.510519 24318 rpcz_store.cc:276] 0709 12:19:47.982735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.497269 (+1514534us) service_pool.cc:224] Handling call
0709 12:19:49.497640 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:49.498324 (+   684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.498594 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.502579 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 804) took 1419 ms. Trace:
I20260709 12:19:49.502336 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:49.513533 24393 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:19:49.514153 24466 raft_consensus.cc:2393] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 11: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:49.504213 24467 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:49.515750 24317 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:19:49.517112 24365 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:49.473433 28172 consensus_meta.cc:287] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.005s
I20260709 12:19:49.522394 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:49.518712 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:49.520241 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:49.440271 28157 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:49.512583 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 127082us
I20260709 12:19:49.524344 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:49.524392 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 43944us
I20260709 12:19:49.528925 24470 raft_consensus.cc:1275] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:19:49.529090 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:49.530290 24466 raft_consensus.cc:2393] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:49.533293 24325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1940) took 1543 ms. Trace:
I20260709 12:19:49.533890 24325 rpcz_store.cc:276] 0709 12:19:47.981912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.503393 (+1521481us) service_pool.cc:224] Handling call
0709 12:19:49.525135 (+ 21742us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:49.525504 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:49.525532 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:49.525577 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:49.525610 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.525672 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:49.525788 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":142}
I20260709 12:19:49.526350 28012 raft_consensus.cc:697] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:49.536943 24318 raft_consensus.cc:1275] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:49.537952 24317 raft_consensus.cc:1240] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:49.502691 28129 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.508206 28120 raft_consensus.cc:2804] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:49.533545 24472 raft_consensus.cc:1217] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 3.6->[6.7-6.7]   Dedup: 6.7->[]
I20260709 12:19:49.545996 24472 raft_consensus.cc:1240] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:19:49.546298 24318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1944) took 1563 ms. Trace:
I20260709 12:19:49.545120 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:49.547851 24469 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:49.548600 24318 rpcz_store.cc:276] 0709 12:19:47.983027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.511800 (+1528773us) service_pool.cc:224] Handling call
0709 12:19:49.536446 (+ 24646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:49.545837 (+  9391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.546202 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.512681 24474 rpcz_store.cc:276] 0709 12:19:48.082838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.097531 (+ 14693us) service_pool.cc:224] Handling call
0709 12:19:48.142003 (+ 44472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:48.142400 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:19:48.511210 (+368810us) log.cc:844] Serialized 14 byte log entry
0709 12:19:49.187289 (+676079us) spinlock_profiling.cc:243] Waited 6.79 ms on lock 0x7b1800289b40. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a94241e07 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425ec02 00007f4a96ee620b 00007f4a96eebd23 00007f4a96eec23a 00007f4a97356a2a
0709 12:19:49.474411 (+287122us) log.cc:844] Serialized 14 byte log entry
0709 12:19:49.474607 (+   196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:49.474652 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:49.474697 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.474765 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:49.502495 (+ 27730us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":362948,"prepare.queue_time_us":366006,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":92,"raft.queue_time_us":8309,"spinlock_wait_cycles":112024576,"thread_start_us":591085,"threads_started":2,"wal-append.queue_time_us":956761}
I20260709 12:19:49.519207 28237 raft_consensus.cc:3055] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:19:49.555187 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:49.562912 24317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1946) took 1564 ms. Trace:
I20260709 12:19:49.566059 24470 raft_consensus.cc:1240] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 8. Current term is 9. Ops: [8.3-8.3]
I20260709 12:19:49.568030 24325 raft_consensus.cc:1240] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:19:49.569176 24325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1956) took 1282 ms. Trace:
I20260709 12:19:49.569738 24325 rpcz_store.cc:276] 0709 12:19:48.286730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.535533 (+1248803us) service_pool.cc:224] Handling call
0709 12:19:49.567722 (+ 32189us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:49.568819 (+  1097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.569104 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.566642 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:49.572959 24466 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:49.564219 24317 rpcz_store.cc:276] 0709 12:19:47.983590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.516766 (+1533176us) service_pool.cc:224] Handling call
0709 12:19:49.537702 (+ 20936us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:49.548069 (+ 10367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.548351 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.539310 28146 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.575767 25084 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:49.610297 24318 raft_consensus.cc:1275] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 2. Preceding OpId from leader: term: 9 index: 3. (index mismatch)
I20260709 12:19:49.610646 25084 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:49.607398 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:49.574549 24468 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:49.551410 28264 raft_consensus.cc:3055] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:19:49.592480 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:49.615522 24467 raft_consensus.cc:1275] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:49.564908 28261 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.617425 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:49.617564 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:49.561798 28237 raft_consensus.cc:740] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:49.618963 25084 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:49.619441 24317 raft_consensus.cc:1240] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:49.528355 28172 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:49.552799 28120 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.626474 24467 raft_consensus.cc:1240] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:19:49.575408 28260 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:19:49.628665 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 111644us
I20260709 12:19:49.630290 24365 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:49.618193 28247 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:49.612753 28264 raft_consensus.cc:740] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:49.612473 28259 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:49.620934 27905 raft_consensus.cc:2804] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:49.566728 28129 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:49.631598 27864 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:49.613826 28262 consensus_queue.cc:1059] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:19:49.640589 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:49.643222 24320 raft_consensus.cc:2393] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 9: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:49.641630 28012 consensus_queue.cc:237] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:49.646435 28240 raft_consensus.cc:2804] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:49.649401 24470 raft_consensus.cc:1275] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:19:49.629172 28120 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:49.653472 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 131102us
I20260709 12:19:49.615589 28146 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:49.638190 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:49.678754 25111 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:19:49.679008 24291 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:49.661695 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:49.680119 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:49.636191 28247 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.670917 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:49.686066 24467 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:49.637766 28233 raft_consensus.cc:2804] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:49.659595 24365 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:49.650811 28259 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.656255 28255 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:49.623843 28261 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:49.656675 28260 raft_consensus.cc:697] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:19:49.677397 28238 log.cc:927] Time spent T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.933s	user 0.006s	sys 0.002s
I20260709 12:19:49.656963 27864 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:49.677914 28240 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:49.571321 24211 maintenance_manager.cc:643] P 68b836feee894afe8d95b23bdf764928: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 8.305s	user 0.167s	sys 0.075s Metrics: {"bytes_written":29533,"cfile_init":1,"dirs.queue_time_us":237541,"dirs.run_cpu_time_us":604,"dirs.run_wall_time_us":58011,"drs_written":1,"lbm_read_time_us":619,"lbm_reads_lt_1ms":4,"lbm_write_time_us":13228,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":29,"peak_mem_usage":0,"rows_written":63,"thread_start_us":10731,"threads_started":1}
I20260709 12:19:49.703642 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:49.705686 24321 raft_consensus.cc:1240] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:49.698589 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:49.710654 25118 raft_consensus.cc:1240] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:19:49.657815 28273 consensus_queue.cc:1059] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:19:49.692095 27788 raft_consensus.cc:2804] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:49.695255 28255 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.715678 28260 consensus_queue.cc:237] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:49.717516 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:49.699486 28167 raft_consensus.cc:2804] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:49.758913 25112 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:19:49.718655 24324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1936) took 1737 ms. Trace:
I20260709 12:19:49.728843 27896 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:49.693162 28259 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:49.759904 24324 rpcz_store.cc:276] 0709 12:19:47.980790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.238764 (+1257974us) service_pool.cc:224] Handling call
0709 12:19:49.362136 (+123372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:49.434119 (+ 71983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.718435 (+284316us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b5400256cd0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:49.718569 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282454272}
I20260709 12:19:49.724414 24399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2114) took 1616 ms. Trace:
I20260709 12:19:49.747781 24393 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:49.728827 28275 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:49.728968 28274 raft_consensus.cc:2804] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:49.731137 24468 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:49.731581 24467 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:49.688048 28247 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:49.733548 27864 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:49.761179 24399 rpcz_store.cc:276] 0709 12:19:48.107908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.108933 (+  1025us) service_pool.cc:224] Handling call
0709 12:19:48.138495 (+ 29562us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:48.138939 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:19:48.410093 (+271154us) log.cc:844] Serialized 14 byte log entry
0709 12:19:48.507443 (+ 97350us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:48.528096 (+ 20653us) log.cc:844] Serialized 26 byte log entry
0709 12:19:48.528259 (+   163us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:48.528301 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:48.528375 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:49.552498 (+1024123us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:19:49.724071 (+171573us) raft_consensus.cc:1685] finished
0709 12:19:49.724175 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:49.724318 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1551,"prepare.queue_time_us":352609,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":97595,"raft.run_cpu_time_us":359,"raft.run_wall_time_us":35480,"spinlock_wait_cycles":8995712,"thread_start_us":278078,"threads_started":2,"wal-append.queue_time_us":229858}
I20260709 12:19:49.740347 28272 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.734589 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:49.742193 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 63237us
I20260709 12:19:49.754436 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:49.718932 28261 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:49.759207 28255 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:49.764715 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:49.741758 28240 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:49.765759 27896 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:49.801975 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:33278 (request call id 2097) took 1104 ms. Trace:
I20260709 12:19:49.804993 24470 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:49.755789 27788 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.768122 28275 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:49.739370 24466 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:19:49.764961 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:49.694695 28237 consensus_queue.cc:260] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:49.808436 24291 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:49.814028 24468 rpcz_store.cc:276] 0709 12:19:48.670455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.226331 (+555876us) service_pool.cc:224] Handling call
0709 12:19:49.712863 (+486532us) spinlock_profiling.cc:243] Waited 37.6 ms on lock 0x7b54001437d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a97343a3d 00007f4a9c313cd0 00007f4a95898254 00007f4a958981e2 00007f4a95898111 00007f4a9589808c 00007f4a95897342 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:49.768970 (+ 56107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86371584}
I20260709 12:19:49.825982 28157 raft_consensus.cc:2804] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:49.826524 28157 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.826927 28157 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:49.829205 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:49.830641 24212 maintenance_manager.cc:419] P 68b836feee894afe8d95b23bdf764928: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9933 bytes on disk
I20260709 12:19:49.821226 27788 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:49.833269 24211 maintenance_manager.cc:643] P 68b836feee894afe8d95b23bdf764928: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":312,"lbm_reads_lt_1ms":4}
I20260709 12:19:49.834157 28275 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:49.802845 28273 raft_consensus.cc:3055] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:49.762598 28167 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.792514 27964 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.792558 28258 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.821936 25118 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:49.840620 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:19:49.841419 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 181935us
I20260709 12:19:49.794216 28274 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:49.842846 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:49.838596 24469 raft_consensus.cc:2410] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:19:49.837392 28273 raft_consensus.cc:740] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:49.858743 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:49.859674 24468 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:19:49.838068 28172 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:49.866847 24291 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:49.839505 28167 raft_consensus.cc:3060] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:49.837464 27905 raft_consensus.cc:697] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:49.872443 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:49.875348 25112 raft_consensus.cc:2393] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:49.852233 28274 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:49.885320 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 198537us
I20260709 12:19:49.761982 28264 consensus_queue.cc:260] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:49.890012 25082 leader_election.cc:336] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.797s (SENT)
I20260709 12:19:49.890429 28264 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:49.890486 25082 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:49.890720 27905 consensus_queue.cc:237] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:49.879101 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 378087us
I20260709 12:19:49.894071 24319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2349) took 1100 ms. Trace:
I20260709 12:19:49.895720 24317 raft_consensus.cc:1275] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:19:49.840440 27964 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:49.893008 27896 raft_consensus.cc:2749] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:49.887446 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:49.898180 24468 raft_consensus.cc:2410] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:19:49.894464 24319 rpcz_store.cc:276] 0709 12:19:48.794135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.103812 (+309677us) service_pool.cc:224] Handling call
0709 12:19:49.893881 (+790069us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b5400361d54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:49.894014 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":710221696}
I20260709 12:19:49.878099 28135 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.825367 28272 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:49.896134 24317 pending_rounds.cc:85] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756: Aborting all ops after (but not including) 6
I20260709 12:19:49.905853 24317 pending_rounds.cc:107] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:19:49.906237 24317 raft_consensus.cc:2889] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:49.852506 28275 consensus_queue.cc:1048] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:19:49.857321 28261 consensus_queue.cc:1048] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:19:49.850644 28258 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:49.902936 28110 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:49.927606 25112 raft_consensus.cc:1275] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:19:49.928256 24366 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:49.937358 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:49.937067 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:49.938305 24473 raft_consensus.cc:2410] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:19:49.943528 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:49.948056 24468 raft_consensus.cc:2393] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 11: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:49.909469 28135 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:49.973855 28135 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:49.976001 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 53395us
W20260709 12:19:49.979709 24465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 2090) took 1712 ms (client timeout 2130 ms). Trace:
W20260709 12:19:49.980198 24465 rpcz_store.cc:269] 0709 12:19:48.267190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.274848 (+  7658us) service_pool.cc:224] Handling call
0709 12:19:49.979467 (+1704619us) spinlock_profiling.cc:243] Waited 744 ms on lock 0x7b540029d954. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:49.979641 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1710546304}
I20260709 12:19:49.981663 24472 raft_consensus.cc:1240] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:19:49.981966 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:49.968618 28279 log.cc:927] Time spent T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
W20260709 12:19:49.987242 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 92761.8us
I20260709 12:19:49.988430 25113 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:19:49.949060 28260 consensus_queue.cc:1059] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:19:49.908254 28273 consensus_queue.cc:260] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:49.994380 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:49.995054 24392 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:49.951500 28281 consensus_queue.cc:1048] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
W20260709 12:19:49.997205 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:49.998710 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:49.999228 24399 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:49.992213 28261 raft_consensus.cc:2749] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:50.004513 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:50.007751 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:50.010507 24366 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:50.016950 24392 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
W20260709 12:19:50.018903 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:50.019214 28293 raft_consensus.cc:3055] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:50.019793 28293 raft_consensus.cc:740] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:50.022279 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:50.021308 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:50.076907 24392 raft_consensus.cc:1275] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:50.080940 25118 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:19:50.007678 28273 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:50.093290 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 82930.9us
I20260709 12:19:50.094165 24366 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:50.098773 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:50.096881 28282 log.cc:927] Time spent T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 12:19:50.096130 28248 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.010s	sys 0.022s
I20260709 12:19:50.120240 24392 raft_consensus.cc:1275] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 2. Preceding OpId from leader: term: 9 index: 3. (index mismatch)
I20260709 12:19:50.118251 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:50.124600 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:50.135949 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:50.100340 28110 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.136999 24468 raft_consensus.cc:2393] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 10: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:50.137035 28110 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:50.139094 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 529083us
I20260709 12:19:50.139377 28110 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:50.141006 28258 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:50.141430 24392 raft_consensus.cc:1275] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:50.124680 24465 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:50.142527 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:50.140559 25083 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:50.112743 28288 log.cc:927] Time spent T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:19:50.095920 28293 consensus_queue.cc:260] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:50.136499 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:50.149245 28079 raft_consensus.cc:2804] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:50.149838 28079 raft_consensus.cc:697] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:50.149089 28148 raft_consensus.cc:2955] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 3 to 7, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:19:50.150774 28079 consensus_queue.cc:237] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:50.150907 28274 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:50.148919 28259 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:50.110766 27964 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:50.100539 28260 raft_consensus.cc:2749] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:50.220541 24470 raft_consensus.cc:1240] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:50.268621 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:50.153254 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:50.121161 28284 log.cc:927] Time spent T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:19:50.100672 28281 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:19:50.219863 28266 log.cc:927] Time spent T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.611s	user 0.003s	sys 0.000s
W20260709 12:19:50.268307 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 104770us
I20260709 12:19:50.169294 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:50.324172 24473 raft_consensus.cc:2393] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 11: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
W20260709 12:19:50.272205 24291 leader_election.cc:336] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Timed out: RequestConsensusVote RPC to 127.22.155.196:35511 timed out after 1.833s (SENT)
W20260709 12:19:50.171470 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:50.325328 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:50.325240 25082 leader_election.cc:336] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.424s (SENT)
I20260709 12:19:50.289011 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:50.292273 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:50.152925 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:50.146623 28248 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.011s	sys 0.023s
W20260709 12:19:50.298779 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:50.326321 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:50.327308 24465 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
W20260709 12:19:50.279474 28229 consensus_meta.cc:287] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.902s	user 0.014s	sys 0.000s
I20260709 12:19:50.334767 24392 raft_consensus.cc:2376] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10. Re-sending same reply.
I20260709 12:19:50.267204 28293 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:50.337865 24393 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:50.250051 28135 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:50.344800 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:50.166011 28233 raft_consensus.cc:697] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
W20260709 12:19:50.351115 24366 connection.cc:256] RPC call timeout handler was delayed by -2.0936579179999626s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
I20260709 12:19:50.366679 24469 raft_consensus.cc:2393] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:50.152521 28122 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:50.367565 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:50.400542 24474 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:50.390125 24366 connection.cc:256] RPC call timeout handler was delayed by -1.9901579180000226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
W20260709 12:19:50.395567 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 123420us
I20260709 12:19:50.295084 28258 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.332726 28272 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:50.224810 28110 consensus_queue.cc:1059] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.113s
I20260709 12:19:50.269137 28183 consensus_queue.cc:1048] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
W20260709 12:19:50.396188 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 70996.6us
I20260709 12:19:50.404454 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:50.359793 28274 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:50.264036 27788 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:50.405892 24318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 570) took 1555 ms. Trace:
I20260709 12:19:50.287921 28157 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:50.407140 24325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 566) took 1562 ms. Trace:
I20260709 12:19:50.442960 24325 rpcz_store.cc:276] 0709 12:19:48.844925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.571958 (+727033us) service_pool.cc:224] Handling call
0709 12:19:49.612835 (+ 40877us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:49.619503 (+  6668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:49.619567 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:49.623766 (+  4199us) log.cc:844] Serialized 26 byte log entry
0709 12:19:49.856216 (+232450us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:49.856262 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.856344 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:50.406939 (+550595us) raft_consensus.cc:1685] finished
0709 12:19:50.406961 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:50.407087 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":170441,"threads_started":1,"wal-append.queue_time_us":287386}
I20260709 12:19:50.154799 28247 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:50.154588 28240 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:50.402318 25116 raft_consensus.cc:2955] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 3 to 7, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:19:50.400331 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:50.217361 27864 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:50.416838 25112 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 5.
I20260709 12:19:50.294451 28125 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:50.418406 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:50.412945 28126 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.422946 24318 rpcz_store.cc:276] 0709 12:19:48.850375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.618684 (+768309us) service_pool.cc:224] Handling call
0709 12:19:49.650751 (+ 32067us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:49.685729 (+ 34978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:49.685763 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:49.686325 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 12:19:49.841021 (+154696us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:49.977222 (+136201us) log.cc:844] Serialized 14 byte log entry
0709 12:19:49.977794 (+   572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.978208 (+   414us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:50.405681 (+427473us) raft_consensus.cc:1685] finished
0709 12:19:50.405702 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:50.405830 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17892,"prepare.queue_time_us":152427,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":27759,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":14470,"thread_start_us":247730,"threads_started":2,"wal-append.queue_time_us":227569}
W20260709 12:19:50.406971 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 226762us
I20260709 12:19:50.459952 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:50.337870 28261 consensus_queue.cc:1059] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
W20260709 12:19:50.446121 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:50.422170 28146 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:50.460232 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:50.460721 24467 raft_consensus.cc:2376] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7. Re-sending same reply.
I20260709 12:19:50.399987 28135 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:50.463187 24391 raft_consensus.cc:2393] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 8: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:50.478686 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:50.479534 25112 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:19:50.479854 28135 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:50.170146 28177 consensus_queue.cc:1175] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d99d5d772cfe4a96afcab3d3b009a281" responder_term: 8 status { last_received { term: 7 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:19:50.481148 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:50.463728 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:50.482287 24318 raft_consensus.cc:1240] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:50.482640 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:50.483486 24469 raft_consensus.cc:2410] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:19:50.483600 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:50.484341 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:50.484961 24469 raft_consensus.cc:2376] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9. Re-sending same reply.
I20260709 12:19:50.468788 24397 raft_consensus.cc:1240] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6. Ops: []
W20260709 12:19:50.468801 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 66841.1us
I20260709 12:19:50.469658 25111 raft_consensus.cc:2393] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 11: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:50.474125 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2100) took 1664 ms. Trace:
I20260709 12:19:50.474570 24395 raft_consensus.cc:1240] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:50.413040 28258 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:50.491117 24366 connection.cc:256] RPC call timeout handler was delayed by -1.8839579180000783s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
I20260709 12:19:50.492245 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:50.492534 24366 connection.cc:256] RPC call timeout handler was delayed by -1.8236579179999808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
W20260709 12:19:50.481410 28120 consensus_meta.cc:287] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.780s	user 0.004s	sys 0.009s
W20260709 12:19:50.493033 24366 connection.cc:256] RPC call timeout handler was delayed by -1.7876579179999226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
I20260709 12:19:50.485112 24438 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:50.493345 24469 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:19:50.347388 28229 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:50.396116 28263 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:19:50.489102 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:50.489796 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:50.494304 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:50.502154 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:50.491415 24471 rpcz_store.cc:276] 0709 12:19:48.809400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.343607 (+534207us) service_pool.cc:224] Handling call
0709 12:19:49.343999 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:49.344472 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:49.344502 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:49.345101 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 12:19:49.478765 (+133664us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:49.478806 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.478885 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:50.219237 (+740352us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:19:50.467603 (+248366us) raft_consensus.cc:1685] finished
0709 12:19:50.467634 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:50.474058 (+  6424us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6122,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":122,"spinlock_wait_cycles":7807232,"thread_start_us":133272,"threads_started":1,"wal-append.queue_time_us":157128}
I20260709 12:19:50.502477 24316 raft_consensus.cc:2393] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 7: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:50.490115 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:50.490962 24325 raft_consensus.cc:1275] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:19:50.467234 28156 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:50.489334 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 69589.1us
W20260709 12:19:50.493613 24366 connection.cc:256] RPC call timeout handler was delayed by -1.7345579180000641s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.213s for a response
I20260709 12:19:50.506754 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:50.493242 28120 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:50.504715 24440 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:50.506875 24366 connection.cc:256] RPC call timeout handler was delayed by -1.706657918000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21610000000000001s for a response
W20260709 12:19:50.508687 24366 connection.cc:256] RPC call timeout handler was delayed by -1.6463579179999215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
I20260709 12:19:50.474246 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:50.504426 28296 log.cc:927] Time spent T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:19:50.510440 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:50.510494 25110 raft_consensus.cc:1240] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:50.511183 24471 raft_consensus.cc:2410] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:19:50.466286 28126 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:50.516971 27864 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:50.518175 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:50.463302 28125 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:50.518779 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:50.522526 28157 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:50.525275 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:19:50.565428 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:50.530484 24472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2011) took 1033 ms. Trace:
I20260709 12:19:50.531296 28155 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:50.531510 28247 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:50.531857 28240 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:50.536444 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:50.537794 24474 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:50.566511 25118 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 LEARNER]: Advancing to term 10
I20260709 12:19:50.574548 24466 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:50.530200 27788 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:50.567057 24472 rpcz_store.cc:276] 0709 12:19:49.510126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.567431 (+ 57305us) service_pool.cc:224] Handling call
0709 12:19:49.979661 (+412230us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:49.982132 (+  2471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:50.530242 (+548110us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b540029d950. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:50.530408 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":842826112}
W20260709 12:19:50.570494 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:50.570837 25117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35188 (request call id 1119) took 1194 ms. Trace:
I20260709 12:19:50.571960 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:50.577566 25117 rpcz_store.cc:276] 0709 12:19:49.345274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.345408 (+   134us) service_pool.cc:224] Handling call
0709 12:19:50.518678 (+1173270us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b5800004598. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227f8c 00007f4a94227ef6 000000000036eb39 00007f4a9c29b1e0 00007f4a9c3640c4 00007f4a9c364131 00007f4a9c3120a0 00007f4a9c311984 00007f4a9588c6d4 00007f4a9588c662
0709 12:19:50.539435 (+ 20757us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51839104}
W20260709 12:19:50.575249 24399 consensus_meta.cc:287] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.001s
I20260709 12:19:50.581300 24399 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
W20260709 12:19:50.582569 28298 log.cc:927] Time spent T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:19:50.584054 24321 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:50.585465 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:50.509017 28156 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:50.590238 28259 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:50.590517 28156 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:50.591329 24466 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
W20260709 12:19:50.592682 28289 log.cc:927] Time spent T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.520s	user 0.005s	sys 0.000s
I20260709 12:19:50.594305 24469 raft_consensus.cc:2410] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:19:50.595813 24468 raft_consensus.cc:1275] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:19:50.611783 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 97643.7us
I20260709 12:19:50.597843 25118 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 LEARNER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:19:50.613463 28126 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:50.614506 28155 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.611457 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:50.616216 24399 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:50.617254 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:50.627060 24399 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
I20260709 12:19:50.627986 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:50.615096 28155 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:50.634017 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:50.638460 28229 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:50.638970 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:50.640177 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:50.623409 28120 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:50.641266 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:50.641997 24366 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:50.642273 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:50.643002 28237 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:50.643187 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:50.644141 28258 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:50.644411 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:50.644716 28258 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:50.645114 28258 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:50.511729 28263 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:50.645452 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:50.645884 28236 raft_consensus.cc:3055] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:50.646018 24398 raft_consensus.cc:2376] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9. Re-sending same reply.
I20260709 12:19:50.646381 28236 raft_consensus.cc:740] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:50.647008 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:50.647814 24398 raft_consensus.cc:2368] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 8. Current term is 9.
I20260709 12:19:50.647931 24399 raft_consensus.cc:2410] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:19:50.512938 28233 consensus_queue.cc:237] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:50.649492 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:50.650260 24399 raft_consensus.cc:2393] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:50.650955 24393 raft_consensus.cc:1240] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260709 12:19:50.651376 24399 raft_consensus.cc:1275] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:19:50.647428 28236 consensus_queue.cc:260] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:50.648006 25114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 1116) took 1303 ms. Trace:
I20260709 12:19:50.647069 28263 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:50.643105 24366 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:50.629240 28264 consensus_meta.cc:287] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.738s	user 0.013s	sys 0.000s
I20260709 12:19:50.656494 25114 rpcz_store.cc:276] 0709 12:19:49.344336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.346485 (+  2149us) service_pool.cc:224] Handling call
0709 12:19:50.430910 (+1084425us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b5800004598. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c325fc0 00007f4a9c310929 00007f4a9c3103d2 00007f4a95887bd4
0709 12:19:50.431237 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:50.646046 (+214809us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:50.646082 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:50.646126 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:50.646167 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:50.647761 (+  1594us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400501c54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:50.647805 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:50.647943 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":543457408}
I20260709 12:19:50.665853 28125 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:50.676611 24394 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:50.645457 28258 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:50.709336 24320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57702 (request call id 575) took 1279 ms. Trace:
I20260709 12:19:50.709954 24320 rpcz_store.cc:276] 0709 12:19:49.429990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.473614 (+ 43624us) service_pool.cc:224] Handling call
0709 12:19:50.709084 (+1235470us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b5400339854. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:50.709262 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":267160320}
I20260709 12:19:50.711752 24317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 571) took 1332 ms. Trace:
I20260709 12:19:50.712307 24317 rpcz_store.cc:276] 0709 12:19:49.379740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.633220 (+253480us) service_pool.cc:224] Handling call
0709 12:19:49.895211 (+261991us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:49.921304 (+ 26093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:50.711494 (+790190us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b5400361d50. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:50.711676 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":562973440}
I20260709 12:19:50.713714 24324 raft_consensus.cc:1240] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:50.695603 28267 raft_consensus.cc:2749] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:50.699447 28236 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:50.719386 25114 raft_consensus.cc:1240] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6. Ops: []
W20260709 12:19:50.718447 28167 consensus_meta.cc:287] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.840s	user 0.007s	sys 0.006s
I20260709 12:19:50.727200 28167 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:50.729830 24323 raft_consensus.cc:2393] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 6: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:19:50.722458 28255 consensus_meta.cc:287] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.898s	user 0.013s	sys 0.000s
I20260709 12:19:50.724458 28183 consensus_queue.cc:1059] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
W20260709 12:19:50.747956 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:50.748363 24397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2130) took 1033 ms. Trace:
I20260709 12:19:50.748842 24397 rpcz_store.cc:276] 0709 12:19:49.714972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.715177 (+   205us) service_pool.cc:224] Handling call
0709 12:19:49.715575 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:50.488044 (+772469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:50.748088 (+260044us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b54000df054. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:50.748296 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1731706752}
I20260709 12:19:50.749679 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:50.753031 24365 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:50.754962 25083 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:50.774341 24366 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:50.776052 24365 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:50.780048 25111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 547) took 1122 ms. Trace:
I20260709 12:19:50.783062 25111 rpcz_store.cc:276] 0709 12:19:49.657649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.679619 (+ 21970us) service_pool.cc:224] Handling call
0709 12:19:50.779855 (+1100236us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b540075e754. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:50.779984 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1676164864}
I20260709 12:19:50.777477 28126 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.777283 28297 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:50.786676 28264 raft_consensus.cc:2804] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:50.806929 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:50.807866 24470 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:50.803375 28126 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:50.792522 28259 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:50.804594 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:50.805735 28264 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:50.810788 24366 leader_election.cc:400] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7.
I20260709 12:19:50.813510 24366 leader_election.cc:403] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:50.790660 28293 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:50.770200 28255 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:50.780371 28267 consensus_queue.cc:1059] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:19:50.781652 28269 consensus_queue.cc:1048] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 12:19:50.820683 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:50.818264 24365 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:50.812844 28264 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:50.811951 28297 raft_consensus.cc:697] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:50.836539 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:50.840683 24470 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:50.838207 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:50.838304 24289 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:50.838702 24325 raft_consensus.cc:1275] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:19:50.842401 24325 pending_rounds.cc:85] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756: Aborting all ops after (but not including) 8
I20260709 12:19:50.842759 24325 pending_rounds.cc:107] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:19:50.842978 24325 raft_consensus.cc:2889] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:50.838912 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:50.839453 28110 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.859833 24316 raft_consensus.cc:1275] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:19:50.840067 28125 raft_consensus.cc:2804] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:50.829111 28281 raft_consensus.cc:2749] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7.
I20260709 12:19:50.839793 28157 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.860737 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:50.871059 24320 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:50.869153 24470 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:50.873894 28126 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:50.874562 28157 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:50.876194 28135 raft_consensus.cc:2804] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:19:50.877295 28314 log.cc:927] Time spent T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:19:50.904345 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:50.879225 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:50.906589 24465 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:50.880523 27864 raft_consensus.cc:3055] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:19:50.881022 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:50.882157 27931 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:50.919059 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:50.920881 28167 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:50.922928 28297 consensus_queue.cc:237] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:50.910014 28126 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.925387 28126 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:50.928223 28126 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:50.885597 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 58614.4us
I20260709 12:19:50.870452 28125 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:50.893546 24470 raft_consensus.cc:1275] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:19:50.897178 24320 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
I20260709 12:19:50.888433 28110 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:50.961315 28110 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:50.910382 24365 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:50.913722 25110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 1124) took 1536 ms. Trace:
I20260709 12:19:50.915189 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:50.966212 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 55955.4us
I20260709 12:19:50.967355 24391 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:50.915850 28129 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:50.966152 25110 rpcz_store.cc:276] 0709 12:19:49.377585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.394179 (+ 16594us) service_pool.cc:224] Handling call
0709 12:19:49.394522 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:50.511071 (+1116549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:50.913466 (+402395us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540065d1d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:50.913654 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2566009088}
I20260709 12:19:50.916841 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:50.978267 24395 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:19:50.936620 28135 raft_consensus.cc:697] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:50.908957 27864 raft_consensus.cc:740] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:50.884858 24400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2122) took 1486 ms. Trace:
W20260709 12:19:50.930320 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 68375.6us
I20260709 12:19:50.936101 28255 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:50.938047 28278 log.cc:927] Time spent T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 1.050s	user 0.004s	sys 0.000s
I20260709 12:19:50.940774 24473 raft_consensus.cc:1240] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:50.942114 28172 raft_consensus.cc:3055] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:50.999084 28172 raft_consensus.cc:740] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:50.946374 28157 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:50.948593 24397 raft_consensus.cc:1240] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:51.000142 28255 consensus_queue.cc:1048] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:19:50.951088 25082 leader_election.cc:336] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 3.144s (SENT)
I20260709 12:19:51.001428 28240 consensus_queue.cc:1048] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:19:51.001828 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 50788us
W20260709 12:19:51.002673 25082 leader_election.cc:336] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 3.161s (SENT)
I20260709 12:19:51.003140 24396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2128) took 1481 ms. Trace:
I20260709 12:19:50.933578 28258 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:50.952564 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:50.954999 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:50.959396 24470 raft_consensus.cc:1240] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:50.917761 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:51.003621 24396 rpcz_store.cc:276] 0709 12:19:49.521738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.521873 (+   135us) service_pool.cc:224] Handling call
0709 12:19:49.539840 (+ 17967us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:49.629111 (+ 89271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:49.629150 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:49.631191 (+  2041us) log.cc:844] Serialized 26 byte log entry
0709 12:19:49.773224 (+142033us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:49.773263 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.773328 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:50.937543 (+1164215us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b24000fd9e8. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a940e59c4 00007f4a940e3acb 00007f4a9429edc9 00007f4a9429ea55 00007f4a9429e09d 00007f4a96ed010e 00007f4a96ee788c 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221
0709 12:19:51.002819 (+ 65276us) raft_consensus.cc:1685] finished
0709 12:19:51.002842 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:51.003066 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90625,"raft.queue_time_us":110265,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":23738,"spinlock_wait_cycles":12171008,"thread_start_us":127196,"threads_started":1,"wal-append.queue_time_us":192758}
I20260709 12:19:51.003105 24366 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:50.984328 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:51.009091 24391 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:50.988534 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 150321us
I20260709 12:19:50.989133 28183 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.991570 27864 consensus_queue.cc:260] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:50.985949 28261 consensus_queue.cc:1048] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:19:50.992827 28260 consensus_queue.cc:1048] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:50.981060 28274 raft_consensus.cc:2804] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:50.964897 28125 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:50.995128 28012 consensus_queue.cc:1048] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:50.995573 27788 consensus_queue.cc:1048] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:19:50.998118 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:51.030177 24473 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:50.981426 24400 rpcz_store.cc:276] 0709 12:19:49.398231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.398392 (+   161us) service_pool.cc:224] Handling call
0709 12:19:49.398867 (+   475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:49.609560 (+210693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:49.609595 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:49.611193 (+  1598us) log.cc:844] Serialized 26 byte log entry
0709 12:19:50.674693 (+1063500us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b1800464c20. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a94241e07 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425ec02 00007f4a96ee620b 00007f4a96eebd23 00007f4a96eec0d1 00007f4a97307a0f
0709 12:19:50.777612 (+102919us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:50.777654 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:50.777731 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:50.884510 (+106779us) raft_consensus.cc:1685] finished
0709 12:19:50.884533 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:50.884790 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82014,"raft.queue_time_us":236640,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":8141,"spinlock_wait_cycles":7352704,"thread_start_us":212660,"threads_started":2,"wal-append.queue_time_us":1203780}
I20260709 12:19:51.019999 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:51.019166 28135 consensus_queue.cc:237] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:51.021992 28316 log.cc:927] Time spent T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:19:51.028311 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:51.038121 25113 raft_consensus.cc:3060] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:51.007332 28259 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:51.034181 24465 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:19:51.037083 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:51.012159 28292 raft_consensus.cc:2749] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:51.007109 28155 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:51.012998 28236 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
W20260709 12:19:51.039815 25082 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.549s (SENT) [suppressed 43 similar messages]
I20260709 12:19:51.040570 24289 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:51.047109 25110 raft_consensus.cc:1240] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:51.050236 24398 raft_consensus.cc:1240] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 10. Current term is 11. Ops: []
W20260709 12:19:51.050872 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:51.051587 28236 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:51.000152 28172 consensus_queue.cc:260] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:51.054388 28172 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:51.050098 28155 consensus_queue.cc:1048] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:51.054700 28236 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:51.017066 28237 consensus_queue.cc:1048] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:19:51.013276 28255 consensus_queue.cc:1059] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:19:51.018064 28183 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:51.061757 24465 raft_consensus.cc:1240] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:51.010509 28272 consensus_queue.cc:1059] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:19:51.065629 25113 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:51.080997 24289 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:51.084931 24473 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
W20260709 12:19:51.085060 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 75682.7us
I20260709 12:19:51.041213 27864 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:51.037163 28274 raft_consensus.cc:697] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:19:51.033135 28277 consensus_queue.cc:1175] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c711faa13ead43ebbea0192cb74a4756" responder_term: 10 status { last_received { term: 8 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 9. Current term is 10. Ops: [9.6-9.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:19:51.091877 28110 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:19:51.112051 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:51.114022 25084 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:51.115978 24366 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:51.121881 24391 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:19:51.094550 24291 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:51.117897 24465 raft_consensus.cc:1240] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:51.123423 28324 raft_consensus.cc:2804] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:51.117311 28323 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.141312 28323 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:51.108424 28258 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:51.127071 28012 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:51.124076 28324 raft_consensus.cc:697] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 6 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:51.117556 28126 raft_consensus.cc:2804] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:51.144084 28323 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:51.144374 28126 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.130017 28155 consensus_queue.cc:1048] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:51.134501 28183 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:51.135564 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:51.137513 28264 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:51.117657 27905 consensus_queue.cc:1048] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
W20260709 12:19:51.063725 28326 consensus_queue.cc:1175] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c855242ec9d34a5397741ef20db9de8a" responder_term: 6 status { last_received { term: 5 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:19:51.129544 28297 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:19:51.144932 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 105130us
I20260709 12:19:51.127485 24366 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:51.115470 28255 consensus_queue.cc:1243] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer 99b8650fa8324ac2ac5f75eee9b1a1e3 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:19:51.150875 25110 raft_consensus.cc:2410] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:19:51.079823 28148 consensus_queue.cc:1059] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.067s
W20260709 12:19:51.162300 25082 leader_election.cc:336] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 3.304s (SENT)
I20260709 12:19:51.164414 25082 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:51.170717 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:51.171974 25117 raft_consensus.cc:2393] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 6: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:51.152233 28126 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:51.184122 24395 raft_consensus.cc:1240] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:51.188150 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:51.189131 24391 raft_consensus.cc:3060] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:51.156229 28275 raft_consensus.cc:3055] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:51.173210 28148 consensus_queue.cc:1243] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer d99d5d772cfe4a96afcab3d3b009a281 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:19:51.193151 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:51.193315 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:51.193992 25082 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:51.194199 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:51.194552 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:51.195303 24319 raft_consensus.cc:2393] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 8: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:51.195386 25082 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:51.196204 28283 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:51.196525 25112 raft_consensus.cc:1275] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:19:51.196821 28155 raft_consensus.cc:2749] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:51.197080 28269 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:51.164296 28272 raft_consensus.cc:2804] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:51.198065 28272 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.193950 24324 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:51.198453 25082 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:51.198541 28272 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:51.196753 28283 raft_consensus.cc:697] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:51.205605 28283 consensus_queue.cc:237] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:51.206395 24324 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:19:51.208890 28237 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.209129 28155 raft_consensus.cc:2749] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:51.209717 28237 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:51.211006 25082 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:51.211459 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:51.211791 28233 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:51.213063 24316 raft_consensus.cc:1275] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:19:51.216745 28272 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:51.212205 24324 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:19:51.209012 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:51.222226 25119 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:51.226933 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:51.227664 24398 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:19:51.228482 24289 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:51.233965 25082 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:51.236881 25082 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:51.239796 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:51.240492 24319 raft_consensus.cc:2376] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8. Re-sending same reply.
W20260709 12:19:51.244925 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 153834us
W20260709 12:19:51.246327 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:51.244333 24391 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:51.196384 28264 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:51.212062 28237 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:51.218701 28275 raft_consensus.cc:740] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:51.253666 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:51.184451 28255 consensus_queue.cc:1059] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 12:19:51.293447 24324 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:51.147389 28324 consensus_queue.cc:237] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:51.248418 28323 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.254873 28167 raft_consensus.cc:2804] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:51.225013 28155 consensus_queue.cc:1048] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:19:51.251047 28297 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:51.304988 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:51.309742 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:51.316344 24319 raft_consensus.cc:2393] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 8: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:51.319080 24325 raft_consensus.cc:1275] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:19:51.320832 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:51.321785 25110 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:51.295465 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:51.311138 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 74389.6us
I20260709 12:19:51.286372 28269 raft_consensus.cc:2749] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:51.324617 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:51.325636 24400 raft_consensus.cc:2410] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:19:51.253497 28120 consensus_queue.cc:1059] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:19:51.295888 28237 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.329371 25112 raft_consensus.cc:1240] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:51.328052 24366 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:51.340224 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:51.248001 28274 consensus_queue.cc:237] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:51.341102 24400 raft_consensus.cc:2393] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 10: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:51.347198 24397 raft_consensus.cc:1275] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:19:51.347952 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:51.312081 28167 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.299577 27905 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.344619 24366 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:51.350958 24393 raft_consensus.cc:1275] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:51.351147 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:51.310256 28183 consensus_queue.cc:1059] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:19:51.352873 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:51.351305 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 100986us
I20260709 12:19:51.337622 28261 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:51.372784 24324 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:51.372375 24289 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:51.314420 28323 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:51.376291 24366 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:51.380988 24289 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:51.348323 28177 raft_consensus.cc:2764] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:19:51.385815 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 911873us
I20260709 12:19:51.387516 24397 raft_consensus.cc:3055] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:51.355947 28167 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:51.387908 24397 raft_consensus.cc:740] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:51.344663 28237 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:51.391866 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:19:51.392531 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 890827us
I20260709 12:19:51.393851 24318 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:51.402127 24324 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:19:51.391542 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:51.403119 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:51.403641 25117 raft_consensus.cc:2410] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:19:51.325738 28125 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:51.396617 25082 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:51.344326 28263 consensus_queue.cc:1059] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:19:51.398597 24366 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:51.378968 28255 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:51.382589 28110 raft_consensus.cc:3055] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:51.415418 24366 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:51.388146 28183 raft_consensus.cc:2804] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:51.347903 28297 consensus_queue.cc:1048] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:19:51.388586 28281 raft_consensus.cc:2804] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:51.389829 28120 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:51.424067 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:51.395561 28146 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:51.427757 24440 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:51.365617 27905 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:51.431381 24289 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:51.435221 24399 raft_consensus.cc:2393] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:51.384238 28292 consensus_queue.cc:1048] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:19:51.382458 28261 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:51.417286 28255 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.416437 28156 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:51.421092 28293 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:51.421263 28270 raft_consensus.cc:2749] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:51.417307 28110 raft_consensus.cc:740] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:51.423918 28272 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:51.412240 28233 consensus_queue.cc:1048] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:19:51.441102 28259 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:51.427987 28281 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:51.434396 28120 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.472815 28120 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:51.454056 24318 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:19:51.424146 28269 consensus_queue.cc:1048] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:19:51.472103 25084 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:51.442643 28183 raft_consensus.cc:697] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:51.503242 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 813) took 1171 ms. Trace:
W20260709 12:19:51.509254 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:51.457679 28341 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:51.449621 28255 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:51.475800 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 60463.8us
W20260709 12:19:51.473903 28328 log.cc:927] Time spent T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 12:19:51.539214 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:51.504947 24466 rpcz_store.cc:276] 0709 12:19:50.332071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:50.592131 (+260060us) service_pool.cc:224] Handling call
0709 12:19:50.592483 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:50.594916 (+  2433us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:19:50.720258 (+125342us) log.cc:844] Serialized 14 byte log entry
0709 12:19:51.502722 (+782464us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:51.502803 (+    81us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:51.502878 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:51.502979 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:51.503159 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":655389,"prepare.queue_time_us":132748,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":646905,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":8214,"thread_start_us":256567,"threads_started":3,"wal-append.queue_time_us":121453}
I20260709 12:19:51.543571 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:51.544399 24466 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:19:51.474264 28281 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:51.469633 28236 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.550706 24396 raft_consensus.cc:1240] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:19:51.551007 24467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2120) took 1280 ms. Trace:
I20260709 12:19:51.473753 28146 raft_consensus.cc:697] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
W20260709 12:19:51.553483 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 166140us
I20260709 12:19:51.519194 28259 raft_consensus.cc:697] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:51.551472 24467 rpcz_store.cc:276] 0709 12:19:50.270143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:50.514775 (+244632us) service_pool.cc:224] Handling call
0709 12:19:50.515172 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:50.538474 (+ 23302us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:50.699181 (+160707us) log.cc:844] Serialized 14 byte log entry
0709 12:19:51.550679 (+851498us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:51.550730 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:51.550774 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:51.550834 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:51.550950 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":623851,"prepare.queue_time_us":162433,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":657395,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":91,"thread_start_us":352776,"threads_started":3,"wal-append.queue_time_us":171866}
I20260709 12:19:51.468266 28293 raft_consensus.cc:697] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:51.552515 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:51.521790 28270 raft_consensus.cc:2804] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:51.517941 28302 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:51.534595 28304 log.cc:927] Time spent T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:19:51.557737 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:51.534008 28258 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.562199 25119 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:19:51.534261 28272 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:51.565855 24467 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:51.549451 28341 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.578264 24438 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:51.473457 28110 consensus_queue.cc:260] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:51.573382 28258 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:51.587924 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:51.589547 28345 log.cc:927] Time spent T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:19:51.590915 28259 consensus_queue.cc:237] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:51.590935 28258 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:51.590891 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:51.567284 28270 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.549221 28118 consensus_queue.cc:1048] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:19:51.605693 24323 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 6.
I20260709 12:19:51.581689 28122 raft_consensus.cc:2764] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:19:51.597222 24397 consensus_queue.cc:260] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:51.643862 24397 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:51.640297 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 212620us
I20260709 12:19:51.641316 24438 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:51.642256 24467 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:51.581300 28341 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:51.649108 28327 log.cc:927] Time spent T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.556s	user 0.005s	sys 0.000s
I20260709 12:19:51.649430 28341 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:51.605494 28293 consensus_queue.cc:237] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:51.651784 28325 log.cc:927] Time spent T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.663s	user 0.003s	sys 0.000s
W20260709 12:19:51.660075 27864 consensus_meta.cc:287] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.538s	user 0.005s	sys 0.005s
I20260709 12:19:51.605150 28348 consensus_queue.cc:1048] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:19:51.679769 24466 raft_consensus.cc:1217] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 3.5->[6.6-10.8]   Dedup: 8.7->[10.8-10.8]
I20260709 12:19:51.680096 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:51.680462 24466 raft_consensus.cc:1240] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11. Ops: [6.6-10.8]
I20260709 12:19:51.665555 28281 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:51.666595 28125 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:51.668764 28336 log.cc:927] Time spent T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 12:19:51.607821 28270 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:51.570602 28272 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:51.571154 28302 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:51.565155 28236 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:51.645043 28338 log.cc:927] Time spent T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 12:19:51.674932 28110 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:51.644026 28323 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:51.605225 28347 raft_consensus.cc:2804] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:19:51.676222 28354 log.cc:927] Time spent T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:19:51.630575 27964 consensus_queue.cc:1048] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:19:51.606796 28183 consensus_queue.cc:237] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:51.670080 28146 consensus_queue.cc:237] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:51.681893 24365 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:51.749375 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 67553.1us
I20260709 12:19:51.676072 28167 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:51.681591 28264 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.681607 28258 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.759725 24438 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:51.774312 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 83080us
I20260709 12:19:51.785698 28233 consensus_queue.cc:1059] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:51.787241 28263 raft_consensus.cc:3055] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:51.787771 28263 raft_consensus.cc:740] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:51.789098 28263 consensus_queue.cc:260] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:51.791040 28263 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:51.723438 28122 raft_consensus.cc:2804] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:51.764932 27864 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:19:51.810328 28336 log.cc:927] Time spent T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:19:51.810456 28122 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.810755 27864 raft_consensus.cc:697] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:51.811040 28122 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:51.811829 27864 consensus_queue.cc:237] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:51.776823 28264 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:51.810865 28297 consensus_queue.cc:1059] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:19:51.723093 28357 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:51.765262 28258 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:51.815290 28357 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:51.818356 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 68050.4us
I20260709 12:19:51.812343 28167 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:51.820499 24472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 810) took 1489 ms. Trace:
I20260709 12:19:51.821331 24470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 816) took 1301 ms. Trace:
I20260709 12:19:51.825454 24470 rpcz_store.cc:276] 0709 12:19:50.519849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:51.016863 (+497014us) service_pool.cc:224] Handling call
0709 12:19:51.025009 (+  8146us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:51.025213 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:19:51.025459 (+   246us) log.cc:844] Serialized 14 byte log entry
0709 12:19:51.772376 (+746917us) log.cc:844] Serialized 14 byte log entry
0709 12:19:51.820961 (+ 48585us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:51.821017 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:51.821064 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:51.821131 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:51.821253 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":396084,"prepare.queue_time_us":8037,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":88,"raft.queue_time_us":425658,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":13097,"thread_start_us":398303,"threads_started":2,"wal-append.queue_time_us":99779}
W20260709 12:19:51.765234 28126 consensus_meta.cc:287] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.546s	user 0.011s	sys 0.001s
W20260709 12:19:51.836079 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 76447.1us
I20260709 12:19:51.764178 28261 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:51.846028 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:51.822543 24472 rpcz_store.cc:276] 0709 12:19:50.331391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:50.586125 (+254734us) service_pool.cc:224] Handling call
0709 12:19:50.629646 (+ 43521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:51.414147 (+784501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:51.414191 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:51.421948 (+  7757us) log.cc:844] Serialized 26 byte log entry
0709 12:19:51.542311 (+120363us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:51.542366 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:51.542457 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:51.820244 (+277787us) raft_consensus.cc:1685] finished
0709 12:19:51.820270 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:51.820427 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":821411,"raft.queue_time_us":817658,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":7990,"spinlock_wait_cycles":680832,"thread_start_us":87060,"threads_started":1,"wal-append.queue_time_us":159767}
I20260709 12:19:51.848481 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:51.849129 28352 consensus_queue.cc:1059] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.108s
W20260709 12:19:51.867743 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 59928.7us
I20260709 12:19:51.817699 28357 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:51.818748 28347 raft_consensus.cc:697] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:51.875377 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:51.876230 24470 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:51.881469 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:51.882732 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:51.883400 24316 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:19:51.764056 27905 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:51.870280 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 188074us
I20260709 12:19:51.884222 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:51.888100 24366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:51.889089 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:51.869387 25083 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:51.892071 24395 raft_consensus.cc:1240] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11. Ops: [6.7-10.9]
W20260709 12:19:51.894186 28334 log.cc:927] Time spent T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.482s	user 0.001s	sys 0.000s
I20260709 12:19:51.896886 28155 raft_consensus.cc:3055] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:51.897521 28155 raft_consensus.cc:740] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:51.898864 28155 consensus_queue.cc:260] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:51.906366 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:51.907346 24324 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:51.914616 28343 log.cc:927] Time spent T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.320s	user 0.002s	sys 0.001s
W20260709 12:19:51.914752 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 45425.9us
I20260709 12:19:51.918910 24440 leader_election.cc:400] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
I20260709 12:19:51.919488 24440 leader_election.cc:403] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:19:51.922981 24395 raft_consensus.cc:1240] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: [9.3-9.3]
I20260709 12:19:51.851293 28126 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:51.939774 24470 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:19:51.938733 28348 raft_consensus.cc:2749] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
I20260709 12:19:51.926939 27964 consensus_queue.cc:1059] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:19:51.944604 24322 raft_consensus.cc:1240] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:19:51.933460 28155 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:51.946852 24324 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:19:51.952170 24440 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:51.948396 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:51.953572 24470 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:19:51.933372 28352 consensus_queue.cc:1059] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 8.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:19:51.947041 28359 raft_consensus.cc:2749] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:51.959247 28351 raft_consensus.cc:2764] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:19:51.951988 28281 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:51.948451 28258 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:51.955224 28012 consensus_meta.cc:287] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.812s	user 0.012s	sys 0.001s
I20260709 12:19:51.969458 28357 raft_consensus.cc:3055] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:51.971386 24366 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:51.978956 24440 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:51.981066 24366 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:51.984293 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:51.976162 28303 log.cc:927] Time spent T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:19:51.961585 27964 raft_consensus.cc:2804] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:51.978631 28357 raft_consensus.cc:740] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:51.954547 28347 consensus_queue.cc:237] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:51.992794 28272 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:51.984375 28267 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:51.996941 28357 consensus_queue.cc:260] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:51.998312 28357 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:51.998752 28293 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:51.999255 28293 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.992762 24366 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:51.999840 28267 raft_consensus.cc:697] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:52.001987 28267 consensus_queue.cc:237] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.2, Last appended by leader: 2, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:52.007032 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.017093 24366 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:52.002698 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:52.018935 24470 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:19:52.020210 24397 raft_consensus.cc:1275] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:19:51.980955 28012 raft_consensus.cc:2749] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:52.000330 28293 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:51.957567 28120 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:51.985970 28351 raft_consensus.cc:2749] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:51.984691 28236 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:52.056985 24394 raft_consensus.cc:1240] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:51.985422 28302 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:51.981341 28258 consensus_queue.cc:1048] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
W20260709 12:19:52.049765 27788 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:19:52.025933 27864 raft_consensus.cc:2804] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:52.017023 27964 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:52.054939 28272 raft_consensus.cc:2804] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:19:52.080178 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 57310.9us
W20260709 12:19:52.086408 28376 log.cc:927] Time spent T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:19:52.087962 28348 raft_consensus.cc:3055] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:52.088472 28348 raft_consensus.cc:740] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
W20260709 12:19:52.088552 28365 log.cc:927] Time spent T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:19:52.090690 28122 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:52.089534 28348 consensus_queue.cc:260] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:52.078117 27864 raft_consensus.cc:697] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:52.093993 27864 consensus_queue.cc:237] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:52.092670 28348 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:52.096575 28272 raft_consensus.cc:697] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:52.110299 28120 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:52.071408 27964 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:52.113133 28367 log.cc:927] Time spent T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.115s	user 0.000s	sys 0.002s
I20260709 12:19:52.115898 28264 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:52.117820 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2119) took 1849 ms. Trace:
I20260709 12:19:52.118537 24471 rpcz_store.cc:276] 0709 12:19:50.268144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:50.513215 (+245071us) service_pool.cc:224] Handling call
0709 12:19:50.568431 (+ 55216us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:51.675272 (+1106841us) spinlock_profiling.cc:243] Waited 4.61 ms on lock 0x7b180042e8c0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a96ef44bc 00007f4a9424248b 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425c455 00007f4a97344060 00007f4a97344bfb 00007f4a9734f64b
0709 12:19:51.680247 (+  4975us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:51.680270 (+    23us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:51.687945 (+  7675us) log.cc:844] Serialized 52 byte log entry
0709 12:19:51.872848 (+184903us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:51.872902 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:51.873006 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:52.112410 (+239404us) spinlock_profiling.cc:243] Waited 51.9 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:19:52.117441 (+  5031us) raft_consensus.cc:1685] finished
0709 12:19:52.117475 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:52.117731 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":876380,"raft.queue_time_us":978472,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":8029,"spinlock_wait_cycles":129984000,"thread_start_us":216965,"threads_started":2,"wal-append.queue_time_us":242535}
I20260709 12:19:52.122229 24440 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:52.124060 24440 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:52.150013 28302 raft_consensus.cc:2749] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:52.153844 24440 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:52.154914 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.155010 28118 raft_consensus.cc:2764] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:19:52.155694 24440 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:52.097666 28272 consensus_queue.cc:237] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:52.159162 28236 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.159822 28236 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:52.160930 25110 raft_consensus.cc:1240] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:52.162315 28236 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:52.133598 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:52.134873 28333 raft_consensus.cc:3055] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:52.163019 28333 raft_consensus.cc:740] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:52.164006 28333 consensus_queue.cc:260] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:52.165169 28333 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:52.167948 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:52.173892 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:52.174240 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:52.174611 25119 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:19:52.116108 28126 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:52.138207 24473 raft_consensus.cc:1275] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:19:52.138091 28351 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:52.176589 28351 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:52.177171 28351 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:52.132545 25113 raft_consensus.cc:1275] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:19:52.179281 28344 log.cc:927] Time spent T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.612s	user 0.009s	sys 0.006s
W20260709 12:19:52.117739 28381 log.cc:927] Time spent T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:19:52.180862 28157 raft_consensus.cc:3055] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:52.181479 28157 raft_consensus.cc:740] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:52.182684 28157 consensus_queue.cc:260] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:52.208909 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:52.210744 24290 leader_election.cc:336] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.575s (SENT)
I20260709 12:19:52.211140 24290 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:52.212152 24290 leader_election.cc:336] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.623s (SENT)
I20260709 12:19:52.212674 28360 raft_consensus.cc:3055] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:52.213133 28360 raft_consensus.cc:740] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:52.215461 28324 raft_consensus.cc:2749] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:52.208931 28157 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:52.214071 28360 consensus_queue.cc:260] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 9.3, Last appended by leader: 3, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:52.221118 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:52.221755 24398 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:52.225010 28360 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:52.235867 28337 log.cc:927] Time spent T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.840s	user 0.001s	sys 0.001s
I20260709 12:19:52.135735 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2140) took 1232 ms. Trace:
I20260709 12:19:52.237879 24392 rpcz_store.cc:276] 0709 12:19:50.903341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:50.912540 (+  9199us) service_pool.cc:224] Handling call
0709 12:19:52.135409 (+1222869us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54001112d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:52.135600 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2399883648}
I20260709 12:19:52.191890 28275 consensus_queue.cc:260] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:52.239912 28275 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:52.245980 24470 raft_consensus.cc:1275] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:19:52.246213 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2133) took 1277 ms. Trace:
I20260709 12:19:52.246829 24468 rpcz_store.cc:276] 0709 12:19:50.968622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:51.413878 (+445256us) service_pool.cc:224] Handling call
0709 12:19:51.418480 (+  4602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:51.418769 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:51.434636 (+ 15867us) log.cc:844] Serialized 14 byte log entry
0709 12:19:52.241535 (+806899us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b1800388ae0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a96ef44bc 00007f4a9424248b 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425c455 00007f4a97344060 00007f4a97356716 00007f4a97367287
0709 12:19:52.245550 (+  4015us) log.cc:844] Serialized 14 byte log entry
0709 12:19:52.245776 (+   226us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:52.245834 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:52.245900 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:52.245991 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:52.246141 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30220,"prepare.queue_time_us":21979,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":79,"raft.queue_time_us":128963,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":5277,"spinlock_wait_cycles":8670464,"thread_start_us":118984,"threads_started":1}
W20260709 12:19:52.252399 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:52.253430 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:52.193202 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:52.268077 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.268411 28368 consensus_queue.cc:1059] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:52.269781 28368 raft_consensus.cc:3055] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:52.270174 28368 raft_consensus.cc:740] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:52.271806 24466 raft_consensus.cc:1275] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:19:52.274428 28371 log.cc:927] Time spent T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.276s	user 0.000s	sys 0.003s
I20260709 12:19:52.277230 28368 consensus_queue.cc:260] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:52.278970 28368 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:52.294378 28369 log.cc:927] Time spent T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.295s	user 0.002s	sys 0.000s
I20260709 12:19:52.295094 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:52.297721 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:52.298300 25112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 582) took 1001 ms. Trace:
I20260709 12:19:52.298553 24391 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:52.298918 25112 rpcz_store.cc:276] 0709 12:19:51.297185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:51.297296 (+   111us) service_pool.cc:224] Handling call
0709 12:19:51.318081 (+ 20785us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:51.339415 (+ 21334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:52.297927 (+958512us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b54007d0354. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:52.298211 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25496960}
W20260709 12:19:52.306640 28361 log.cc:927] Time spent T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.613s	user 0.000s	sys 0.001s
I20260709 12:19:52.308645 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2121) took 2036 ms. Trace:
I20260709 12:19:52.308986 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:52.310185 24391 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:52.330413 28237 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:52.212520 24290 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:52.331619 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:52.334780 24470 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
I20260709 12:19:52.309222 24474 rpcz_store.cc:276] 0709 12:19:50.272063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:50.585005 (+312942us) service_pool.cc:224] Handling call
0709 12:19:50.585388 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:51.409134 (+823746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:51.409164 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:51.434174 (+ 25010us) log.cc:844] Serialized 26 byte log entry
0709 12:19:51.633925 (+199751us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:51.633975 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:51.634052 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:52.305635 (+671583us) spinlock_profiling.cc:243] Waited 4.45 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:19:52.308177 (+  2542us) raft_consensus.cc:1685] finished
0709 12:19:52.308224 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:52.308540 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":830288,"raft.queue_time_us":835266,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":9636,"spinlock_wait_cycles":10224896,"thread_start_us":168523,"threads_started":1,"wal-append.queue_time_us":185401}
W20260709 12:19:52.336357 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:52.207616 28255 consensus_meta.cc:287] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.661s	user 0.006s	sys 0.004s
I20260709 12:19:52.343709 28255 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:52.346484 24400 raft_consensus.cc:2393] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 11: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:52.348678 28255 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:52.364253 28156 consensus_queue.cc:1059] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:52.365406 28156 raft_consensus.cc:3055] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:52.365764 28156 raft_consensus.cc:740] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:52.369704 28156 consensus_queue.cc:260] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:52.378662 28156 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:52.382863 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.196508 28122 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:52.384197 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:52.385152 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 117056us
I20260709 12:19:52.386162 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:52.387058 24474 raft_consensus.cc:2393] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 11: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
W20260709 12:19:52.395879 28110 consensus_meta.cc:287] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.673s	user 0.008s	sys 0.004s
W20260709 12:19:52.397392 28270 consensus_meta.cc:287] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.654s	user 0.008s	sys 0.003s
I20260709 12:19:52.398141 28270 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:52.401875 24320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1980) took 1098 ms. Trace:
I20260709 12:19:52.441862 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:52.431550 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:52.445344 24318 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:19:52.444284 24320 rpcz_store.cc:276] 0709 12:19:51.303314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:51.920686 (+617372us) service_pool.cc:224] Handling call
0709 12:19:51.930200 (+  9514us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:51.930588 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:51.930616 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:51.936904 (+  6288us) log.cc:844] Serialized 26 byte log entry
0709 12:19:52.061378 (+124474us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:52.061463 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:52.061641 (+   178us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:52.401567 (+339926us) raft_consensus.cc:1685] finished
0709 12:19:52.401597 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:52.401784 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":125,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":8698,"thread_start_us":113568,"threads_started":1,"wal-append.queue_time_us":458357}
I20260709 12:19:52.429993 24317 raft_consensus.cc:1240] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9. Ops: []
W20260709 12:19:52.445151 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 289563us
I20260709 12:19:52.445416 24469 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:52.441043 24398 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:19:52.449426 24440 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:52.421245 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:52.425463 25083 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:52.420539 24365 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:52.470467 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 45125us
I20260709 12:19:52.828446 28349 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.829103 28349 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:52.472206 28357 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:52.469983 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:52.472703 24440 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:52.948454 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 475825us
I20260709 12:19:52.949520 24440 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:52.487052 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:52.951648 25112 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:19:52.954154 28397 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.487242 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:52.954882 28397 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:52.956003 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:52.956725 24322 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:19:52.417485 28155 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.958570 28397 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:52.958643 28155 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:52.469009 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:52.963201 24465 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:19:52.483258 28122 raft_consensus.cc:2749] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:19:52.967893 24399 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.007s	sys 0.008s
W20260709 12:19:52.968267 24399 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.007s	sys 0.008s
I20260709 12:19:52.489681 28269 raft_consensus.cc:2804] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:52.968827 28269 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:52.969223 28269 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:52.544734 25117 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:52.975282 28155 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:52.470204 28359 consensus_queue.cc:1048] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:19:52.978346 28156 raft_consensus.cc:2804] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:52.978801 28156 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:52.979151 28156 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:52.533797 28293 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:52.980820 28357 raft_consensus.cc:2749] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:52.981617 28293 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:52.562690 28236 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.615666 28270 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:52.982888 28236 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:52.617381 27964 consensus_meta.cc:287] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.506s	user 0.012s	sys 0.000s
I20260709 12:19:52.984205 27964 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:52.986088 28236 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:52.599480 28267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.016s	sys 0.001s
W20260709 12:19:52.608369 28347 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.009s	sys 0.010s
W20260709 12:19:52.987258 28267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.016s	sys 0.001s
W20260709 12:19:52.987534 28347 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.988s	user 0.010s	sys 0.010s
W20260709 12:19:52.705727 28378 log.cc:927] Time spent T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:19:52.707002 28351 consensus_meta.cc:287] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.529s	user 0.014s	sys 0.005s
I20260709 12:19:52.742175 24318 raft_consensus.cc:1240] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 12:19:52.745608 27864 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.000s	sys 0.013s
I20260709 12:19:52.762280 24323 raft_consensus.cc:1240] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:52.993338 27964 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:52.995045 24323 raft_consensus.cc:1275] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:52.489822 27905 consensus_queue.cc:1048] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:19:52.807109 24366 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:52.832650 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 412129us
W20260709 12:19:53.179024 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 371984us
I20260709 12:19:53.179327 24365 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:53.179873 24366 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:52.851619 28402 log.cc:927] Time spent T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 12:19:52.901170 24391 consensus_meta.cc:287] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.003s
I20260709 12:19:53.181162 24366 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:53.181409 24391 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
W20260709 12:19:52.913952 24393 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.023s	sys 0.076s
W20260709 12:19:53.182472 24393 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.023s	sys 0.076s
W20260709 12:19:52.941802 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:53.183125 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.945312 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:52.989513 24471 raft_consensus.cc:1240] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:52.806901 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:53.381853 25113 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:52.855356 28233 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:52.922303 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:53.557776 24317 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:53.559294 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.926594 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:53.563287 24320 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
W20260709 12:19:52.924922 24321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.969s	user 0.069s	sys 0.077s
W20260709 12:19:53.613270 24321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.658s	user 0.073s	sys 0.077s
W20260709 12:19:52.839687 24324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.021s	sys 0.012s
I20260709 12:19:53.616231 24324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1983) took 2092 ms. Trace:
I20260709 12:19:53.616657 24324 rpcz_store.cc:276] 0709 12:19:51.524138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:51.949762 (+425624us) service_pool.cc:224] Handling call
0709 12:19:51.950227 (+   465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:51.950702 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:51.950746 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:51.954780 (+  4034us) log.cc:844] Serialized 26 byte log entry
0709 12:19:53.615793 (+1661013us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:53.615841 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:53.615961 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:53.616008 (+    47us) raft_consensus.cc:1685] finished
0709 12:19:53.616021 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:53.616164 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":116,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":4503,"thread_start_us":1593990,"threads_started":1,"wal-append.queue_time_us":421248,"wal-append.run_cpu_time_us":7045,"wal-append.run_wall_time_us":1194757}
I20260709 12:19:52.810482 24325 raft_consensus.cc:1275] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:19:53.183635 28417 raft_consensus.cc:2749] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:53.204409 28416 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:53.622190 24325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1993) took 1192 ms. Trace:
I20260709 12:19:53.207219 28419 consensus_queue.cc:1048] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:53.212805 28422 consensus_queue.cc:1048] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:53.210508 28421 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:53.624361 28421 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:53.626885 28421 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:53.626744 24325 rpcz_store.cc:276] 0709 12:19:52.429932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.809810 (+379878us) service_pool.cc:224] Handling call
0709 12:19:52.810167 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:53.621861 (+811694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:53.622125 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:53.310719 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 1.09847e+06us
W20260709 12:19:53.629608 24290 leader_election.cc:336] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.660s (SENT)
I20260709 12:19:53.630043 24290 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:53.631213 24290 leader_election.cc:336] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.671s (SENT)
I20260709 12:19:53.631628 24290 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:53.110476 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.257515 24365 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:53.205363 24366 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:53.643075 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 437803us
I20260709 12:19:53.111236 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:53.646834 24290 leader_election.cc:336] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.676s (SENT)
I20260709 12:19:53.184106 24400 raft_consensus.cc:2393] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:53.648900 24400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2155) took 1252 ms. Trace:
I20260709 12:19:53.649319 24400 rpcz_store.cc:276] 0709 12:19:52.409017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.441988 (+ 32971us) service_pool.cc:224] Handling call
0709 12:19:53.648811 (+1206823us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:53.208811 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2151) took 1010 ms. Trace:
I20260709 12:19:53.660449 24393 rpcz_store.cc:276] 0709 12:19:52.198011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.198196 (+   185us) service_pool.cc:224] Handling call
0709 12:19:52.198703 (+   507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:52.199062 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:19:53.182890 (+983828us) log.cc:844] Serialized 14 byte log entry
0709 12:19:53.208238 (+ 25348us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:53.208329 (+    91us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:53.208424 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:53.208536 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:53.208726 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":167,"prepare.queue_time_us":553587,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":18934,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":1736,"thread_start_us":1008119,"threads_started":3,"wal-append.queue_time_us":2234}
I20260709 12:19:53.664609 28359 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:53.046674 24396 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.845s	user 0.001s	sys 0.018s
W20260709 12:19:53.667366 24396 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.466s	user 0.003s	sys 0.019s
I20260709 12:19:53.667060 28359 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:53.018199 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.990808 24440 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:53.686605 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 695780us
I20260709 12:19:53.687690 24440 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:53.091905 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:53.093708 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:53.127277 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:53.028808 24469 consensus_meta.cc:287] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.579s	user 0.016s	sys 0.000s
I20260709 12:19:53.731410 24469 raft_consensus.cc:2410] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:19:53.731951 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 2152) took 1301 ms. Trace:
I20260709 12:19:53.093151 24470 raft_consensus.cc:1275] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:19:53.735013 24470 pending_rounds.cc:85] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 8
I20260709 12:19:53.735289 24470 pending_rounds.cc:107] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:19:53.735536 24470 raft_consensus.cc:2889] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:53.736143 28122 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.126633 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:53.737563 24473 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
W20260709 12:19:52.993386 27864 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.000s	sys 0.013s
I20260709 12:19:53.313114 28110 raft_consensus.cc:2749] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:53.197183 28156 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:53.745242 28122 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:53.746701 28156 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:53.747623 28156 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.749253 25083 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:53.749490 28122 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:52.747102 28263 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:53.752910 24474 raft_consensus.cc:1240] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:53.755863 28404 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:53.756409 28404 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.756832 28404 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:53.760826 28405 consensus_queue.cc:1048] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:52.846479 28255 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:53.763693 28255 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:53.766022 28255 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:53.207679 28269 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:52.835453 28275 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:53.769673 28275 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.770099 28275 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:52.753427 28283 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.357271 28236 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.903743 28237 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.795774 28237 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:53.798389 28275 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:52.806231 28272 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:53.336998 28270 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:52.815744 28333 consensus_meta.cc:287] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.650s	user 0.014s	sys 0.004s
I20260709 12:19:52.754280 28341 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.833633 28405 consensus_queue.cc:1059] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:52.836699 28349 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:52.990338 28351 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:53.843883 28351 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:53.365248 28357 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.845597 28275 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:52.832278 28368 consensus_meta.cc:287] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.553s	user 0.013s	sys 0.000s
I20260709 12:19:53.117175 28397 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:53.848135 28397 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:53.850570 28397 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:53.389209 25113 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:19:53.853199 25113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35194 (request call id 592) took 1048 ms. Trace:
I20260709 12:19:53.853597 25113 rpcz_store.cc:276] 0709 12:19:52.804826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.806423 (+  1597us) service_pool.cc:224] Handling call
0709 12:19:53.853131 (+1046708us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:53.181177 28407 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:53.572513 27905 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.855245 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:53.856081 24467 raft_consensus.cc:2368] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 8. Current term is 9.
I20260709 12:19:53.580547 28233 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:53.858819 28233 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:53.859364 28233 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:53.859892 28233 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:53.597626 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:53.863788 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:53.603116 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 1.32582e+06us
I20260709 12:19:53.868347 28436 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.868966 28436 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:53.871759 28436 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:53.874575 28326 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.875180 28326 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:53.877081 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:53.877854 24322 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:19:53.879496 24323 raft_consensus.cc:1275] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:19:53.642048 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 384623us
I20260709 12:19:53.884826 28437 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.885414 28437 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:53.887840 28437 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:53.644405 28421 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.889230 28421 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:53.892108 28421 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:53.644973 28422 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:53.892786 28422 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.893203 28422 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:53.645350 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.622298 28416 raft_consensus.cc:697] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:53.898200 28416 consensus_queue.cc:237] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:53.900789 28122 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.901355 28122 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:53.903628 28122 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:53.904127 28122 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.647379 24290 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:53.652865 28427 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:19:53.905345 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 258522us
I20260709 12:19:53.658169 24221 catalog_manager.cc:5697] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 3 to 6, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 6 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:53.906857 28324 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:53.907356 24221 catalog_manager.cc:5697] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 5 to 9, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 9 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:53.644362 24366 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:53.909289 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 264980us
I20260709 12:19:53.910830 24366 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:53.665001 28129 consensus_queue.cc:1048] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:53.911178 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:53.911950 25117 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:19:53.669790 28342 raft_consensus.cc:2749] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:53.680243 28359 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:53.673105 28350 raft_consensus.cc:2749] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:53.690819 28293 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:53.915174 28293 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:53.915714 28293 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:53.916898 28427 raft_consensus.cc:2749] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:53.917588 24466 raft_consensus.cc:1275] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:19:53.918893 24221 catalog_manager.cc:5697] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:53.691491 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 902160us
I20260709 12:19:53.921869 24366 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:53.694438 24321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1978) took 2392 ms. Trace:
I20260709 12:19:53.923657 24321 rpcz_store.cc:276] 0709 12:19:51.302071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:51.882581 (+580510us) service_pool.cc:224] Handling call
0709 12:19:51.907747 (+ 25166us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:51.918090 (+ 10343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:51.918137 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:51.941130 (+ 22993us) log.cc:844] Serialized 26 byte log entry
0709 12:19:53.613768 (+1672638us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:53.629063 (+ 15295us) log.cc:844] Serialized 14 byte log entry
0709 12:19:53.694074 (+ 65011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:53.694180 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:53.694223 (+    43us) raft_consensus.cc:1685] finished
0709 12:19:53.694235 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:53.694374 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64683,"prepare.queue_time_us":12380,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":78404,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":14563,"thread_start_us":1657898,"threads_started":1,"wal-append.queue_time_us":652974}
I20260709 12:19:53.693302 24465 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:53.695336 24396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2150) took 1538 ms. Trace:
I20260709 12:19:53.926376 24396 rpcz_store.cc:276] 0709 12:19:52.197466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.200333 (+  2867us) service_pool.cc:224] Handling call
0709 12:19:52.200790 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:52.201072 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:19:53.667823 (+1466751us) log.cc:844] Serialized 14 byte log entry
0709 12:19:53.690313 (+ 22490us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:53.690379 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:53.690458 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:53.691212 (+   754us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:53.695270 (+  4058us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":551860,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":6766,"raft.queue_time_us":95,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":161,"thread_start_us":1488008,"threads_started":2,"wal-append.queue_time_us":22109}
I20260709 12:19:53.691412 28347 raft_consensus.cc:2804] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:53.928542 28347 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:53.929168 28347 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:53.691515 27964 raft_consensus.cc:2764] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:19:53.713047 24316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 1990) took 1284 ms. Trace:
I20260709 12:19:53.732316 24469 rpcz_store.cc:276] 0709 12:19:52.431017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.431187 (+   170us) service_pool.cc:224] Handling call
0709 12:19:53.731878 (+1300691us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:53.774119 28283 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:53.778486 28269 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:53.748226 28156 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:53.793417 28236 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:53.785315 28183 raft_consensus.cc:3055] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:53.752456 28263 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:53.802892 24217 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54244 (request call id 271) took 31701 ms (client timeout 15000 ms). Trace:
I20260709 12:19:53.798983 28237 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:53.813369 28270 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:53.819921 28404 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:53.813711 28272 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:53.834174 28341 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:53.837769 28405 raft_consensus.cc:3055] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:53.839824 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:53.845374 28357 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:52.769450 28360 consensus_meta.cc:287] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.537s	user 0.001s	sys 0.012s
I20260709 12:19:53.847291 28155 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.855588 27905 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:53.581980 28423 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.589370 24317 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:19:53.922226 24289 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:53.693272 24440 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:53.922748 28427 raft_consensus.cc:2804] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:53.949326 28333 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.980602 28351 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:53.931123 28407 raft_consensus.cc:2804] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:53.982527 25113 raft_consensus.cc:1217] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 3.6->[5.7-8.8]   Dedup: 5.7->[8.8-8.8]
I20260709 12:19:53.982766 28407 raft_consensus.cc:697] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:53.983110 25113 raft_consensus.cc:1240] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 8. Current term is 9. Ops: [5.7-8.8]
I20260709 12:19:53.983655 27905 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:53.966213 28350 consensus_queue.cc:1059] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:19:53.984375 28156 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:53.940707 28275 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.984958 28272 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:53.985739 28427 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:53.985357 28155 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:53.986457 28405 raft_consensus.cc:740] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:53.986847 28350 raft_consensus.cc:3055] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:53.987385 28350 raft_consensus.cc:740] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:53.986696 24317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57702 (request call id 603) took 1200 ms. Trace:
I20260709 12:19:53.988590 28263 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:53.988871 24317 rpcz_store.cc:276] 0709 12:19:52.786174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.921889 (+135715us) service_pool.cc:224] Handling call
0709 12:19:53.986629 (+1064740us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:53.990646 24319 raft_consensus.cc:2393] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 8: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:53.990952 28233 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:53.991431 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 69275us
I20260709 12:19:53.986208 28427 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:53.992267 24289 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:53.992403 24319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 1988) took 1572 ms (client timeout 1564 ms). Trace:
I20260709 12:19:53.993076 28342 raft_consensus.cc:2804] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:53.993240 28357 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:53.993582 28342 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:53.993791 24289 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:53.994167 24474 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:53.994280 28342 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:53.994897 28341 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:53.995585 28341 raft_consensus.cc:2804] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:53.929265 24366 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:53.981887 28183 raft_consensus.cc:740] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:19:53.992898 24319 rpcz_store.cc:269] 0709 12:19:52.420239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.469633 (+ 49394us) service_pool.cc:224] Handling call
0709 12:19:53.992170 (+1522537us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54000d4dd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:53.992325 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2664040704}
W20260709 12:19:53.997400 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 68257.6us
I20260709 12:19:53.930296 24221 catalog_manager.cc:5697] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 5 to 7, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 7 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:53.872339 28436 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:53.933240 24291 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:19:54.002242 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 309054us
I20260709 12:19:54.034607 24440 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:54.006757 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:54.008215 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:53.990605 24316 rpcz_store.cc:276] 0709 12:19:52.428702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.470622 (+ 41920us) service_pool.cc:224] Handling call
0709 12:19:52.506609 (+ 35987us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:53.628045 (+1121436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:53.628082 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:53.628684 (+   602us) log.cc:844] Serialized 26 byte log entry
0709 12:19:53.693324 (+ 64640us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:53.693370 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:53.693453 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:53.712755 (+ 19302us) raft_consensus.cc:1685] finished
0709 12:19:53.712781 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:53.712963 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1120942,"raft.queue_time_us":1162186,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"thread_start_us":64254,"threads_started":1,"wal-append.queue_time_us":72198}
I20260709 12:19:54.012591 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:54.023315 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:53.985419 28275 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:53.999614 24221 catalog_manager.cc:5697] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:19:54.036922 24395 raft_consensus.cc:2368] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 8. Current term is 9.
I20260709 12:19:54.030884 28236 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:54.031093 28404 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:53.980486 28333 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:54.041036 28129 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:54.041527 28129 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:54.041882 28129 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:54.042851 28333 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:53.987780 28405 consensus_queue.cc:260] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:54.007550 24495 debug-util.cc:398] Leaking SignalData structure 0x7b08003b4b80 after lost signal to thread 23154
W20260709 12:19:54.047437 24495 debug-util.cc:398] Leaking SignalData structure 0x7b080013bf60 after lost signal to thread 24257
W20260709 12:19:54.048810 24495 debug-util.cc:398] Leaking SignalData structure 0x7b08000de200 after lost signal to thread 24349
I20260709 12:19:54.049135 24396 raft_consensus.cc:1240] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 12:19:54.049939 24495 debug-util.cc:398] Leaking SignalData structure 0x7b08003678c0 after lost signal to thread 24424
W20260709 12:19:54.050251 24495 debug-util.cc:398] Leaking SignalData structure 0x7b0800383700 after lost signal to thread 24425
W20260709 12:19:54.051290 24495 debug-util.cc:398] Leaking SignalData structure 0x7b08003c0ba0 after lost signal to thread 24498
I20260709 12:19:53.996351 28341 raft_consensus.cc:697] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:54.037889 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:54.038784 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:54.053929 24397 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:19:54.039383 24440 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:54.039335 24221 catalog_manager.cc:5697] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 6 to 7, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 7 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:19:54.055438 24221 catalog_manager.cc:5697] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:54.044005 24399 raft_consensus.cc:2410] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:19:54.036149 24392 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:19:54.031635 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:54.040284 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 107158us
I20260709 12:19:54.057657 25084 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:54.045578 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:54.052513 24495 debug-util.cc:398] Leaking SignalData structure 0x7b08003c4320 after lost signal to thread 25143
W20260709 12:19:54.059397 24495 debug-util.cc:398] Leaking SignalData structure 0x7b080032e7e0 after lost signal to thread 25144
W20260709 12:19:54.060592 24495 debug-util.cc:398] Leaking SignalData structure 0x7b08003b0420 after lost signal to thread 28363
I20260709 12:19:54.065528 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:54.066979 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:54.068030 24393 raft_consensus.cc:2393] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 11: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:54.069810 24221 catalog_manager.cc:5697] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 7 to 10, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 10 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:19:54.070809 24400 raft_consensus.cc:1275] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:19:54.071396 24221 catalog_manager.cc:5697] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 4 to 7, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 7 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:54.053404 24395 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
I20260709 12:19:54.075088 24465 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:19:54.078641 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:54.079612 24395 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
W20260709 12:19:54.082087 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:54.085680 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 45186us
I20260709 12:19:54.086139 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:54.086759 24391 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:19:54.088905 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:53.982841 28283 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:54.087005 28269 consensus_queue.cc:1059] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.143s
I20260709 12:19:54.230391 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:54.105588 28156 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:54.044726 28437 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:54.230170 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:54.167014 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.997706 28183 consensus_queue.cc:260] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:54.104215 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 64916us
I20260709 12:19:54.087690 28236 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:19:54.156837 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 250819us
I20260709 12:19:54.275389 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:54.275748 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:54.276824 24290 leader_election.cc:336] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.752s (SENT)
I20260709 12:19:54.277504 24290 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:54.241467 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 159008us
I20260709 12:19:53.967836 28326 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:54.160869 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 241295us
I20260709 12:19:53.983892 28407 consensus_queue.cc:237] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:54.284562 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:54.046891 27964 raft_consensus.cc:2749] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:54.037633 28237 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:53.904580 28122 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:54.076886 24221 catalog_manager.cc:5697] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 4 to 7, leader changed from d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 7 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:19:54.307000 24221 catalog_manager.cc:5697] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 1 to 4, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 4 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:53.990746 28423 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:54.246332 24474 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:19:54.248894 24289 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:53.979928 24217 rpcz_store.cc:269] 0709 12:19:22.101074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.101479 (+   405us) service_pool.cc:224] Handling call
0709 12:19:53.802792 (+31701313us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:47.950007 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:47.975195 (+ 25188us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:47.975259 (+    64us) write_op.cc:435] Acquired schema lock
0709 12:19:47.975277 (+    18us) tablet.cc:662] Decoding operations
0709 12:19:47.975894 (+   617us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:47.975965 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:47.975991 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:19:47.976457 (+   466us) tablet.cc:701] Row locks acquired
0709 12:19:47.976510 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:19:48.059326 (+ 82816us) write_op.cc:270] Start()
0709 12:19:48.072769 (+ 13443us) write_op.cc:276] Timestamp: P: 1783599588039526 usec, L: 0
0709 12:19:48.072803 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:19:48.081036 (+  8233us) log.cc:844] Serialized 1317 byte log entry
0709 12:19:49.193057 (+1112021us) op_driver.cc:464] REPLICATION: finished
0709 12:19:49.979462 (+786405us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a942420ac 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425ec02 00007f4a9ad82ef0
0709 12:19:50.294068 (+314606us) write_op.cc:301] APPLY: starting
0709 12:19:50.294169 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:50.588462 (+294293us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:50.588514 (+    52us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:50.622351 (+ 33837us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:50.622636 (+   285us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 12:19:50.622679 (+    43us) write_op.cc:312] APPLY: finished
0709 12:19:50.622966 (+   287us) log.cc:844] Serialized 41 byte log entry
0709 12:19:50.819533 (+196567us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:50.829803 (+ 10270us) write_op.cc:454] Released schema lock
0709 12:19:50.841775 (+ 11972us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:50.890891 (+ 49116us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:50.890934 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8118359,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":1082526,"apply.run_cpu_time_us":26226,"apply.run_wall_time_us":576177,"cfile_cache_hit":10,"cfile_cache_hit_bytes":10460,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6219,"cfile_init":1,"lbm_read_time_us":69447,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":5,"num_ops":3,"prepare.queue_time_us":169417,"prepare.run_cpu_time_us":18824,"prepare.run_wall_time_us":356126,"raft.queue_time_us":372565,"raft.run_cpu_time_us":44948,"raft.run_wall_time_us":1258352,"replication_time_us":1097081,"spinlock_wait_cycles":5589248,"thread_start_us":1703302,"threads_started":5,"wal-append.queue_time_us":500347,"wal-append.run_cpu_time_us":28743,"wal-append.run_wall_time_us":2666976}]]}
I20260709 12:19:54.253459 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:53.988269 28350 consensus_queue.cc:260] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:54.240926 28359 consensus_queue.cc:1048] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
W20260709 12:19:54.237212 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 163134us
I20260709 12:19:54.258986 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:54.317672 24316 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:19:54.044368 28436 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:54.238270 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:54.265446 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:54.266287 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:54.266556 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:54.323096 24473 raft_consensus.cc:2393] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:54.267000 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:54.267670 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 425403us
I20260709 12:19:54.148701 28351 raft_consensus.cc:697] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
W20260709 12:19:54.324800 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 48030.8us
I20260709 12:19:54.325476 28351 consensus_queue.cc:237] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:54.326449 24290 connection.cc:256] RPC call timeout handler was delayed by -1.9721609660000468s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
W20260709 12:19:54.326834 24290 connection.cc:256] RPC call timeout handler was delayed by -1.9666286330002549s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
W20260709 12:19:54.327526 24290 leader_election.cc:336] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.785s (SENT)
I20260709 12:19:54.327879 24290 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:54.273339 24440 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:54.329314 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 56798.7us
I20260709 12:19:54.330334 24440 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:54.268404 28405 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:54.270921 28156 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:54.290943 28155 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:54.358122 24397 raft_consensus.cc:1275] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:19:54.291738 28183 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:54.296494 28275 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:54.257109 28419 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.296734 28428 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:54.282433 28236 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:54.277768 28293 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:54.297859 28157 consensus_queue.cc:1175] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d99d5d772cfe4a96afcab3d3b009a281" responder_term: 9 status { last_received { term: 7 index: 8 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 8. Current term is 9. Ops: [5.7-8.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:19:54.298069 28342 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:54.303973 25083 leader_election.cc:400] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453) with higher term. Message: Invalid argument: T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 8. Current term is 9.
I20260709 12:19:54.427106 25083 leader_election.cc:403] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:19:54.427829 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 124004us
I20260709 12:19:54.237880 28333 consensus_queue.cc:1059] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:19:54.372090 28357 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:19:54.314113 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 65310.9us
I20260709 12:19:54.309276 24221 catalog_manager.cc:5697] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:54.257731 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:54.435504 24321 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:19:54.335206 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:54.435536 24221 catalog_manager.cc:5697] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 3 to 5, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 5 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:19:54.339224 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:19:54.436861 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:54.437530 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:54.437278 24221 catalog_manager.cc:5697] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:54.438779 24221 catalog_manager.cc:5697] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 7 to 8, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 8 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:54.339210 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:19:54.346805 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:54.350920 24438 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:54.440958 25110 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:54.290712 28422 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:54.441298 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 90478.3us
W20260709 12:19:54.441332 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:54.362819 24290 leader_election.cc:336] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.808s (SENT)
I20260709 12:19:54.443018 24221 catalog_manager.cc:5697] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:54.374933 25084 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:19:54.377128 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 110513us
I20260709 12:19:54.319941 28323 raft_consensus.cc:2804] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:19:54.377868 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 137107us
I20260709 12:19:54.317770 28437 raft_consensus.cc:2749] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:54.453622 28293 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:54.315986 28237 raft_consensus.cc:697] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:54.290776 28417 consensus_queue.cc:1048] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 12:19:54.454986 28342 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:54.455124 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:54.330348 28397 raft_consensus.cc:3055] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:54.456285 25115 raft_consensus.cc:2410] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:19:54.456215 28397 raft_consensus.cc:740] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:54.457528 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:54.417074 25112 raft_consensus.cc:1240] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:54.409162 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:54.276268 28341 consensus_queue.cc:237] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:54.459378 25116 raft_consensus.cc:1275] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:54.442992 28440 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:19:54.422498 28236 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:54.431716 24346 debug-util.cc:398] Leaking SignalData structure 0x7b0800122b60 after lost signal to thread 23154
W20260709 12:19:54.468935 24346 debug-util.cc:398] Leaking SignalData structure 0x7b080004d6a0 after lost signal to thread 24257
W20260709 12:19:54.469576 24346 debug-util.cc:398] Leaking SignalData structure 0x7b08000c45a0 after lost signal to thread 24277
I20260709 12:19:54.432690 25119 raft_consensus.cc:1240] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 LEARNER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:54.395644 28350 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:54.443823 24290 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:54.448336 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:54.474395 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 111627us
W20260709 12:19:54.475071 24290 leader_election.cc:336] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.810s (SENT)
I20260709 12:19:54.475416 24290 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:54.478214 25117 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:19:54.450793 24221 catalog_manager.cc:5697] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 5 to 8, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 8 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:54.452490 28323 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:54.453004 27864 raft_consensus.cc:3055] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:54.452793 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:54.484727 25118 raft_consensus.cc:2410] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:19:54.388491 24319 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:19:54.485725 28272 consensus_queue.cc:1048] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:54.491667 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:54.451539 27964 raft_consensus.cc:2804] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:54.493355 27964 raft_consensus.cc:697] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:54.495430 28422 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:54.416268 28428 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:54.496963 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:54.501394 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:54.457209 28397 consensus_queue.cc:260] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:54.358716 28156 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:54.400542 28360 raft_consensus.cc:2804] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:54.400316 28110 raft_consensus.cc:2749] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:54.402274 28270 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:54.323482 28427 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:54.470103 24346 debug-util.cc:398] Leaking SignalData structure 0x7b080003c280 after lost signal to thread 24291
I20260709 12:19:54.480600 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:54.416267 28419 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:54.503167 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 128350us
I20260709 12:19:54.518972 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:54.519646 24321 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:19:54.521986 25117 raft_consensus.cc:2393] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 11: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:54.482679 24221 catalog_manager.cc:5697] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:54.522204 24346 debug-util.cc:398] Leaking SignalData structure 0x7b080022b480 after lost signal to thread 24349
I20260709 12:19:54.526787 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:54.540867 24346 debug-util.cc:398] Leaking SignalData structure 0x7b080022b4c0 after lost signal to thread 24350
I20260709 12:19:54.528517 24391 raft_consensus.cc:1275] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:54.529593 24399 raft_consensus.cc:1275] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:54.531575 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:54.532300 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:54.543241 24392 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:54.535830 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:54.544814 25112 raft_consensus.cc:1275] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:54.544489 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:54.545531 24320 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:54.545291 24221 catalog_manager.cc:5697] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 5 to 7, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 7 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:19:54.544721 24318 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:54.498327 28448 log.cc:927] Time spent T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.208s	user 0.004s	sys 0.001s
I20260709 12:19:54.547230 25082 leader_election.cc:400] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 8. Current term is 9.
I20260709 12:19:54.469194 28357 raft_consensus.cc:697] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:54.625070 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:54.498104 28323 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:54.635905 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:54.621565 25118 raft_consensus.cc:1275] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:54.636711 24321 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
I20260709 12:19:54.621744 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:54.637800 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:54.638365 24393 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
W20260709 12:19:54.623836 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:54.553406 24440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:54.635957 24323 raft_consensus.cc:1275] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:19:54.455032 28237 consensus_queue.cc:237] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:54.555600 23156 debug-util.cc:398] Leaking SignalData structure 0x7b0800099960 after lost signal to thread 24289
I20260709 12:19:54.634402 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:54.639410 25084 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:54.647238 24399 raft_consensus.cc:2410] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:19:54.548148 24346 debug-util.cc:398] Leaking SignalData structure 0x7b080018e440 after lost signal to thread 24424
W20260709 12:19:54.648860 24346 debug-util.cc:398] Leaking SignalData structure 0x7b08001af8e0 after lost signal to thread 24425
I20260709 12:19:54.535229 28417 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.622169 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:54.656824 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:54.548238 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:54.657471 24397 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
I20260709 12:19:54.657563 24324 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:54.548977 24221 catalog_manager.cc:5697] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 6 to 9, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 9 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:19:54.658989 24221 catalog_manager.cc:5697] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:54.639443 24440 connection.cc:256] RPC call timeout handler was delayed by -4.078501961000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
I20260709 12:19:54.498907 27864 raft_consensus.cc:740] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:54.642858 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:54.660183 24440 connection.cc:256] RPC call timeout handler was delayed by -3.9741019609998602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1761s for a response
I20260709 12:19:54.644003 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:54.644665 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:54.660593 24440 connection.cc:256] RPC call timeout handler was delayed by -3.8697019609999188s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1877s for a response
W20260709 12:19:54.660962 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 185906us
W20260709 12:19:54.661239 24440 connection.cc:256] RPC call timeout handler was delayed by -3.846301960999881s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
W20260709 12:19:54.661578 24440 connection.cc:256] RPC call timeout handler was delayed by -3.8202019609998388s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
W20260709 12:19:54.661839 24440 connection.cc:256] RPC call timeout handler was delayed by -3.550201960999857s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22320000000000004s for a response
W20260709 12:19:54.662034 24290 leader_election.cc:336] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.979s (SENT)
W20260709 12:19:54.662147 24440 connection.cc:256] RPC call timeout handler was delayed by -3.1614019609999104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2664s for a response
W20260709 12:19:54.662479 24440 connection.cc:256] RPC call timeout handler was delayed by -2.7033019609998519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3173s for a response
I20260709 12:19:54.502938 28263 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.667461 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:54.668401 24400 raft_consensus.cc:2410] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:19:54.668816 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:54.669785 24324 raft_consensus.cc:2368] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
I20260709 12:19:54.670866 24320 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:19:54.671784 24221 catalog_manager.cc:5697] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 3 to 9, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 9 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:54.648119 25084 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:54.648329 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:54.674180 24221 catalog_manager.cc:5697] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:54.548734 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:54.676155 25117 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:54.663380 24440 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:54.664515 24318 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:19:54.666115 24392 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 8: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
W20260709 12:19:54.652769 24346 debug-util.cc:398] Leaking SignalData structure 0x7b08003b3fc0 after lost signal to thread 24498
W20260709 12:19:54.677929 24346 debug-util.cc:398] Leaking SignalData structure 0x7b0800344ec0 after lost signal to thread 24499
W20260709 12:19:54.679173 24346 debug-util.cc:398] Leaking SignalData structure 0x7b08003c1300 after lost signal to thread 25143
W20260709 12:19:54.679896 24346 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6ee0 after lost signal to thread 25144
I20260709 12:19:54.679180 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:54.680446 24346 debug-util.cc:398] Leaking SignalData structure 0x7b080006ff80 after lost signal to thread 28237
W20260709 12:19:54.680859 24346 debug-util.cc:398] Leaking SignalData structure 0x7b0800101000 after lost signal to thread 28255
I20260709 12:19:54.655491 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:54.681139 24318 raft_consensus.cc:2393] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 8: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
W20260709 12:19:54.681164 24346 debug-util.cc:398] Leaking SignalData structure 0x7b0800310140 after lost signal to thread 28263
I20260709 12:19:54.548348 28342 raft_consensus.cc:2749] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:19:54.697896 24346 debug-util.cc:398] Leaking SignalData structure 0x7b0800384ec0 after lost signal to thread 28272
W20260709 12:19:54.683326 24290 leader_election.cc:336] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.021s (SENT)
I20260709 12:19:54.698585 24290 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:54.699880 24316 raft_consensus.cc:1275] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 2. Preceding OpId from leader: term: 10 index: 3. (index mismatch)
I20260709 12:19:54.546721 27905 raft_consensus.cc:2804] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:54.700521 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:54.701272 24318 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:54.685078 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:54.688577 24440 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:54.688840 24399 raft_consensus.cc:1275] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:19:54.702154 24393 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
I20260709 12:19:54.676498 24221 catalog_manager.cc:5697] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:54.703243 24221 catalog_manager.cc:5697] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:19:54.703701 24440 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:54.704696 24221 catalog_manager.cc:5697] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 6 to 9, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 9 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:54.706238 24221 catalog_manager.cc:5697] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:19:54.654772 25082 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:19:54.698228 24346 debug-util.cc:398] Leaking SignalData structure 0x7b08003c75e0 after lost signal to thread 28275
W20260709 12:19:54.709779 24346 debug-util.cc:398] Leaking SignalData structure 0x7b080030b3a0 after lost signal to thread 28283
I20260709 12:19:54.709980 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:54.710341 24346 debug-util.cc:398] Leaking SignalData structure 0x7b080021ee80 after lost signal to thread 28333
W20260709 12:19:54.710753 24346 debug-util.cc:398] Leaking SignalData structure 0x7b080034a100 after lost signal to thread 28341
W20260709 12:19:54.711064 24346 debug-util.cc:398] Leaking SignalData structure 0x7b080037dc80 after lost signal to thread 28342
W20260709 12:19:54.711376 24346 debug-util.cc:398] Leaking SignalData structure 0x7b080037dfa0 after lost signal to thread 28349
W20260709 12:19:54.711812 24346 debug-util.cc:398] Leaking SignalData structure 0x7b080022a500 after lost signal to thread 28351
W20260709 12:19:54.712143 24346 debug-util.cc:398] Leaking SignalData structure 0x7b0800368980 after lost signal to thread 28360
I20260709 12:19:54.712282 24323 raft_consensus.cc:1275] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:19:54.712459 24346 debug-util.cc:398] Leaking SignalData structure 0x7b0800301640 after lost signal to thread 28368
I20260709 12:19:54.707515 24221 catalog_manager.cc:5697] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 2 to 7, leader changed from d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 7 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:19:54.718173 24221 catalog_manager.cc:5697] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 2 to 8, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 8 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:54.639209 28293 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.710879 25118 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:19:54.721310 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:54.769276 24320 raft_consensus.cc:2393] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 8: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:54.769121 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:54.770078 24321 raft_consensus.cc:2393] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 10: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:54.643481 28255 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.724489 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:54.782379 24318 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:54.726806 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:54.783866 24324 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:19:54.545696 28460 raft_consensus.cc:2749] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:19:54.789242 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 91798.8us
I20260709 12:19:54.777233 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:54.663713 28397 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:54.788481 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:54.793115 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:54.800678 24324 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
W20260709 12:19:54.796010 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 112720us
I20260709 12:19:54.795400 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:54.803088 24323 raft_consensus.cc:2368] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 8. Current term is 9.
I20260709 12:19:54.802920 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:54.803556 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:54.804281 24321 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:54.802953 24290 leader_election.cc:336] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.142s (SENT)
I20260709 12:19:54.806083 24290 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:54.715116 28110 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.682371 28351 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:54.814043 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:54.820665 24290 leader_election.cc:336] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.146s (SENT)
I20260709 12:19:54.833591 24290 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:54.770483 28342 raft_consensus.cc:2749] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:54.836037 24324 raft_consensus.cc:2410] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:19:54.834287 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 130710us
I20260709 12:19:54.839207 24318 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:54.849432 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:54.708379 28272 consensus_queue.cc:1059] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.128s
I20260709 12:19:54.683691 28417 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:54.846863 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:54.838769 25110 raft_consensus.cc:2410] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:19:54.709383 28263 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:54.845376 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:54.852152 24318 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:19:54.916285 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:54.917227 24324 raft_consensus.cc:2410] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:19:54.924094 24321 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:54.937453 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:54.791190 28293 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:54.892558 28404 raft_consensus.cc:2804] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:54.841796 28435 raft_consensus.cc:2749] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:54.798631 28255 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:54.949106 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:54.953634 24323 raft_consensus.cc:2410] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:19:54.850883 28122 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:54.911247 28341 raft_consensus.cc:2749] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:19:54.936690 28129 consensus_meta.cc:287] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.886s	user 0.009s	sys 0.004s
I20260709 12:19:54.780232 27964 consensus_queue.cc:237] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:54.964182 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 173698us
I20260709 12:19:54.964330 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:54.833425 28110 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:54.933405 28423 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:54.937696 28450 raft_consensus.cc:2749] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:19:54.955870 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 301165us
I20260709 12:19:54.968113 24323 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
W20260709 12:19:54.979795 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:54.980247 25113 raft_consensus.cc:1217] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Deduplicated request from leader. Original: 8.8->[10.9-10.9]   Dedup: 10.9->[]
I20260709 12:19:54.982373 25113 raft_consensus.cc:1240] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:19:54.950311 28270 raft_consensus.cc:2804] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:54.969726 24395 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:19:54.981420 24391 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:19:54.982425 25082 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:54.982802 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:54.946455 28467 raft_consensus.cc:2749] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:54.844882 28351 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:54.986501 24323 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:54.975159 28451 log.cc:927] Time spent T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.491s	user 0.000s	sys 0.001s
I20260709 12:19:54.951683 27905 raft_consensus.cc:697] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 10 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:54.957315 28404 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:54.991855 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 171226us
I20260709 12:19:54.992666 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:54.831378 27864 consensus_queue.cc:260] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:54.999127 24290 connection.cc:256] RPC call timeout handler was delayed by -1.77326096600018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
W20260709 12:19:54.994369 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 145226us
I20260709 12:19:54.910548 28357 consensus_queue.cc:237] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:54.957145 28469 raft_consensus.cc:2749] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:19:54.994952 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:55.012621 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:54.993984 24366 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:54.985026 28269 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:55.002061 24440 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:55.015115 25082 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
W20260709 12:19:55.013288 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:55.017704 24290 connection.cc:256] RPC call timeout handler was delayed by -1.5495359660001213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
W20260709 12:19:55.021904 24290 connection.cc:256] RPC call timeout handler was delayed by -1.5203609659999984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20830000000000004s for a response
I20260709 12:19:55.018239 24396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:49122
W20260709 12:19:55.022289 24290 connection.cc:256] RPC call timeout handler was delayed by -1.0649783159999515s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2239s for a response
I20260709 12:19:55.022645 24396 raft_consensus.cc:606] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:55.023149 24396 raft_consensus.cc:614] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:19:55.000489 28457 log.cc:927] Time spent T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 12:19:55.037669 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:55.038076 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:55.039193 24474 raft_consensus.cc:2410] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:19:55.039252 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:55.040122 24397 raft_consensus.cc:2410] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:19:55.040534 24400 raft_consensus.cc:1275] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:55.042642 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:55.043555 24474 raft_consensus.cc:2393] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:55.045135 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:55.047534 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:55.049396 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:55.050194 24469 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:55.052443 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:55.053136 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:55.054072 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:55.054872 24474 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:55.055050 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:55.056308 24471 raft_consensus.cc:2393] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 10: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:55.057682 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:55.057180 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:55.069185 24466 raft_consensus.cc:2376] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7. Re-sending same reply.
I20260709 12:19:55.056250 24474 raft_consensus.cc:3055] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:55.072962 24474 raft_consensus.cc:740] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:55.074182 24474 consensus_queue.cc:260] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:54.994485 28436 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:54.975768 28129 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:55.000833 28404 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:55.095968 24469 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:19:55.082203 24474 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:55.082691 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 67725.7us
I20260709 12:19:55.087380 24323 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:19:55.099403 24323 raft_consensus.cc:1275] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:19:55.103034 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:55.104601 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:55.021131 28270 raft_consensus.cc:697] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 9 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:55.020890 28269 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.023772 28427 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:55.113457 24472 raft_consensus.cc:2393] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:55.099005 25082 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:19:55.090124 28451 log.cc:927] Time spent T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:19:55.121243 24317 raft_consensus.cc:2393] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 10: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:55.086345 28333 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:55.081633 28470 raft_consensus.cc:2749] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:55.091161 28473 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:19:55.115828 28453 log.cc:927] Time spent T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.176s	user 0.001s	sys 0.001s
I20260709 12:19:55.111295 28436 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.121949 28269 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:55.086025 28450 consensus_queue.cc:1048] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:19:55.023612 28459 consensus_queue.cc:1048] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.121s
I20260709 12:19:55.131160 25082 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:55.093598 28407 consensus_queue.cc:1048] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:19:55.153258 24474 raft_consensus.cc:1275] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
W20260709 12:19:55.154978 24290 leader_election.cc:336] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.593s (SENT)
I20260709 12:19:55.157285 25082 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:55.157640 24474 pending_rounds.cc:85] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 7
W20260709 12:19:55.131999 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 106583us
I20260709 12:19:55.161795 24474 pending_rounds.cc:107] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:19:55.162209 24474 raft_consensus.cc:2889] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:55.162320 24366 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:55.159269 24290 leader_election.cc:336] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.691s (SENT)
I20260709 12:19:55.164352 24290 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:55.129016 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 480962us
I20260709 12:19:55.165886 24291 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:55.170379 24396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:19:55.136677 28419 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:55.171307 24396 raft_consensus.cc:606] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:55.171845 24396 raft_consensus.cc:614] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:55.173616 24440 leader_election.cc:400] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
I20260709 12:19:55.174157 24440 leader_election.cc:403] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:19:55.175132 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:55.176301 24366 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:55.170760 28465 log.cc:927] Time spent T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 12:19:55.177486 28155 raft_consensus.cc:2749] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:55.179215 24366 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:55.117267 28441 consensus_queue.cc:1048] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:19:55.181293 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:55.135690 28480 raft_consensus.cc:2804] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:19:55.167887 28455 log.cc:927] Time spent T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 12:19:55.141567 28473 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.205077 24394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 609) took 1192 ms. Trace:
I20260709 12:19:55.208796 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2160) took 1287 ms. Trace:
I20260709 12:19:55.208873 24291 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:55.205186 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:55.185010 28419 raft_consensus.cc:2804] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:19:55.197260 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 112229us
I20260709 12:19:55.198132 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:55.157032 28468 raft_consensus.cc:2804] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:55.194577 24366 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:55.177688 28110 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:55.202014 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:55.195698 24440 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:55.209270 24468 rpcz_store.cc:276] 0709 12:19:53.921272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:53.921682 (+   410us) service_pool.cc:224] Handling call
0709 12:19:53.921963 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:53.922165 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:19:54.241044 (+318879us) log.cc:844] Serialized 14 byte log entry
0709 12:19:54.774084 (+533040us) log.cc:844] Serialized 14 byte log entry
0709 12:19:55.208371 (+434287us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:55.208430 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:55.208490 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:55.208581 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:55.208731 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9175,"prepare.queue_time_us":389108,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":80,"raft.queue_time_us":218486,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":92932,"thread_start_us":1108962,"threads_started":4,"wal-append.queue_time_us":539627}
I20260709 12:19:55.156790 28436 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:55.129657 27905 consensus_queue.cc:237] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:55.140437 28469 consensus_queue.cc:1048] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:19:55.199908 28480 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:55.181159 28463 raft_consensus.cc:2804] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:55.169435 28467 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:55.185603 28470 raft_consensus.cc:2749] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
W20260709 12:19:55.278875 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 83308.3us
I20260709 12:19:55.288556 24440 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:55.202912 28416 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:55.221485 28255 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:55.278854 28455 log.cc:927] Time spent T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:19:55.289973 28475 log.cc:927] Time spent T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 12:19:55.318329 24440 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:55.292771 28465 log.cc:927] Time spent T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:19:55.206133 24394 rpcz_store.cc:276] 0709 12:19:54.012465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.040767 (+ 28302us) service_pool.cc:224] Handling call
0709 12:19:54.041160 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:54.237173 (+196013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:54.237219 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:54.238911 (+  1692us) log.cc:844] Serialized 26 byte log entry
0709 12:19:54.291147 (+ 52236us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b1800141f40. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a96ef44bc 00007f4a9424248b 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425ec02 00007f4a96ee620b 00007f4a96eebd23 00007f4a96eec0d1
0709 12:19:54.291301 (+   154us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:54.291336 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:54.291420 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:55.198240 (+906820us) raft_consensus.cc:1685] finished
0709 12:19:55.198257 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:55.205004 (+  6747us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":195554,"raft.queue_time_us":204307,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":15127,"spinlock_wait_cycles":4581760,"thread_start_us":12741,"threads_started":1,"wal-append.queue_time_us":577670}
I20260709 12:19:55.217519 25118 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:19:55.267242 28487 raft_consensus.cc:2749] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:19:55.211966 28464 log.cc:927] Time spent T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 12:19:55.324427 28436 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:55.271354 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:55.325122 28129 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:55.220237 24438 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:55.325350 28436 raft_consensus.cc:2804] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:55.186431 28263 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:55.325950 28436 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.326362 28490 raft_consensus.cc:2804] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:55.327131 28490 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.327536 28490 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:55.201812 28421 consensus_queue.cc:1048] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:19:55.202768 28293 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:55.293198 28407 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:55.185904 28270 consensus_queue.cc:237] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:55.318979 28462 log.cc:927] Time spent T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.298s	user 0.001s	sys 0.000s
I20260709 12:19:55.277311 28463 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:55.295753 28471 log.cc:927] Time spent T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.187s	user 0.001s	sys 0.001s
I20260709 12:19:55.224032 28468 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.297520 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:55.216568 28351 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:55.275564 28480 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:55.319757 24440 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:55.193243 28423 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:55.323962 28450 raft_consensus.cc:2749] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:55.326481 28436 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:55.329990 28470 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:19:55.291131 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 862151us
I20260709 12:19:55.324421 28487 raft_consensus.cc:2804] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:55.218222 28419 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.275677 28478 raft_consensus.cc:2749] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:19:55.337607 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 178346us
W20260709 12:19:55.340574 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 146067us
I20260709 12:19:55.342250 25111 raft_consensus.cc:2368] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 11. Current term is 12.
I20260709 12:19:55.208020 28473 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:55.320776 28417 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:55.323464 28416 raft_consensus.cc:697] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:19:55.349418 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 127548us
W20260709 12:19:55.400094 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:55.333137 28407 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.290999 28467 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:55.325953 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 109798us
I20260709 12:19:55.354679 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:55.359189 24440 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:55.361248 28347 consensus_meta.cc:287] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 1.432s	user 0.012s	sys 0.002s
I20260709 12:19:55.356083 28419 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:55.350327 28487 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.343624 28463 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:55.349977 28470 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:55.343339 28468 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:55.404963 28323 consensus_meta.cc:287] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.749s	user 0.010s	sys 0.002s
I20260709 12:19:55.380156 24366 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:55.379869 28156 consensus_meta.cc:287] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.830s	user 0.007s	sys 0.000s
W20260709 12:19:55.401284 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 66893.9us
W20260709 12:19:55.367522 28405 consensus_meta.cc:287] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 1.035s	user 0.012s	sys 0.000s
I20260709 12:19:55.356089 28351 raft_consensus.cc:2749] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:55.406075 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:19:55.402428 28350 consensus_meta.cc:287] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.904s	user 0.011s	sys 0.002s
I20260709 12:19:55.421132 24322 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
I20260709 12:19:55.422842 28269 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:55.423992 28323 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:55.425508 28183 consensus_meta.cc:287] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.041s	user 0.006s	sys 0.007s
I20260709 12:19:55.426287 24320 raft_consensus.cc:2368] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 8. Current term is 9.
I20260709 12:19:55.426563 28323 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:55.428491 28440 consensus_meta.cc:287] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.968s	user 0.009s	sys 0.004s
I20260709 12:19:55.428794 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:55.429014 28440 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453) with higher term. Message: Invalid argument: T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 8. Current term is 9.
I20260709 12:19:55.429960 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:55.430567 25111 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:19:55.431419 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:55.431082 28416 consensus_queue.cc:237] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:55.432090 25111 raft_consensus.cc:2393] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 9: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:55.432803 25114 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:19:55.434970 24398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 606) took 1427 ms. Trace:
I20260709 12:19:55.435371 24398 rpcz_store.cc:276] 0709 12:19:54.007898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.008004 (+   106us) service_pool.cc:224] Handling call
0709 12:19:55.434788 (+1426784us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54001b9254. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:55.434911 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2874536192}
W20260709 12:19:55.409958 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 50864.4us
W20260709 12:19:55.412371 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:55.437206 24440 leader_election.cc:400] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 8. Current term is 9.
I20260709 12:19:55.411623 24438 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:55.353617 28423 raft_consensus.cc:697] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:55.427027 24325 raft_consensus.cc:2410] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:19:55.437593 24440 leader_election.cc:403] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:19:55.405349 28407 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:55.438292 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:55.408054 28469 consensus_queue.cc:1048] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:19:55.414786 28435 raft_consensus.cc:2804] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:55.452818 28435 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:55.410640 28347 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:19:55.415331 28470 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:55.455610 28347 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:19:55.456861 24470 raft_consensus.cc:1240] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:55.459051 28347 consensus_queue.cc:1048] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:55.459772 28505 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.460335 28505 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:55.461781 28452 log.cc:927] Time spent T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.812s	user 0.002s	sys 0.000s
I20260709 12:19:55.461452 28423 consensus_queue.cc:237] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:55.464255 28505 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:55.436617 28237 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:55.447875 25110 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:55.449460 25111 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:19:55.413959 28487 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:55.451144 28450 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:19:55.452370 28236 consensus_meta.cc:287] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.949s	user 0.012s	sys 0.000s
I20260709 12:19:55.453254 28404 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:55.441988 28467 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:55.444396 24440 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:55.470842 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:55.473073 24290 leader_election.cc:336] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 6.040s (SENT)
I20260709 12:19:55.473677 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:55.488196 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 43892.7us
I20260709 12:19:55.488711 24323 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:19:55.489086 24440 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:55.480489 25082 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:55.449440 28397 consensus_meta.cc:287] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.637s	user 0.010s	sys 0.002s
I20260709 12:19:55.490370 24440 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:55.453267 28435 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:55.493408 24440 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:55.470448 28357 raft_consensus.cc:2749] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 8. Current term is 9.
W20260709 12:19:55.495292 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:55.525494 24440 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:55.527180 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:55.536931 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:55.596907 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:55.482188 28450 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:55.482764 28237 raft_consensus.cc:697] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:19:55.603051 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 104560us
I20260709 12:19:55.604898 24440 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:55.449481 28156 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:55.608405 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:55.448701 28477 consensus_queue.cc:1048] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:19:55.499542 28347 raft_consensus.cc:2804] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:55.496682 28469 raft_consensus.cc:2749] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:55.496230 28359 raft_consensus.cc:2749] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:55.496589 28351 raft_consensus.cc:2749] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:55.615782 24440 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:55.599851 28493 raft_consensus.cc:2749] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:19:55.630025 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 192728us
I20260709 12:19:55.685052 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:55.782397 25111 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:19:55.499022 28478 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:19:55.723950 24467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 2167) took 1660 ms (client timeout 1600 ms). Trace:
I20260709 12:19:55.608657 28499 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:55.727540 28417 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:19:55.730185 28485 log.cc:927] Time spent T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.559s	user 0.001s	sys 0.000s
I20260709 12:19:55.733034 28237 consensus_queue.cc:237] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:55.604809 28450 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:55.730232 24366 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:55.813948 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 83772us
I20260709 12:19:55.487627 28236 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:55.745512 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:55.792305 24467 rpcz_store.cc:269] 0709 12:19:54.063888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.088524 (+ 24636us) service_pool.cc:224] Handling call
0709 12:19:55.704931 (+1616407us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b5400242f54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:55.723826 (+ 18895us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":924791040}
I20260709 12:19:55.725387 28419 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:55.803514 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:55.701045 28269 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:55.739976 28357 raft_consensus.cc:2804] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:55.817191 24366 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:55.883323 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 66221us
I20260709 12:19:55.824250 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:55.885381 25111 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:55.825783 28360 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:19:55.829649 28510 log.cc:927] Time spent T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.226s	user 0.000s	sys 0.000s
W20260709 12:19:55.848610 28509 log.cc:927] Time spent T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:19:55.851847 28236 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:55.852705 25118 raft_consensus.cc:2393] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 11: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:55.854667 28419 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:55.911497 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 295818us
I20260709 12:19:55.914491 24440 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:55.860119 28404 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:55.809295 28469 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.815171 28417 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:55.868165 28490 consensus_meta.cc:287] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.540s	user 0.011s	sys 0.000s
W20260709 12:19:55.874979 28480 consensus_meta.cc:287] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.000s
I20260709 12:19:55.876417 28468 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:55.884325 24366 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:55.895011 25113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48252 (request call id 550) took 1557 ms. Trace:
I20260709 12:19:55.812479 28351 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:55.815158 28488 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:55.917532 24290 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:55.935984 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:55.935829 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:55.936730 24398 raft_consensus.cc:1240] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:55.937647 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:55.945574 24319 raft_consensus.cc:1240] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:55.945886 24320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2360) took 1291 ms. Trace:
W20260709 12:19:55.906003 28436 consensus_meta.cc:287] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.550s	user 0.007s	sys 0.002s
I20260709 12:19:55.898521 28255 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:55.896291 28360 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:55.898458 28326 consensus_queue.cc:1048] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:19:55.897224 28435 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:55.910578 28323 consensus_queue.cc:1048] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:19:55.916993 28357 raft_consensus.cc:697] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
W20260709 12:19:56.006954 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 122737us
I20260709 12:19:56.033995 24366 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:56.007218 28293 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:55.956990 28490 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:55.958256 28493 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:55.960888 28350 consensus_queue.cc:1048] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:19:56.006707 25113 rpcz_store.cc:276] 0709 12:19:54.338009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.338867 (+   858us) service_pool.cc:224] Handling call
0709 12:19:54.391210 (+ 52343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:54.982724 (+591514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:55.894470 (+911746us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b54004e3754. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:55.894791 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1354181376}
I20260709 12:19:56.008438 24396 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:55.974570 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:55.972471 24289 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:56.046577 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 74219us
I20260709 12:19:56.048240 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:56.049196 24323 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:55.961603 28480 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:55.950693 28511 log.cc:927] Time spent T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:19:56.011080 28351 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.951445 28469 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:55.957396 28495 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:56.006690 24320 rpcz_store.cc:276] 0709 12:19:54.654358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.913865 (+259507us) service_pool.cc:224] Handling call
0709 12:19:55.933284 (+1019419us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b540001d454. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:55.945778 (+ 12494us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1121932672}
I20260709 12:19:56.013257 24397 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:56.007238 24400 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:19:55.950373 28505 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:56.121753 28468 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:56.017979 28473 consensus_meta.cc:287] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.613s	user 0.011s	sys 0.000s
I20260709 12:19:56.125270 28473 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:56.126132 28461 raft_consensus.cc:3055] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:56.126446 25116 raft_consensus.cc:1240] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:56.126654 28461 raft_consensus.cc:740] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:56.036334 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:55.957695 28157 consensus_queue.cc:1048] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:19:56.040549 24324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 2011) took 1244 ms. Trace:
I20260709 12:19:55.811702 28499 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:56.055703 28435 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:56.056912 28490 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:56.057406 28255 raft_consensus.cc:2749] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:56.039355 28293 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.059243 28156 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:56.059942 25111 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:19:56.148211 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:56.061525 28350 raft_consensus.cc:2749] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:56.062424 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:56.064800 28508 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.166890 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:56.168227 25111 raft_consensus.cc:2410] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:19:56.065189 28416 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.069466 24396 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:19:56.171363 24440 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:56.071327 28437 consensus_queue.cc:1059] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:56.073601 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 616) took 1442 ms. Trace:
I20260709 12:19:56.075814 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:19:56.076344 28463 consensus_meta.cc:287] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.633s	user 0.005s	sys 0.005s
I20260709 12:19:56.076889 24325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57702 (request call id 609) took 1845 ms. Trace:
I20260709 12:19:56.057272 28428 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:56.077795 24317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57702 (request call id 606) took 1847 ms. Trace:
W20260709 12:19:56.079886 28407 consensus_meta.cc:287] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.626s	user 0.011s	sys 0.000s
W20260709 12:19:56.081972 28470 consensus_meta.cc:287] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.628s	user 0.011s	sys 0.000s
I20260709 12:19:56.082576 28519 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:56.083768 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:56.027084 28467 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:56.114272 28351 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:56.117453 28469 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:56.117810 28404 consensus_queue.cc:1059] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:56.119364 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:56.193598 25118 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:19:56.195087 25118 raft_consensus.cc:1275] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:19:56.121233 28505 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:19:56.130563 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:56.197876 25113 raft_consensus.cc:1240] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:56.053700 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:56.184114 28156 raft_consensus.cc:2749] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:56.039664 28488 raft_consensus.cc:2749] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:56.139178 24397 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:19:56.140522 25112 raft_consensus.cc:1240] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 8. Current term is 9. Ops: []
W20260709 12:19:56.146775 25084 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.155.193:36951 timed out after 2.149s (SENT) [suppressed 19 similar messages]
I20260709 12:19:56.179545 28521 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:56.052366 28493 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.127760 28461 consensus_queue.cc:260] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:56.150876 24393 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:19:56.057550 28419 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.162582 24323 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:56.176921 25115 raft_consensus.cc:2393] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 10: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:56.176165 24391 rpcz_store.cc:276] 0709 12:19:54.631094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.642590 (+ 11496us) service_pool.cc:224] Handling call
0709 12:19:56.073389 (+1430799us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b54003642d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:56.073514 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":737815424}
W20260709 12:19:56.177270 28423 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.050s	sys 0.072s
I20260709 12:19:56.147926 28293 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:56.180146 24325 rpcz_store.cc:276] 0709 12:19:54.231161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.231309 (+   148us) service_pool.cc:224] Handling call
0709 12:19:56.076671 (+1845362us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54000a7154. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:56.076821 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2538568960}
I20260709 12:19:56.180361 24317 rpcz_store.cc:276] 0709 12:19:54.230035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.230177 (+   142us) service_pool.cc:224] Handling call
0709 12:19:56.077544 (+1847367us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b5400339854. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:56.077719 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1959477632}
I20260709 12:19:56.201277 28270 raft_consensus.cc:3055] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:56.185446 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:56.189034 25111 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915"
dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:47070
I20260709 12:19:56.134899 28495 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:56.195013 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 146374us
I20260709 12:19:56.119735 28417 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:56.175733 28435 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.128983 24324 rpcz_store.cc:276] 0709 12:19:54.796165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.917948 (+121783us) service_pool.cc:224] Handling call
0709 12:19:54.926423 (+  8475us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:19:54.949524 (+ 23101us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:54.949583 (+    59us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:19:54.964059 (+ 14476us) log.cc:844] Serialized 78 byte log entry
0709 12:19:55.058759 (+ 94700us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:55.132258 (+ 73499us) log.cc:844] Serialized 14 byte log entry
0709 12:19:55.201410 (+ 69152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:55.201502 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:55.729336 (+527834us) spinlock_profiling.cc:243] Waited 8.04 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:19:56.040093 (+310757us) raft_consensus.cc:1685] finished
0709 12:19:56.040222 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:56.040453 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14547,"prepare.queue_time_us":120308,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":114705,"raft.run_cpu_time_us":20743,"raft.run_wall_time_us":870074,"spinlock_wait_cycles":30905984,"thread_start_us":189278,"threads_started":3,"wal-append.queue_time_us":133466}
W20260709 12:19:56.197669 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 280234us
I20260709 12:19:56.177448 28490 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:19:56.209582 25114 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 554) took 1801 ms (client timeout 2088 ms). Trace:
I20260709 12:19:56.006922 28436 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:56.211316 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:56.219017 24391 raft_consensus.cc:1240] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:56.219165 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:56.177069 28508 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:56.145267 28347 raft_consensus.cc:697] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:56.179330 28416 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:56.189529 28407 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:56.229770 24399 raft_consensus.cc:2393] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 10: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:56.187736 28463 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:56.199589 28469 consensus_queue.cc:1048] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:19:56.190112 28470 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:56.233811 25118 raft_consensus.cc:1240] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: [7.7-9.8]
I20260709 12:19:56.307142 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:56.257061 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:56.307816 24321 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:19:56.308063 24323 raft_consensus.cc:2393] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 10: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:19:56.229935 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 56823.6us
W20260709 12:19:56.303905 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 157255us
I20260709 12:19:56.301236 24289 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:56.186841 28357 consensus_queue.cc:237] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:56.301064 25114 rpcz_store.cc:269] 0709 12:19:54.408659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.408818 (+   159us) service_pool.cc:224] Handling call
0709 12:19:56.209385 (+1800567us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b54005b18d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:56.209520 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2240200448}
I20260709 12:19:56.233624 25111 raft_consensus.cc:606] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:56.311148 24289 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:56.218413 28493 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:56.314819 25111 raft_consensus.cc:614] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:56.221859 28473 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:56.310936 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:56.310735 24440 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:56.312892 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:56.315958 28416 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:56.334255 24325 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:56.334458 28469 raft_consensus.cc:2749] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:19:56.303069 28453 log.cc:927] Time spent T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:19:56.317521 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:56.318074 28351 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:56.318614 28514 log.cc:927] Time spent T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:19:56.192087 28519 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:56.319986 28505 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:56.320508 28468 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:56.223125 28419 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:56.346065 28468 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:56.348129 28419 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:56.321358 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:56.349134 24399 raft_consensus.cc:2393] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 8: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:56.320140 28407 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:56.321857 25119 raft_consensus.cc:2393] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 10: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:56.218279 28521 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:56.229096 28270 raft_consensus.cc:740] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
W20260709 12:19:56.222941 28423 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.050s	sys 0.073s
I20260709 12:19:56.325193 24289 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:56.311750 25084 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:56.357514 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 45856.2us
I20260709 12:19:56.333590 28526 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:56.327371 28436 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:56.331480 28450 consensus_meta.cc:287] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.509s	user 0.012s	sys 0.000s
I20260709 12:19:56.326195 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:56.307260 28490 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:56.335902 24321 raft_consensus.cc:2393] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 11: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:56.335765 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:56.374529 24397 raft_consensus.cc:2410] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:19:56.336135 24440 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:56.325088 28467 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:56.312160 28435 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:19:56.376550 24398 raft_consensus.cc:1240] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11. Ops: []
W20260709 12:19:56.381979 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 44789.8us
I20260709 12:19:56.381734 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:56.385336 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:56.387262 24321 raft_consensus.cc:1275] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:56.388732 28351 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:56.388902 28519 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:56.389411 28351 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.388748 28468 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:56.389714 28435 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:56.366379 28473 raft_consensus.cc:2749] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:56.354091 24325 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:19:56.311940 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:56.396387 25084 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:56.373405 28505 raft_consensus.cc:2804] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:56.404285 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:56.219960 28522 consensus_queue.cc:1048] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.138s
W20260709 12:19:56.315874 28516 log.cc:927] Time spent T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:19:56.370381 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:56.412441 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:56.412871 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:56.418413 24395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 613) took 1788 ms. Trace:
I20260709 12:19:56.418701 24474 raft_consensus.cc:2393] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 11: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:56.417809 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:56.419652 24465 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:19:56.418581 24467 raft_consensus.cc:2393] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:56.419740 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:56.376682 28467 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.414227 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:56.414951 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:56.415174 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:56.424566 24469 raft_consensus.cc:2393] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:56.425901 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:56.427049 24469 raft_consensus.cc:2410] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 3.
I20260709 12:19:56.415808 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:56.416990 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:56.430490 24471 raft_consensus.cc:2376] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9. Re-sending same reply.
I20260709 12:19:56.430900 24466 raft_consensus.cc:2410] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:19:56.420583 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:56.390303 28405 consensus_queue.cc:1048] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:19:56.443308 24394 raft_consensus.cc:1275] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:56.420586 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:56.418879 24395 rpcz_store.cc:276] 0709 12:19:54.629975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.643765 (+ 13790us) service_pool.cc:224] Handling call
0709 12:19:56.418225 (+1774460us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b54001b9c54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:56.418354 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":710335360}
I20260709 12:19:56.382791 28526 raft_consensus.cc:697] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:56.445000 24467 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:19:56.445354 28495 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:56.445751 28526 consensus_queue.cc:237] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:56.446475 28523 log.cc:927] Time spent T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928: Append to log took a long time: real 0.261s	user 0.000s	sys 0.004s
I20260709 12:19:56.449301 24470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2164) took 2440 ms. Trace:
I20260709 12:19:56.449795 24470 rpcz_store.cc:276] 0709 12:19:54.009119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.009239 (+   120us) service_pool.cc:224] Handling call
0709 12:19:54.009540 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:55.457423 (+1447883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:56.449041 (+991618us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54000fd2d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:56.449236 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3328025984}
I20260709 12:19:56.401252 28499 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:56.390022 28351 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:56.431548 24469 raft_consensus.cc:1275] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:19:56.432101 24465 raft_consensus.cc:2410] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:19:56.476490 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:56.477353 24465 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:56.432363 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:56.423930 28360 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:56.483306 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:56.483894 24394 raft_consensus.cc:1275] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:19:56.433854 28521 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:56.417778 28519 consensus_queue.cc:1059] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:19:56.435810 28470 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:56.421089 28270 consensus_queue.cc:260] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:56.458194 24468 raft_consensus.cc:2393] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:56.494414 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:56.459043 24289 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:56.459471 24473 raft_consensus.cc:2393] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:56.460680 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:56.497382 24466 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
I20260709 12:19:56.498585 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:56.420403 24474 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:19:56.461742 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:56.500252 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:56.500837 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:56.501646 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:56.501993 24471 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 8: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:56.403946 28473 raft_consensus.cc:2804] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:56.474793 24291 leader_election.cc:400] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 11. Current term is 12.
I20260709 12:19:56.503896 24291 leader_election.cc:403] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:56.481389 25118 raft_consensus.cc:1275] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:19:56.504521 25118 pending_rounds.cc:85] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281: Aborting all ops after (but not including) 8
I20260709 12:19:56.504941 25118 pending_rounds.cc:107] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:19:56.505221 25118 raft_consensus.cc:2889] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:56.505241 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:56.506381 24473 raft_consensus.cc:2393] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:56.506896 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:56.495337 24468 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 6.
I20260709 12:19:56.379956 28450 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:56.513458 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:56.486902 24467 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:19:56.484323 24472 raft_consensus.cc:2376] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9. Re-sending same reply.
I20260709 12:19:56.458877 28467 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:56.423549 28505 raft_consensus.cc:697] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:56.502489 24474 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:19:56.463184 27964 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:56.524438 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:19:56.516062 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 203902us
I20260709 12:19:56.516348 24471 raft_consensus.cc:2410] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:19:56.521145 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:56.393884 28347 consensus_queue.cc:237] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:56.529923 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:56.530821 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:56.531909 24321 raft_consensus.cc:2393] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 8: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:56.543761 24473 raft_consensus.cc:1240] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:56.508356 28508 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:56.507966 28521 raft_consensus.cc:3055] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:19:56.534636 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 75734us
W20260709 12:19:56.569713 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 260936us
I20260709 12:19:56.547957 24290 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:56.571965 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:56.576368 25118 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:56.549876 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:56.516178 28469 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:56.579784 24465 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 12.
I20260709 12:19:56.574339 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:56.524837 28436 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:19:56.584648 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:56.586824 25084 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:56.587517 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:56.515725 28473 raft_consensus.cc:697] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:56.534384 28270 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:56.590107 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:56.591768 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 43906.3us
I20260709 12:19:56.588992 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:56.571184 28157 raft_consensus.cc:2804] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:56.589915 28469 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:56.603513 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:56.605568 24290 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:56.602309 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:56.607184 24290 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:56.612105 25118 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
W20260709 12:19:56.614600 28520 log.cc:927] Time spent T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.537s	user 0.004s	sys 0.000s
I20260709 12:19:56.574762 28521 raft_consensus.cc:740] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:56.617233 24290 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:56.534677 28495 consensus_queue.cc:1048] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:19:56.616175 28479 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:56.593677 28283 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:56.574188 28324 consensus_queue.cc:1048] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 12:19:56.616290 28533 log.cc:927] Time spent T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:19:56.639830 24468 raft_consensus.cc:1275] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:56.627264 24291 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:56.634837 24290 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:56.597282 28460 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:56.610216 28157 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.533794 27964 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:56.652257 27964 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:56.653585 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:56.654913 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:56.596349 28522 consensus_queue.cc:1059] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
W20260709 12:19:56.648222 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 135790us
I20260709 12:19:56.659178 24440 leader_election.cc:400] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 8. Current term is 9.
I20260709 12:19:56.659509 24440 leader_election.cc:403] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:56.656153 24323 raft_consensus.cc:1240] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:56.621369 28526 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:56.660590 24440 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:56.666839 28478 raft_consensus.cc:2749] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 8. Current term is 9.
I20260709 12:19:56.667126 24440 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:56.668028 28478 raft_consensus.cc:2749] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:56.669157 24440 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:56.661906 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:56.670984 24321 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:56.662956 24323 raft_consensus.cc:1275] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:56.637020 28129 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:56.665220 24468 raft_consensus.cc:1275] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:56.671836 24440 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:56.647023 28497 raft_consensus.cc:2804] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:56.657008 28157 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:56.643497 28490 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:56.681866 28490 raft_consensus.cc:2749] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:56.683252 28490 consensus_queue.cc:1059] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:56.684293 28519 raft_consensus.cc:3055] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:56.684818 28519 raft_consensus.cc:740] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:56.685792 28519 consensus_queue.cc:260] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:56.656365 28342 raft_consensus.cc:2749] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:56.689932 25111 raft_consensus.cc:1275] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 LEARNER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:19:56.690311 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:56.639575 28498 consensus_queue.cc:1048] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:19:56.693900 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:56.696044 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:56.665446 28360 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:56.700042 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:19:56.695952 28487 consensus_meta.cc:287] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.210s	user 0.016s	sys 0.000s
I20260709 12:19:56.670459 27964 raft_consensus.cc:2749] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:56.676622 28478 raft_consensus.cc:2749] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:56.710624 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:56.692806 28522 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.625379 28505 consensus_queue.cc:237] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:56.708098 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 73355.2us
I20260709 12:19:56.714148 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:56.723417 24468 raft_consensus.cc:2393] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 8: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:56.724555 24290 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:56.713830 24321 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:19:56.698191 28519 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:56.668874 28473 consensus_queue.cc:237] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:56.733979 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:56.734956 25111 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:56.736801 24440 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:56.693168 28236 consensus_queue.cc:1048] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:19:56.739281 24290 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:56.727988 28522 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:56.749634 24290 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:56.750491 25110 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 564) took 1576 ms (client timeout 1796 ms). Trace:
I20260709 12:19:56.752135 24290 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:56.752337 25110 rpcz_store.cc:269] 0709 12:19:55.174598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:55.174788 (+   190us) service_pool.cc:224] Handling call
0709 12:19:56.750290 (+1575502us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b540069a5d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:56.750421 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":595448576}
I20260709 12:19:56.753880 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:56.755216 25110 raft_consensus.cc:2376] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8. Re-sending same reply.
I20260709 12:19:56.758157 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:56.759123 24471 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:19:56.712888 28487 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:56.748767 28129 raft_consensus.cc:2749] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:56.764075 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:56.752332 28342 raft_consensus.cc:2749] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:56.766981 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:56.792402 24471 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:19:56.756448 24290 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:56.797957 24467 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:56.796108 24320 raft_consensus.cc:1240] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:19:56.756314 27964 raft_consensus.cc:2804] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:56.751757 28526 raft_consensus.cc:2749] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:56.798758 24290 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:56.766099 24469 raft_consensus.cc:1275] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:19:56.764238 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 71029.1us
I20260709 12:19:56.800400 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:56.750517 28324 consensus_queue.cc:1048] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:19:56.767059 28544 raft_consensus.cc:2749] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:56.818960 28283 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:56.824513 28469 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:56.827584 24467 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:19:56.759789 28497 raft_consensus.cc:697] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:56.846505 28487 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:56.951164 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 98826.9us
I20260709 12:19:56.849328 24472 raft_consensus.cc:1240] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 8. Ops: []
W20260709 12:19:56.842898 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 44180.6us
I20260709 12:19:56.892186 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:56.953691 24290 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:56.807922 28129 raft_consensus.cc:2804] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:56.962929 24471 pending_rounds.cc:85] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 2
W20260709 12:19:56.970513 25119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 568) took 1775 ms (client timeout 1657 ms). Trace:
I20260709 12:19:56.970759 24471 pending_rounds.cc:107] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 9.3
W20260709 12:19:56.971052 25119 rpcz_store.cc:269] 0709 12:19:55.195139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:55.195271 (+   132us) service_pool.cc:224] Handling call
0709 12:19:56.970226 (+1774955us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540066b7d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:56.970407 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2554757888}
I20260709 12:19:56.972015 24471 raft_consensus.cc:2889] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:56.862528 28293 consensus_meta.cc:287] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.620s	user 0.011s	sys 0.002s
I20260709 12:19:56.962289 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:56.889360 28326 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:56.867898 27964 raft_consensus.cc:697] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:56.801836 28157 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:57.028849 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:57.045198 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:56.965207 28544 raft_consensus.cc:2749] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:56.972582 28129 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:56.950788 28342 consensus_queue.cc:1048] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 12:19:57.057782 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:57.058913 25119 raft_consensus.cc:2393] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 7: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:57.055801 24316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 2004) took 2515 ms. Trace:
I20260709 12:19:57.059741 24316 rpcz_store.cc:276] 0709 12:19:54.540858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.645932 (+105074us) service_pool.cc:224] Handling call
0709 12:19:54.646246 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:54.700522 (+ 54276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:57.055358 (+2354836us) spinlock_profiling.cc:243] Waited 53.1 ms on lock 0x7b54000d48d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:57.055711 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122160896}
I20260709 12:19:57.063953 24321 raft_consensus.cc:1275] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:19:57.064365 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:57.014791 28293 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:57.070886 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:57.050933 28129 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:57.074968 25119 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
W20260709 12:19:57.061257 28493 consensus_meta.cc:287] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.722s	user 0.004s	sys 0.010s
I20260709 12:19:57.079879 25119 raft_consensus.cc:1275] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:57.062124 28436 raft_consensus.cc:2749] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 11. Current term is 12.
W20260709 12:19:57.074939 28467 consensus_meta.cc:287] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.003s
I20260709 12:19:57.076881 28490 consensus_queue.cc:1048] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:19:57.081614 28326 raft_consensus.cc:697] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:57.101536 27864 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:57.089305 28467 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:57.088572 28547 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.113945 28326 consensus_queue.cc:237] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:57.071404 28497 consensus_queue.cc:237] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:57.088529 28493 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:57.091053 27964 consensus_queue.cc:237] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:19:57.109584 28467 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:57.117436 28157 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:57.123930 28522 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:57.143255 24468 raft_consensus.cc:1240] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11. Ops: []
W20260709 12:19:57.168741 28553 log.cc:927] Time spent T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:19:57.169139 28293 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:57.110671 28547 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:57.176433 28547 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:57.183895 28463 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:57.184731 28427 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.842s	user 0.035s	sys 0.024s
W20260709 12:19:57.185425 28427 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.843s	user 0.035s	sys 0.024s
W20260709 12:19:57.186508 28351 consensus_meta.cc:287] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.711s	user 0.006s	sys 0.006s
I20260709 12:19:57.186918 28351 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:57.188272 24474 raft_consensus.cc:2393] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 11: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:57.143548 28556 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.197549 28493 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:57.197962 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:57.199199 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:57.199739 24465 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:57.200147 28479 consensus_meta.cc:287] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.003s
W20260709 12:19:57.189916 28554 log.cc:927] Time spent T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:19:57.205900 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:57.206319 28460 consensus_meta.cc:287] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.558s	user 0.009s	sys 0.002s
I20260709 12:19:57.206622 24466 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:57.206728 28460 raft_consensus.cc:2749] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:57.207857 25115 raft_consensus.cc:1275] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:57.194969 28129 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:57.210399 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:57.211086 24440 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:57.211727 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:57.212007 28493 raft_consensus.cc:2749] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:57.212509 24440 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:57.213434 28493 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:57.213706 25115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 605) took 1173 ms. Trace:
I20260709 12:19:57.213853 24440 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:57.212918 28129 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:57.214236 25115 rpcz_store.cc:276] 0709 12:19:56.040745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.229455 (+188710us) service_pool.cc:224] Handling call
0709 12:19:57.207078 (+977623us) spinlock_profiling.cc:243] Waited 920 us on lock 0x7b5800004598. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c325fc0 00007f4a9c310929 00007f4a9c3103d2 00007f4a95887bd4
0709 12:19:57.207383 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:57.208387 (+  1004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:57.213642 (+  5255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2115328}
I20260709 12:19:57.214702 28493 raft_consensus.cc:2804] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:57.215221 28493 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:57.215543 28450 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:57.215617 28493 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:57.212846 28270 consensus_meta.cc:287] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.611s	user 0.006s	sys 0.007s
I20260709 12:19:57.218535 28519 consensus_queue.cc:1048] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:57.194550 28556 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:57.219669 28552 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.219884 25083 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:57.220254 28552 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:57.221012 28556 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:57.221760 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:57.222671 28552 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:57.224179 25116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48252 (request call id 567) took 2036 ms. Trace:
I20260709 12:19:57.224586 25116 rpcz_store.cc:276] 0709 12:19:55.188258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:55.188413 (+   155us) service_pool.cc:224] Handling call
0709 12:19:55.205584 (+ 17171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:56.126808 (+921224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:57.223955 (+1097147us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b54007085d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:57.224120 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2117290112}
W20260709 12:19:57.225438 25082 leader_election.cc:336] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.028s (SENT)
I20260709 12:19:57.228519 28479 raft_consensus.cc:2749] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:57.222862 24473 raft_consensus.cc:2410] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:19:57.233178 25114 raft_consensus.cc:1240] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: [7.7-9.8]
I20260709 12:19:57.233291 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:57.237880 25083 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:57.238232 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:57.238857 24473 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:19:57.240667 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:57.241499 24470 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:57.245462 24466 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:19:57.246534 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:57.247255 24466 raft_consensus.cc:2393] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 8: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:57.249701 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:57.250082 24465 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:19:57.252197 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:57.253217 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:57.253779 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:57.253964 25116 raft_consensus.cc:2393] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 10: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:57.254529 24473 raft_consensus.cc:2393] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 12: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:57.255555 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:57.256273 24473 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:57.257740 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:57.251201 28473 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:57.280685 24440 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:57.260330 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:57.259544 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:57.277801 28357 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:57.284228 28560 log.cc:927] Time spent T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:19:57.251575 28236 consensus_queue.cc:1048] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:19:57.259320 28283 consensus_queue.cc:1048] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:19:57.275374 28450 consensus_queue.cc:1059] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:19:57.321376 28450 raft_consensus.cc:3055] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:57.321871 28450 raft_consensus.cc:740] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:57.278084 28347 consensus_queue.cc:1059] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:19:57.240203 28552 raft_consensus.cc:2804] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:57.325203 28552 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:57.328039 28493 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:57.329008 28450 consensus_queue.cc:260] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:57.330046 25116 raft_consensus.cc:1275] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:19:57.317193 28357 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:57.348776 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:57.349644 25116 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:57.351100 24470 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:19:57.357954 24470 raft_consensus.cc:1240] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 8. Ops: []
W20260709 12:19:57.369856 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 120125us
I20260709 12:19:57.341300 28552 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:57.372280 25116 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:19:57.354628 28490 raft_consensus.cc:2749] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:57.346843 28450 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:57.368957 24470 raft_consensus.cc:1240] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:57.374225 24440 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:57.348551 28351 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:57.346870 28470 consensus_queue.cc:1048] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:19:57.378228 28347 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:57.380576 28404 consensus_queue.cc:1059] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:19:57.381134 28347 raft_consensus.cc:697] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:57.381492 28404 raft_consensus.cc:3055] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:57.381817 28404 raft_consensus.cc:740] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:57.382050 28347 consensus_queue.cc:237] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:57.382650 28404 consensus_queue.cc:260] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:57.383805 28404 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:57.385795 28493 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:57.386265 28357 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:57.389436 28480 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:57.397117 28461 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:57.394009 28473 raft_consensus.cc:697] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 12 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:57.405985 28473 consensus_queue.cc:237] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:57.412235 28521 consensus_queue.cc:260] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:57.414219 28521 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:57.412264 28552 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:57.416571 28552 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:57.474035 24400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 623) took 1436 ms. Trace:
I20260709 12:19:57.473909 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:57.477533 24316 raft_consensus.cc:1240] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:57.475124 24400 rpcz_store.cc:276] 0709 12:19:56.037626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.197897 (+160271us) service_pool.cc:224] Handling call
0709 12:19:56.198251 (+   354us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:19:56.201527 (+  3276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:56.201559 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:19:56.215843 (+ 14284us) log.cc:844] Serialized 78 byte log entry
0709 12:19:56.336555 (+120712us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:56.421841 (+ 85286us) log.cc:844] Serialized 14 byte log entry
0709 12:19:57.471608 (+1049767us) log.cc:844] Serialized 14 byte log entry
0709 12:19:57.472358 (+   750us) log.cc:844] Serialized 14 byte log entry
0709 12:19:57.472866 (+   508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:57.473110 (+   244us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:57.473224 (+   114us) raft_consensus.cc:1685] finished
0709 12:19:57.473287 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:57.473694 (+   407us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1051003,"prepare.queue_time_us":235343,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":5281,"raft.queue_time_us":10334,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":1894,"thread_start_us":193734,"threads_started":2,"wal-append.queue_time_us":178509}
W20260709 12:19:57.483882 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:57.484732 24440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:57.514693 28498 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.516840 28526 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:57.517781 28526 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:57.518000 24398 raft_consensus.cc:1240] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:57.517822 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:57.539964 24396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:19:57.510803 24470 raft_consensus.cc:1275] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:19:57.391177 25083 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:57.545100 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:57.556218 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:57.563395 24398 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:57.515969 28498 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:57.573266 27864 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:19:57.575417 28237 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.575605 28497 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.577147 24290 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:19:57.577531 24322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57702 (request call id 611) took 3334 ms (client timeout 2149 ms). Trace:
I20260709 12:19:57.579728 28347 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:57.559044 24470 pending_rounds.cc:85] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 6
I20260709 12:19:57.581723 28521 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.581889 24392 raft_consensus.cc:1275] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 12:19:57.582933 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 191737us
I20260709 12:19:57.584925 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:57.586455 28473 raft_consensus.cc:2804] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:57.588394 24394 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:57.588985 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 79910.1us
W20260709 12:19:57.589692 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 86311.3us
I20260709 12:19:57.591223 28526 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:57.589702 24396 raft_consensus.cc:606] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Received request to transfer leadership to TS c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:57.573289 28437 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:57.605285 27864 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:57.605921 28437 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:57.607613 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:57.603582 24470 pending_rounds.cc:107] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:19:57.609059 24470 raft_consensus.cc:2889] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:57.611783 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:57.613312 24366 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:57.612979 28521 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:57.615355 28468 consensus_queue.cc:1059] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:57.618623 28468 raft_consensus.cc:3055] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:57.620780 24396 raft_consensus.cc:614] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:57.605325 28347 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:57.621869 28237 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:57.620689 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:57.597617 24322 rpcz_store.cc:269] 0709 12:19:54.243460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.243603 (+   143us) service_pool.cc:224] Handling call
0709 12:19:57.576996 (+3333393us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54002134d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:57.577286 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2523316096}
I20260709 12:19:57.632361 24396 raft_consensus.cc:3055] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:57.634193 24396 raft_consensus.cc:740] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:19:57.642443 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 76810.6us
I20260709 12:19:57.641301 27864 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:57.645349 28473 raft_consensus.cc:697] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
W20260709 12:19:57.649358 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:57.651120 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:57.651768 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:57.627635 28468 raft_consensus.cc:740] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:19:57.653318 24324 raft_consensus.cc:1240] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:57.652911 24396 consensus_queue.cc:260] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:57.677191 24325 raft_consensus.cc:1275] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:57.678542 28454 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:57.681473 24398 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:19:57.671168 28521 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:57.698146 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 85086.8us
I20260709 12:19:57.698331 28526 raft_consensus.cc:2749] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:57.699707 28110 raft_consensus.cc:3055] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:57.700078 28473 consensus_queue.cc:237] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:57.700845 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 86172.8us
I20260709 12:19:57.702186 25118 raft_consensus.cc:1275] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:19:57.703941 28275 raft_consensus.cc:2764] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:19:57.706238 28466 consensus_queue.cc:1059] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:57.707796 28466 raft_consensus.cc:3055] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:57.708168 28466 raft_consensus.cc:740] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:57.709022 24396 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:57.709503 28577 log.cc:927] Time spent T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.122s	user 0.002s	sys 0.000s
I20260709 12:19:57.710757 24400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:49122
W20260709 12:19:57.711277 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 69426us
I20260709 12:19:57.711203 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2171) took 1396 ms. Trace:
I20260709 12:19:57.711717 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:57.712771 24316 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:57.697456 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:57.716663 28468 consensus_queue.cc:260] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:57.718743 28468 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:57.722046 24323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 634) took 1095 ms. Trace:
I20260709 12:19:57.722637 28237 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:57.722532 24323 rpcz_store.cc:276] 0709 12:19:56.626873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.672794 (+ 45921us) service_pool.cc:224] Handling call
0709 12:19:56.673168 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:56.708796 (+ 35628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:56.708829 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:56.708871 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:56.708907 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:57.721406 (+1012499us) spinlock_profiling.cc:243] Waited 35.3 ms on lock 0x7b5400361d54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:57.721474 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:57.721805 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81253632}
W20260709 12:19:57.723935 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 147322us
I20260709 12:19:57.725868 24290 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:57.697322 28497 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:57.728991 24467 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:19:57.730041 28497 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:57.730934 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:57.732591 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:57.732939 28498 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:57.712195 24393 rpcz_store.cc:276] 0709 12:19:56.314539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.439663 (+125124us) service_pool.cc:224] Handling call
0709 12:19:56.440152 (+   489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:57.462383 (+1022231us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:19:57.462513 (+   130us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:57.464143 (+  1630us) log.cc:844] Serialized 26 byte log entry
0709 12:19:57.505912 (+ 41769us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:57.505981 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:57.506175 (+   194us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:57.710718 (+204543us) raft_consensus.cc:1685] finished
0709 12:19:57.710742 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:57.710964 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1020815,"raft.queue_time_us":1129673,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":318,"thread_start_us":41010,"threads_started":1,"wal-append.queue_time_us":41617}
I20260709 12:19:57.713145 24289 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:57.735083 24394 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:19:57.692204 28437 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:57.740799 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:57.741125 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:57.742661 24470 raft_consensus.cc:2393] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:57.708354 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:57.700367 28110 raft_consensus.cc:740] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:19:57.759905 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 59256us
I20260709 12:19:57.679405 28454 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:57.753587 24440 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:57.754865 24320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 2032) took 1712 ms. Trace:
I20260709 12:19:57.754763 28526 consensus_queue.cc:1059] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:57.738546 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:57.758816 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2559) took 1534 ms. Trace:
I20260709 12:19:57.711489 24400 raft_consensus.cc:606] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:19:57.765873 28324 consensus_queue.cc:1048] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:19:57.763121 24320 rpcz_store.cc:276] 0709 12:19:56.042702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.125693 (+ 82991us) service_pool.cc:224] Handling call
0709 12:19:56.126002 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:56.798637 (+672635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:57.754231 (+955594us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b5400384d54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:57.754695 (+   464us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1487739776}
I20260709 12:19:57.764727 24391 rpcz_store.cc:276] 0709 12:19:56.227915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.424814 (+196899us) service_pool.cc:224] Handling call
0709 12:19:56.425252 (+   438us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:57.476382 (+1051130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:57.476656 (+   274us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:57.480248 (+  3592us) log.cc:844] Serialized 52 byte log entry
0709 12:19:57.561210 (+ 80962us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:57.561269 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:57.569800 (+  8531us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:57.755801 (+186001us) raft_consensus.cc:1685] finished
0709 12:19:57.755830 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:57.756133 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1049133,"raft.queue_time_us":1150374,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":131,"thread_start_us":78623,"threads_started":1,"wal-append.queue_time_us":194098}
I20260709 12:19:57.781966 28461 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:57.782258 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 56641.7us
I20260709 12:19:57.783051 28461 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:57.784476 28323 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:57.785187 28323 raft_consensus.cc:697] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:57.786576 28323 consensus_queue.cc:237] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:57.787573 28454 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:57.783434 24290 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:57.794420 24473 consensus_meta.cc:287] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.536s	user 0.013s	sys 0.009s
W20260709 12:19:57.806828 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 93887.6us
I20260709 12:19:57.798702 24469 raft_consensus.cc:1240] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:57.807687 28437 raft_consensus.cc:2749] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:57.807859 28498 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:57.799661 24399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2556) took 1578 ms. Trace:
I20260709 12:19:57.808979 28498 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:57.809211 24399 rpcz_store.cc:276] 0709 12:19:56.221000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.349740 (+128740us) service_pool.cc:224] Handling call
0709 12:19:56.350210 (+   470us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:19:57.538817 (+1188607us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:57.538894 (+    77us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:19:57.540532 (+  1638us) log.cc:844] Serialized 78 byte log entry
0709 12:19:57.639000 (+ 98468us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:57.639125 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:57.647070 (+  7945us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:57.799071 (+152001us) raft_consensus.cc:1685] finished
0709 12:19:57.799104 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:57.799326 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1143484,"raft.queue_time_us":1226476,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":152,"thread_start_us":63729,"threads_started":1,"wal-append.queue_time_us":155428}
I20260709 12:19:57.813462 28275 consensus_queue.cc:1048] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:57.814862 24469 raft_consensus.cc:1240] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:57.816377 24472 raft_consensus.cc:1240] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:57.802314 25111 raft_consensus.cc:2393] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 9: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:57.803790 25112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 1157) took 2622 ms. Trace:
I20260709 12:19:57.817286 25112 rpcz_store.cc:276] 0709 12:19:55.181219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:55.181412 (+   193us) service_pool.cc:224] Handling call
0709 12:19:55.205569 (+ 24157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:56.210554 (+1004985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:57.803111 (+1592557us) spinlock_profiling.cc:243] Waited 935 ms on lock 0x7b540065de54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:19:57.803524 (+   413us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2149687168}
I20260709 12:19:57.799685 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:57.819046 25117 raft_consensus.cc:1240] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:57.819350 24397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2557) took 1597 ms. Trace:
I20260709 12:19:57.804339 28497 consensus_queue.cc:1048] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:57.802307 28461 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:57.805253 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:57.804056 24365 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:57.821295 25110 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:19:57.798141 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:57.799350 28324 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:57.823515 28454 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:57.824275 28454 raft_consensus.cc:697] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:57.802304 24467 raft_consensus.cc:1240] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:19:57.820051 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33198 (request call id 872) took 1283 ms. Trace:
I20260709 12:19:57.819494 25116 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:57.820070 24397 rpcz_store.cc:276] 0709 12:19:56.221247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.384134 (+162887us) service_pool.cc:224] Handling call
0709 12:19:56.421298 (+ 37164us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:57.483818 (+1062520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:57.483889 (+    71us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:57.485026 (+  1137us) log.cc:844] Serialized 26 byte log entry
0709 12:19:57.533565 (+ 48539us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:57.533622 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:57.533962 (+   340us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:57.719192 (+185230us) spinlock_profiling.cc:243] Waited 25.9 ms on lock 0x7b24000fd9e8. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a940e59c4 00007f4a940e3acb 00007f4a9429edc9 00007f4a9429ea55 00007f4a9429dfb0 00007f4a96f14488 00007f4a96f14be8 00007f4a96eec398 00007f4a96ee776a 00007f4a96ee6bb6
0709 12:19:57.724713 (+  5521us) raft_consensus.cc:1685] finished
0709 12:19:57.724737 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:57.818977 (+ 94240us) spinlock_profiling.cc:243] Waited 36.8 ms on lock 0x7b54001b9c50. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:57.819116 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1061196,"raft.queue_time_us":1155028,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":194,"spinlock_wait_cycles":144257536,"thread_start_us":47920,"threads_started":1,"wal-append.queue_time_us":48551}
I20260709 12:19:57.826575 24474 rpcz_store.cc:276] 0709 12:19:56.529367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.529580 (+   213us) service_pool.cc:224] Handling call
0709 12:19:57.812080 (+1282500us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b540029d454. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:57.812378 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1511890688}
I20260709 12:19:57.833933 24316 raft_consensus.cc:2410] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:19:57.834712 28526 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:57.825899 28454 consensus_queue.cc:237] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:57.834867 28466 consensus_queue.cc:260] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
W20260709 12:19:57.841114 28580 log.cc:927] Time spent T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:19:57.843590 24395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2174) took 1505 ms. Trace:
I20260709 12:19:57.843977 24395 rpcz_store.cc:276] 0709 12:19:56.337876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.445286 (+107410us) service_pool.cc:224] Handling call
0709 12:19:56.445669 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:57.478785 (+1033116us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:57.479319 (+   534us) log.cc:844] Serialized 14 byte log entry
0709 12:19:57.559160 (+ 79841us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:57.632233 (+ 73073us) log.cc:844] Serialized 26 byte log entry
0709 12:19:57.632412 (+   179us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:57.632696 (+   284us) log.cc:844] Serialized 14 byte log entry
0709 12:19:57.632933 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:57.633053 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:57.843286 (+210233us) raft_consensus.cc:1685] finished
0709 12:19:57.843303 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:57.843428 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1032181,"prepare.queue_time_us":22933,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":105,"raft.queue_time_us":1130511,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":342,"thread_start_us":79304,"threads_started":1,"wal-append.queue_time_us":203552}
I20260709 12:19:57.849325 24289 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:57.851497 28350 raft_consensus.cc:2749] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:57.851377 28437 consensus_queue.cc:1048] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:57.827771 24473 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:19:57.824189 28324 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:57.873989 28405 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.826831 28498 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:57.837940 28466 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:57.877920 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:19:57.882162 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 78374.6us
I20260709 12:19:57.880978 28521 raft_consensus.cc:2749] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:57.881259 28497 consensus_queue.cc:1059] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:19:57.834951 28110 consensus_queue.cc:260] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:57.909891 28110 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:57.912803 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:57.917546 24366 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:57.919243 28582 log.cc:927] Time spent T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.130s	user 0.001s	sys 0.003s
I20260709 12:19:57.919952 28461 raft_consensus.cc:2804] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:57.921082 24365 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:57.922451 27864 consensus_queue.cc:1059] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:57.924072 28459 raft_consensus.cc:3055] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:57.924558 28459 raft_consensus.cc:740] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:57.925758 28459 consensus_queue.cc:260] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:57.927460 28459 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:57.928426 25082 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:57.922647 24365 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:57.929248 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:57.930326 25115 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:57.931370 28503 consensus_queue.cc:1048] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:57.931638 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:57.933032 28428 consensus_queue.cc:1059] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:19:57.933507 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 195976us
I20260709 12:19:57.934266 28428 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:57.934988 28427 raft_consensus.cc:3055] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:57.923712 27864 raft_consensus.cc:2804] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:57.936838 28480 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.934999 24290 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:57.955003 28275 consensus_queue.cc:1059] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:57.956947 24320 raft_consensus.cc:1240] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:57.960139 24396 raft_consensus.cc:1275] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:19:57.955850 28422 consensus_queue.cc:1059] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:19:57.967757 28480 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:57.971004 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:57.971930 24318 raft_consensus.cc:1275] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:57.972401 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:57.973383 28569 raft_consensus.cc:2749] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:57.970559 28480 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:57.974177 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 59861.9us
I20260709 12:19:57.973779 24323 raft_consensus.cc:2393] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 8: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:19:57.974829 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:57.973804 24324 raft_consensus.cc:1240] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:57.964519 24396 pending_rounds.cc:85] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a: Aborting all ops after (but not including) 8
I20260709 12:19:57.973822 24322 raft_consensus.cc:1275] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:57.950217 28427 raft_consensus.cc:740] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:57.958913 27864 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:57.982385 24317 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:58.000494 24320 raft_consensus.cc:1275] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:19:57.975884 28450 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.005396 24396 pending_rounds.cc:107] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:19:58.006021 24396 raft_consensus.cc:2889] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:58.010094 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:57.900336 28405 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:58.014698 24440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:57.999544 27864 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:58.010094 25084 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:19:58.059993 24395 raft_consensus.cc:1275] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:19:58.062911 24472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2179) took 1103 ms. Trace:
I20260709 12:19:58.067798 24395 pending_rounds.cc:85] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a: Aborting all ops after (but not including) 5
W20260709 12:19:58.065860 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 137566us
W20260709 12:19:58.064587 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 99688.8us
I20260709 12:19:58.002172 28350 raft_consensus.cc:2749] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:57.965992 28498 consensus_queue.cc:1059] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 12:19:58.067934 24472 rpcz_store.cc:276] 0709 12:19:56.959637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.959798 (+   161us) service_pool.cc:224] Handling call
0709 12:19:57.815726 (+855928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:57.818002 (+  2276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:58.062597 (+244595us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b540029d450. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:19:58.062799 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1967409920}
I20260709 12:19:58.070488 24395 pending_rounds.cc:107] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:19:58.067368 28497 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.076364 28497 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:58.079171 24467 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
I20260709 12:19:58.075301 24395 raft_consensus.cc:2889] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:58.074333 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 139463us
I20260709 12:19:57.974335 28569 consensus_queue.cc:1048] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.095s
W20260709 12:19:58.089500 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.090325 28544 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:58.091538 28568 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:58.091629 28450 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:58.093129 28324 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:58.095268 28517 consensus_queue.cc:1048] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:58.100903 24365 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:19:58.108801 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 109656us
I20260709 12:19:58.109035 25110 raft_consensus.cc:1275] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:58.109431 28490 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:58.113114 28427 consensus_queue.cc:260] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:58.088377 28323 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:58.149748 24467 raft_consensus.cc:1275] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:58.150287 28323 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:58.122429 28405 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:58.106325 28293 consensus_queue.cc:1059] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:58.139454 25116 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:19:58.147264 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:58.148963 28544 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:58.149307 28490 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:58.151189 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:58.155159 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:58.153312 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 52745.4us
I20260709 12:19:58.157105 25082 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:58.163103 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:58.166790 24468 raft_consensus.cc:2393] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 11: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:58.141748 28461 raft_consensus.cc:697] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:19:58.220690 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 56895.2us
I20260709 12:19:58.223358 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2075) took 1260 ms. Trace:
I20260709 12:19:58.224881 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:58.227967 24472 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:19:58.228200 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:19:58.229010 24325 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:58.221455 28405 raft_consensus.cc:2749] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:58.247473 24467 raft_consensus.cc:2393] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:19:58.252426 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:58.262048 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:58.273020 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.273138 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:58.276279 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:58.280041 24395 raft_consensus.cc:2410] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 12:19:58.281224 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 137540us
I20260709 12:19:58.282991 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:58.259877 28428 raft_consensus.cc:697] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:58.279548 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:58.282123 25113 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:58.251259 28350 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:58.281312 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:58.287521 24320 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:19:58.292963 25083 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:58.302979 24471 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:19:58.304118 24472 raft_consensus.cc:1275] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:19:58.306753 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 175558us
I20260709 12:19:58.307193 28428 consensus_queue.cc:237] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:58.308413 28490 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:58.309257 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:58.309672 25082 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:58.311339 28405 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:58.311802 28508 raft_consensus.cc:2804] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:58.312168 25082 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:58.225186 24466 rpcz_store.cc:276] 0709 12:19:56.962562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.335779 (+373217us) service_pool.cc:224] Handling call
0709 12:19:57.336096 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:57.343863 (+  7767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:57.343910 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:57.347834 (+  3924us) log.cc:844] Serialized 26 byte log entry
0709 12:19:57.728406 (+380572us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b18003bd760. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a94241e07 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425ec02 00007f4a96ee620b 00007f4a96eebd23 00007f4a96eec0d1 00007f4a97307a0f
0709 12:19:57.894119 (+165713us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:58.143473 (+249354us) log.cc:844] Serialized 14 byte log entry
0709 12:19:58.148391 (+  4918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:58.157369 (+  8978us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:58.157424 (+    55us) raft_consensus.cc:1685] finished
0709 12:19:58.161799 (+  4375us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:58.223175 (+ 61376us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":51285,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":67,"raft.queue_time_us":13325,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":1269,"spinlock_wait_cycles":33529216,"thread_start_us":231311,"threads_started":2,"wal-append.queue_time_us":763524}
I20260709 12:19:58.312778 28508 raft_consensus.cc:697] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:19:58.318367 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:58.294206 28427 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:58.321754 24472 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
I20260709 12:19:58.323639 28468 consensus_queue.cc:1048] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:58.324426 28508 consensus_queue.cc:237] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:58.327194 28519 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.327710 28490 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.347411 28490 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:58.349908 24470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2076) took 1212 ms. Trace:
I20260709 12:19:58.351082 28490 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:58.351759 28490 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:19:58.352830 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.353029 28519 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:58.353549 28323 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:58.328581 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:58.331580 24317 raft_consensus.cc:1240] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:58.324471 28450 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:58.343649 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:58.337371 28404 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:58.364939 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:58.365432 28589 log.cc:927] Time spent T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.378s	user 0.003s	sys 0.000s
I20260709 12:19:58.365825 24394 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:19:58.368960 28347 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:58.369210 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:58.369772 28347 consensus_queue.cc:1059] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:19:58.370079 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 58091.5us
I20260709 12:19:58.371088 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:58.371958 25116 raft_consensus.cc:2393] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 10: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:58.352320 28490 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:58.322052 28480 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:58.354972 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:58.358300 28461 consensus_queue.cc:237] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:58.362787 28519 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:58.363696 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:58.365837 25110 raft_consensus.cc:1240] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:58.384775 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:58.390416 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:19:58.350507 24470 rpcz_store.cc:276] 0709 12:19:57.137966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.764193 (+626227us) service_pool.cc:224] Handling call
0709 12:19:57.794521 (+ 30328us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:57.888860 (+ 94339us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:19:57.903887 (+ 15027us) log.cc:844] Serialized 14 byte log entry
0709 12:19:58.224243 (+320356us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:58.228099 (+  3856us) log.cc:844] Serialized 52 byte log entry
0709 12:19:58.228519 (+   420us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:58.228554 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:58.228619 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:58.349547 (+120928us) raft_consensus.cc:1685] finished
0709 12:19:58.349581 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:58.349821 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":190930,"prepare.queue_time_us":11230,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":72,"raft.queue_time_us":91226,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":8705,"thread_start_us":220517,"threads_started":1,"wal-append.queue_time_us":356407}
W20260709 12:19:58.391963 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 105243us
I20260709 12:19:58.378473 28480 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.403298 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:58.400285 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:58.381096 28450 raft_consensus.cc:3055] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:58.409622 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:58.413625 24395 raft_consensus.cc:1275] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:58.414116 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:58.414851 24396 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:19:58.341600 28350 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:58.413221 24397 raft_consensus.cc:1240] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:58.420400 25110 raft_consensus.cc:2393] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 9: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:58.411366 28480 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:58.435271 25083 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:58.423689 24440 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:58.416528 28450 raft_consensus.cc:740] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:19:58.395603 28569 consensus_queue.cc:1059] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:19:58.442996 24289 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:58.422164 24290 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:58.443786 24393 raft_consensus.cc:1275] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:58.443926 24321 raft_consensus.cc:1240] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:58.449849 24317 raft_consensus.cc:1275] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:58.433566 28604 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.451654 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:58.454056 28609 log.cc:927] Time spent T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:19:58.454416 28610 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.456544 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:58.460927 28519 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:58.461494 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:58.464844 28490 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:58.469023 28323 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:58.469781 28323 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:58.474622 28610 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:58.486054 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 61524us
I20260709 12:19:58.516831 28604 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:58.521786 28605 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:58.522375 28605 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.522742 28605 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:58.524890 24395 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:58.530776 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:58.531579 24397 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:19:58.543516 28450 consensus_queue.cc:260] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:58.544999 28450 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:58.600764 28497 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:58.606168 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 163302us
W20260709 12:19:58.607983 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 188516us
W20260709 12:19:58.616336 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 220675us
I20260709 12:19:58.623952 24440 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:19:58.627660 28615 raft_consensus.cc:2749] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:58.628782 28604 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:58.661883 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:58.673993 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 114945us
I20260709 12:19:58.674429 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:58.651721 28490 raft_consensus.cc:2749] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:58.679137 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:19:58.682948 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:19:58.669065 28466 consensus_meta.cc:287] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.784s	user 0.013s	sys 0.009s
W20260709 12:19:58.689795 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 76463.7us
W20260709 12:19:58.682770 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 58962.9us
I20260709 12:19:58.660876 28323 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:58.692677 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:58.696147 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 286073us
I20260709 12:19:58.707424 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:58.686969 28437 raft_consensus.cc:2804] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:58.705926 24440 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:19:58.715802 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:19:58.714344 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.682252 28350 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:58.734354 24325 consensus_meta.cc:287] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.505s	user 0.026s	sys 0.016s
I20260709 12:19:58.735260 24325 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:19:58.718142 28323 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.757913 24290 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:58.768090 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:58.768898 24394 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:19:58.769850 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:58.771073 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:58.772328 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:58.732753 28544 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:58.756973 28422 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.010s	sys 0.005s
I20260709 12:19:58.765331 28610 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:58.736845 28437 raft_consensus.cc:697] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:58.776077 24289 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:19:58.784199 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:19:58.778529 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 273108us
I20260709 12:19:58.763507 28519 raft_consensus.cc:2804] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:58.790145 24397 raft_consensus.cc:1275] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:19:58.789007 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 53913us
W20260709 12:19:58.776652 28422 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.011s	sys 0.006s
I20260709 12:19:58.796155 24467 raft_consensus.cc:2368] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 9. Current term is 10.
I20260709 12:19:58.797968 24289 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:19:58.800040 28610 raft_consensus.cc:2804] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:58.800453 28610 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:58.800859 28610 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:58.801493 25110 raft_consensus.cc:1240] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:58.803131 28604 consensus_queue.cc:1048] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:58.804528 25116 raft_consensus.cc:1275] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:19:58.809679 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.784915 28498 raft_consensus.cc:2749] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:58.814046 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:58.817703 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:58.819583 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:58.780675 28323 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:58.824445 28323 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:58.825206 28437 consensus_queue.cc:237] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:58.788491 28519 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:58.783263 28350 consensus_queue.cc:1048] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 12:19:58.828830 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:58.830349 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 104013us
I20260709 12:19:58.822296 24397 raft_consensus.cc:2410] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:19:58.831846 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:58.774500 28616 consensus_queue.cc:1048] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 12:19:58.837065 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:58.785241 28544 consensus_queue.cc:1048] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:19:58.828915 28519 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:58.843448 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:58.846482 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:58.847251 24467 raft_consensus.cc:2410] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:19:58.842649 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:58.828408 27864 consensus_meta.cc:287] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.753s	user 0.011s	sys 0.026s
I20260709 12:19:58.845129 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:19:58.861903 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 62920.3us
I20260709 12:19:58.848943 28498 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.865176 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:58.866134 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:19:58.866976 28522 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:58.867542 28635 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.855176 27864 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:58.873492 28635 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:58.874716 24290 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:58.875379 27864 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:58.876209 24391 raft_consensus.cc:1240] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:58.877707 24399 raft_consensus.cc:1275] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:58.878995 28522 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:58.880752 28614 raft_consensus.cc:2804] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:58.881268 28614 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.881448 28522 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:58.881744 28614 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:58.882210 28522 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.882718 28522 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:58.884850 24466 raft_consensus.cc:1275] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:58.886233 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:58.886792 28350 consensus_queue.cc:1048] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:58.886983 28617 consensus_queue.cc:1048] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 12:19:58.884764 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:19:58.891567 24471 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:19:58.868710 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:19:58.875974 24290 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:19:58.886840 24466 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:19:58.895927 24290 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:19:58.903522 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:58.904083 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.858247 28323 consensus_queue.cc:1059] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
W20260709 12:19:58.896804 28619 log.cc:927] Time spent T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:19:58.907753 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:58.913575 24469 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:58.894434 28350 raft_consensus.cc:2749] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:58.876006 28635 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:58.888616 28617 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:19:58.946008 28617 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:58.944211 24394 raft_consensus.cc:3055] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:58.950098 24394 raft_consensus.cc:740] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:19:58.965524 28624 log.cc:927] Time spent T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:19:58.971401 28637 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:58.972450 28522 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:58.983179 28480 consensus_meta.cc:287] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.538s	user 0.009s	sys 0.007s
I20260709 12:19:58.983718 28480 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:58.984938 25113 raft_consensus.cc:2393] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 12: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:58.985422 24365 leader_election.cc:400] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Vote denied by peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453) with higher term. Message: Invalid argument: T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 9. Current term is 10.
W20260709 12:19:58.985538 28584 log.cc:927] Time spent T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 1.137s	user 0.000s	sys 0.007s
I20260709 12:19:58.985816 28617 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:58.985855 24365 leader_election.cc:403] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:58.986989 28614 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:58.989876 28605 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:58.990418 28614 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:58.991211 25117 raft_consensus.cc:2393] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 12: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:19:58.994542 28519 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:19:58.960301 28625 log.cc:927] Time spent T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:19:58.996438 24469 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:19:58.996817 24468 raft_consensus.cc:1240] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:58.997080 27864 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:19:58.998652 28519 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:19:58.999325 28605 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:58.902340 28498 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:58.984812 28466 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.956804 28497 raft_consensus.cc:2749] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:58.953581 28526 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.008589 28480 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:59.010900 28610 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:58.955631 28404 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.955861 28428 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.018386 28466 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:59.038688 28428 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:59.037537 28526 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:59.046187 28427 consensus_meta.cc:287] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.707s	user 0.003s	sys 0.019s
I20260709 12:19:59.041684 28468 raft_consensus.cc:3055] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:59.040591 28466 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:59.097208 28468 raft_consensus.cc:740] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
W20260709 12:19:59.125469 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 261995us
W20260709 12:19:59.139972 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:59.121847 28450 consensus_meta.cc:287] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.008s
I20260709 12:19:59.095854 28404 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:59.152845 24472 raft_consensus.cc:1275] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:19:59.200647 24440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:59.208986 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:59.254910 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:59.295939 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 141528us
I20260709 12:19:59.306113 28641 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:59.145004 28617 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:59.323318 28641 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:59.323820 28428 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:59.509740 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 164110us
I20260709 12:19:59.567803 28450 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:59.568782 28450 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:59.569132 28522 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:59.570063 28522 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:59.572971 28642 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:19:59.573755 28642 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:59.576839 28639 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:59.577551 28639 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:59.505854 28610 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:59.341248 28468 consensus_queue.cc:260] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:19:59.644217 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:59.694382 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:59.836479 28450 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:59.881610 28640 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:19:59.882302 28640 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:59.882622 28641 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:19:59.884758 28639 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:59.576525 28642 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:19:59.888016 28654 log.cc:927] Time spent T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:19:59.889531 28526 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:59.837568 28498 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:59.895377 27864 consensus_meta.cc:287] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.898s	user 0.013s	sys 0.000s
I20260709 12:19:59.896241 27864 raft_consensus.cc:2749] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453) with higher term. Message: Invalid argument: T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 9. Current term is 10.
I20260709 12:19:59.331215 28617 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:19:59.837000 28404 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:19:59.905323 24469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.052s	sys 0.077s
W20260709 12:19:59.906105 24469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.052s	sys 0.077s
I20260709 12:19:59.912005 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2205) took 1010 ms. Trace:
I20260709 12:19:59.899585 28617 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:59.917757 24467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.009s	sys 0.012s
W20260709 12:19:59.918615 24467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.009s	sys 0.012s
I20260709 12:19:59.908341 28640 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:19:59.922214 25114 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.010s	sys 0.020s
W20260709 12:19:59.923303 25114 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.011s	sys 0.021s
I20260709 12:19:59.919728 28522 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:19:59.925590 25114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48252 (request call id 594) took 1059 ms. Trace:
W20260709 12:19:59.933080 28652 log.cc:927] Time spent T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.426s	user 0.000s	sys 0.002s
I20260709 12:19:59.933708 28324 raft_consensus.cc:3055] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:59.934216 28324 raft_consensus.cc:740] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:19:59.935179 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2204) took 1042 ms. Trace:
I20260709 12:19:59.935420 28324 consensus_queue.cc:260] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:19:59.935639 24466 rpcz_store.cc:276] 0709 12:19:58.892948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.913906 (+ 20958us) service_pool.cc:224] Handling call
0709 12:19:58.951361 (+ 37455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:59.004101 (+ 52740us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:59.004661 (+   560us) log.cc:844] Serialized 14 byte log entry
0709 12:19:59.128050 (+123389us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:59.256143 (+128093us) log.cc:844] Serialized 26 byte log entry
0709 12:19:59.256329 (+   186us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:59.256376 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:59.256470 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:59.934906 (+678436us) raft_consensus.cc:1685] finished
0709 12:19:59.934930 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:59.935102 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7999,"prepare.queue_time_us":1670,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":60,"raft.queue_time_us":53481,"raft.run_cpu_time_us":378,"raft.run_wall_time_us":16871,"thread_start_us":117408,"threads_started":1,"wal-append.queue_time_us":497621}
I20260709 12:19:59.938539 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:19:59.939513 24466 raft_consensus.cc:2393] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 12: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:19:59.926209 25114 rpcz_store.cc:276] 0709 12:19:58.866430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.866569 (+   139us) service_pool.cc:224] Handling call
0709 12:19:58.888935 (+ 22366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:58.889175 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:19:59.111960 (+222785us) log.cc:844] Serialized 14 byte log entry
0709 12:19:59.269195 (+157235us) log.cc:844] Serialized 14 byte log entry
0709 12:19:59.924091 (+654896us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:59.924174 (+    83us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:59.924741 (+   567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:59.925240 (+   499us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:59.925453 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110757,"prepare.queue_time_us":511847,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":77,"raft.queue_time_us":202257,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":278,"thread_start_us":900541,"threads_started":3,"wal-append.queue_time_us":237197}
I20260709 12:19:59.955819 24467 raft_consensus.cc:1275] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:59.956300 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:19:59.957530 25084 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.012s	sys 0.052s
W20260709 12:19:59.958037 25084 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.012s	sys 0.052s
W20260709 12:19:59.976259 28275 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.946s	user 0.008s	sys 0.027s
W20260709 12:19:59.998705 28275 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.986s	user 0.008s	sys 0.027s
W20260709 12:19:59.997345 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 171278us
I20260709 12:19:59.980770 28324 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:00.325642 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:00.384105 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:00.385596 28640 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.383759 28642 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:00.392577 28642 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:00.388402 28651 log.cc:927] Time spent T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.460s	user 0.000s	sys 0.001s
I20260709 12:20:00.390291 28640 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:00.471269 28640 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:00.478156 28642 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:00.500211 28653 log.cc:927] Time spent T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.479s	user 0.000s	sys 0.001s
I20260709 12:20:00.522593 28642 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.523823 28642 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:00.698247 28640 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.699074 28640 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:00.702077 28640 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:00.471331 28637 consensus_meta.cc:287] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.499s	user 0.017s	sys 0.000s
I20260709 12:20:00.761379 28637 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:00.779057 28642 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:00.783111 24438 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:00.786909 28639 raft_consensus.cc:2749] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:00.820990 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:00.900153 28504 raft_consensus.cc:3055] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:00.900874 28504 raft_consensus.cc:740] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:00.901921 28504 consensus_queue.cc:260] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:00.903534 28504 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:00.906586 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:00.919099 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 136179us
I20260709 12:20:00.937069 28272 raft_consensus.cc:3055] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:00.978772 28272 raft_consensus.cc:740] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:20:00.969552 24395 consensus_meta.cc:287] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 2.444s	user 0.021s	sys 0.020s
I20260709 12:20:00.975173 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2202) took 2028 ms. Trace:
I20260709 12:20:00.962352 28521 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.979693 24468 rpcz_store.cc:276] 0709 12:19:58.884589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.885432 (+   843us) service_pool.cc:224] Handling call
0709 12:19:58.885773 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:58.997175 (+111402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:00.912181 (+1915006us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b540010ed54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:00.912524 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254928768}
I20260709 12:20:00.980299 28521 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:00.982156 28347 consensus_queue.cc:1048] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:00.982941 28521 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:00.979553 24395 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
W20260709 12:20:00.983788 24395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2572) took 2532 ms (client timeout 1776 ms). Trace:
W20260709 12:20:00.983955 28324 consensus_meta.cc:287] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.905s	user 0.005s	sys 0.005s
W20260709 12:20:00.980028 25113 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35194 (request call id 612) took 2616 ms (client timeout 2096 ms). Trace:
W20260709 12:20:00.984716 25113 rpcz_store.cc:269] 0709 12:19:58.363718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.380869 (+ 17151us) service_pool.cc:224] Handling call
0709 12:20:00.979770 (+2598901us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b540072f454. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:00.979915 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1365239040}
W20260709 12:20:00.984203 24395 rpcz_store.cc:269] 0709 12:19:58.451073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.451321 (+   248us) service_pool.cc:224] Handling call
0709 12:20:00.983689 (+2532368us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:00.989500 24438 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:00.991245 28521 raft_consensus.cc:2804] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:00.991654 28521 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:00.991976 28521 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:00.979853 28272 consensus_queue.cc:260] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:00.994403 24438 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:00.996447 24438 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:01.000850 28642 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:01.001621 28642 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:01.002147 28642 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:01.002630 28642 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:01.008601 28490 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:20:01.009825 24438 connection.cc:256] RPC call timeout handler was delayed by -1.0899023070001022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
I20260709 12:20:01.009965 28640 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:01.010679 28617 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:01.010766 28640 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:01.011344 28617 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:01.009300 28490 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:01.013419 24319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 636) took 3999 ms. Trace:
I20260709 12:20:01.011566 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2072) took 4049 ms. Trace:
I20260709 12:20:01.014493 28490 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:01.013381 28617 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:01.013386 28640 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:01.014074 24319 rpcz_store.cc:276] 0709 12:19:57.013686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.013885 (+   199us) service_pool.cc:224] Handling call
0709 12:19:57.014313 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:57.017746 (+  3433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:57.017788 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:57.591136 (+573348us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b2c000dd788. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a95c45a11 00007f4a95c55372 00007f4a97387a01 00007f4a9734c43a 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2
0709 12:19:57.592069 (+   933us) log.cc:844] Serialized 26 byte log entry
0709 12:19:57.675462 (+ 83393us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:57.680003 (+  4541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:57.691929 (+ 11926us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:58.737966 (+1046037us) spinlock_profiling.cc:243] Waited 7.7 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:20:01.013034 (+2275068us) raft_consensus.cc:1685] finished
0709 12:20:01.013056 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:01.013242 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2909,"raft.queue_time_us":38447,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":6322,"spinlock_wait_cycles":67915904,"thread_start_us":61694,"threads_started":1,"wal-append.queue_time_us":145582,"wal-append.run_cpu_time_us":8787,"wal-append.run_wall_time_us":2243092}
I20260709 12:20:01.014844 24465 rpcz_store.cc:276] 0709 12:19:56.961655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.295824 (+334169us) service_pool.cc:224] Handling call
0709 12:19:57.886479 (+590655us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:57.949949 (+ 63470us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:57.950003 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:58.015488 (+ 65485us) log.cc:844] Serialized 26 byte log entry
0709 12:19:58.260967 (+245479us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:58.261016 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:58.269252 (+  8236us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:58.463996 (+194744us) raft_consensus.cc:1685] finished
0709 12:19:58.464020 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:01.011114 (+2547094us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b540030dc50. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:01.011378 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":61628,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":131,"spinlock_wait_cycles":1311204224,"thread_start_us":159654,"threads_started":1,"wal-append.queue_time_us":362496,"wal-append.run_cpu_time_us":2293,"wal-append.run_wall_time_us":1062279}
I20260709 12:20:01.022377 28642 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:01.026520 28642 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:01.037592 28497 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:01.040863 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:01.043154 25113 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:20:01.045774 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:01.048226 25110 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:01.049643 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:01.054107 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:01.055518 25115 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:20:01.059077 28504 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:01.061031 28504 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:01.043715 28497 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:01.069505 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:01.071638 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:01.069289 28637 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.072971 24319 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:20:01.073127 28637 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:01.073522 28504 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:01.065126 28642 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.074131 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:01.075209 28613 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:01.076109 28497 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:01.067647 28615 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.066807 28324 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.087271 28615 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:01.078128 28637 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:01.085568 28613 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:01.089038 24321 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:20:01.080014 28526 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.087329 28324 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:01.081888 24319 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:01.091113 25110 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:20:01.090524 28526 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:01.093560 28324 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:01.094484 28526 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:01.096004 28613 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:01.096724 28642 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:01.098348 28615 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:01.099218 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:01.100164 28642 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:01.103823 28421 raft_consensus.cc:3055] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:01.100596 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:01.107692 24319 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:20:01.104485 28421 raft_consensus.cc:740] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:01.118075 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:01.118659 24319 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:01.120486 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:01.115471 28421 consensus_queue.cc:260] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:01.125428 28421 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:01.122160 24465 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 12.
I20260709 12:20:01.122406 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:01.129376 24468 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:20:01.110888 28615 consensus_queue.cc:1048] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
W20260709 12:20:01.146803 24392 consensus_meta.cc:287] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 2.749s	user 0.020s	sys 0.028s
I20260709 12:20:01.147535 24392 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
W20260709 12:20:01.151438 24365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.164s	user 0.015s	sys 0.022s
W20260709 12:20:01.154889 24365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.167s	user 0.016s	sys 0.022s
W20260709 12:20:01.154772 24438 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.522s (SENT) [suppressed 18 similar messages]
W20260709 12:20:01.155728 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 2.17035e+06us
W20260709 12:20:01.159853 24438 leader_election.cc:336] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.570s (SENT)
W20260709 12:20:01.160141 28623 log.cc:927] Time spent T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 2.387s	user 0.019s	sys 0.012s
I20260709 12:20:01.160360 24438 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:01.161689 24438 leader_election.cc:336] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.572s (SENT)
I20260709 12:20:01.161763 24365 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:01.162086 24438 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:01.162845 28599 consensus_queue.cc:1048] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:01.162930 24365 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:01.163635 28599 consensus_queue.cc:1243] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer 99b8650fa8324ac2ac5f75eee9b1a1e3 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:20:01.164502 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:01.165130 28599 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:01.165625 28599 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:01.165908 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:01.166019 28599 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:01.164512 24365 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:01.172106 28642 raft_consensus.cc:2749] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:01.172147 28454 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:01.175287 28454 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:01.175695 28454 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:01.176352 28521 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:01.177047 28421 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:01.169176 28669 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.184520 28640 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:20:01.191076 24438 leader_election.cc:336] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.681s (SENT)
I20260709 12:20:01.191601 24438 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:01.192499 28640 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:20:01.193946 25117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 593) took 2330 ms (client timeout 1953 ms). Trace:
W20260709 12:20:01.194386 25117 rpcz_store.cc:269] 0709 12:19:58.863156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.868399 (+  5243us) service_pool.cc:224] Handling call
0709 12:20:01.193710 (+2325311us) spinlock_profiling.cc:243] Waited 98.7 ms on lock 0x7b54004ad154. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:01.193867 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227000576}
W20260709 12:20:01.200950 24438 leader_election.cc:336] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.698s (SENT)
I20260709 12:20:01.201478 24438 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:01.202524 28640 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:01.202796 24438 leader_election.cc:336] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.788s (SENT)
I20260709 12:20:01.203333 24438 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:01.205020 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:01.205694 24325 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:01.213860 28640 raft_consensus.cc:2749] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:01.209183 28669 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:01.238062 24366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:01.241546 24366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:01.222955 28673 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.274365 28521 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:01.275707 28669 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:01.278594 28673 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:01.233147 28454 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:01.288430 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 102026us
I20260709 12:20:01.294036 28673 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:01.297353 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 49744.4us
I20260709 12:20:01.309450 24319 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:20:01.316298 24366 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:01.318929 28682 consensus_queue.cc:1059] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:01.324507 28681 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:01.325395 28681 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:01.326467 24366 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:01.327106 28686 raft_consensus.cc:2749] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:01.329879 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 71927.6us
I20260709 12:20:01.328071 28681 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:01.335386 28681 raft_consensus.cc:2804] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:01.335843 28681 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:01.336207 28681 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:01.308528 28599 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:01.342022 28272 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:01.345249 28454 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:01.347308 28599 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:01.351559 24393 raft_consensus.cc:1240] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:01.323796 28421 raft_consensus.cc:697] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:01.328053 28686 raft_consensus.cc:3055] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:01.356705 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2574) took 2733 ms. Trace:
I20260709 12:20:01.361824 28686 raft_consensus.cc:740] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:20:01.358892 24392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2568) took 3003 ms (client timeout 1681 ms). Trace:
W20260709 12:20:01.362502 24392 rpcz_store.cc:269] 0709 12:19:58.355674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.355855 (+   181us) service_pool.cc:224] Handling call
0709 12:20:01.358634 (+3002779us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b54000e47d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:01.358791 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35501952}
I20260709 12:20:01.362972 28686 consensus_queue.cc:260] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:01.362080 24393 rpcz_store.cc:276] 0709 12:19:58.621172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.621480 (+   308us) service_pool.cc:224] Handling call
0709 12:19:58.629702 (+  8222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:01.352098 (+2722396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:01.353775 (+  1677us) spinlock_profiling.cc:243] Waited 2.72 s on lock 0x7b54001a6654. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:01.354091 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6259113344}
I20260709 12:20:01.364940 28421 consensus_queue.cc:237] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:01.375141 28272 consensus_queue.cc:1048] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:01.377170 24366 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:01.378888 24366 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:01.379050 28683 raft_consensus.cc:2804] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:01.379535 28683 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:01.380090 28683 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:01.379557 24316 raft_consensus.cc:1275] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:20:01.381009 28685 raft_consensus.cc:2749] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:01.381312 24316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 649) took 2481 ms. Trace:
I20260709 12:20:01.381757 24316 rpcz_store.cc:276] 0709 12:19:58.899651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.899790 (+   139us) service_pool.cc:224] Handling call
0709 12:19:58.955701 (+ 55911us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:01.381039 (+2425338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:01.381255 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:01.382618 28498 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.383203 28498 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:01.390136 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:01.392248 24472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2199) took 2508 ms. Trace:
I20260709 12:20:01.392619 24472 rpcz_store.cc:276] 0709 12:19:58.883660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.888754 (+  5094us) service_pool.cc:224] Handling call
0709 12:19:58.889123 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:59.153487 (+264364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:01.391930 (+2238443us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54000334d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:01.392175 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":605223808}
I20260709 12:20:01.393226 28681 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:01.388314 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2196) took 3027 ms. Trace:
I20260709 12:20:01.397379 24391 rpcz_store.cc:276] 0709 12:19:58.361059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.361204 (+   145us) service_pool.cc:224] Handling call
0709 12:19:58.368767 (+  7563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:58.876733 (+507966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:01.388016 (+2511283us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b54000e42d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:01.388243 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1166529408}
I20260709 12:20:01.398129 24366 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:01.401088 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 95197.9us
I20260709 12:20:01.400563 28681 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:01.427174 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:01.408404 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:01.408664 24366 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:01.409260 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:01.409850 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:01.410388 28272 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.409299 28687 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:01.397285 28685 consensus_queue.cc:1048] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:20:01.411755 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:01.434653 28685 raft_consensus.cc:2804] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:01.435248 28685 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:01.435600 28685 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:01.412295 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:01.437223 24398 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:20:01.438416 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:01.439592 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:01.412915 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:01.413062 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:01.413766 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:01.414330 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:01.442996 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:01.443351 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:01.444149 24316 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:20:01.414454 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:01.415009 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:01.444900 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:01.420861 28612 consensus_queue.cc:1048] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:01.445438 24397 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:20:01.445675 28612 consensus_queue.cc:1243] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer 99b8650fa8324ac2ac5f75eee9b1a1e3 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:20:01.446431 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:19:58.956418 24394 consensus_queue.cc:260] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:01.447003 24397 raft_consensus.cc:2376] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12. Re-sending same reply.
I20260709 12:20:01.447526 24394 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:01.447350 28270 consensus_queue.cc:1048] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:01.448035 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:01.448984 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:01.449225 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:01.449735 24465 raft_consensus.cc:2393] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 10: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:01.449904 24319 raft_consensus.cc:2393] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 7: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:20:01.417524 28647 log.cc:927] Time spent T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 2.053s	user 0.021s	sys 0.002s
I20260709 12:20:01.424186 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:01.451149 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:01.451630 24399 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:20:01.451786 24395 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:01.452294 24470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 892) took 2845 ms. Trace:
I20260709 12:20:01.452718 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:01.453739 24399 raft_consensus.cc:2393] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 8: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:01.452695 24470 rpcz_store.cc:276] 0709 12:19:58.606857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.607098 (+   241us) service_pool.cc:224] Handling call
0709 12:19:58.621951 (+ 14853us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:58.627110 (+  5159us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:19:58.755977 (+128867us) log.cc:844] Serialized 14 byte log entry
0709 12:19:59.119698 (+363721us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:59.130613 (+ 10915us) log.cc:844] Serialized 26 byte log entry
0709 12:19:59.130759 (+   146us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:59.130791 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:59.130861 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:01.416736 (+2285875us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:20:01.451975 (+ 35239us) raft_consensus.cc:1685] finished
0709 12:20:01.452106 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:01.452235 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9794,"prepare.queue_time_us":441,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":16747,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":20188,"spinlock_wait_cycles":314569088,"thread_start_us":459438,"threads_started":2,"wal-append.queue_time_us":375958}
I20260709 12:20:01.454593 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:01.455478 24470 raft_consensus.cc:1275] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:01.455747 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:01.456382 24399 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:01.427232 24290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.515s	user 0.007s	sys 0.027s
W20260709 12:20:01.470744 24290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.559s	user 0.008s	sys 0.028s
I20260709 12:20:01.431161 24472 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:01.471397 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 2.57533e+06us
I20260709 12:20:01.431143 24468 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:20:01.432909 28272 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:20:01.445042 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:01.441833 24393 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:20:01.428072 24473 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:20:01.457043 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:01.434706 28600 raft_consensus.cc:3055] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:20:01.456861 28632 consensus_queue.cc:1175] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" responder_term: 11 status { last_received { term: 11 index: 11 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:20:01.458688 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:01.429373 24467 pending_rounds.cc:85] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 5
I20260709 12:20:01.482765 24467 pending_rounds.cc:107] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:20:01.466250 28659 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.483012 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:01.483047 24467 raft_consensus.cc:2889] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:01.466951 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:01.472158 24290 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:01.473376 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:01.474083 25083 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:01.485785 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:01.477617 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:01.478318 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:01.486660 24398 raft_consensus.cc:2410] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:20:01.477612 24392 raft_consensus.cc:2410] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:20:01.481261 24391 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:20:01.487484 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:01.488516 25114 raft_consensus.cc:2393] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 11: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:01.485013 24395 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:20:01.489149 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:01.489866 24321 raft_consensus.cc:2468] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:20:01.497092 24465 pending_rounds.cc:85] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 6
I20260709 12:20:01.497924 28569 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:02.613957 28569 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.614485 28569 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:01.516189 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:01.517619 24393 raft_consensus.cc:2410] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:20:02.617597 24325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 2055) took 1102 ms. Trace:
I20260709 12:20:02.617758 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 633) took 1158 ms. Trace:
I20260709 12:20:02.618125 24325 rpcz_store.cc:276] 0709 12:20:01.514957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.515853 (+   896us) service_pool.cc:224] Handling call
0709 12:20:02.617495 (+1101642us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:02.618486 24393 rpcz_store.cc:276] 0709 12:20:01.459300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.473117 (+ 13817us) service_pool.cc:224] Handling call
0709 12:20:02.617624 (+1144507us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:02.619741 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:02.620028 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:01.522603 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:01.522555 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:02.621104 24393 raft_consensus.cc:2393] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 10: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:02.621234 24398 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:02.621462 24318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2418) took 1136 ms. Trace:
I20260709 12:20:02.621629 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2607) took 1205 ms. Trace:
I20260709 12:20:02.621896 24318 rpcz_store.cc:276] 0709 12:20:01.484946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.489052 (+  4106us) service_pool.cc:224] Handling call
0709 12:20:02.621396 (+1132344us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:02.622159 24393 rpcz_store.cc:276] 0709 12:20:01.416622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.619735 (+1203113us) service_pool.cc:224] Handling call
0709 12:20:02.621561 (+  1826us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:02.623369 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:02.623730 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:02.624900 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:01.527726 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:02.625617 24325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 2061) took 1084 ms. Trace:
I20260709 12:20:02.626019 24325 rpcz_store.cc:276] 0709 12:20:01.540891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.619428 (+1078537us) service_pool.cc:224] Handling call
0709 12:20:02.625554 (+  6126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:01.494213 28659 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:02.628334 28659 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:01.531596 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:20:01.517206 28688 consensus_queue.cc:1175] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d99d5d772cfe4a96afcab3d3b009a281" responder_term: 10 status { last_received { term: 9 index: 10 } last_committed_idx: 9 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:20:01.542227 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:02.629247 24321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 2057) took 1113 ms. Trace:
I20260709 12:20:02.629463 24400 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:20:02.629685 24321 rpcz_store.cc:276] 0709 12:20:01.515740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.526589 (+ 10849us) service_pool.cc:224] Handling call
0709 12:20:02.629184 (+1102595us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:02.630076 24400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2611) took 1212 ms. Trace:
I20260709 12:20:02.630460 24400 rpcz_store.cc:276] 0709 12:20:01.417809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.442769 (+ 24960us) service_pool.cc:224] Handling call
0709 12:20:01.542044 (+ 99275us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b58001c9e98. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c3120a0 00007f4a9c311984 00007f4a9588c6d4 00007f4a9588c662
0709 12:20:02.630019 (+1087975us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4008320}
I20260709 12:20:02.630857 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:02.631512 24321 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
I20260709 12:20:02.631569 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:02.632423 24400 raft_consensus.cc:2393] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 10: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:01.523854 28683 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:02.080845 28646 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:02.652757 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:02.653079 28646 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:02.655741 28646 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:01.520744 28685 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:02.658869 28685 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:02.310576 24319 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.839s	user 0.004s	sys 0.008s
I20260709 12:20:02.373978 28686 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:02.659646 24319 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.188s	user 0.004s	sys 0.008s
I20260709 12:20:02.385210 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:02.663810 28437 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.416442 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:02.420027 28497 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.664587 28437 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:02.665257 28497 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:02.429745 24366 connection.cc:256] RPC call timeout handler was delayed by -2.1869500020002306s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
W20260709 12:20:02.668069 24366 connection.cc:256] RPC call timeout handler was delayed by -2.0762500020000516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1623s for a response
W20260709 12:20:02.668499 24366 connection.cc:256] RPC call timeout handler was delayed by -2.0411500020002222s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16620000000000001s for a response
W20260709 12:20:02.668869 24366 connection.cc:256] RPC call timeout handler was delayed by -2.0267500020001989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
I20260709 12:20:02.669103 28613 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:02.669214 24366 connection.cc:256] RPC call timeout handler was delayed by -1.6253500020002321s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21240000000000003s for a response
W20260709 12:20:02.669756 24366 connection.cc:256] RPC call timeout handler was delayed by -1.1771500020001895s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2622s for a response
I20260709 12:20:02.669785 28613 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:02.660559 24319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 2049) took 1198 ms. Trace:
I20260709 12:20:02.430279 28691 consensus_queue.cc:1048] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:02.431941 28687 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.672531 28613 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:02.673311 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:02.673846 28437 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:02.674362 24468 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:20:02.442126 24324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 647) took 4000 ms. Trace:
I20260709 12:20:02.452306 24470 raft_consensus.cc:1240] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:20:02.677215 24470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2223) took 1196 ms. Trace:
I20260709 12:20:02.677870 24470 rpcz_store.cc:276] 0709 12:20:01.481019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.481209 (+   190us) service_pool.cc:224] Handling call
0709 12:20:02.451900 (+970691us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:02.676890 (+224990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.677151 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:02.458889 28498 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:02.679296 28450 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.679867 28450 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:02.461429 24471 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.010s	user 0.008s	sys 0.019s
I20260709 12:20:01.490938 28324 raft_consensus.cc:2804] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:01.482184 28600 raft_consensus.cc:740] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:20:02.681262 24471 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.230s	user 0.008s	sys 0.020s
I20260709 12:20:02.466038 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:02.682260 28600 consensus_queue.cc:260] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:02.529379 24421 debug-util.cc:398] Leaking SignalData structure 0x7b0800324dc0 after lost signal to thread 23154
I20260709 12:20:02.683509 28600 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:02.684186 24421 debug-util.cc:398] Leaking SignalData structure 0x7b080024bb60 after lost signal to thread 24257
I20260709 12:20:02.512174 28110 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:02.684954 28110 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:02.685815 24421 debug-util.cc:398] Leaking SignalData structure 0x7b08003af260 after lost signal to thread 24349
W20260709 12:20:02.686157 24421 debug-util.cc:398] Leaking SignalData structure 0x7b08003af240 after lost signal to thread 24350
I20260709 12:20:02.531340 28612 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:02.687484 28110 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:02.531755 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:02.689009 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.565653 24394 raft_consensus.cc:1275] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 12:20:02.690109 24394 pending_rounds.cc:85] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a: Aborting all ops after (but not including) 10
I20260709 12:20:02.690408 24394 pending_rounds.cc:107] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 12:20:02.690485 28237 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.566596 28526 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.691298 28237 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:02.691519 28526 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:02.566982 28521 consensus_queue.cc:1048] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:02.693742 28521 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.694180 28526 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:02.573001 28628 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.694298 28521 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:02.695165 28628 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:02.577657 28504 raft_consensus.cc:2955] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Committing config change with OpId 5.6: config changed from index 4 to 6, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:02.697845 28628 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:02.583947 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:02.586804 28661 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.699107 24395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2604) took 1283 ms. Trace:
I20260709 12:20:02.590298 28272 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:19:59.912819 24469 rpcz_store.cc:276] 0709 12:19:58.901332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.997386 (+ 96054us) service_pool.cc:224] Handling call
0709 12:19:58.997736 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:59.029957 (+ 32221us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:19:59.089474 (+ 59517us) log.cc:844] Serialized 14 byte log entry
0709 12:19:59.911403 (+821929us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:59.911494 (+    91us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:59.911582 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:59.911695 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:59.911886 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39660,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":11000,"raft.queue_time_us":5444,"thread_start_us":792962,"threads_started":1}
I20260709 12:20:02.591084 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:02.700719 25114 raft_consensus.cc:2393] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 10: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:02.593067 25116 raft_consensus.cc:1240] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:20:02.594434 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:02.702827 24467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2213) took 1276 ms. Trace:
I20260709 12:20:02.703153 25117 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:02.703380 24467 rpcz_store.cc:276] 0709 12:20:01.426198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.428834 (+  2636us) service_pool.cc:224] Handling call
0709 12:20:01.429162 (+   328us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:02.654513 (+1225351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:02.654556 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:02.656951 (+  2395us) log.cc:844] Serialized 52 byte log entry
0709 12:20:02.702300 (+ 45349us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:02.702427 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.702523 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:02.702579 (+    56us) raft_consensus.cc:1685] finished
0709 12:20:02.702594 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:02.702737 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":49534,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"thread_start_us":44856,"threads_started":1,"wal-append.queue_time_us":42370}
I20260709 12:20:02.596222 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:02.709226 24291 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:02.710017 24322 raft_consensus.cc:2410] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:20:02.710198 28646 raft_consensus.cc:2804] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:02.710343 24291 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:02.710582 24322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 2058) took 1171 ms. Trace:
I20260709 12:20:02.710692 28646 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.711066 28637 raft_consensus.cc:2804] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:02.606683 28636 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:02.611555 24465 pending_rounds.cc:107] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:20:02.626188 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2615) took 1207 ms. Trace:
I20260709 12:20:02.624823 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 637) took 1164 ms. Trace:
I20260709 12:20:01.547878 24317 raft_consensus.cc:1240] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:01.625151 24399 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:20:02.629001 28699 consensus_queue.cc:1048] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:20:02.711294 28646 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:02.681304 28324 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:02.736407 28324 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:02.634059 28659 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.737597 28659 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:02.739883 28659 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:02.740837 24325 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:20:02.711109 24322 rpcz_store.cc:276] 0709 12:20:01.539718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.595895 (+1056177us) service_pool.cc:224] Handling call
0709 12:20:02.710515 (+114620us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:02.742429 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:02.743104 24322 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:02.632607 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:20:02.634675 24440 connection.cc:256] RPC call timeout handler was delayed by -1.22419698900012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
W20260709 12:20:02.708364 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.744614 24440 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:02.729712 28631 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
W20260709 12:20:02.745736 25084 connection.cc:256] RPC call timeout handler was delayed by -1.0012057760000062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19140000000000001s for a response
I20260709 12:20:02.746049 24440 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:02.745877 28631 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:02.746691 24398 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:20:02.747095 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:02.747354 24440 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:02.639182 24316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 2052) took 1168 ms. Trace:
I20260709 12:20:02.748224 28631 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:02.651882 28405 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.665037 28635 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.798800 28405 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:02.799126 28635 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:02.667629 28497 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:02.428653 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 933492us
I20260709 12:20:02.802094 28405 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:02.803512 24365 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:02.804551 24365 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:02.805326 28686 raft_consensus.cc:2804] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:02.805723 28686 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.805807 28685 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:02.806119 28686 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:02.806475 28685 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:02.807045 28685 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:02.671437 24319 rpcz_store.cc:276] 0709 12:20:01.462551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.470132 (+  7581us) service_pool.cc:224] Handling call
0709 12:20:01.470442 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:01.470683 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:01.471046 (+   363us) log.cc:844] Serialized 14 byte log entry
0709 12:20:02.660155 (+1189109us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:02.660216 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:02.660277 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.660355 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:02.660500 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6879,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":3414,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"thread_start_us":1188630,"threads_started":1,"wal-append.queue_time_us":510300}
I20260709 12:20:02.812752 24319 raft_consensus.cc:1275] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:20:02.673117 28687 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:02.815052 24221 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54252 (request call id 255) took 14931 ms (client timeout 15000 ms). Trace:
I20260709 12:20:02.815683 28687 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:02.432451 28681 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.674733 28691 consensus_queue.cc:1048] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:02.677161 24366 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:02.817204 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:02.817549 28691 consensus_queue.cc:1243] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer c711faa13ead43ebbea0192cb74a4756 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:20:02.522779 28468 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:02.815759 28686 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:02.675495 24324 rpcz_store.cc:276] 0709 12:19:58.441791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.441935 (+   144us) service_pool.cc:224] Handling call
0709 12:19:58.449916 (+  7981us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:58.472479 (+ 22563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:58.472519 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:58.473260 (+   741us) log.cc:844] Serialized 52 byte log entry
0709 12:19:58.642723 (+169463us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:58.642786 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:58.642888 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:02.441833 (+3798945us) raft_consensus.cc:1685] finished
0709 12:20:02.441859 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:02.442049 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18340,"raft.queue_time_us":145690,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"thread_start_us":168761,"threads_started":1,"wal-append.queue_time_us":304152,"wal-append.run_cpu_time_us":3403,"wal-append.run_wall_time_us":1217225}
I20260709 12:20:02.687112 28612 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:02.815676 24221 rpcz_store.cc:269] 0709 12:19:47.883708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:47.883975 (+   267us) service_pool.cc:224] Handling call
0709 12:20:02.814755 (+14930780us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:55.355896 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:55.414894 (+ 58998us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:55.414939 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:19:55.414963 (+    24us) tablet.cc:662] Decoding operations
0709 12:19:55.420658 (+  5695us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:55.420726 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:55.420755 (+    29us) tablet.cc:685] Acquiring locks for 29 operations
0709 12:19:55.474673 (+ 53918us) tablet.cc:701] Row locks acquired
0709 12:19:55.474694 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:19:55.491845 (+ 17151us) write_op.cc:270] Start()
0709 12:19:55.505468 (+ 13623us) write_op.cc:276] Timestamp: P: 1783599595488033 usec, L: 0
0709 12:19:55.505496 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:19:55.814706 (+309210us) log.cc:844] Serialized 11498 byte log entry
0709 12:19:56.649231 (+834525us) op_driver.cc:464] REPLICATION: finished
0709 12:19:56.716060 (+ 66829us) write_op.cc:301] APPLY: starting
0709 12:19:56.716213 (+   153us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:57.115259 (+399046us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:57.115367 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:57.387110 (+271743us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:57.387542 (+   432us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=58,key_file_lookups=58,delta_file_lookups=0,mrs_lookups=0
0709 12:19:57.387596 (+    54us) write_op.cc:312] APPLY: finished
0709 12:19:57.388170 (+   574us) log.cc:844] Serialized 252 byte log entry
0709 12:19:57.388367 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:57.391668 (+  3301us) write_op.cc:454] Released schema lock
0709 12:19:57.393855 (+  2187us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:57.395747 (+  1892us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:57.395781 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":606276,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":57576,"apply.run_cpu_time_us":44587,"apply.run_wall_time_us":679694,"cfile_cache_hit":118,"cfile_cache_hit_bytes":125463,"num_ops":29,"prepare.queue_time_us":307916,"prepare.run_cpu_time_us":30229,"prepare.run_wall_time_us":642631,"raft.queue_time_us":200888,"raft.run_cpu_time_us":5528,"raft.run_wall_time_us":42481,"replication_time_us":1052456,"thread_start_us":500066,"threads_started":4,"wal-append.queue_time_us":361188,"wal-append.run_cpu_time_us":52190,"wal-append.run_wall_time_us":2262216}]]}
I20260709 12:20:02.825621 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:02.816998 28681 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:02.826676 28612 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:02.544071 28522 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:02.824465 28686 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:02.827975 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:02.690699 24394 raft_consensus.cc:2889] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:02.547683 24438 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:02.589867 28473 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.731187 28610 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.699592 24395 rpcz_store.cc:276] 0709 12:20:01.415877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.583517 (+1167640us) service_pool.cc:224] Handling call
0709 12:20:02.699023 (+115506us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:02.699273 28661 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:02.830350 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:02.825676 24324 raft_consensus.cc:1240] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 8. Ops: []
W20260709 12:20:02.834309 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 286692us
I20260709 12:20:02.835170 24324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 2062) took 1294 ms. Trace:
I20260709 12:20:02.834331 25112 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:20:02.835913 28473 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:02.828460 28681 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:02.802081 28635 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:02.837867 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:02.838300 28635 raft_consensus.cc:2749] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:02.813431 24319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 2060) took 1272 ms. Trace:
I20260709 12:20:02.730679 28637 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.732203 28636 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:02.732750 24465 raft_consensus.cc:2889] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:02.732174 24392 rpcz_store.cc:276] 0709 12:20:01.418883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.519542 (+100659us) service_pool.cc:224] Handling call
0709 12:20:02.626120 (+1106578us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:02.830060 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 152986us
I20260709 12:20:02.840317 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:02.831022 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:02.732929 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:02.841180 28636 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:02.841590 24320 raft_consensus.cc:2468] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:20:02.828545 24397 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:20:02.733248 24393 rpcz_store.cc:276] 0709 12:20:01.460543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.623369 (+1162826us) service_pool.cc:224] Handling call
0709 12:20:02.624752 (+  1383us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:02.842818 24397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 632) took 1405 ms. Trace:
I20260709 12:20:02.835873 28610 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:02.843379 24397 rpcz_store.cc:276] 0709 12:20:01.441407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.416092 (+974685us) service_pool.cc:224] Handling call
0709 12:20:02.842643 (+426551us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54001e96d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:02.842738 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375964928}
I20260709 12:20:02.846472 24397 raft_consensus.cc:1240] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:02.841188 24392 raft_consensus.cc:2393] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 10: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:02.829053 24394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2580) took 4060 ms. Trace:
I20260709 12:20:02.847237 24397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2605) took 1431 ms. Trace:
I20260709 12:20:02.847358 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 629) took 1411 ms. Trace:
I20260709 12:20:02.835546 24438 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:02.838908 24395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 638) took 1378 ms. Trace:
I20260709 12:20:02.849025 24395 rpcz_store.cc:276] 0709 12:20:01.460859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.837510 (+1376651us) service_pool.cc:224] Handling call
0709 12:20:02.838832 (+  1322us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:02.849953 24438 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:02.850508 24395 raft_consensus.cc:1275] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:20:02.835539 24324 rpcz_store.cc:276] 0709 12:20:01.541243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.825093 (+1283850us) service_pool.cc:224] Handling call
0709 12:20:02.825457 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:02.834917 (+  9460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.835110 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:02.847564 24394 rpcz_store.cc:276] 0709 12:19:58.768536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.894348 (+125812us) service_pool.cc:224] Handling call
0709 12:19:58.905232 (+ 10884us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:02.565282 (+3660050us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b54001179a0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a972c3dc0 00007f4a9734ed87 00007f4a9734f470 00007f4a9734bd8f 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c
0709 12:20:02.828790 (+263508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.828990 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27508608}
I20260709 12:20:02.847756 24392 rpcz_store.cc:276] 0709 12:20:01.436122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.840026 (+1403904us) service_pool.cc:224] Handling call
0709 12:20:02.847305 (+  7279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:02.852238 24438 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:02.747227 24398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 630) took 1310 ms. Trace:
W20260709 12:20:02.634732 28618 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.781s	user 0.016s	sys 0.029s
I20260709 12:20:02.651743 24400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 636) took 1191 ms. Trace:
I20260709 12:20:02.744263 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:02.749477 28519 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:02.853492 24395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 635) took 1393 ms. Trace:
I20260709 12:20:02.748611 24440 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:02.748467 24316 rpcz_store.cc:276] 0709 12:20:01.470926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.471083 (+   157us) service_pool.cc:224] Handling call
0709 12:20:01.471413 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:01.519956 (+ 48543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:01.519983 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:01.528036 (+  8053us) log.cc:844] Serialized 26 byte log entry
0709 12:20:02.545703 (+1017667us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b18003bfbc0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a94241e07 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425ec02 00007f4a96ee620b 00007f4a96eebd23 00007f4a96eec0d1 00007f4a97307a0f
0709 12:20:02.638630 (+ 92927us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:02.638681 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.638771 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:02.638826 (+    55us) raft_consensus.cc:1685] finished
0709 12:20:02.638841 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:02.639109 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1688,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":126,"spinlock_wait_cycles":2303623424,"thread_start_us":92690,"threads_started":1,"wal-append.queue_time_us":1094528}
I20260709 12:20:02.854803 24395 rpcz_store.cc:276] 0709 12:20:01.459951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.849806 (+1389855us) service_pool.cc:224] Handling call
0709 12:20:02.850166 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:02.850914 (+   748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.853431 (+  2517us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:02.854169 24400 rpcz_store.cc:276] 0709 12:20:01.460262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.631279 (+1171017us) service_pool.cc:224] Handling call
0709 12:20:02.651655 (+ 20376us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:02.725430 25082 connection.cc:256] RPC call timeout handler was delayed by -3.7365643840000757s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
I20260709 12:20:02.755772 28699 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:02.853808 24398 rpcz_store.cc:276] 0709 12:20:01.436388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.522382 (+ 85994us) service_pool.cc:224] Handling call
0709 12:20:02.747162 (+1224780us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:02.854069 28618 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.023s	user 0.016s	sys 0.029s
I20260709 12:20:02.858152 28712 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:02.854569 28519 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:02.763396 24470 raft_consensus.cc:1240] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:02.766016 24396 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:20:02.858896 28712 raft_consensus.cc:697] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:02.859175 28519 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:02.859887 24396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2596) took 1446 ms. Trace:
I20260709 12:20:02.860282 24396 rpcz_store.cc:276] 0709 12:20:01.413620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.414205 (+   585us) service_pool.cc:224] Handling call
0709 12:20:02.859705 (+1445500us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54001112d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:02.859820 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3020229504}
I20260709 12:20:02.860220 28712 consensus_queue.cc:237] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:02.682303 24391 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:20:02.750393 25117 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:20:02.861706 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 631) took 1425 ms. Trace:
I20260709 12:20:02.769079 28450 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:02.769913 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:02.862068 24391 rpcz_store.cc:276] 0709 12:20:01.437441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.384833 (+947392us) service_pool.cc:224] Handling call
0709 12:20:02.861647 (+476814us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:02.750232 28526 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:02.771334 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:02.773149 24421 debug-util.cc:398] Leaking SignalData structure 0x7b08003dfa00 after lost signal to thread 24424
W20260709 12:20:02.863149 24421 debug-util.cc:398] Leaking SignalData structure 0x7b08003f71e0 after lost signal to thread 24425
I20260709 12:20:02.863193 24394 raft_consensus.cc:1275] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:02.863368 28450 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:02.864002 28450 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:20:02.864465 24421 debug-util.cc:398] Leaking SignalData structure 0x7b0800322760 after lost signal to thread 24498
W20260709 12:20:02.864874 24421 debug-util.cc:398] Leaking SignalData structure 0x7b080028ada0 after lost signal to thread 24499
I20260709 12:20:02.865428 24394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 639) took 1404 ms. Trace:
W20260709 12:20:02.866175 24421 debug-util.cc:398] Leaking SignalData structure 0x7b0800363420 after lost signal to thread 25143
I20260709 12:20:02.865772 24394 rpcz_store.cc:276] 0709 12:20:01.461115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.852106 (+1390991us) service_pool.cc:224] Handling call
0709 12:20:02.862861 (+ 10755us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:02.863739 (+   878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.865221 (+  1482us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b54000ce750. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:02.865369 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23987456}
W20260709 12:20:02.866446 24421 debug-util.cc:398] Leaking SignalData structure 0x7b0800369680 after lost signal to thread 25144
I20260709 12:20:02.777870 28640 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:02.867271 28640 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:02.867761 28635 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:02.868198 28635 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:02.868599 28635 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:02.869671 28640 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:02.870384 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 121855us
I20260709 12:20:02.871682 24440 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:02.782063 28569 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:02.853729 24319 rpcz_store.cc:276] 0709 12:20:01.540519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.811972 (+1271453us) service_pool.cc:224] Handling call
0709 12:20:02.812368 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:02.813177 (+   809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.813368 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:02.874904 28569 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:02.787844 25115 raft_consensus.cc:1275] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:02.793991 25083 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:20:02.875648 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:02.875941 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 82062us
I20260709 12:20:02.772462 28659 raft_consensus.cc:2804] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:02.682789 24323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 2063) took 1141 ms. Trace:
I20260709 12:20:02.827630 28522 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:02.731298 24317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 2056) took 1215 ms. Trace:
I20260709 12:20:02.836721 28691 raft_consensus.cc:2749] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:02.887753 24317 rpcz_store.cc:276] 0709 12:20:01.515406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.536263 (+ 20857us) service_pool.cc:224] Handling call
0709 12:20:01.536658 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:02.730982 (+1194324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.731233 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:02.733193 28521 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:02.731377 28237 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:02.677531 28613 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.731858 24399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 628) took 1296 ms. Trace:
I20260709 12:20:02.914992 24399 rpcz_store.cc:276] 0709 12:20:01.435817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.455505 (+ 19688us) service_pool.cc:224] Handling call
0709 12:20:02.731798 (+1276293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:02.844506 28612 consensus_queue.cc:1048] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:02.845157 28637 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:02.835554 28661 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:02.847028 28610 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:02.839018 28473 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:02.743791 24321 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:20:02.853228 24392 raft_consensus.cc:1240] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:02.934636 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 641) took 1472 ms. Trace:
I20260709 12:20:02.911343 28683 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:02.935132 24392 rpcz_store.cc:276] 0709 12:20:01.461705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.852757 (+1391052us) service_pool.cc:224] Handling call
0709 12:20:02.853071 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:02.934319 (+ 81248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.934550 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:02.917371 28324 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:02.856436 28699 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:02.858657 28675 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.636592 24318 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:02.862609 25116 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:20:02.937047 28675 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:02.937899 28324 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:02.938572 25114 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:20:02.936395 28699 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:02.930150 24291 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:02.864491 28450 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:02.795967 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:02.847700 24397 rpcz_store.cc:276] 0709 12:20:01.416131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.845879 (+1429748us) service_pool.cc:224] Handling call
0709 12:20:02.846245 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:02.846984 (+   739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.847185 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:02.878968 24421 debug-util.cc:398] Leaking SignalData structure 0x7b0800365a00 after lost signal to thread 28579
I20260709 12:20:02.879222 24323 rpcz_store.cc:276] 0709 12:20:01.541546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.465691 (+924145us) service_pool.cc:224] Handling call
0709 12:20:02.682717 (+217026us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:02.878749 28659 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:02.879606 28688 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:20:02.889436 24472 consensus_meta.cc:287] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 1.407s	user 0.018s	sys 0.007s
I20260709 12:20:02.891047 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:02.842118 24366 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:02.897342 24474 consensus_meta.cc:287] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 1.405s	user 0.005s	sys 0.022s
I20260709 12:20:02.886516 28526 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:20:02.911217 24440 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:02.925429 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 68824.5us
W20260709 12:20:02.981451 25082 connection.cc:256] RPC call timeout handler was delayed by -3.6078643839998676s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2106s for a response
W20260709 12:20:02.981845 25082 connection.cc:256] RPC call timeout handler was delayed by -3.5106643839999379s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2214s for a response
W20260709 12:20:02.982556 25082 connection.cc:256] RPC call timeout handler was delayed by -3.49356438399991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
I20260709 12:20:02.925758 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2218) took 1479 ms. Trace:
I20260709 12:20:02.881702 28569 raft_consensus.cc:2804] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:20:02.924245 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 254485us
I20260709 12:20:02.929139 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:02.985595 24470 raft_consensus.cc:2410] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:20:02.929857 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:02.893939 28686 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:02.770962 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:03.035089 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:03.015051 28610 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.946110 24291 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:02.947364 25114 raft_consensus.cc:2955] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:20:03.037874 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 91861.8us
I20260709 12:20:03.038051 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:02.951697 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:02.929180 28468 consensus_queue.cc:1059] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:20:02.979627 28685 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:02.977140 28324 consensus_queue.cc:1048] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.054s
W20260709 12:20:02.974264 24421 debug-util.cc:398] Leaking SignalData structure 0x7b0800255ec0 after lost signal to thread 28608
I20260709 12:20:02.943984 28521 raft_consensus.cc:2804] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:02.977041 24472 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
W20260709 12:20:03.046721 24472 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 2209) took 1642 ms (client timeout 1609 ms). Trace:
W20260709 12:20:03.047133 24472 rpcz_store.cc:269] 0709 12:20:01.404075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.404252 (+   177us) service_pool.cc:224] Handling call
0709 12:20:03.046632 (+1642380us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:02.977522 24474 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
W20260709 12:20:02.980486 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 138476us
I20260709 12:20:02.976620 28659 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:03.028329 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:02.915866 28631 consensus_queue.cc:1048] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:20:03.025858 28519 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:02.984406 28688 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:03.016377 25082 connection.cc:256] RPC call timeout handler was delayed by -2.7398378830000638s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.42100000000000004s for a response
I20260709 12:20:02.983479 24471 rpcz_store.cc:276] 0709 12:20:01.450177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.450331 (+   154us) service_pool.cc:224] Handling call
0709 12:20:01.450657 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:01.450860 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:02.681837 (+1230977us) log.cc:844] Serialized 14 byte log entry
0709 12:20:02.925393 (+243556us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:02.925457 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:02.925510 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.925578 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:02.925700 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2292,"prepare.queue_time_us":85882,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"thread_start_us":1471485,"threads_started":2}
I20260709 12:20:03.019976 28628 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.014863 28677 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:03.015612 28569 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:03.035748 24364 connection.cc:256] RPC call timeout handler was delayed by -1.3869805440001528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:20:02.944597 28522 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:03.088301 24398 raft_consensus.cc:1240] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:20:03.088963 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.090103 24396 raft_consensus.cc:1240] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:03.091604 24395 raft_consensus.cc:1240] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:20:02.927856 28613 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:03.038785 24470 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:03.025221 28661 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.953775 28497 raft_consensus.cc:2804] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:02.953976 28699 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:03.057098 24468 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:20:03.063174 28698 consensus_queue.cc:1059] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:20:03.111508 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:03.058339 28526 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:03.063802 28519 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:03.048455 24474 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 2216) took 1619 ms (client timeout 1504 ms). Trace:
W20260709 12:20:03.123072 24474 rpcz_store.cc:269] 0709 12:20:01.430682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.432583 (+  1901us) service_pool.cc:224] Handling call
0709 12:20:03.048374 (+1615791us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:03.049026 24366 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:03.124543 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 75630.5us
W20260709 12:20:03.067988 25082 connection.cc:256] RPC call timeout handler was delayed by -2.3282365059999393s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2553s for a response
W20260709 12:20:03.125705 25082 connection.cc:256] RPC call timeout handler was delayed by -2.1832667139999558s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2013s for a response
W20260709 12:20:03.126356 25082 connection.cc:256] RPC call timeout handler was delayed by -2.0550943190000908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32080000000000003s for a response
W20260709 12:20:03.126854 25082 connection.cc:256] RPC call timeout handler was delayed by -1.4292420249998941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 12:20:03.127261 25082 connection.cc:256] RPC call timeout handler was delayed by -1.4084444289999283s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3259s for a response
I20260709 12:20:03.072697 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:03.036233 28640 raft_consensus.cc:2804] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:03.093525 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.132620 24473 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:03.040017 28686 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:03.100550 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.094924 28569 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:03.101727 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.042783 28324 consensus_queue.cc:1243] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer d99d5d772cfe4a96afcab3d3b009a281 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:20:03.108844 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:03.110981 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:03.046204 28615 raft_consensus.cc:2804] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:03.111253 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:03.115976 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:03.120946 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.150538 24396 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:20:03.150766 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:03.046648 28504 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:03.130299 24325 raft_consensus.cc:1240] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:03.110622 28628 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:03.047658 28706 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:20:03.097113 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 244895us
I20260709 12:20:03.132294 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:03.138353 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:03.141386 24394 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:03.125708 28716 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.179476 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:03.099582 28497 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:03.144377 24319 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:20:03.146617 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.148474 28615 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:03.113710 28661 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:03.223771 24398 raft_consensus.cc:2410] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:20:03.152536 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:03.152665 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:03.224421 24322 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
I20260709 12:20:03.155282 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.123833 28522 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:03.157649 24395 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:03.231276 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.161550 24473 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:20:03.161729 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.232084 24398 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:20:03.041515 28610 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:03.165807 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.141844 24399 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:20:03.164948 25116 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:20:03.217301 24466 raft_consensus.cc:1275] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:20:03.219080 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 73799.7us
W20260709 12:20:03.216951 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 52293.5us
I20260709 12:20:03.229144 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:03.140755 28612 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:03.249459 24219 catalog_manager.cc:5697] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:03.163666 28504 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:03.179136 28706 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:03.298491 25117 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:20:03.230223 28522 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:03.309613 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.228730 28615 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:03.298247 24438 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:03.328105 24397 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:03.231657 28497 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:03.331456 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:03.327224 24438 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:03.306876 28640 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:03.346297 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.308331 28628 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:03.229622 28635 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:03.353129 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:03.353592 24392 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:03.314529 28473 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.320434 28522 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:03.355432 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:03.222235 28716 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:03.361223 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:20:03.352877 28714 log.cc:927] Time spent T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.111s	user 0.000s	sys 0.003s
W20260709 12:20:03.377463 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 466381us
W20260709 12:20:03.380851 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 422880us
I20260709 12:20:03.389087 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:03.347644 28519 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:03.394371 24397 raft_consensus.cc:1275] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:03.395993 24394 raft_consensus.cc:1275] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:20:03.377447 28730 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.387262 24325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 2059) took 1826 ms. Trace:
I20260709 12:20:03.401250 24325 rpcz_store.cc:276] 0709 12:20:01.540196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.786867 (+1246671us) service_pool.cc:224] Handling call
0709 12:20:02.787233 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:03.154877 (+367644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.366313 (+211436us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b5400256cd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:03.366501 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":788327680}
I20260709 12:20:03.347044 28640 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:03.398983 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.399956 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.402678 24395 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:20:03.402823 24474 raft_consensus.cc:1240] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:03.390570 24440 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:03.358657 28719 raft_consensus.cc:2804] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:03.412813 24468 raft_consensus.cc:1275] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:20:03.413407 28704 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:03.414130 24316 raft_consensus.cc:1240] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:03.415899 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:03.406181 24440 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:03.423785 24392 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:20:03.433566 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:03.434713 28504 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:03.435391 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:03.436048 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:03.425384 28704 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:03.461635 28704 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:03.346822 28712 consensus_queue.cc:1048] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 12:20:03.465422 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:03.465966 28712 raft_consensus.cc:2804] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:03.466554 28712 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:03.466924 28712 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:03.395217 28636 raft_consensus.cc:3055] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:20:03.436323 25082 leader_election.cc:336] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.963s (SENT)
I20260709 12:20:03.468212 28636 raft_consensus.cc:740] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:03.468372 25082 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:03.437109 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.434772 25117 raft_consensus.cc:1275] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:20:03.469271 28636 consensus_queue.cc:260] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:03.394447 28519 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:03.470489 28519 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:03.470543 28636 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:03.438622 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 90481.4us
I20260709 12:20:03.440819 25111 raft_consensus.cc:2410] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:20:03.370425 28473 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:03.530462 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:03.530651 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 54371.8us
I20260709 12:20:03.535045 25084 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:03.438199 28688 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:03.479239 28711 log.cc:927] Time spent T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 12:20:03.546490 25084 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:03.473827 28685 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:03.474834 28699 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:03.478440 28686 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:03.548292 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 112009us
I20260709 12:20:03.427804 28727 consensus_queue.cc:1059] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.144s
I20260709 12:20:03.546978 28635 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:03.580842 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.549944 28628 raft_consensus.cc:2804] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:20:03.612054 25082 leader_election.cc:336] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.013s (SENT)
I20260709 12:20:03.577533 28656 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:03.549955 28737 raft_consensus.cc:2749] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:03.608242 28661 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:03.617061 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:03.617304 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.618050 24400 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
W20260709 12:20:03.618165 28732 log.cc:927] Time spent T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:20:03.618463 28706 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:03.625645 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.626340 24399 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:20:03.626372 28656 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:03.627096 28656 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:03.624199 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:03.612823 28628 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:03.628408 28628 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:03.612875 28699 raft_consensus.cc:3055] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:03.628973 28699 raft_consensus.cc:740] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:03.628993 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.630048 28699 consensus_queue.cc:260] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:03.631381 28699 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:03.631477 24399 raft_consensus.cc:2955] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:03.633308 28473 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:03.634940 28646 consensus_meta.cc:287] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.899s	user 0.012s	sys 0.003s
I20260709 12:20:03.635531 28646 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:03.639158 28610 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:03.633452 28716 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:03.642850 24323 raft_consensus.cc:2393] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 9: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:03.648267 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2224) took 2162 ms. Trace:
I20260709 12:20:03.648803 24465 rpcz_store.cc:276] 0709 12:20:01.485856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.491183 (+  5327us) service_pool.cc:224] Handling call
0709 12:20:01.496837 (+  5654us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:02.844495 (+1347658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:02.844527 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:02.845117 (+   590us) log.cc:844] Serialized 52 byte log entry
0709 12:20:02.922336 (+ 77219us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:02.922375 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.922449 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:03.648041 (+725592us) raft_consensus.cc:1685] finished
0709 12:20:03.648062 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:03.648207 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13292,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":143,"thread_start_us":76799,"threads_started":1,"wal-append.queue_time_us":287649}
W20260709 12:20:03.649159 24470 consensus_meta.cc:287] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.000s
I20260709 12:20:03.651180 24470 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:20:03.419319 28730 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:03.548899 28613 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:03.667339 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:03.671661 24289 leader_election.cc:336] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.996s (SENT)
I20260709 12:20:03.554076 28659 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:03.674104 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 62114.1us
I20260709 12:20:03.692482 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:03.704591 24470 raft_consensus.cc:1240] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:03.550021 28521 raft_consensus.cc:697] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
W20260709 12:20:03.705618 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 158184us
W20260709 12:20:03.712620 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:03.716674 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:03.716806 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 310653us
I20260709 12:20:03.718108 24440 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:03.734819 24440 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:03.738083 24470 raft_consensus.cc:1240] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:03.707255 28719 raft_consensus.cc:697] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:03.740831 24440 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:03.742022 28504 consensus_queue.cc:1059] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:03.739403 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:03.747892 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:03.750537 28736 raft_consensus.cc:2749] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:03.751843 28497 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:03.754424 28497 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:03.743804 28618 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
W20260709 12:20:03.755457 28637 consensus_meta.cc:287] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.810s	user 0.004s	sys 0.008s
I20260709 12:20:03.755338 28618 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:03.755885 28637 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:03.757969 28637 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:03.758958 28646 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:03.762374 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:03.763203 25118 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:20:03.764753 28631 consensus_queue.cc:1059] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:03.766017 25118 raft_consensus.cc:1217] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 3.6->[5.7-10.9]   Dedup: 5.7->[8.8-10.9]
I20260709 12:20:03.766525 25118 pending_rounds.cc:85] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281: Aborting all ops after (but not including) 7
I20260709 12:20:03.766512 24321 raft_consensus.cc:2393] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 10: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:03.766829 25118 pending_rounds.cc:107] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:20:03.767761 25118 raft_consensus.cc:2889] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:03.770327 24325 raft_consensus.cc:2393] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 9: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:03.769423 24440 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:03.772516 24440 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:03.774013 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:03.774221 28743 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:03.774730 28743 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:03.775110 28743 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:03.775454 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:03.776132 25111 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:03.771011 28640 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:03.771592 28736 raft_consensus.cc:2749] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:20:03.797462 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 104221us
I20260709 12:20:03.779395 28719 consensus_queue.cc:237] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:03.787407 28739 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:03.743498 28613 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.793342 24440 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:03.744079 28610 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:03.745671 28635 raft_consensus.cc:2749] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:03.795253 24291 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:03.796916 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2601) took 2381 ms. Trace:
I20260709 12:20:03.765587 28110 consensus_queue.cc:1059] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 12:20:03.785465 28450 consensus_meta.cc:287] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.765s	user 0.008s	sys 0.004s
W20260709 12:20:03.799055 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:03.799461 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:03.852057 25110 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:03.845227 25111 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
W20260709 12:20:03.845503 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:03.802021 28569 consensus_meta.cc:287] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.644s	user 0.012s	sys 0.000s
I20260709 12:20:03.806221 24440 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:03.843240 24393 rpcz_store.cc:276] 0709 12:20:01.415015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.842736 (+1427721us) service_pool.cc:224] Handling call
0709 12:20:02.843045 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:02.843246 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:20:02.979798 (+136552us) log.cc:844] Serialized 14 byte log entry
0709 12:20:03.162393 (+182595us) log.cc:844] Serialized 14 byte log entry
0709 12:20:03.787425 (+625032us) spinlock_profiling.cc:243] Waited 4.95 ms on lock 0x7b18002de200. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a941d9c0a 00007f4a9d919219 00007f4a9b22058f 00007f4a9425f571 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd
0709 12:20:03.788344 (+   919us) log.cc:844] Serialized 14 byte log entry
0709 12:20:03.788511 (+   167us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:03.788557 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:03.788825 (+   268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.788916 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:03.796829 (+  7913us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":728636,"prepare.queue_time_us":81491,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":633963,"raft.run_cpu_time_us":386,"raft.run_wall_time_us":14073,"spinlock_wait_cycles":52067584,"thread_start_us":294786,"threads_started":2,"wal-append.queue_time_us":240814}
W20260709 12:20:03.848428 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 53265.3us
I20260709 12:20:03.846704 28610 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:03.787012 28521 consensus_queue.cc:237] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:03.802004 28600 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.859591 28600 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:03.778684 28497 consensus_queue.cc:1059] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:20:03.803915 28739 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:03.862455 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.863397 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.864492 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.864805 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.863991 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.865720 24397 raft_consensus.cc:2410] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 12:20:03.866148 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 60030.3us
I20260709 12:20:03.866379 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:03.867049 24440 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:03.867715 24365 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:03.855692 24289 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:03.870465 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:03.872670 24440 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:03.874085 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:03.875517 24289 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:03.854763 28691 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.876264 28237 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:03.876848 28237 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:03.877373 28237 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:03.845147 28716 raft_consensus.cc:2804] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:03.884411 25110 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:20:03.897583 24440 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:03.882082 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.803735 28646 consensus_queue.cc:1048] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:20:03.899796 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.881467 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.860653 28610 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:03.845234 28613 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:03.904852 28727 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:03.905305 28727 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:20:03.898996 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 599987us
I20260709 12:20:03.905730 28727 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:03.882447 25082 leader_election.cc:336] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 3.208s (SENT)
I20260709 12:20:03.907145 25082 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:03.811419 28637 consensus_queue.cc:1048] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:20:03.865653 28422 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.873297 28110 raft_consensus.cc:2804] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:03.930644 28613 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:03.873214 28739 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:03.901252 28716 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:03.873557 28736 raft_consensus.cc:2804] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:03.978914 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.861140 28450 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:03.869798 28569 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:03.916658 28635 raft_consensus.cc:2804] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:03.982116 24397 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
W20260709 12:20:03.987396 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 129378us
I20260709 12:20:03.979702 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:03.971525 24366 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:20:03.989463 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 107037us
I20260709 12:20:03.980705 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:04.000102 24393 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:20:03.966081 28110 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:03.876852 28691 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:03.990698 28746 log.cc:927] Time spent T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:20:03.900595 28682 consensus_queue.cc:1048] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:20:04.003051 24291 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:03.970480 28659 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:03.990429 28716 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:03.989869 28613 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:03.990549 28736 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:04.014552 25116 raft_consensus.cc:2393] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 10: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:04.006471 28110 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:04.016599 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:04.017603 28720 raft_consensus.cc:2749] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:04.018225 28723 raft_consensus.cc:3055] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:03.965678 28519 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:04.001323 28686 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.998767 28635 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:20:04.026764 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:04.026862 24398 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:20:03.969740 28422 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:04.030107 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 154660us
I20260709 12:20:04.010320 28618 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:04.040292 28750 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:04.040731 28723 raft_consensus.cc:740] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:04.050423 28755 consensus_queue.cc:1048] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:04.051625 24366 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:04.077376 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:04.078241 24318 raft_consensus.cc:2410] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:20:04.051836 28739 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:04.053915 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 50923.9us
W20260709 12:20:04.054867 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:04.056967 24289 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:04.058790 28686 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:04.063004 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 77911.1us
I20260709 12:20:04.065846 28450 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:04.066448 28600 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:04.066805 28615 consensus_meta.cc:287] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.719s	user 0.011s	sys 0.000s
I20260709 12:20:04.066877 28237 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:04.081637 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:04.096307 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:04.096527 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:04.036239 28736 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:04.066829 28636 consensus_meta.cc:287] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.588s	user 0.014s	sys 0.000s
I20260709 12:20:04.059989 28685 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:04.087285 24322 raft_consensus.cc:1275] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:20:04.087520 24465 raft_consensus.cc:2368] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11.
I20260709 12:20:04.057266 28635 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:04.102703 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:04.089159 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:04.089341 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:04.089833 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:04.106515 24317 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 9: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:04.092180 24316 raft_consensus.cc:1275] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:20:04.106597 24291 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:04.093322 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:04.107960 25110 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 9: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:04.094997 24324 raft_consensus.cc:1275] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:20:04.077463 28750 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:04.099215 24289 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:04.102881 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:20:04.088335 24440 connection.cc:256] RPC call timeout handler was delayed by -1.1495162960000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1502s for a response
I20260709 12:20:04.109153 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:04.109488 24440 connection.cc:256] RPC call timeout handler was delayed by -1.0604162959998575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
W20260709 12:20:04.109856 24440 connection.cc:256] RPC call timeout handler was delayed by -1.0541162959998474s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16080000000000003s for a response
W20260709 12:20:04.110164 24440 connection.cc:256] RPC call timeout handler was delayed by -1.0253162959998008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
I20260709 12:20:04.090485 28659 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.118472 24440 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:04.121194 24400 raft_consensus.cc:2393] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 13: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:04.124714 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:04.124795 24440 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:04.125589 24399 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:04.130589 24440 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:04.145105 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:04.114305 28618 raft_consensus.cc:2804] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:04.150192 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:04.151046 24322 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:20:04.151957 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2231) took 1206 ms. Trace:
I20260709 12:20:04.112838 28750 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:04.152595 24474 rpcz_store.cc:276] 0709 12:20:02.945654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.385997 (+440343us) service_pool.cc:224] Handling call
0709 12:20:03.386352 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:03.403391 (+ 17039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:04.151595 (+748204us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b5400242f54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:04.151865 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37434240}
I20260709 12:20:04.125969 28637 raft_consensus.cc:2804] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:04.104036 28615 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:04.134199 28521 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:04.174608 24399 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:20:04.176091 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:04.179469 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:04.111521 28685 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:04.182482 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 51965.7us
I20260709 12:20:04.120829 28659 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:04.185837 24440 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:04.188530 24319 raft_consensus.cc:2393] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 8: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:04.170074 28637 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:04.170800 28618 raft_consensus.cc:697] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:04.189236 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:04.193238 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:04.193729 24397 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:20:04.175577 28706 raft_consensus.cc:2749] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:04.188277 28688 raft_consensus.cc:2749] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:04.127513 28723 consensus_queue.cc:260] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:04.205585 28610 raft_consensus.cc:3055] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:04.206724 28610 raft_consensus.cc:740] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:04.200059 28569 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:04.225642 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:04.226588 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:04.195581 28521 raft_consensus.cc:2749] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:04.192278 28637 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:04.254484 24316 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:20:04.249471 24324 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:04.257011 24468 raft_consensus.cc:1240] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:04.230255 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.263746 24289 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:04.195343 28730 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:04.269062 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:04.269075 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.278257 28659 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:04.225550 28686 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:04.237208 28699 consensus_meta.cc:287] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.004s
I20260709 12:20:04.258198 28691 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:04.252802 28640 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:04.280869 28422 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:04.238117 28752 raft_consensus.cc:2804] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:04.281687 28752 raft_consensus.cc:697] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:04.282655 28752 consensus_queue.cc:237] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:04.276666 28613 raft_consensus.cc:2804] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:04.232761 28762 raft_consensus.cc:2804] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:20:04.285070 28753 log.cc:927] Time spent T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 12:20:04.285408 28762 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:04.285880 28762 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:04.286306 28615 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:04.285028 28613 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:04.269034 28656 consensus_meta.cc:287] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.641s	user 0.012s	sys 0.000s
W20260709 12:20:04.289362 28628 consensus_meta.cc:287] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.660s	user 0.012s	sys 0.000s
I20260709 12:20:04.289134 28656 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:04.289839 28628 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:04.291111 25113 raft_consensus.cc:2393] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:04.291447 28656 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:04.293068 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:04.260843 28712 consensus_meta.cc:287] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.793s	user 0.011s	sys 0.003s
I20260709 12:20:04.288514 28613 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:04.294265 28704 consensus_meta.cc:287] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.832s	user 0.012s	sys 0.000s
I20260709 12:20:04.239051 28739 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:04.294116 28712 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:04.294693 28704 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:04.296036 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.266052 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.296844 28519 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:04.197762 28450 consensus_queue.cc:1048] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 12:20:04.297044 24472 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:20:04.208577 28610 consensus_queue.cc:260] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:04.298185 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.229846 28618 consensus_queue.cc:237] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:04.298520 28610 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:04.298979 24472 raft_consensus.cc:2410] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:20:04.299815 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.226027 28758 raft_consensus.cc:2749] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:20:04.229982 28522 consensus_meta.cc:287] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.825s	user 0.006s	sys 0.006s
I20260709 12:20:04.301685 28522 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:04.244423 28743 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:04.304774 28743 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:04.305689 24468 raft_consensus.cc:2393] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:04.306777 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.306896 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.307842 24474 raft_consensus.cc:2393] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:04.307958 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:04.308782 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.293483 24469 raft_consensus.cc:1275] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:20:04.309690 24474 raft_consensus.cc:2410] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:20:04.310670 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.311235 24467 raft_consensus.cc:1240] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:04.311488 24469 raft_consensus.cc:2393] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:04.314536 25119 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:20:04.320947 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.322069 24470 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:04.226154 28754 raft_consensus.cc:2804] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:04.335544 24468 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:04.335821 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:04.336297 24366 connection.cc:256] RPC call timeout handler was delayed by -1.2589084620001358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
W20260709 12:20:04.336752 24366 connection.cc:256] RPC call timeout handler was delayed by -1.1716084619999947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
I20260709 12:20:04.338393 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.328384 24324 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
I20260709 12:20:04.339459 24474 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
W20260709 12:20:04.337786 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:04.342486 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:04.344805 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:04.345619 24394 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 12.
I20260709 12:20:04.304354 28522 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:04.336817 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.348026 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:04.349296 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:04.353434 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:04.357416 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:04.358367 24394 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:04.357257 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.359620 24468 raft_consensus.cc:2393] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 12: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:04.361441 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:04.362039 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:04.364369 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:04.365856 24324 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:04.367274 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.367980 24473 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:04.355094 28110 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:04.370281 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.370502 24474 raft_consensus.cc:1240] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 9. Current term is 11. Ops: [9.8-9.8]
I20260709 12:20:04.285107 28237 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:04.372404 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:04.374439 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:04.375568 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:04.376199 24325 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:04.314711 28727 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:04.335623 28712 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:04.347127 28754 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:04.351540 28758 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.379112 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:04.385166 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:04.385556 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:04.386160 24317 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 7.
I20260709 12:20:04.386700 24396 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:04.387333 24468 raft_consensus.cc:1240] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:04.391956 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:04.395712 24397 raft_consensus.cc:2393] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 9: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:04.395805 28237 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:04.394757 24469 raft_consensus.cc:1240] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:04.370612 28628 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:04.370761 28704 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:04.406122 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:04.408838 28757 log.cc:927] Time spent T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.372s	user 0.002s	sys 0.003s
I20260709 12:20:04.409729 28675 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:04.410523 28237 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:04.413120 28237 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:04.405287 24324 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
I20260709 12:20:04.406098 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:04.414645 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:04.415383 24317 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:04.417112 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.418495 24472 raft_consensus.cc:2393] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 12: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:04.419354 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 2240) took 1017 ms. Trace:
I20260709 12:20:04.419787 24465 rpcz_store.cc:276] 0709 12:20:03.401529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.653933 (+252404us) service_pool.cc:224] Handling call
0709 12:20:04.419146 (+765213us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b540010e854. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:04.419287 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":896931584}
I20260709 12:20:04.388705 28754 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:04.417299 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:04.379719 24473 raft_consensus.cc:2955] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:04.448101 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:04.451503 24396 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:20:04.456840 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:04.458282 24317 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:20:04.463984 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:04.467990 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:04.468917 24317 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:20:04.470280 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:04.477072 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.479315 24471 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:20:04.460489 24394 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 13.
I20260709 12:20:04.472281 24317 pending_rounds.cc:85] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756: Aborting all ops after (but not including) 8
I20260709 12:20:04.480726 24317 pending_rounds.cc:107] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:20:04.393718 28758 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:04.481052 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:04.498592 24394 raft_consensus.cc:2376] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10. Re-sending same reply.
I20260709 12:20:04.499567 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:04.481071 24317 raft_consensus.cc:2889] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:04.470029 28638 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.108s	user 0.020s	sys 0.036s
W20260709 12:20:04.502920 28638 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.379s	user 0.026s	sys 0.036s
I20260709 12:20:04.473171 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:04.504266 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:04.504866 24396 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:20:04.505709 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:04.505991 24397 raft_consensus.cc:2410] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:20:04.500557 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:04.508422 28758 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:04.508934 24394 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
W20260709 12:20:04.510175 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 66104.3us
W20260709 12:20:04.481333 28698 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.332s	user 0.031s	sys 0.052s
W20260709 12:20:04.514127 28698 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.374s	user 0.031s	sys 0.068s
I20260709 12:20:04.402415 28716 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:04.538400 24467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 918) took 1473 ms. Trace:
I20260709 12:20:04.544466 24467 rpcz_store.cc:276] 0709 12:20:03.065120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.697662 (+632542us) service_pool.cc:224] Handling call
0709 12:20:03.697947 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:04.311717 (+613770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:04.538052 (+226335us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b54001432d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:04.538303 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1409904384}
I20260709 12:20:04.560348 28727 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:04.563825 28716 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:04.564329 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:04.564607 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:04.565104 24394 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:04.565958 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:04.566524 24396 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:04.574194 24396 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:20:04.577521 24394 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:04.572019 24438 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:04.576865 28750 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:04.579561 28688 consensus_queue.cc:1059] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:04.580538 24316 raft_consensus.cc:2393] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 12: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:04.581187 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:04.581864 24398 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:20:04.582741 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:04.582832 28750 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:04.583271 24398 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:04.583456 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 608) took 1169 ms. Trace:
I20260709 12:20:04.583804 25119 rpcz_store.cc:276] 0709 12:20:03.413643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.430011 (+ 16368us) service_pool.cc:224] Handling call
0709 12:20:04.583273 (+1153262us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b5400514ad4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:04.583372 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1120780672}
I20260709 12:20:04.590652 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.591400 28723 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:04.591428 24471 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:04.593408 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:04.594718 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:04.595108 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.598443 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:04.604414 24397 raft_consensus.cc:1275] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:04.606532 24397 raft_consensus.cc:1275] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:20:04.579075 24366 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:04.609251 24323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57702 (request call id 659) took 1472 ms. Trace:
I20260709 12:20:04.611771 24323 rpcz_store.cc:276] 0709 12:20:03.136503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.136742 (+   239us) service_pool.cc:224] Handling call
0709 12:20:04.608926 (+1472184us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b54000d43d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:04.609160 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1127347456}
I20260709 12:20:04.614106 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.615350 24467 raft_consensus.cc:2393] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 10: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
W20260709 12:20:04.621548 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 62109us
I20260709 12:20:04.608173 24438 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:04.629397 24366 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:04.633245 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.634667 24325 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:20:04.635762 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:04.636819 24320 raft_consensus.cc:1240] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:04.607038 28758 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:04.641238 24471 raft_consensus.cc:2393] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 10: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:04.639037 24289 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:04.642272 24398 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:04.643379 24467 raft_consensus.cc:1240] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:04.650712 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.653026 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:04.644168 28752 raft_consensus.cc:2804] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:04.651262 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.698633 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.699419 24468 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
I20260709 12:20:04.700325 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.640331 28522 raft_consensus.cc:2804] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:04.637404 28687 raft_consensus.cc:2804] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:04.647961 28758 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:04.651286 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.649919 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:04.638799 28613 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:04.694307 28685 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:04.657750 28775 log.cc:927] Time spent T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:20:04.640803 28682 consensus_queue.cc:1048] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:20:04.643788 28237 consensus_queue.cc:1048] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:20:04.649435 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.646088 24323 raft_consensus.cc:1240] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 12:20:04.642664 24289 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:04.640914 28681 consensus_queue.cc:1048] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:20:04.493899 28736 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:04.757710 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:04.695508 24466 raft_consensus.cc:2393] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 10: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:04.695624 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.759155 24467 raft_consensus.cc:2393] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:04.720971 28687 raft_consensus.cc:697] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:04.702899 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.704849 28752 raft_consensus.cc:697] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:04.713914 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.652220 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:04.719661 24365 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:04.637764 28704 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:04.719972 24465 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:04.726563 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:04.716754 28635 consensus_meta.cc:287] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.601s	user 0.011s	sys 0.000s
I20260709 12:20:04.715324 28522 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:04.746243 25114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 1204) took 1800 ms. Trace:
I20260709 12:20:04.798888 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.798166 25114 rpcz_store.cc:276] 0709 12:20:02.945500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.946684 (+  1184us) service_pool.cc:224] Handling call
0709 12:20:02.946990 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:02.947227 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:03.477776 (+530549us) log.cc:844] Serialized 14 byte log entry
0709 12:20:03.905260 (+427484us) log.cc:844] Serialized 14 byte log entry
0709 12:20:03.917135 (+ 11875us) log.cc:844] Serialized 14 byte log entry
0709 12:20:04.068073 (+150938us) spinlock_profiling.cc:243] Waited 6.99 ms on lock 0x7b18003e7520. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9425f3f3 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd 0000000000388634 0000000000388479 00007f4a9424283a
0709 12:20:04.209930 (+141857us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b18003e7520. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9422d2a6 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9425f3f3 00007f4a942617c1
0709 12:20:04.211877 (+  1947us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b18003e7520. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9425f3f3 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd 0000000000388634 0000000000388479 00007f4a9424283a
0709 12:20:04.424548 (+212671us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b18003e7520. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9425f3f3 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd 0000000000388634 0000000000388479 00007f4a9424283a
0709 12:20:04.737299 (+312751us) spinlock_profiling.cc:243] Waited 5.74 ms on lock 0x7b18003e7520. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a941d9c0a 00007f4a9d919219 00007f4a9b22058f 00007f4a9425f571 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd
0709 12:20:04.745832 (+  8533us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:04.745890 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:04.745943 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:04.746014 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:04.746171 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":888416,"prepare.queue_time_us":162018,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":66,"raft.queue_time_us":839988,"raft.run_cpu_time_us":477,"raft.run_wall_time_us":17806,"spinlock_wait_cycles":120568192,"thread_start_us":393700,"threads_started":1,"wal-append.queue_time_us":488833}
I20260709 12:20:04.750636 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:04.803042 25119 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:20:04.760283 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.641091 28749 raft_consensus.cc:2749] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:04.761358 24472 raft_consensus.cc:2393] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:04.762439 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:04.809598 24398 raft_consensus.cc:2376] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10. Re-sending same reply.
I20260709 12:20:04.762848 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:04.751910 28742 raft_consensus.cc:2749] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:04.763259 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:04.793546 25115 raft_consensus.cc:2393] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 9: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:04.793852 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:20:04.826844 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 107271us
I20260709 12:20:04.804437 24467 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:04.807024 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:04.807185 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.829241 25114 raft_consensus.cc:2368] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9.
I20260709 12:20:04.826071 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.817226 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:04.831754 24474 raft_consensus.cc:2376] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8. Re-sending same reply.
I20260709 12:20:04.833186 24399 raft_consensus.cc:2368] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 9. Current term is 10.
W20260709 12:20:04.826262 28775 log.cc:927] Time spent T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:20:04.835312 28741 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.835497 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:04.836261 25111 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:20:04.835986 28741 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:04.839681 28521 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:04.840283 28521 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:04.842439 25114 raft_consensus.cc:1275] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:04.843724 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:04.845809 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:04.846681 25112 raft_consensus.cc:2393] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 13: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:04.847530 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:04.848304 25112 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
W20260709 12:20:04.848596 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 136347us
I20260709 12:20:04.847524 24465 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:20:04.838850 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:04.850659 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:04.853461 24366 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:04.834983 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:04.849253 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:04.795786 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 153185us
I20260709 12:20:04.853490 24323 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:20:04.858726 25112 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:20:04.861475 24289 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:04.765674 28704 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:04.849747 28756 raft_consensus.cc:2764] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:20:04.879227 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:04.883561 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:04.799342 28750 raft_consensus.cc:2804] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:04.884436 25111 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:20:04.881683 25114 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:20:04.806118 28522 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:04.895342 25119 raft_consensus.cc:1275] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:20:04.900015 25083 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:04.901044 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:20:04.874452 28762 consensus_meta.cc:287] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.588s	user 0.014s	sys 0.000s
I20260709 12:20:04.899818 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:04.904460 25082 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:04.910141 28324 raft_consensus.cc:3055] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:04.870230 28618 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:04.849709 28636 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:04.888124 28687 consensus_queue.cc:237] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:04.908620 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:04.903049 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:04.942698 24472 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:04.911612 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.878808 28704 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:04.918401 25082 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:04.919497 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.905560 24323 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:20:04.922586 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.951624 24467 raft_consensus.cc:2410] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:20:04.954716 24473 raft_consensus.cc:2393] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:04.956005 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:04.956919 24398 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:04.956002 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:20:04.939388 28776 log.cc:927] Time spent T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:20:04.892547 28628 consensus_queue.cc:1048] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:20:04.927604 24400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2619) took 1065 ms. Trace:
I20260709 12:20:04.972909 24400 rpcz_store.cc:276] 0709 12:20:03.862370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.862546 (+   176us) service_pool.cc:224] Handling call
0709 12:20:04.927318 (+1064772us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54001b8854. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:04.927519 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":491863808}
W20260709 12:20:04.928572 25116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48252 (request call id 604) took 1516 ms (client timeout 1899 ms). Trace:
I20260709 12:20:04.929450 24391 raft_consensus.cc:1240] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:20:04.930873 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:04.935310 28498 raft_consensus.cc:3055] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:20:04.936504 24321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57702 (request call id 655) took 1844 ms (client timeout 1686 ms). Trace:
W20260709 12:20:04.977598 24321 rpcz_store.cc:269] 0709 12:20:03.091958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.092151 (+   193us) service_pool.cc:224] Handling call
0709 12:20:04.936200 (+1844049us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b5400338e54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:04.936409 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1416861952}
W20260709 12:20:04.937501 24319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57702 (request call id 666) took 1577 ms (client timeout 1900 ms). Trace:
W20260709 12:20:04.974524 25116 rpcz_store.cc:269] 0709 12:20:03.412267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.415627 (+  3360us) service_pool.cc:224] Handling call
0709 12:20:04.928331 (+1512704us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b5400501c54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:04.928491 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1362425600}
W20260709 12:20:04.978930 24319 rpcz_store.cc:269] 0709 12:20:03.360491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.360804 (+   313us) service_pool.cc:224] Handling call
0709 12:20:04.937270 (+1576466us) spinlock_profiling.cc:243] Waited 814 ms on lock 0x7b5400103954. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:04.937433 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1873211136}
I20260709 12:20:04.812301 28635 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:04.947448 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:04.899349 28720 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.958854 24473 raft_consensus.cc:2393] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 10: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:04.961212 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:04.984061 24467 raft_consensus.cc:2393] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 10: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:04.924998 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:04.985175 24395 raft_consensus.cc:2393] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 10: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:04.926409 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:04.921219 28742 raft_consensus.cc:2764] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:20:04.911531 28750 raft_consensus.cc:697] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:04.918561 28682 raft_consensus.cc:2749] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:04.917557 28324 raft_consensus.cc:740] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:04.855154 28754 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:04.912510 28473 consensus_queue.cc:1059] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:20:05.034576 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.898456 28656 consensus_queue.cc:1059] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 12:20:04.939060 28618 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:04.986392 24393 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:05.047384 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 218666us
I20260709 12:20:05.043077 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:04.971966 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:05.032451 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:05.051671 24400 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:04.995355 24392 raft_consensus.cc:1240] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:20:04.916772 28762 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:20:05.031545 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:04.915257 28405 consensus_queue.cc:1048] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
W20260709 12:20:05.042861 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 230305us
I20260709 12:20:05.073999 24472 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:05.046591 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:05.054646 24473 raft_consensus.cc:2393] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:05.052969 24467 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:20:05.078231 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:05.079089 24467 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:05.065810 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:05.032702 28784 log.cc:927] Time spent T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:20:05.083078 24395 raft_consensus.cc:2368] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 10. Current term is 11.
I20260709 12:20:05.086778 24469 raft_consensus.cc:1240] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:04.964704 28758 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:04.953119 28636 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:05.090818 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:05.092577 24396 raft_consensus.cc:1275] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:05.093345 24316 raft_consensus.cc:1240] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:05.094637 24392 raft_consensus.cc:1240] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:04.965744 28737 raft_consensus.cc:2749] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:20:05.089824 28783 log.cc:927] Time spent T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:20:04.938874 28752 consensus_queue.cc:237] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:05.095300 24470 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 7.
I20260709 12:20:05.075659 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:05.111281 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:05.068575 28618 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:05.116312 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:05.127231 25111 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:05.116807 24323 raft_consensus.cc:1240] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:05.117934 24365 leader_election.cc:400] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Vote denied by peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453) with higher term. Message: Invalid argument: T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11.
I20260709 12:20:05.129551 24365 leader_election.cc:403] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:20:05.095208 24469 raft_consensus.cc:1240] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:05.090874 28742 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:20:04.971331 28637 consensus_meta.cc:287] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.699s	user 0.012s	sys 0.000s
I20260709 12:20:04.977394 28498 raft_consensus.cc:740] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:05.125111 24318 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:20:05.040230 28720 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:05.131842 24438 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:05.137615 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:20:05.139505 24291 leader_election.cc:336] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Timed out: RequestConsensusVote RPC to 127.22.155.196:35511 timed out after 1.767s (SENT)
I20260709 12:20:05.151820 24291 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:05.132942 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:05.150998 24438 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:05.154281 24469 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
W20260709 12:20:05.141621 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 288262us
I20260709 12:20:05.145987 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:05.155341 24472 raft_consensus.cc:1275] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:20:05.155829 24318 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:05.148489 24398 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:05.144508 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:05.155957 24366 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:05.136183 28473 raft_consensus.cc:3055] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:05.156957 24317 raft_consensus.cc:2393] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 10: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:05.097368 28685 consensus_queue.cc:1048] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:20:05.171633 24289 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:05.134411 28613 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:05.173533 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:05.176375 24472 raft_consensus.cc:2410] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:20:05.119489 28682 consensus_queue.cc:1059] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 12:20:05.177515 28781 log.cc:927] Time spent T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.365s	user 0.001s	sys 0.000s
I20260709 12:20:05.179486 24316 raft_consensus.cc:1240] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:05.179965 28762 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:05.173926 28727 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:05.124708 28237 consensus_queue.cc:1059] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:20:05.145848 28736 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:05.178702 28685 consensus_queue.cc:1243] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer 99b8650fa8324ac2ac5f75eee9b1a1e3 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:20:05.176764 24366 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:05.185986 24316 raft_consensus.cc:1240] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:05.180598 28773 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:05.149693 28637 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:05.172531 28473 raft_consensus.cc:740] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:05.156832 28716 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:05.263299 24321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44278 (request call id 2436) took 1096 ms. Trace:
I20260709 12:20:05.192209 25111 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:20:05.209956 24318 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
I20260709 12:20:05.264662 28736 consensus_queue.cc:1048] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:05.211227 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:05.266341 24472 raft_consensus.cc:2393] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 13: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:05.156698 28519 consensus_queue.cc:1048] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:20:05.151468 28779 consensus_queue.cc:1059] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:20:05.146319 28646 consensus_queue.cc:1048] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:20:05.185546 28758 raft_consensus.cc:2749] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453) with higher term. Message: Invalid argument: T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11.
I20260709 12:20:05.197580 24467 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
I20260709 12:20:05.178148 28677 consensus_queue.cc:1059] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:20:05.267589 24291 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:05.150899 28324 consensus_queue.cc:260] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:05.280061 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 361609us
I20260709 12:20:05.333521 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:05.280092 24325 raft_consensus.cc:2393] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 9: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:20:05.349656 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 82183.3us
I20260709 12:20:05.353633 25082 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:05.174949 28750 consensus_queue.cc:237] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:05.355556 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 178905us
W20260709 12:20:05.277676 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 106129us
I20260709 12:20:05.275736 28405 raft_consensus.cc:3055] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:05.354439 28698 consensus_queue.cc:1059] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:20:05.358271 28801 raft_consensus.cc:3055] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:05.360564 24323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44278 (request call id 2434) took 1241 ms. Trace:
I20260709 12:20:05.398780 24323 rpcz_store.cc:276] 0709 12:20:04.128693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.041512 (+912819us) service_pool.cc:224] Handling call
0709 12:20:05.093880 (+ 52368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:05.140416 (+ 46536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:05.360216 (+219800us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b540001ca54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:05.360470 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47782272}
I20260709 12:20:05.361334 28754 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:05.363591 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:05.364827 28788 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:05.365197 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:05.406348 24469 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:20:05.365520 28791 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:05.356613 28779 raft_consensus.cc:2804] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:05.363593 24400 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:20:05.367326 24393 raft_consensus.cc:2410] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:20:05.372442 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:05.415422 24467 raft_consensus.cc:2376] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9. Re-sending same reply.
I20260709 12:20:05.379209 28635 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:05.375669 28636 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:05.280015 28716 raft_consensus.cc:697] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:05.267952 28773 raft_consensus.cc:697] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:05.266601 28610 raft_consensus.cc:2749] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:05.377465 28637 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:05.398710 28801 raft_consensus.cc:740] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:05.357008 25082 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:05.427335 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 70447us
I20260709 12:20:05.428148 25082 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:05.382984 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 113730us
I20260709 12:20:05.379868 24438 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:05.400645 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:05.433315 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:05.434063 24468 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:05.434355 25082 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:05.403426 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:05.436405 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:05.437582 24473 raft_consensus.cc:2393] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 10: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:05.373297 28473 consensus_queue.cc:260] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:05.416193 24289 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:05.399690 28618 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:05.382642 28405 raft_consensus.cc:740] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:05.442726 28637 raft_consensus.cc:2804] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:05.443452 28637 raft_consensus.cc:697] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:05.443697 28110 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:05.444134 28716 consensus_queue.cc:237] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:05.444798 28637 consensus_queue.cc:237] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:05.421785 28779 raft_consensus.cc:697] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:05.379482 24366 leader_election.cc:400] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9.
I20260709 12:20:05.448988 24366 leader_election.cc:403] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:20:05.448982 28779 consensus_queue.cc:237] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:05.449702 28405 consensus_queue.cc:260] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:05.450400 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 71067.2us
I20260709 12:20:05.450852 28405 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:05.451256 24366 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
W20260709 12:20:05.452401 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.452840 28790 raft_consensus.cc:2749] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9.
I20260709 12:20:05.453512 28805 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:05.454017 28805 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:05.454427 28805 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:05.434641 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:05.353451 28682 raft_consensus.cc:2749] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:05.378922 28789 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:05.459179 28789 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:05.459401 28773 consensus_queue.cc:237] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:05.460247 28742 raft_consensus.cc:3055] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:05.460779 28742 raft_consensus.cc:740] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
W20260709 12:20:05.460994 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.461659 28789 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:05.462479 24366 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:05.461783 28742 consensus_queue.cc:260] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:05.469450 28473 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:05.470212 28802 raft_consensus.cc:3055] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:05.470722 28802 raft_consensus.cc:740] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:05.431351 28636 raft_consensus.cc:2749] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:05.467054 24366 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:05.475171 24366 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:05.435107 28720 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:05.467911 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:05.476836 24366 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:05.513643 24323 raft_consensus.cc:2393] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 9: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:05.432862 28788 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:05.518013 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:05.552073 25116 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:20:05.521314 24366 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:05.477005 25082 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:05.561707 25110 raft_consensus.cc:1240] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:05.461928 28682 consensus_queue.cc:1048] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 12:20:05.479709 28646 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:05.518561 28758 raft_consensus.cc:2804] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:05.514249 28685 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:05.511072 28789 raft_consensus.cc:2749] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:05.548724 28790 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:05.608255 24320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 2082) took 1176 ms. Trace:
W20260709 12:20:05.579131 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.557971 28742 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:05.554880 28795 raft_consensus.cc:2749] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:05.566823 28237 raft_consensus.cc:2749] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:05.559001 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 82155us
I20260709 12:20:05.571110 28758 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:05.637800 28758 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:05.642377 25111 raft_consensus.cc:1240] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:20:05.643800 25082 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:05.646176 25082 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:05.646333 24365 leader_election.cc:336] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.609s (SENT)
I20260709 12:20:05.647017 24365 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:05.581211 28727 raft_consensus.cc:697] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:05.618745 28790 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:05.654266 28807 consensus_queue.cc:1059] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:20:05.629496 28677 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:05.664664 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:05.682356 24319 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
I20260709 12:20:05.681502 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:05.683547 25116 raft_consensus.cc:1275] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:05.683614 25110 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:05.574216 28646 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:05.670063 25082 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:05.687105 25082 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:05.688544 25082 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:05.690928 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 44646.4us
I20260709 12:20:05.694885 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:05.651528 28788 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:05.659291 28790 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:05.682765 28522 consensus_meta.cc:287] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.772s	user 0.007s	sys 0.007s
I20260709 12:20:05.702427 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:05.708165 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:20:05.714182 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 160795us
I20260709 12:20:05.715526 24366 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:05.667454 28677 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:05.684715 28795 raft_consensus.cc:2749] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:05.718954 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:05.718662 28637 consensus_queue.cc:1048] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:05.696856 28789 raft_consensus.cc:2749] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:05.738517 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 44392.8us
I20260709 12:20:05.697160 28656 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:05.739554 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:05.751897 24324 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:05.569939 28802 consensus_queue.cc:260] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:05.734124 28677 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:05.741096 25113 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35188 (request call id 1207) took 2025 ms (client timeout 1767 ms). Trace:
I20260709 12:20:05.753516 25082 leader_election.cc:400] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 election: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 9. Current term is 10.
W20260709 12:20:05.736500 28747 log.cc:927] Time spent T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 1.312s	user 0.007s	sys 0.000s
W20260709 12:20:05.763207 25113 rpcz_store.cc:269] 0709 12:20:03.716124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.716290 (+   166us) service_pool.cc:224] Handling call
0709 12:20:05.740844 (+2024554us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b54004b4bd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:05.741021 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1318609664}
I20260709 12:20:05.760258 25110 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:20:05.761003 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:05.763054 25116 raft_consensus.cc:1275] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:05.763248 25082 leader_election.cc:403] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:20:05.767920 24468 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:20:05.774605 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:05.777735 25082 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:05.778934 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:05.779947 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:05.780421 24319 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:05.573637 28801 consensus_queue.cc:260] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:05.781543 24324 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
I20260709 12:20:05.773293 28802 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:05.755002 28759 raft_consensus.cc:2749] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:05.783273 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:05.733450 28522 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:05.796187 24324 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:05.794056 28789 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 9. Current term is 10.
I20260709 12:20:05.762780 28656 raft_consensus.cc:697] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:05.808194 25084 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:20:05.807741 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.813341 25084 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:20:05.813498 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.815284 25084 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:05.782943 28618 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:05.820684 24471 raft_consensus.cc:2393] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:05.802919 28795 raft_consensus.cc:2749] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:20:05.814079 28810 log.cc:927] Time spent T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:20:05.828619 24319 raft_consensus.cc:2468] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
W20260709 12:20:05.835656 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.762042 28727 consensus_queue.cc:237] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:05.831666 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 54020us
I20260709 12:20:05.839902 25082 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:05.837244 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:05.818941 28788 raft_consensus.cc:2804] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:05.820195 28468 raft_consensus.cc:2749] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:05.819432 28801 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:05.831422 24324 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
I20260709 12:20:05.854218 25082 leader_election.cc:400] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 10. Current term is 11.
I20260709 12:20:05.854628 25082 leader_election.cc:403] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 12:20:05.846699 28806 log.cc:927] Time spent T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 12:20:05.858287 24316 raft_consensus.cc:1240] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:05.860903 28683 raft_consensus.cc:3055] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:05.861397 28683 raft_consensus.cc:740] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:05.861168 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:05.862324 24319 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:05.862437 28683 consensus_queue.cc:260] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:05.863605 28683 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:05.865024 28646 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:05.866926 28813 log.cc:927] Time spent T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:20:05.867273 28795 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:05.865083 28811 log.cc:927] Time spent T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:20:05.870260 28656 consensus_queue.cc:237] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:05.871335 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:05.872816 25115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c"
dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
mode: GRACEFUL
new_leader_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:47070
I20260709 12:20:05.873445 25115 raft_consensus.cc:606] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 10 LEADER]: Received request to transfer leadership to TS c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:05.879002 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:05.882715 24470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 2105) took 1592 ms. Trace:
I20260709 12:20:05.883400 24470 rpcz_store.cc:276] 0709 12:20:04.290439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.335453 (+ 45014us) service_pool.cc:224] Handling call
0709 12:20:05.882431 (+1546978us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b5400032ad4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:05.882616 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1744502528}
I20260709 12:20:05.845009 28788 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:05.848119 28789 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:20:05.890970 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.893361 24317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 2085) took 1269 ms. Trace:
I20260709 12:20:05.901165 24317 rpcz_store.cc:276] 0709 12:20:04.623859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.174274 (+550415us) service_pool.cc:224] Handling call
0709 12:20:05.186182 (+ 11908us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:05.186768 (+   586us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:05.186813 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:05.249105 (+ 62292us) log.cc:844] Serialized 52 byte log entry
0709 12:20:05.421855 (+172750us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:05.421897 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:05.421967 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:05.893116 (+471149us) raft_consensus.cc:1685] finished
0709 12:20:05.893138 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:05.893288 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7764,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":47700,"thread_start_us":89181,"threads_started":1,"wal-append.queue_time_us":283313}
I20260709 12:20:05.857280 28793 raft_consensus.cc:2804] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:05.899334 28788 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:05.892649 28815 log.cc:927] Time spent T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 12:20:05.887457 28723 consensus_meta.cc:287] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.295s	user 0.018s	sys 0.000s
W20260709 12:20:05.898805 28704 consensus_meta.cc:287] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.932s	user 0.011s	sys 0.002s
I20260709 12:20:05.914047 28805 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:05.942036 28758 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:05.945180 28805 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:05.953855 24319 raft_consensus.cc:2410] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 12:20:05.909579 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 55676.4us
I20260709 12:20:05.936697 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:05.958282 24318 raft_consensus.cc:2410] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:20:05.959874 24318 raft_consensus.cc:1240] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:05.962024 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:05.963110 24317 raft_consensus.cc:2393] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 10: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:05.966475 24322 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:20:05.937882 28522 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:05.967203 28646 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.935696 28793 raft_consensus.cc:697] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:05.968763 28646 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:05.969545 28793 consensus_queue.cc:237] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:05.909816 28521 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:05.975330 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:05.976410 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:05.977205 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:05.978267 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:05.934851 28704 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:05.994544 28704 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:05.995282 24466 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:05.997148 28741 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:05.263820 24321 rpcz_store.cc:276] 0709 12:20:04.170812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.045582 (+874770us) service_pool.cc:224] Handling call
0709 12:20:05.094546 (+ 48964us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:05.094833 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:05.117413 (+ 22580us) log.cc:844] Serialized 14 byte log entry
0709 12:20:05.262725 (+145312us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:05.262826 (+   101us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:05.262909 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:05.263030 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:05.263227 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5840,"prepare.queue_time_us":55233,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":5981,"thread_start_us":138540,"threads_started":1}
I20260709 12:20:06.001794 24321 raft_consensus.cc:1240] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 12:20:06.004523 28324 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:06.009959 24325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 2086) took 1385 ms (client timeout 1702 ms). Trace:
W20260709 12:20:06.010424 24325 rpcz_store.cc:269] 0709 12:20:04.624114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.635399 (+ 11285us) service_pool.cc:224] Handling call
0709 12:20:06.009691 (+1374292us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b5400256cd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:06.009870 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1479955328}
I20260709 12:20:06.015205 25117 raft_consensus.cc:2468] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:20:06.018949 28790 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:06.021076 28758 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:06.022641 24317 raft_consensus.cc:1240] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:06.024817 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:06.025456 24290 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:06.026414 28750 consensus_queue.cc:1048] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:06.027910 28750 raft_consensus.cc:2749] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:06.028445 28795 raft_consensus.cc:2749] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 10. Current term is 11.
I20260709 12:20:06.029320 25110 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
W20260709 12:20:05.996546 28405 consensus_meta.cc:287] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.545s	user 0.006s	sys 0.006s
I20260709 12:20:06.031296 28788 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:06.037930 24290 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:06.049657 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:06.051762 24290 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:06.059598 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.052832 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:06.063071 24290 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:06.067245 25115 raft_consensus.cc:2393] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 10: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:06.066795 28437 raft_consensus.cc:2749] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:06.068354 28824 log.cc:927] Time spent T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:20:06.051818 28526 raft_consensus.cc:2749] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:06.049167 28497 consensus_queue.cc:1059] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:20:06.073283 28790 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:06.074776 28788 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:06.075518 24471 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 2121) took 1426 ms (client timeout 1838 ms). Trace:
I20260709 12:20:06.075798 28677 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:06.080186 25113 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
W20260709 12:20:06.081984 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 702164us
I20260709 12:20:06.064844 28637 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:06.082345 24290 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:06.078536 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:06.076792 28635 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:20:06.085394 24471 rpcz_store.cc:269] 0709 12:20:04.648870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.649038 (+   168us) service_pool.cc:224] Handling call
0709 12:20:06.075304 (+1426266us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400243e54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:06.075455 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2447785344}
I20260709 12:20:06.087960 25115 raft_consensus.cc:2368] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 7. Current term is 8.
I20260709 12:20:06.089938 28677 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:06.092732 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:06.093751 24290 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:06.095266 28800 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.095357 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:06.095956 28800 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:20:06.096807 28754 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.099427 24468 raft_consensus.cc:1217] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 3.5->[6.6-12.9]   Dedup: 8.7->[10.8-12.9]
I20260709 12:20:06.085345 28716 raft_consensus.cc:2804] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:06.099987 24468 pending_rounds.cc:85] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 7
I20260709 12:20:06.097784 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:06.101998 24468 pending_rounds.cc:107] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:20:06.102417 24468 raft_consensus.cc:2889] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:06.105334 24473 raft_consensus.cc:1240] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:06.105749 24290 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:06.106165 24465 raft_consensus.cc:1275] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:20:06.107874 28750 raft_consensus.cc:2749] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:06.108211 28800 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:06.097400 28754 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:06.093686 28635 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:06.112048 24471 raft_consensus.cc:1240] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:06.112357 28754 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:06.115026 28716 raft_consensus.cc:697] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:06.116060 28716 consensus_queue.cc:237] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:06.116508 24290 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:06.119199 28637 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:06.120431 24290 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:06.100732 28437 raft_consensus.cc:2749] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:06.127652 24290 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:06.130610 24290 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:06.101032 28497 raft_consensus.cc:2749] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:06.133802 28526 raft_consensus.cc:2749] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:06.138845 24397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:20:06.139587 24397 raft_consensus.cc:606] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:06.139945 24397 raft_consensus.cc:614] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:20:06.137923 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 61315us
I20260709 12:20:06.129405 28637 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:06.153810 24397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:20:06.154716 24397 raft_consensus.cc:606] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:06.155139 24397 raft_consensus.cc:614] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:06.124183 28635 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:06.137992 24290 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:06.165086 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.132061 28723 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:06.167927 24290 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:06.132748 28754 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:06.167179 28497 raft_consensus.cc:2749] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:06.174121 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:06.174804 24474 raft_consensus.cc:2376] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12. Re-sending same reply.
I20260709 12:20:06.175278 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 2140) took 1120 ms. Trace:
I20260709 12:20:06.175555 24474 rpcz_store.cc:276] 0709 12:20:05.055234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.058631 (+  3397us) service_pool.cc:224] Handling call
0709 12:20:06.174046 (+1115415us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b5c0017610c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9acb6161 00007f4a9ae57a79 00007f4a9c3119b6 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:06.175217 (+  1171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6942464}
I20260709 12:20:06.176754 28754 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:06.179092 28754 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:06.179468 28646 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:06.181370 24440 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:06.186892 24397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48340fd716644ed18711f9addc546f4b"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:20:06.186954 24290 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:06.188601 24397 raft_consensus.cc:606] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:06.189064 24397 raft_consensus.cc:614] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:06.190778 24290 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:06.198042 24440 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:06.168890 28723 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:06.171864 28526 raft_consensus.cc:2749] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:06.202112 28498 consensus_queue.cc:260] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:06.198941 28497 raft_consensus.cc:2749] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:06.195164 28646 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:20:06.216926 24466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 2248) took 1492 ms (client timeout 1826 ms). Trace:
W20260709 12:20:06.254566 24466 rpcz_store.cc:269] 0709 12:20:04.724065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.794037 (+ 69972us) service_pool.cc:224] Handling call
0709 12:20:06.216713 (+1422676us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540029ed54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:06.216859 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2748728064}
I20260709 12:20:06.180928 28635 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.198427 24290 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:06.200407 28754 raft_consensus.cc:2804] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:20:06.248806 28600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.315s	user 0.015s	sys 0.000s
W20260709 12:20:06.265774 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 67408.4us
I20260709 12:20:06.266724 24290 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:06.265219 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 67238.7us
I20260709 12:20:06.268368 24440 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:06.270714 24440 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:06.272326 24440 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:06.274623 25114 raft_consensus.cc:1240] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:06.251945 28723 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:06.277837 24440 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:06.279140 24440 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:06.260106 28600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.326s	user 0.016s	sys 0.001s
W20260709 12:20:06.399585 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 684416us
I20260709 12:20:06.401510 28636 raft_consensus.cc:2749] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:06.256068 28719 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:06.406217 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 1209) took 2686 ms. Trace:
I20260709 12:20:06.297104 28498 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:06.264328 28635 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:06.407907 28819 raft_consensus.cc:2764] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:20:06.406733 25118 rpcz_store.cc:276] 0709 12:20:03.719815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.763948 (+ 44133us) service_pool.cc:224] Handling call
0709 12:20:03.764349 (+   401us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:20:03.794379 (+ 30030us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:04.126143 (+331764us) log.cc:844] Serialized 14 byte log entry
0709 12:20:04.848188 (+722045us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:04.870636 (+ 22448us) log.cc:844] Serialized 52 byte log entry
0709 12:20:04.870881 (+   245us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:05.138299 (+267418us) log.cc:844] Serialized 14 byte log entry
0709 12:20:06.388564 (+1250265us) spinlock_profiling.cc:243] Waited 7.64 ms on lock 0x7b540065d4a0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a972c7733 00007f4a9734cdbf 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c
0709 12:20:06.388619 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.401164 (+ 12545us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:06.405954 (+  4790us) raft_consensus.cc:1685] finished
0709 12:20:06.405978 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:06.406147 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":498688,"prepare.queue_time_us":599774,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":87,"raft.queue_time_us":542737,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":7664,"spinlock_wait_cycles":17569024,"thread_start_us":712160,"threads_started":3,"wal-append.queue_time_us":227552,"wal-append.run_cpu_time_us":5137,"wal-append.run_wall_time_us":1813862}
I20260709 12:20:06.409461 28635 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:06.330433 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.275632 28613 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:06.411899 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:06.412938 24394 raft_consensus.cc:1240] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:06.412309 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:06.413180 24392 raft_consensus.cc:1240] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:06.413530 24393 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:06.280784 28712 raft_consensus.cc:2804] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:06.415660 24399 raft_consensus.cc:2393] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:06.418596 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:06.375345 28637 raft_consensus.cc:2749] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:06.291899 28615 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:06.428344 25083 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:06.429921 28793 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:06.276686 28519 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:06.290729 24440 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:06.385825 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2242) took 2260 ms. Trace:
I20260709 12:20:06.299094 28743 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:06.432767 28405 consensus_queue.cc:1059] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:06.433933 28405 raft_consensus.cc:3055] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:06.434291 28405 raft_consensus.cc:740] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:06.435218 28405 consensus_queue.cc:260] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:06.436921 28801 consensus_queue.cc:1059] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:06.432399 24391 rpcz_store.cc:276] 0709 12:20:04.125443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.189944 (+ 64501us) service_pool.cc:224] Handling call
0709 12:20:04.929118 (+739174us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:04.978716 (+ 49598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.322219 (+1343503us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b54001b8850. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:06.385725 (+ 63506us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1681579904}
I20260709 12:20:06.277112 24290 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:06.260449 28754 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:06.409554 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.299157 28800 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:06.415362 25111 raft_consensus.cc:1275] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:20:06.418524 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:06.276331 28804 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:06.420392 24471 raft_consensus.cc:1240] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 9. Current term is 10. Ops: []
W20260709 12:20:06.421772 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.423537 24473 raft_consensus.cc:1240] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:06.424086 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:20:06.444286 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 167246us
I20260709 12:20:06.425602 28698 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:06.415230 28613 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:06.425844 28324 consensus_queue.cc:1048] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:06.420553 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:06.445075 24290 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:06.436435 28405 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:06.442955 24469 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:20:06.448173 24394 raft_consensus.cc:1275] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:20:06.453361 24365 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.007s (SENT) [suppressed 54 similar messages]
I20260709 12:20:06.453617 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:06.455896 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:06.456928 24465 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:06.450941 24393 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:20:06.460261 28752 raft_consensus.cc:2749] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:06.414554 28719 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:06.466360 25083 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:06.468192 24290 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:06.470187 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:06.471182 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:06.475063 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:06.473652 24366 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:06.442234 28754 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:06.493291 24366 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:06.508080 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:06.446647 28749 raft_consensus.cc:3055] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:06.442391 28800 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:06.451889 28637 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:06.446956 28613 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:06.519629 25118 raft_consensus.cc:1275] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:20:06.508977 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:06.506518 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:06.522307 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:06.505826 24398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:20:06.521791 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:06.524994 24398 raft_consensus.cc:606] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:06.525655 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:06.514935 24396 raft_consensus.cc:2393] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 9: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:06.478508 28468 raft_consensus.cc:2804] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:06.472935 28819 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.441885 28688 consensus_queue.cc:1059] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:20:06.471804 28719 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:06.509761 28526 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:06.472306 28646 consensus_queue.cc:1048] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:20:06.475221 28661 consensus_queue.cc:1059] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:20:06.478927 28805 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.524470 24395 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:20:06.513296 28685 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:06.528810 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:06.506839 28683 raft_consensus.cc:2804] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:06.478442 28473 consensus_queue.cc:1059] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:20:06.520154 28615 raft_consensus.cc:2749] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:06.531949 25082 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:06.465276 28698 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:06.566143 28698 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:06.527750 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:06.538610 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:06.568310 24392 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 9: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:06.516469 28800 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:06.544413 28661 raft_consensus.cc:3055] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:06.576939 28661 raft_consensus.cc:740] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:06.578037 28661 consensus_queue.cc:260] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:06.530561 28468 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:06.513203 28677 consensus_queue.cc:1059] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:20:06.547094 28791 raft_consensus.cc:3055] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:06.579489 28468 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:06.579744 28791 raft_consensus.cc:740] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:06.548693 24472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 2144) took 1215 ms. Trace:
I20260709 12:20:06.580984 24472 rpcz_store.cc:276] 0709 12:20:05.332943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.333188 (+   245us) service_pool.cc:224] Handling call
0709 12:20:06.548454 (+1215266us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b540010f254. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:06.548602 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506482560}
I20260709 12:20:06.550611 24395 raft_consensus.cc:1240] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 9. Current term is 10. Ops: [7.7-9.8]
I20260709 12:20:05.621093 24320 rpcz_store.cc:276] 0709 12:20:04.432106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.100922 (+668816us) service_pool.cc:224] Handling call
0709 12:20:05.105908 (+  4986us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:05.106213 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:20:05.400617 (+294404us) log.cc:844] Serialized 14 byte log entry
0709 12:20:05.607770 (+207153us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:05.607846 (+    76us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:05.607909 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:05.608005 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:05.608177 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11477,"prepare.queue_time_us":70906,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":126,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":4168,"thread_start_us":458673,"threads_started":2}
I20260709 12:20:06.533517 28801 consensus_queue.cc:1048] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:20:06.512176 28749 raft_consensus.cc:740] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:06.585259 28749 consensus_queue.cc:260] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:06.586565 28749 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:06.534217 28819 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:06.589896 28791 consensus_queue.cc:260] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:06.590674 28819 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:06.555845 28685 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:06.554147 28688 raft_consensus.cc:3055] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:06.591777 28685 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:06.591960 28688 raft_consensus.cc:740] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:06.593009 28688 consensus_queue.cc:260] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:06.593564 28677 raft_consensus.cc:3055] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:06.593995 28677 raft_consensus.cc:740] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:06.594267 28688 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:06.558961 28683 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:06.559700 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:06.568246 24397 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:20:06.598593 24397 raft_consensus.cc:1240] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:06.598862 24399 raft_consensus.cc:1275] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:20:06.600315 24399 raft_consensus.cc:1240] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:06.556700 24396 raft_consensus.cc:2410] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:20:06.545262 28805 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:06.597121 28683 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:06.603076 28805 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:06.478598 28758 consensus_queue.cc:1048] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:20:06.607880 24397 raft_consensus.cc:1240] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:20:06.614494 28473 raft_consensus.cc:3055] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:06.614995 28473 raft_consensus.cc:740] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:06.615856 28473 consensus_queue.cc:260] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:06.591320 28791 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:06.637864 28519 raft_consensus.cc:697] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:06.680907 28473 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:06.671762 28736 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:06.682847 28736 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:06.661214 24392 raft_consensus.cc:1275] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:20:06.638902 28743 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:06.686734 28743 raft_consensus.cc:697] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:06.562290 28723 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:06.687714 28743 consensus_queue.cc:237] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:06.639297 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 186016us
I20260709 12:20:06.688959 28723 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:06.649878 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:06.690116 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.639456 28804 raft_consensus.cc:697] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:06.640482 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:06.692299 28804 consensus_queue.cc:237] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:06.692452 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:06.645987 28437 consensus_queue.cc:1059] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:20:06.693770 25114 raft_consensus.cc:2393] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 12: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:06.694037 28437 raft_consensus.cc:3055] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:06.694416 28437 raft_consensus.cc:740] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:06.640022 24393 raft_consensus.cc:1275] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:20:06.639082 28712 raft_consensus.cc:697] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:06.594939 28677 consensus_queue.cc:260] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:06.692559 24398 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
W20260709 12:20:06.638447 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 347846us
I20260709 12:20:06.670859 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:06.697373 24319 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:20:06.697410 24440 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:06.699069 28727 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:06.699705 28727 consensus_queue.cc:1059] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:06.644784 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:06.701011 28635 raft_consensus.cc:3055] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:06.701488 28635 raft_consensus.cc:740] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:06.671368 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:06.702657 28635 consensus_queue.cc:260] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:20:06.703743 28661 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:06.704306 24440 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:06.616798 28569 raft_consensus.cc:2749] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:06.644784 28779 consensus_queue.cc:1059] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
W20260709 12:20:06.649092 24290 leader_election.cc:336] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.703s (SENT)
W20260709 12:20:06.737645 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 88576us
I20260709 12:20:06.617604 24397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:20:06.639181 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:06.641462 24323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2450) took 1226 ms. Trace:
W20260709 12:20:06.616503 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 84656.5us
I20260709 12:20:06.738656 24397 raft_consensus.cc:606] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Received request to transfer leadership to TS c711faa13ead43ebbea0192cb74a4756
W20260709 12:20:06.633876 24322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 2079) took 2534 ms (client timeout 2007 ms). Trace:
I20260709 12:20:06.713068 28519 consensus_queue.cc:237] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:06.696465 28712 consensus_queue.cc:237] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:06.646581 28849 log.cc:927] Time spent T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.186s	user 0.002s	sys 0.000s
I20260709 12:20:06.721369 24440 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:06.730016 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:06.757318 25112 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:20:06.730664 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:06.735904 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:06.739396 24322 rpcz_store.cc:269] 0709 12:20:04.099693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.182403 (+ 82710us) service_pool.cc:224] Handling call
0709 12:20:06.633703 (+2451300us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b54002143d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:06.633801 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4002817920}
W20260709 12:20:06.739962 24290 leader_election.cc:336] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.731s (SENT)
I20260709 12:20:06.740170 24323 rpcz_store.cc:276] 0709 12:20:05.415618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.434377 (+ 18759us) service_pool.cc:224] Handling call
0709 12:20:06.641283 (+1206906us) spinlock_profiling.cc:243] Waited 54.8 ms on lock 0x7b540019fd54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:06.641406 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125951744}
I20260709 12:20:06.760357 24440 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:06.696676 28677 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:06.761794 24440 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:06.764060 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:20:06.765195 24318 raft_consensus.cc:1240] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:06.718541 28635 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:06.740726 28716 raft_consensus.cc:2749] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:06.777441 24397 raft_consensus.cc:1240] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:06.751935 28797 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.768507 28727 raft_consensus.cc:2749] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:06.783420 28736 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:06.786495 24319 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:20:06.789069 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:06.790495 24397 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 8.
I20260709 12:20:06.716524 28526 raft_consensus.cc:2749] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:06.792613 25116 raft_consensus.cc:1275] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:06.768338 28720 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:06.695438 28437 consensus_queue.cc:260] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:06.797646 24397 raft_consensus.cc:1275] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:20:06.798144 28437 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:06.801782 28685 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:06.802613 28683 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:06.803140 24399 raft_consensus.cc:1240] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:06.776259 28800 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:06.807143 28800 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:06.807789 28800 raft_consensus.cc:2804] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:06.808292 28800 raft_consensus.cc:697] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:06.804754 28685 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:06.812116 24391 raft_consensus.cc:1240] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:20:06.812980 28613 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:06.814320 24324 raft_consensus.cc:1240] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 9. Current term is 10. Ops: []
W20260709 12:20:06.815987 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.817288 24467 raft_consensus.cc:3055] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:06.817757 24467 raft_consensus.cc:740] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:06.785648 28805 consensus_queue.cc:1059] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:20:06.822022 28683 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:06.818593 24467 consensus_queue.cc:260] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:06.827687 24467 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:06.787715 28237 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.848558 28805 raft_consensus.cc:3055] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:06.849220 28805 raft_consensus.cc:740] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:06.850282 28805 consensus_queue.cc:260] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:06.861474 24467 raft_consensus.cc:1275] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 12:20:06.863755 24467 pending_rounds.cc:85] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 9
I20260709 12:20:06.862668 28526 consensus_queue.cc:1048] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:06.864948 24467 pending_rounds.cc:107] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:20:06.865456 24467 raft_consensus.cc:2889] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:06.867466 28405 consensus_queue.cc:1048] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:06.868885 28613 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:06.870908 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:06.872021 24365 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:06.830668 28720 raft_consensus.cc:697] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:06.852002 28788 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.875510 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:06.790635 28797 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:06.889775 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 128569us
I20260709 12:20:06.891649 28805 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:06.892987 28752 raft_consensus.cc:3055] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:06.893461 28752 raft_consensus.cc:740] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:06.894413 28752 consensus_queue.cc:260] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:06.896103 28752 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:06.898445 28797 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:06.854514 28237 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:06.903394 28237 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:06.890980 24290 leader_election.cc:336] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.826s (SENT)
I20260709 12:20:06.904577 24290 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:06.911674 28646 raft_consensus.cc:2749] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:20:06.913280 24290 leader_election.cc:336] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.972s (SENT)
I20260709 12:20:06.914417 24290 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:06.915385 28437 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.917570 28437 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:06.926483 28437 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:06.919252 28646 raft_consensus.cc:2749] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:06.890089 28788 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:06.923475 28754 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:06.792608 24366 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:06.935235 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:20:06.945866 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 56119.4us
W20260709 12:20:06.948807 24290 leader_election.cc:336] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.096s (SENT)
I20260709 12:20:06.927135 28468 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:06.977655 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:06.890983 28681 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:07.014294 28468 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:07.017516 24324 raft_consensus.cc:1275] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:20:07.019743 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:07.020579 24467 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:07.020931 24219 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35986 (request call id 182) took 51231 ms (client timeout 15000 ms). Trace:
I20260709 12:20:07.007639 28600 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.025425 28600 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:07.026412 28754 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:07.027733 24222 catalog_manager.cc:5697] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:07.030233 24222 catalog_manager.cc:5697] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:07.021427 24219 rpcz_store.cc:269] 0709 12:19:15.790392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:15.791018 (+   626us) service_pool.cc:224] Handling call
0709 12:20:07.020815 (+51229797us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:04.197219 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:04.227255 (+ 30036us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:04.227335 (+    80us) write_op.cc:435] Acquired schema lock
0709 12:20:04.227368 (+    33us) tablet.cc:662] Decoding operations
0709 12:20:04.227932 (+   564us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:04.228069 (+   137us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:04.228111 (+    42us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:20:04.228552 (+   441us) tablet.cc:701] Row locks acquired
0709 12:20:04.228617 (+    65us) write_op.cc:260] PREPARE: finished
0709 12:20:04.300669 (+ 72052us) write_op.cc:270] Start()
0709 12:20:04.300949 (+   280us) write_op.cc:276] Timestamp: P: 1783599604260142 usec, L: 0
0709 12:20:04.301005 (+    56us) op_driver.cc:348] REPLICATION: starting
0709 12:20:04.301808 (+   803us) log.cc:844] Serialized 539 byte log entry
0709 12:20:04.558487 (+256679us) op_driver.cc:464] REPLICATION: finished
0709 12:20:04.631145 (+ 72658us) write_op.cc:301] APPLY: starting
0709 12:20:04.631271 (+   126us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:04.706248 (+ 74977us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:04.720467 (+ 14219us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:04.758452 (+ 37985us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:04.943502 (+185050us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:20:04.965652 (+ 22150us) write_op.cc:312] APPLY: finished
0709 12:20:05.120779 (+155127us) log.cc:844] Serialized 25 byte log entry
0709 12:20:05.149997 (+ 29218us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:05.156791 (+  6794us) write_op.cc:454] Released schema lock
0709 12:20:05.174063 (+ 17272us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:05.194114 (+ 20051us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:05.197005 (+  2891us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":669156,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":71684,"apply.run_cpu_time_us":13150,"apply.run_wall_time_us":552900,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8311,"num_ops":1,"prepare.queue_time_us":373901,"prepare.run_cpu_time_us":14543,"prepare.run_wall_time_us":172103,"raft.queue_time_us":213350,"raft.run_cpu_time_us":9276,"raft.run_wall_time_us":83826,"replication_time_us":257260,"spinlock_wait_cycles":1203456,"thread_start_us":535803,"threads_started":4,"wal-append.queue_time_us":40648,"wal-append.run_cpu_time_us":20869,"wal-append.run_wall_time_us":1820103}]]}
I20260709 12:20:07.034322 25084 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:07.034430 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:20:07.036963 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 244444us
I20260709 12:20:07.037348 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:20:07.040267 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 48147.4us
I20260709 12:20:07.041143 24365 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:07.044404 24289 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:07.048956 24366 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:07.053110 24222 catalog_manager.cc:5697] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:07.055305 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:07.056180 24398 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:07.057760 24391 raft_consensus.cc:1275] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:07.061910 25113 raft_consensus.cc:1275] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:20:07.062032 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 300293us
I20260709 12:20:07.062925 24440 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:07.058248 24289 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:07.064146 24440 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:07.027736 28600 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:06.933221 28720 consensus_queue.cc:237] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:07.046641 28613 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.045622 28801 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:07.073957 24400 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:07.046720 28473 raft_consensus.cc:2749] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:07.076794 28635 raft_consensus.cc:2749] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:07.048424 28681 consensus_queue.cc:1048] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:20:07.078370 28698 consensus_queue.cc:1048] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:07.065003 28688 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:07.065773 28237 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.070578 28754 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:07.084264 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:07.075820 24222 catalog_manager.cc:5697] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:07.086134 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:07.106655 25116 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:07.053797 28749 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:07.055166 28779 raft_consensus.cc:2804] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:07.073638 28615 raft_consensus.cc:2804] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:07.083819 24440 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:07.109881 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:07.113054 24440 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:07.116147 24440 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:07.064780 28498 consensus_queue.cc:1048] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:20:07.073770 28819 consensus_queue.cc:1048] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:20:07.079087 28324 consensus_queue.cc:1048] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:20:07.092981 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.092880 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:07.127789 24222 catalog_manager.cc:5697] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:07.141021 24321 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:07.093672 24467 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:20:07.094739 24318 raft_consensus.cc:1240] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:07.081001 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:07.094827 24289 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:07.143000 24324 raft_consensus.cc:2376] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10. Re-sending same reply.
I20260709 12:20:07.088860 28613 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:07.143267 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 48585.8us
I20260709 12:20:07.049410 28610 consensus_queue.cc:1048] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:20:07.128391 24440 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:07.147436 24366 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:07.125936 28754 raft_consensus.cc:697] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:07.117600 28635 raft_consensus.cc:2804] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:07.159703 28635 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:07.160171 28635 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:07.160543 28719 consensus_meta.cc:287] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.600s	user 0.005s	sys 0.006s
I20260709 12:20:07.161162 28719 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:07.165185 28736 raft_consensus.cc:2749] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:07.166249 24290 leader_election.cc:336] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.429s (SENT)
I20260709 12:20:07.130672 28716 raft_consensus.cc:2749] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:07.069842 28800 consensus_queue.cc:237] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:07.087294 28600 consensus_queue.cc:1059] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:20:07.118045 28749 raft_consensus.cc:697] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:20:07.167526 24290 leader_election.cc:336] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.434s (SENT)
I20260709 12:20:07.168371 28749 consensus_queue.cc:237] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:07.169787 24322 raft_consensus.cc:1240] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:07.117828 28779 raft_consensus.cc:697] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:07.171226 28805 raft_consensus.cc:2804] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:07.172154 28779 consensus_queue.cc:237] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:07.116341 28688 raft_consensus.cc:697] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:07.154641 24222 catalog_manager.cc:5697] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:07.090653 24365 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:07.112151 28615 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.097885 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:07.144985 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:07.125633 28712 raft_consensus.cc:2749] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:07.187520 24320 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:20:07.154304 25116 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:20:07.157562 24440 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:07.158705 28754 consensus_queue.cc:237] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:07.159089 28613 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:07.171785 28805 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.088723 28727 consensus_queue.cc:1059] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:20:07.176924 24392 raft_consensus.cc:1275] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:20:07.183320 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:07.189064 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:07.187666 24323 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:20:07.146409 28752 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.178045 28498 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:07.186585 28698 consensus_queue.cc:1048] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:20:07.194990 28600 raft_consensus.cc:3055] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:07.250047 28600 raft_consensus.cc:740] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:20:07.251603 28852 log.cc:927] Time spent T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.174s	user 0.002s	sys 0.000s
I20260709 12:20:07.251329 28600 consensus_queue.cc:260] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:07.111939 28237 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:07.255290 28237 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:07.206804 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:07.256804 28661 raft_consensus.cc:993] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281: : Instructing follower c711faa13ead43ebbea0192cb74a4756 to start an election
I20260709 12:20:07.257220 24399 raft_consensus.cc:2393] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 10: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:07.257572 28661 raft_consensus.cc:1081] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 10 LEADER]: Signalling peer c711faa13ead43ebbea0192cb74a4756 to start an election
I20260709 12:20:07.207599 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:07.109745 28851 consensus_queue.cc:1048] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 12:20:07.219022 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 61526.8us
I20260709 12:20:07.259941 24440 leader_election.cc:400] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 7. Current term is 8.
I20260709 12:20:07.260330 24440 leader_election.cc:403] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:20:07.223845 24366 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:07.192554 28688 consensus_queue.cc:237] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:07.215456 28615 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:07.231580 24394 raft_consensus.cc:1275] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:20:07.287859 24394 pending_rounds.cc:85] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a: Aborting all ops after (but not including) 6
I20260709 12:20:07.288153 24394 pending_rounds.cc:107] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:20:07.288434 24394 raft_consensus.cc:2889] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:07.229055 24393 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:20:07.229396 24396 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:07.239509 28405 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.187803 28719 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:07.297022 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.304725 24289 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:07.306500 24289 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:07.228323 28805 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:07.310539 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:07.286320 28727 consensus_queue.cc:1243] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer c711faa13ead43ebbea0192cb74a4756 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:20:07.264596 28498 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:07.294535 28831 log.cc:927] Time spent T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:20:07.292973 24222 catalog_manager.cc:5697] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 3 to 7, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 7 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:07.227645 28858 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:07.312251 28437 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:07.395608 24465 raft_consensus.cc:1240] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 11. Current term is 12. Ops: []
W20260709 12:20:07.396109 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 136361us
I20260709 12:20:07.397361 24440 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:07.308149 24323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:57702
I20260709 12:20:07.398831 24323 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:07.399296 24323 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:07.407845 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 184100us
W20260709 12:20:07.408277 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 317680us
I20260709 12:20:07.409351 24365 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:07.412875 24290 leader_election.cc:336] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.632s (SENT)
I20260709 12:20:07.415248 24290 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:07.422945 24440 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:07.321058 28646 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:07.313241 28788 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:07.433193 24396 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:20:07.272106 28752 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:07.390344 28498 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:07.390486 28719 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:07.462283 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 53041.1us
I20260709 12:20:07.396420 28437 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:07.309024 28405 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:07.477023 28473 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:07.460433 28698 raft_consensus.cc:2749] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:07.478094 28712 raft_consensus.cc:3055] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:07.478621 28712 raft_consensus.cc:740] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:07.442190 28237 consensus_queue.cc:1059] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:20:07.484153 24321 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:20:07.477766 28473 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:07.467394 24222 catalog_manager.cc:5697] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:07.433292 28685 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:07.434230 28646 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.429684 28716 raft_consensus.cc:2749] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:07.432704 28797 raft_consensus.cc:2749] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:07.477715 28405 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:07.468166 28866 log.cc:927] Time spent T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:20:07.507226 28635 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:07.535337 25084 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:07.539086 28635 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:07.506313 28857 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:07.540932 28857 raft_consensus.cc:697] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:07.541680 28742 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:07.541868 28857 consensus_queue.cc:237] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:07.542258 28742 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:07.544265 28742 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:07.505136 28437 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:07.525349 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:07.545675 24473 raft_consensus.cc:2410] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:20:07.550513 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:07.558049 24222 catalog_manager.cc:5697] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:07.554069 24323 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:07.570647 24323 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:07.533937 28646 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:07.562845 28864 log.cc:927] Time spent T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.161s	user 0.002s	sys 0.000s
I20260709 12:20:07.591959 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:07.578218 28742 raft_consensus.cc:2804] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:20:07.592101 28637 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.023s	sys 0.007s
I20260709 12:20:07.589515 28324 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:07.648222 28858 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:20:07.614053 28637 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.024s	sys 0.008s
I20260709 12:20:07.611377 28719 raft_consensus.cc:2749] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 7. Current term is 8.
W20260709 12:20:07.677696 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.620013 28742 raft_consensus.cc:697] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
W20260709 12:20:07.685938 28683 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.014s	sys 0.025s
I20260709 12:20:07.649107 28858 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:07.717898 24398 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.014s	sys 0.017s
I20260709 12:20:07.652711 28324 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:07.699955 28779 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.010s	sys 0.020s
W20260709 12:20:07.718418 24398 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.014s	sys 0.017s
W20260709 12:20:07.718799 28802 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.002s	sys 0.028s
W20260709 12:20:07.717459 28683 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.014s	sys 0.026s
W20260709 12:20:07.730746 28779 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.010s	sys 0.020s
W20260709 12:20:07.733352 28802 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.003s	sys 0.028s
I20260709 12:20:07.747556 28324 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:07.748979 28805 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:07.755858 28859 log.cc:927] Time spent T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.281s	user 0.001s	sys 0.004s
W20260709 12:20:07.713867 28758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.017s	sys 0.019s
W20260709 12:20:07.764765 28758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.019s	sys 0.022s
W20260709 12:20:07.765040 28869 log.cc:927] Time spent T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:20:07.765650 28712 consensus_queue.cc:260] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:07.767270 28712 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:07.767490 28868 log.cc:927] Time spent T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:20:07.770641 28805 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:07.774444 28677 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:07.730265 28698 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:07.729451 28661 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.773550 28742 consensus_queue.cc:237] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:07.781745 28685 raft_consensus.cc:697] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:07.744354 28675 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.732777 28405 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.747689 28858 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:07.776608 28867 log.cc:927] Time spent T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:20:07.789921 28473 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:07.801504 28758 raft_consensus.cc:993] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a: : Instructing follower 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
I20260709 12:20:07.787123 28661 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:07.786917 28698 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:07.807540 28791 raft_consensus.cc:3055] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:07.801057 28615 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:07.795253 28675 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:07.816370 28683 raft_consensus.cc:1081] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Signalling peer 99b8650fa8324ac2ac5f75eee9b1a1e3 to start an election
W20260709 12:20:07.862896 28861 log.cc:927] Time spent T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.783s	user 0.000s	sys 0.012s
I20260709 12:20:07.872726 28685 consensus_queue.cc:237] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:07.822710 28791 raft_consensus.cc:740] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:07.877965 28791 consensus_queue.cc:260] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:07.882220 28661 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:07.865715 28872 log.cc:927] Time spent T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:20:07.886121 28698 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:07.903612 28675 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:07.910742 28646 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:07.958108 24290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.008s	sys 0.004s
W20260709 12:20:07.964905 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:08.073773 24290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.008s	sys 0.004s
W20260709 12:20:08.076102 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 683109us
I20260709 12:20:08.087260 28886 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:07.977171 24366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.003s	sys 0.014s
W20260709 12:20:07.977208 24365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.007s	sys 0.006s
W20260709 12:20:07.978363 24392 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.005s	sys 0.009s
I20260709 12:20:07.979243 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:08.101963 24365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.008s	sys 0.006s
I20260709 12:20:07.981588 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:07.983076 24397 raft_consensus.cc:1240] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 12:20:07.983732 24395 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.013s	sys 0.014s
W20260709 12:20:07.997208 24439 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.009s	sys 0.021s
W20260709 12:20:08.000334 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.009619 25114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 644) took 1280 ms. Trace:
I20260709 12:20:08.011554 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 1232) took 1456 ms. Trace:
I20260709 12:20:08.012259 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:07.795771 28405 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:08.021858 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:20:08.030414 28498 consensus_meta.cc:287] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.546s	user 0.002s	sys 0.015s
I20260709 12:20:08.078621 28661 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.079646 28882 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:07.971630 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:08.084900 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.044466 25112 raft_consensus.cc:3055] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:08.089450 28324 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.092247 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:07.971351 24323 raft_consensus.cc:1240] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:08.080092 28615 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:08.102070 24392 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.005s	sys 0.009s
I20260709 12:20:08.117501 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:08.118511 24400 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:08.120524 25111 raft_consensus.cc:2393] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:08.103868 25114 rpcz_store.cc:276] 0709 12:20:06.728680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.730599 (+  1919us) service_pool.cc:224] Handling call
0709 12:20:06.750998 (+ 20399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:06.752615 (+  1617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:06.752679 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:06.770687 (+ 18008us) log.cc:844] Serialized 26 byte log entry
0709 12:20:07.092517 (+321830us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:07.092561 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.092660 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:07.755111 (+662451us) spinlock_profiling.cc:243] Waited 48.9 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:20:07.802402 (+ 47291us) raft_consensus.cc:1685] finished
0709 12:20:07.802435 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:08.009047 (+206612us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10823,"raft.queue_time_us":4052,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":7816,"spinlock_wait_cycles":112530688,"thread_start_us":298331,"threads_started":1,"wal-append.queue_time_us":651847}
I20260709 12:20:08.122221 28324 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:08.110812 25112 raft_consensus.cc:740] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
W20260709 12:20:08.110757 24366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.003s	sys 0.015s
I20260709 12:20:08.098263 28646 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:08.130040 24395 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.014s	sys 0.014s
W20260709 12:20:08.129688 24439 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.010s	sys 0.021s
I20260709 12:20:08.130707 24396 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:20:08.072500 28600 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:08.133535 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 670244us
I20260709 12:20:08.131315 25112 consensus_queue.cc:260] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:08.142112 28885 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.143649 28886 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:08.144488 28882 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:08.145385 24398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2281) took 1059 ms. Trace:
I20260709 12:20:08.145642 28661 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:08.148932 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 739871us
I20260709 12:20:08.165096 28685 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:08.166329 28685 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:08.166538 28885 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:08.145381 28405 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:08.130481 28498 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:08.187361 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:08.189721 24323 raft_consensus.cc:2468] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:20:08.193181 28904 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.194360 28904 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:08.205466 28720 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.205650 28661 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:08.206370 28904 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:08.207552 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:08.209192 24465 raft_consensus.cc:2393] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 10: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:08.209354 24366 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:08.211356 24366 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:08.104312 25118 rpcz_store.cc:276] 0709 12:20:06.555288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.557436 (+  2148us) service_pool.cc:224] Handling call
0709 12:20:06.557719 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:06.716868 (+159149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:06.716898 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:06.717418 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 12:20:07.035959 (+318541us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:07.036009 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.036082 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:07.796575 (+760493us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:20:08.010650 (+214075us) raft_consensus.cc:1685] finished
0709 12:20:08.010723 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:08.011270 (+   547us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":158771,"raft.queue_time_us":162181,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":9971,"spinlock_wait_cycles":2431232,"thread_start_us":317348,"threads_started":1,"wal-append.queue_time_us":361560}
I20260709 12:20:08.206519 28683 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:08.200919 24320 raft_consensus.cc:2468] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:20:08.152086 24398 rpcz_store.cc:276] 0709 12:20:07.086059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.086287 (+   228us) service_pool.cc:224] Handling call
0709 12:20:07.109481 (+ 23194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:07.109727 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:20:07.732136 (+622409us) log.cc:844] Serialized 14 byte log entry
0709 12:20:08.126670 (+394534us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:08.134709 (+  8039us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:08.144741 (+ 10032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:08.144848 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:08.145124 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71251,"prepare.queue_time_us":82994,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":44181,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":272,"thread_start_us":883108,"threads_started":2,"wal-append.queue_time_us":329261}
I20260709 12:20:08.236843 28904 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.237792 28904 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:08.217542 28615 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.240391 24438 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:08.242700 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:20:08.250785 28688 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.014s	sys 0.031s
W20260709 12:20:08.251350 28688 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.015s	sys 0.031s
W20260709 12:20:08.252003 24440 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.009s	sys 0.017s
W20260709 12:20:08.252692 24440 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.010s	sys 0.017s
I20260709 12:20:08.254328 24399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2286) took 1027 ms. Trace:
W20260709 12:20:08.254746 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 831821us
I20260709 12:20:08.257229 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:08.258141 24467 raft_consensus.cc:1240] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:08.261380 28685 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:08.261610 28887 consensus_queue.cc:1059] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:20:08.263103 28887 raft_consensus.cc:3055] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:08.263626 28887 raft_consensus.cc:740] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:08.206421 28720 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:20:08.254979 24399 rpcz_store.cc:276] 0709 12:20:07.226592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.258077 (+ 31485us) service_pool.cc:224] Handling call
0709 12:20:07.258531 (+   454us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:20:07.983976 (+725445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:07.984031 (+    55us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:20:07.985270 (+  1239us) log.cc:844] Serialized 78 byte log entry
0709 12:20:08.109614 (+124344us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:08.109671 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:08.118314 (+  8643us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:08.253702 (+135388us) raft_consensus.cc:1685] finished
0709 12:20:08.253735 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:08.254081 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":724701,"raft.queue_time_us":827889,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":176,"thread_start_us":114880,"threads_started":1,"wal-append.queue_time_us":217328}
I20260709 12:20:08.266595 28498 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:08.266218 24366 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:08.269044 28615 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:08.271641 28720 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:20:08.272045 28615 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:08.272800 28890 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:08.273413 28890 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.273854 28890 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:08.276750 28687 raft_consensus.cc:2804] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:08.277637 28687 raft_consensus.cc:697] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:08.240617 28904 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:08.256323 24440 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:08.279234 28687 consensus_queue.cc:237] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:08.280805 28886 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:08.281189 24317 raft_consensus.cc:2393] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 13: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:08.282518 28712 raft_consensus.cc:2804] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:08.283268 28802 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:08.227960 28661 consensus_queue.cc:1059] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:20:08.252727 24393 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:08.281626 28801 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:20:08.289716 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 45220.5us
I20260709 12:20:08.292750 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:08.292883 28887 consensus_queue.cc:260] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:08.294492 28405 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.294294 28801 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:08.244249 28683 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:08.295339 28405 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:08.296562 24289 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:08.295356 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:08.298801 28882 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:08.299940 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:08.244222 28437 consensus_meta.cc:287] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.699s	user 0.003s	sys 0.027s
I20260709 12:20:08.300972 28437 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:08.300989 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2285) took 1098 ms. Trace:
I20260709 12:20:08.301882 24392 rpcz_store.cc:276] 0709 12:20:07.202143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.234196 (+ 32053us) service_pool.cc:224] Handling call
0709 12:20:07.234601 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:08.149920 (+915319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:08.152774 (+  2854us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:08.165167 (+ 12393us) log.cc:844] Serialized 26 byte log entry
0709 12:20:08.231690 (+ 66523us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:08.231746 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:08.231941 (+   195us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:08.300733 (+ 68792us) raft_consensus.cc:1685] finished
0709 12:20:08.300756 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:08.300920 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":473194,"raft.queue_time_us":206990,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":5197,"thread_start_us":774262,"threads_started":2,"wal-append.queue_time_us":133258}
I20260709 12:20:08.303216 28437 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:08.303849 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:08.304299 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:08.304615 25114 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:20:08.305174 25113 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:20:08.305936 28405 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:08.306720 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:08.307756 25117 raft_consensus.cc:2468] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:20:08.249590 28324 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:08.310913 25084 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:08.307271 28887 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:08.313699 28661 raft_consensus.cc:2804] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:08.314294 28661 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.314700 28661 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:08.298743 28683 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:08.319015 24291 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:08.320570 28805 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.321091 28911 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.321412 28805 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:08.321858 28911 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:08.324241 28805 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:08.320268 24291 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:20:08.329877 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 89760.3us
I20260709 12:20:08.291817 28802 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.329613 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:08.325531 28324 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:08.346823 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:08.347209 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:08.342654 28802 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:08.344206 28324 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.350517 28897 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:08.341610 28712 raft_consensus.cc:697] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:08.355834 24400 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:08.358580 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:08.345551 28437 raft_consensus.cc:2804] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:08.348867 28911 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:08.370266 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:08.359680 28324 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:08.360105 28897 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.363510 28498 raft_consensus.cc:2804] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:20:08.376313 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 56152.9us
I20260709 12:20:08.378927 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:08.381230 24399 raft_consensus.cc:1275] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:20:08.382513 24471 raft_consensus.cc:1240] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:08.370410 28437 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.388974 28437 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:08.388870 28858 consensus_queue.cc:1059] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:20:08.376976 28897 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:08.397178 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:08.376405 28498 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.399796 28498 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:08.401219 24465 raft_consensus.cc:1240] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:20:08.403280 24397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2287) took 1146 ms. Trace:
I20260709 12:20:08.403788 24397 rpcz_store.cc:276] 0709 12:20:07.256535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.259777 (+  3242us) service_pool.cc:224] Handling call
0709 12:20:07.260172 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:08.118470 (+858298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:08.402935 (+284465us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b54000ce254. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:08.403205 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1660507008}
I20260709 12:20:08.383512 24291 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:20:08.418155 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 94728.3us
I20260709 12:20:08.421315 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:08.430538 28890 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:08.433168 24392 raft_consensus.cc:1240] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11. Ops: []
W20260709 12:20:08.435920 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 58635.9us
I20260709 12:20:08.437000 24393 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:08.440769 28904 raft_consensus.cc:2804] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:08.440521 28883 consensus_queue.cc:1048] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:20:08.445587 28907 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.446519 28907 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:08.449013 28779 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:08.449805 28779 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:08.449560 28712 consensus_queue.cc:237] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:08.451929 24471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:33278
I20260709 12:20:08.441401 28904 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.452953 24471 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:08.453902 28904 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:08.454704 24471 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:08.452584 28779 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:08.470168 28882 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:08.471073 28882 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:08.473055 28907 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:08.473462 28405 consensus_queue.cc:1048] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:08.474140 28882 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:08.486215 24438 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:08.488986 28727 consensus_queue.cc:1059] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:08.473148 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:08.499948 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.494068 25084 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:08.519258 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:08.517539 25118 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
W20260709 12:20:08.525103 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 99536.6us
W20260709 12:20:08.531396 24366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.531905 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:20:08.532678 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.531358 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:08.537006 28858 raft_consensus.cc:2804] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:20:08.539574 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 165309us
I20260709 12:20:08.519399 28883 consensus_queue.cc:1048] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:20:08.541157 28920 consensus_queue.cc:1059] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:20:08.542166 24398 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:08.542390 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:08.543272 24467 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:20:08.544782 28405 raft_consensus.cc:2804] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:08.545318 28405 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.545373 24465 raft_consensus.cc:1240] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:08.545831 28405 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:08.553956 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:08.530105 28904 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:08.556223 24394 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:08.537693 28858 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.558050 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:08.553967 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:08.559687 24320 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 12.
I20260709 12:20:08.559815 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:08.560583 28904 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:08.560680 24397 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
W20260709 12:20:08.562273 24366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.563557 24289 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:08.547674 28324 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:08.570349 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:08.571645 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:08.537885 28779 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.566783 28858 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:08.582201 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 51194.2us
I20260709 12:20:08.580010 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:08.591174 25113 raft_consensus.cc:2393] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 12: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:08.591670 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:08.601109 28237 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:08.601807 25082 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:08.602409 28637 raft_consensus.cc:2804] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:08.602710 28779 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:08.603585 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 95527us
I20260709 12:20:08.607401 28890 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:08.608939 28882 raft_consensus.cc:2749] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:08.609506 28661 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:08.610133 24321 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:20:08.601958 28683 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.611397 25118 raft_consensus.cc:2393] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 10: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:08.612812 24289 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:08.629691 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:08.629070 28646 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:08.630117 24289 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:08.631428 24323 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:20:08.638175 24400 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:08.647797 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:08.591084 28805 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.633173 28688 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:08.601999 28237 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:20:08.658486 28683 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:08.659204 28688 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:08.660928 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.661039 28237 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:20:08.661366 28688 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:08.658504 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.661844 28897 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:08.658564 24465 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
W20260709 12:20:08.640844 28857 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.022s	sys 0.007s
I20260709 12:20:08.675885 28688 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.676756 28688 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:08.685009 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:08.682772 25084 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:08.641613 28801 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:08.673219 28857 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.058s	user 0.022s	sys 0.008s
I20260709 12:20:08.650590 28637 raft_consensus.cc:697] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:08.691799 25084 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:08.693568 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:08.700572 24400 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 8.
I20260709 12:20:08.693053 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:08.618610 28727 consensus_queue.cc:1059] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 12:20:08.704957 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:08.708881 28610 consensus_queue.cc:1059] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 12:20:08.709333 24398 raft_consensus.cc:2410] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:20:08.710067 28610 raft_consensus.cc:3055] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:08.710283 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:08.710476 28610 raft_consensus.cc:740] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:08.710601 24320 raft_consensus.cc:1275] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:20:08.711127 24398 raft_consensus.cc:2393] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 12: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:08.711416 28610 consensus_queue.cc:260] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:08.707361 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:08.702771 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:08.706513 28683 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:08.737231 28851 consensus_queue.cc:1048] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 12:20:08.738107 28675 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:08.738615 28675 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.738948 28675 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:08.739109 28851 raft_consensus.cc:2804] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:08.739580 28851 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.739909 28851 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:08.721943 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:08.724188 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 92511us
I20260709 12:20:08.728691 28473 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:08.729028 28928 consensus_queue.cc:1048] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:20:08.730410 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 87801.4us
I20260709 12:20:08.722906 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:08.753468 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:08.788765 28909 log.cc:927] Time spent T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:20:08.701422 28805 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:08.789646 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:08.713783 28688 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:08.754492 24398 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 12.
I20260709 12:20:08.800889 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:08.802451 28858 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:08.804579 24321 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 9: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:08.705715 28904 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:08.808573 28904 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:08.810376 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:08.811127 28904 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:08.728724 28915 raft_consensus.cc:2804] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:08.811825 28915 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.811914 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:08.812296 28915 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:08.768899 24471 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:08.821019 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:08.796404 25119 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
W20260709 12:20:08.793372 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 103429us
I20260709 12:20:08.789384 28926 raft_consensus.cc:3055] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:08.831035 24465 raft_consensus.cc:1240] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:08.832962 24393 raft_consensus.cc:2393] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 10: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:08.834430 24394 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 13.
I20260709 12:20:08.837392 24320 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 10: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:08.839216 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:08.839444 28937 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.840065 28937 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:08.699724 28637 consensus_queue.cc:237] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:08.842907 24466 raft_consensus.cc:1275] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:20:08.845139 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:08.846645 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:08.848029 24469 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:20:08.840528 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:08.791268 28661 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:08.857132 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:08.854316 24289 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:08.866874 24471 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:08.873979 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:08.879949 25114 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:20:08.874634 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:08.813705 28437 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:08.848812 28324 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:08.881300 28882 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:08.893476 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:08.905364 28882 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:08.891031 28805 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:08.907248 28858 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:08.833521 28926 raft_consensus.cc:740] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
W20260709 12:20:08.916230 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 49861.6us
I20260709 12:20:08.882140 24289 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:08.903947 28752 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:08.842919 28937 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:08.869148 28727 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.933422 24291 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:08.935266 24320 raft_consensus.cc:2393] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 9: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:20:08.936457 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 54402us
I20260709 12:20:08.901512 28897 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:08.943563 24289 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:08.874207 28473 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:08.962486 24472 raft_consensus.cc:1275] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:20:08.953964 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:08.953435 24469 raft_consensus.cc:1240] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:08.937534 24366 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:08.957008 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:08.849702 28498 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:08.943425 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:08.940160 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:08.872861 28610 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:08.958455 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:09.020916 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:08.964560 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:09.020370 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:08.965901 28885 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:08.994036 25082 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:08.952740 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:09.017619 24474 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:20:09.023207 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:08.957711 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:09.022652 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:09.031705 24392 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:20:08.956944 28613 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:20:08.954770 28802 consensus_meta.cc:287] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.584s	user 0.014s	sys 0.000s
I20260709 12:20:08.955935 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:08.961604 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:09.043728 24322 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:08.943236 28752 raft_consensus.cc:2804] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:20:09.034448 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 115582us
I20260709 12:20:08.966403 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:08.962925 28723 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:09.003815 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:09.047240 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:09.039077 25116 raft_consensus.cc:2393] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 10: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:08.966025 28437 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:09.041991 24316 raft_consensus.cc:1240] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12. Ops: []
W20260709 12:20:09.046981 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 108463us
W20260709 12:20:09.049569 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 109588us
I20260709 12:20:09.020539 28805 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:09.054605 25084 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:09.040234 28613 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:09.065594 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:09.066367 25116 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:20:09.002413 28675 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:08.999380 28942 consensus_queue.cc:1048] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:20:09.067363 24366 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:09.074533 24324 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:09.074931 24321 raft_consensus.cc:2393] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 10: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:08.977308 28727 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:09.076164 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 57922.7us
I20260709 12:20:09.068879 24394 raft_consensus.cc:1240] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:09.068931 24467 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:20:09.075798 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:09.079154 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:09.047559 28752 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
W20260709 12:20:09.084005 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.077396 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:09.077284 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:09.077821 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:09.085245 24393 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:09.035432 28405 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:09.083967 24400 raft_consensus.cc:1240] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 12:20:09.081367 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 87499.6us
I20260709 12:20:09.003655 28851 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:09.087482 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:09.091123 24469 raft_consensus.cc:2410] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:20:09.056326 28723 raft_consensus.cc:697] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:09.099958 24394 raft_consensus.cc:1240] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:20:09.101964 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:20:09.102170 24290 leader_election.cc:336] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.838s (SENT)
I20260709 12:20:09.102986 28473 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:09.103353 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:09.104164 25115 raft_consensus.cc:1240] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:09.105178 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:09.105721 25115 raft_consensus.cc:1275] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:09.105901 24321 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:20:09.106060 28468 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:09.106729 28468 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:09.106907 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:09.107208 28468 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:09.107801 24321 raft_consensus.cc:2393] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 10: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:09.083241 28688 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:09.109052 28688 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:09.109473 28688 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:09.109676 28498 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:09.111770 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:09.065649 28613 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:09.112573 24400 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:09.104197 24469 raft_consensus.cc:2393] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:09.095552 24318 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:09.047573 28802 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:09.116616 25084 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:09.132198 28742 raft_consensus.cc:2749] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:09.133178 28742 raft_consensus.cc:2749] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:08.960160 28926 consensus_queue.cc:260] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:09.133980 28802 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:09.134510 24393 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:09.134684 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:09.135515 24392 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
I20260709 12:20:09.135833 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:09.136183 24391 raft_consensus.cc:1240] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:20:09.136672 24393 raft_consensus.cc:3055] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:09.137063 24393 raft_consensus.cc:740] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:09.138154 25082 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:09.139674 25082 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:09.087854 28324 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:09.088135 28752 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:09.140594 28942 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:09.140710 28324 raft_consensus.cc:697] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:09.142091 28324 consensus_queue.cc:237] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:09.056907 28920 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:09.144443 28920 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:09.145267 28897 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:09.145505 28742 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:09.146166 28405 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:09.145998 28897 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:09.148562 28946 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:09.148939 28897 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:09.149175 28946 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:09.149560 28946 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:09.149960 28915 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:09.117573 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:09.153223 28727 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:09.155362 28942 raft_consensus.cc:2749] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:09.127151 25117 raft_consensus.cc:2368] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10.
I20260709 12:20:09.146087 28742 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:09.158522 28742 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:09.160449 24317 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 2109) took 2014 ms (client timeout 1981 ms). Trace:
I20260709 12:20:09.126401 28723 consensus_queue.cc:237] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:09.160694 24324 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
W20260709 12:20:09.161636 24319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44280 (request call id 2101) took 2088 ms (client timeout 1702 ms). Trace:
W20260709 12:20:09.162099 24319 rpcz_store.cc:269] 0709 12:20:07.072622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.088071 (+ 15449us) service_pool.cc:224] Handling call
0709 12:20:09.161238 (+2073167us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b5400256cd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:09.161422 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1974946176}
I20260709 12:20:09.126663 28675 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:09.137913 24393 consensus_queue.cc:260] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:09.115520 28805 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:09.127317 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:09.160991 24366 leader_election.cc:336] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Timed out: RequestConsensusVote RPC to 127.22.155.193:36951 timed out after 1.702s (SENT)
W20260709 12:20:09.160970 24317 rpcz_store.cc:269] 0709 12:20:07.145623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.145771 (+   148us) service_pool.cc:224] Handling call
0709 12:20:09.160148 (+2014377us) spinlock_profiling.cc:243] Waited 959 ms on lock 0x7b54002139d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:09.160344 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2204982656}
I20260709 12:20:09.168646 24366 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:09.172428 24317 raft_consensus.cc:1240] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:09.163615 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:09.176981 24319 raft_consensus.cc:1275] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:20:09.177292 28637 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:09.177959 28637 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:09.180907 24319 raft_consensus.cc:1275] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:20:09.182499 24319 raft_consensus.cc:1275] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:20:09.182830 28779 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:09.180437 28637 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:09.187011 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:09.188345 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:09.198967 24400 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:20:09.184549 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:09.158973 28851 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:09.201643 24322 raft_consensus.cc:2410] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:20:09.205174 24392 raft_consensus.cc:2393] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 11: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:09.211964 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:09.215560 24318 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:09.173753 28802 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:09.219488 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.220247 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:09.218623 24393 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:09.222945 24324 raft_consensus.cc:1275] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:20:09.224905 24392 raft_consensus.cc:2393] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 9: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:09.167075 28920 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:09.228211 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.230031 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:09.230312 25082 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:09.231271 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:09.235708 24317 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:09.239023 24467 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:20:09.251255 24393 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
I20260709 12:20:09.252475 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:09.239275 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:09.255048 24319 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:20:09.255613 25116 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:09.256414 24392 raft_consensus.cc:1240] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:09.257529 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:09.260962 24469 raft_consensus.cc:2393] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 11: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
W20260709 12:20:09.262286 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 101391us
W20260709 12:20:09.264276 24366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:09.266563 24366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.272450 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:09.273491 24467 raft_consensus.cc:2393] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:09.273713 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:09.259778 28942 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:09.279560 24350 heartbeater.cc:646] Failed to heartbeat to 127.22.155.254:34311 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.22.155.254:34311 timed out after 15.000s (SENT)
I20260709 12:20:09.288231 28957 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.287766 28688 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:09.275599 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:09.291741 24365 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:09.293705 24469 raft_consensus.cc:3060] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:09.245908 28473 consensus_queue.cc:1048] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:20:09.294281 24392 raft_consensus.cc:2393] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 11: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
W20260709 12:20:09.297603 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 84551.4us
I20260709 12:20:09.300872 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:09.301739 24467 raft_consensus.cc:2393] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:09.312577 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:09.302645 28885 raft_consensus.cc:2749] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:09.287801 28613 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:09.318127 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:09.296280 28957 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:09.324008 28957 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:09.325516 28853 log.cc:927] Time spent T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 1.932s	user 0.006s	sys 0.010s
I20260709 12:20:09.325739 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:09.326627 24322 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
I20260709 12:20:09.327384 25110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 1233) took 2766 ms. Trace:
I20260709 12:20:09.327808 25110 rpcz_store.cc:276] 0709 12:20:06.561254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.561400 (+   146us) service_pool.cc:224] Handling call
0709 12:20:06.561761 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:06.612872 (+ 51111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:06.612901 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:06.613340 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 12:20:07.089398 (+476058us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:07.089456 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.089536 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:09.324692 (+2235156us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:20:09.326818 (+  2126us) raft_consensus.cc:1685] finished
0709 12:20:09.326846 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:09.327181 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50634,"raft.queue_time_us":52090,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":112,"spinlock_wait_cycles":24123264,"thread_start_us":445210,"threads_started":1,"wal-append.queue_time_us":672114}
I20260709 12:20:09.307289 28915 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:09.337903 28688 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:09.342694 28791 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:09.343261 28742 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:09.318986 28437 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.345144 28437 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:09.347707 28437 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:09.349756 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:09.352396 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:09.352861 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 76414.3us
I20260709 12:20:09.353365 28742 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:09.354723 25110 raft_consensus.cc:1240] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:09.355609 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:09.357404 28883 raft_consensus.cc:3055] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:09.357950 28883 raft_consensus.cc:740] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:09.358513 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:09.360944 24467 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:20:09.362200 24469 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
I20260709 12:20:09.363366 25119 raft_consensus.cc:1240] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:09.365265 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:09.366542 25116 raft_consensus.cc:1240] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:09.361567 28688 consensus_queue.cc:1059] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:20:09.367858 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:09.372766 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:09.374653 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:09.375638 28885 consensus_queue.cc:1059] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 10.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:09.377008 28688 raft_consensus.cc:3055] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:09.377226 28957 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:09.377633 28688 raft_consensus.cc:740] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:09.377995 28957 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:09.378844 28688 consensus_queue.cc:260] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:09.363734 28805 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:09.361912 28802 consensus_queue.cc:1059] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:20:09.385481 28688 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:09.385972 28802 raft_consensus.cc:3055] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:09.386698 28802 raft_consensus.cc:740] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:09.387032 28946 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:09.387655 28802 consensus_queue.cc:260] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:09.389281 28802 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:09.390533 28926 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:09.391291 25084 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:09.394105 24365 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:09.395490 28887 raft_consensus.cc:2804] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:09.395918 28887 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:09.396267 28887 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:09.396142 28883 consensus_queue.cc:260] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:09.397827 28883 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:09.406495 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:09.407232 24471 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:09.409653 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:09.411127 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:09.415850 28805 raft_consensus.cc:3055] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:09.416229 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:09.416409 28805 raft_consensus.cc:740] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:09.417750 28805 consensus_queue.cc:260] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.3, Last appended by leader: 3, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:09.424757 28804 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.425525 28804 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:09.427189 28805 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:09.428793 28613 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:09.432426 28468 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:09.433477 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:09.433672 25117 raft_consensus.cc:1240] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:09.434319 24465 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:20:09.435309 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:09.436008 24465 raft_consensus.cc:2393] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 11: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:09.436901 28804 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:09.437410 28887 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:09.328356 28752 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:09.440052 28887 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:09.442876 24325 raft_consensus.cc:1240] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:09.412323 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:09.445233 24317 raft_consensus.cc:2468] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:20:09.447010 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:09.448576 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 57373.9us
W20260709 12:20:09.460208 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 165153us
I20260709 12:20:09.460947 25112 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:09.436365 24471 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:09.465166 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:09.469058 24319 raft_consensus.cc:2468] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
I20260709 12:20:09.470534 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:09.473094 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:09.473650 24467 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 13.
I20260709 12:20:09.475011 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:09.380483 28942 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:09.468621 28661 raft_consensus.cc:2804] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:09.481253 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:09.481598 28661 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:09.482228 28661 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:09.482838 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:09.484388 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:09.486011 28468 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:09.487677 24465 raft_consensus.cc:1275] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:09.488665 28908 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.489351 28908 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:09.444583 28752 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:09.479676 28613 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:09.497808 28613 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:09.477624 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:09.479966 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:09.499848 25117 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:09.500018 25119 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:09.479300 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:09.481657 25115 raft_consensus.cc:1240] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:09.480357 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:09.501483 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:09.508697 24466 raft_consensus.cc:2393] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 11: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:09.509881 24467 raft_consensus.cc:2393] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 11: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:09.513244 24291 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:09.514519 25112 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:09.517771 28610 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:09.518342 28610 raft_consensus.cc:697] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:09.519295 28610 consensus_queue.cc:237] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:09.525651 28946 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:09.541870 24474 raft_consensus.cc:1275] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:20:09.547545 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:09.549335 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:09.549670 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:09.550107 25110 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:09.551831 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:09.560571 24466 raft_consensus.cc:1240] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260709 12:20:09.562564 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:09.563166 24466 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:09.568149 24473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2276) took 1219 ms. Trace:
I20260709 12:20:09.568605 24473 rpcz_store.cc:276] 0709 12:20:08.349302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:08.349474 (+   172us) service_pool.cc:224] Handling call
0709 12:20:08.368069 (+ 18595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:08.397321 (+ 29252us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:08.500741 (+103420us) log.cc:844] Serialized 14 byte log entry
0709 12:20:08.964564 (+463823us) spinlock_profiling.cc:243] Waited 33.2 ms on lock 0x7b18004857a0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9425f3f3 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd 0000000000388634 0000000000388479 00007f4a9424283a
0709 12:20:09.567147 (+602583us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b18004857a0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9422d2a6 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a96ef44bc 00007f4a9424248b
0709 12:20:09.567648 (+   501us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b18004857a0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a96ef44bc 00007f4a9424248b 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425c455 00007f4a97344060 00007f4a97356716 00007f4a97367287
0709 12:20:09.567741 (+    93us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:09.567791 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:09.567874 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:09.567947 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:09.568068 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11997,"prepare.queue_time_us":147285,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":70168,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":21699,"spinlock_wait_cycles":442116864,"thread_start_us":175822,"threads_started":3,"wal-append.queue_time_us":133215}
I20260709 12:20:09.571108 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:09.572270 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:09.573982 28613 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:09.583086 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:09.583667 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:20:09.574528 25112 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35188 (request call id 1250) took 1968 ms (client timeout 1913 ms). Trace:
I20260709 12:20:09.543797 25119 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
I20260709 12:20:09.586695 24392 raft_consensus.cc:1275] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:20:09.585361 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:09.588106 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:09.588949 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:09.589448 24467 raft_consensus.cc:2393] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:09.586212 24396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2299) took 1155 ms. Trace:
I20260709 12:20:09.590875 24474 raft_consensus.cc:1275] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:20:09.585858 25112 rpcz_store.cc:269] 0709 12:20:07.576262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.576397 (+   135us) service_pool.cc:224] Handling call
0709 12:20:08.043964 (+467567us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b540070a1a0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a972c3dc0 00007f4a9734fe18 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6
0709 12:20:09.418287 (+1374323us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b580052e8d0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a972a80aa 00007f4a9732a447 00007f4a97342fe7 00007f4a973447de 00007f4a9735027c 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c
0709 12:20:09.544500 (+126213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81559040}
I20260709 12:20:09.593807 24471 raft_consensus.cc:1275] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:20:09.594293 24471 pending_rounds.cc:85] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 5
I20260709 12:20:09.593353 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:09.591146 24396 rpcz_store.cc:276] 0709 12:20:08.430452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:09.580781 (+1150329us) service_pool.cc:224] Handling call
0709 12:20:09.586124 (+  5343us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:09.598539 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:09.599148 25114 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:09.598686 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:09.600056 24399 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:09.600884 24469 raft_consensus.cc:2393] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:09.602334 24321 raft_consensus.cc:1240] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:09.603139 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:20:09.600823 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 206792us
I20260709 12:20:09.613636 25113 raft_consensus.cc:2393] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 10: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:09.615186 24365 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:09.609653 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:09.618939 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:09.620882 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:09.647854 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:09.532050 28661 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:09.594568 24471 pending_rounds.cc:107] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:20:09.647862 24467 raft_consensus.cc:2393] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 11: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:09.648917 24471 raft_consensus.cc:2889] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:09.601357 28688 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.647744 24473 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:09.658689 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:09.664201 24290 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:09.666814 24320 raft_consensus.cc:2393] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 10: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:09.650987 24291 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:09.648358 24474 raft_consensus.cc:2376] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10. Re-sending same reply.
I20260709 12:20:09.665912 24290 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:09.680612 25084 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:09.681949 25084 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:20:09.660647 28961 log.cc:927] Time spent T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:20:09.708222 24438 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:09.713516 28804 raft_consensus.cc:2804] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:09.683679 28723 raft_consensus.cc:2804] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:09.714195 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:09.676584 28437 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:09.728289 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:09.699937 28905 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:09.729233 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:09.697742 28851 raft_consensus.cc:2804] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:09.713738 24438 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:09.719319 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 53484.9us
I20260709 12:20:09.699524 28945 raft_consensus.cc:2804] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:09.715778 25117 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:09.729606 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:09.741932 24471 raft_consensus.cc:2393] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:09.683225 28688 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:09.753031 24319 raft_consensus.cc:1240] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:09.721438 28804 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:09.748518 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:09.754437 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:09.757040 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:09.758106 24320 raft_consensus.cc:2393] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 9: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:09.728061 28437 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:09.730248 28723 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:09.772584 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.762892 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:09.774022 25117 raft_consensus.cc:2376] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11. Re-sending same reply.
I20260709 12:20:09.712255 28926 consensus_queue.cc:1059] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:20:09.711272 28805 consensus_queue.cc:1059] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
W20260709 12:20:09.716115 28646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.032s	user 0.004s	sys 0.017s
W20260709 12:20:09.786955 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 51439.9us
I20260709 12:20:09.784737 24291 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:09.781116 24316 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
I20260709 12:20:09.792307 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:09.762079 28804 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:09.757385 28851 raft_consensus.cc:697] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
W20260709 12:20:09.785405 28646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.098s	user 0.004s	sys 0.021s
I20260709 12:20:09.772701 28802 raft_consensus.cc:2749] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:09.772315 28437 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:09.836872 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:09.804340 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.805372 24290 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:09.761062 28945 raft_consensus.cc:697] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:09.771617 28883 raft_consensus.cc:2749] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:09.782555 28723 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:09.782233 28967 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:09.827689 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.791061 28791 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.861747 28791 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:09.864204 28791 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:09.840183 25117 raft_consensus.cc:1240] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 12. Current term is 13. Ops: []
W20260709 12:20:09.867969 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 78782.4us
I20260709 12:20:09.868824 28758 raft_consensus.cc:3055] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:09.869180 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:20:09.870034 24468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 2272) took 1625 ms (client timeout 1990 ms). Trace:
W20260709 12:20:09.870383 24468 rpcz_store.cc:269] 0709 12:20:08.246384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:08.251274 (+  4890us) service_pool.cc:224] Handling call
0709 12:20:09.868893 (+1617619us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b58001c3e98. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c3120a0 00007f4a9c311984 00007f4a9588c6d4 00007f4a9588c662
0709 12:20:09.869946 (+  1053us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24110336}
W20260709 12:20:09.843312 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.805241 28646 raft_consensus.cc:697] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:09.873294 28805 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:09.873418 28646 consensus_queue.cc:237] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:09.873906 28805 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:09.875924 28805 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:09.877113 28661 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:09.878230 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:09.846668 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:09.849845 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:20:09.853356 28963 log.cc:927] Time spent T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:20:09.807564 28613 raft_consensus.cc:2804] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:20:09.857941 28965 log.cc:927] Time spent T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:20:09.835253 28887 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:09.860870 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:09.844597 28946 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.869357 28758 raft_consensus.cc:740] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:09.856809 24471 raft_consensus.cc:3055] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:09.905145 24471 raft_consensus.cc:740] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:09.887223 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:09.888019 24290 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:09.803864 28940 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.022s	sys 0.008s
I20260709 12:20:09.899960 25114 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:20:09.898362 24399 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 13.
I20260709 12:20:09.910828 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:09.911347 24290 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:09.911695 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:09.915846 28610 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:09.916335 28610 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:09.916741 28610 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:09.916213 28945 consensus_queue.cc:237] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:09.946060 24465 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:20:09.950043 28851 consensus_queue.cc:237] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:09.947978 28610 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:09.957201 28758 consensus_queue.cc:260] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:09.958918 28758 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:09.896797 28967 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:09.908710 28940 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.022s	sys 0.008s
I20260709 12:20:09.959147 28610 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:09.905929 28887 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:09.964076 28949 log.cc:927] Time spent T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.835s	user 0.005s	sys 0.000s
I20260709 12:20:09.965476 28688 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:09.967281 28720 raft_consensus.cc:3055] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:20:09.972067 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 258374us
I20260709 12:20:09.914170 28613 raft_consensus.cc:697] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:09.977387 24466 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:09.975672 24471 consensus_queue.cc:260] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:09.973142 28742 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:09.900617 28970 consensus_queue.cc:1059] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 12:20:09.978899 28752 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:09.909528 28946 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:09.982715 28720 raft_consensus.cc:740] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
W20260709 12:20:10.004735 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 93472.2us
I20260709 12:20:10.005492 24438 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:10.020907 24471 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:10.023480 28975 consensus_queue.cc:1059] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:10.024403 28975 raft_consensus.cc:3055] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:10.028697 24290 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:10.032729 24290 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:10.039705 24395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 667) took 3524 ms. Trace:
I20260709 12:20:09.996796 28742 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:10.024737 28975 raft_consensus.cc:740] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:10.047852 24471 raft_consensus.cc:1275] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:20:10.053607 24438 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:10.041994 28688 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:10.039263 28911 raft_consensus.cc:2749] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:10.038977 28610 consensus_queue.cc:1048] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:20:10.049312 28926 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:10.053282 28915 raft_consensus.cc:2749] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:10.040189 24395 rpcz_store.cc:276] 0709 12:20:06.511601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.582607 (+ 71006us) service_pool.cc:224] Handling call
0709 12:20:06.582985 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:06.657079 (+ 74094us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:06.775376 (+118297us) log.cc:844] Serialized 14 byte log entry
0709 12:20:07.315864 (+540488us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:07.316588 (+   724us) log.cc:844] Serialized 26 byte log entry
0709 12:20:07.316791 (+   203us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:07.317141 (+   350us) log.cc:844] Serialized 14 byte log entry
0709 12:20:07.773093 (+455952us) spinlock_profiling.cc:243] Waited 41.8 ms on lock 0x7b180041bae0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a941d9c0a 00007f4a9d919219 00007f4a9b22058f 00007f4a9425f571 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd
0709 12:20:08.190505 (+417412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:10.035439 (+1844934us) spinlock_profiling.cc:243] Waited 73.5 ms on lock 0x7b54000ce754. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:10.035500 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:10.035585 (+    85us) raft_consensus.cc:1685] finished
0709 12:20:10.035595 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:10.035761 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":508681,"prepare.queue_time_us":165005,"prepare.run_cpu_time_us":140,"prepare.run_wall_time_us":4212,"raft.queue_time_us":386205,"raft.run_cpu_time_us":400,"raft.run_wall_time_us":22640,"spinlock_wait_cycles":265132800,"thread_start_us":1130095,"threads_started":3,"wal-append.queue_time_us":497891,"wal-append.run_cpu_time_us":9969,"wal-append.run_wall_time_us":1481629}
I20260709 12:20:10.073360 28911 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:10.076772 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.082090 28742 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:10.067939 28973 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:10.073635 28926 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:10.087118 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.053947 28613 consensus_queue.cc:237] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:10.093065 28916 consensus_queue.cc:1048] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:10.076867 28437 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:10.100908 28975 consensus_queue.cc:260] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:10.102249 28975 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:10.102522 28437 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:10.104494 28979 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:10.104951 24320 raft_consensus.cc:2393] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 11: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:10.106005 28946 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:10.072670 28688 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:10.079738 28720 consensus_queue.cc:260] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:10.084535 28882 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:10.091686 28911 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:10.121667 28804 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:20:10.130553 28911 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:10.091339 28926 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:10.092159 28973 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:10.138804 28932 raft_consensus.cc:3055] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:10.139370 28932 raft_consensus.cc:740] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:10.140170 28973 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:10.111483 28720 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:10.140424 28932 consensus_queue.cc:260] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:10.155169 28932 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:10.124469 28804 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:20:10.133116 28967 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:10.179891 28948 log.cc:927] Time spent T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 1.040s	user 0.000s	sys 0.003s
I20260709 12:20:10.180927 28688 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:10.181559 28908 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:10.187479 25112 raft_consensus.cc:1275] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:20:10.192703 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:10.193379 24317 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
I20260709 12:20:10.194839 25084 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:10.196216 28945 raft_consensus.cc:2804] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:10.196662 28945 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:10.187626 24469 raft_consensus.cc:2955] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 3 to 7, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:10.173411 28979 raft_consensus.cc:697] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
W20260709 12:20:10.191643 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 116167us
W20260709 12:20:10.199119 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 134287us
I20260709 12:20:10.207018 28983 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.207967 28983 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:10.211566 28974 log.cc:927] Time spent T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
W20260709 12:20:10.214355 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.189589 28723 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:10.215972 24316 raft_consensus.cc:2368] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12.
I20260709 12:20:10.217139 28723 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:10.219491 28983 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:10.189280 28911 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.222038 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:10.222725 28905 raft_consensus.cc:2764] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 12:20:10.225104 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:10.235752 24319 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:20:10.226334 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:10.237332 24321 raft_consensus.cc:2393] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 9: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:10.230578 24317 raft_consensus.cc:1240] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:10.230384 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:20:10.238394 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.238628 25112 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:10.238987 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.203893 28945 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:10.254381 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.241766 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:10.241446 28911 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:10.241580 28979 consensus_queue.cc:237] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:10.241460 28720 consensus_queue.cc:1059] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:10.235049 28646 consensus_queue.cc:1048] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 12:20:10.243242 24391 raft_consensus.cc:1275] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:20:10.243801 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:20:10.257408 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.248044 24321 raft_consensus.cc:1240] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:10.248242 28883 raft_consensus.cc:3055] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:10.248606 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:10.257617 24398 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:20:10.299304 28986 raft_consensus.cc:3055] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:10.296322 25112 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
W20260709 12:20:10.302786 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 48317.3us
I20260709 12:20:10.307174 24290 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:10.308179 24324 raft_consensus.cc:1240] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:10.268869 28883 raft_consensus.cc:740] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
W20260709 12:20:10.314096 28950 log.cc:927] Time spent T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 1.180s	user 0.003s	sys 0.000s
I20260709 12:20:10.259506 28926 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:10.316272 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.316191 28926 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:10.317606 24290 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:10.320680 24289 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:10.323256 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 961) took 1093 ms. Trace:
I20260709 12:20:10.323694 24469 rpcz_store.cc:276] 0709 12:20:09.230110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:09.734683 (+504573us) service_pool.cc:224] Handling call
0709 12:20:09.735478 (+   795us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:10.049753 (+314275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:10.049787 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:10.068178 (+ 18391us) log.cc:844] Serialized 598 byte log entry
0709 12:20:10.184056 (+115878us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:10.322610 (+138554us) log.cc:844] Serialized 14 byte log entry
0709 12:20:10.322895 (+   285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:10.322980 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:10.323023 (+    43us) raft_consensus.cc:1685] finished
0709 12:20:10.323034 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:10.323189 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10015,"raft.queue_time_us":239582,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"thread_start_us":342073,"threads_started":2,"wal-append.queue_time_us":153134}
I20260709 12:20:10.304227 28986 raft_consensus.cc:740] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
W20260709 12:20:10.334441 28925 log.cc:927] Time spent T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 1.296s	user 0.001s	sys 0.001s
I20260709 12:20:10.328619 28982 raft_consensus.cc:2804] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:10.336753 28984 raft_consensus.cc:2749] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:10.337293 28982 raft_consensus.cc:697] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:10.338351 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:10.339310 24324 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:20:10.326411 28802 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:10.341244 28802 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:10.348129 24325 raft_consensus.cc:1240] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:10.334453 28883 consensus_queue.cc:260] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:10.347442 28945 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:10.349872 28883 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:10.351226 28945 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:10.353595 24323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2463) took 1612 ms. Trace:
I20260709 12:20:10.311471 28720 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.354043 24323 rpcz_store.cc:276] 0709 12:20:08.748484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:08.789265 (+ 40781us) service_pool.cc:224] Handling call
0709 12:20:10.353302 (+1564037us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400167e54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:10.353509 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3082591616}
I20260709 12:20:10.354461 28720 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:10.317042 28498 raft_consensus.cc:2749] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:10.358945 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.369468 28986 consensus_queue.cc:260] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:10.370115 28957 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:10.370942 28986 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:10.360855 28802 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:10.374306 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:10.374938 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:10.374979 24391 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:10.375869 24392 raft_consensus.cc:2410] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:20:10.378360 24396 raft_consensus.cc:1275] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:20:10.378321 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:10.379910 24394 raft_consensus.cc:1240] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:10.380712 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:10.381278 24399 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:10.381422 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:10.385316 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:10.385533 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:10.386188 24316 raft_consensus.cc:2393] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 10: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:10.386845 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:10.387203 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:10.387320 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:10.388163 24396 raft_consensus.cc:1275] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:20:10.338418 28982 consensus_queue.cc:237] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:10.391745 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:10.392501 24318 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:10.388783 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:10.389057 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:10.327663 28752 raft_consensus.cc:2749] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:10.395866 24392 raft_consensus.cc:2393] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:10.398222 24317 raft_consensus.cc:1240] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11. Ops: []
W20260709 12:20:10.407450 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.411845 24391 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:20:10.413256 28498 consensus_queue.cc:1048] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:20:10.421996 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:10.422416 24316 raft_consensus.cc:1275] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:20:10.422674 24394 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 6.
I20260709 12:20:10.425012 24474 raft_consensus.cc:1275] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:20:10.426312 24399 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:20:10.430635 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:10.489600 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:10.490336 24324 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:20:10.431607 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:10.441876 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:10.493515 24316 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:10.442894 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 657) took 1701 ms. Trace:
I20260709 12:20:10.494158 25118 rpcz_store.cc:276] 0709 12:20:08.741067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:08.790609 (+ 49542us) service_pool.cc:224] Handling call
0709 12:20:08.797336 (+  6727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:09.046969 (+249633us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:09.047014 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:09.067249 (+ 20235us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:09.076566 (+  9317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:10.442631 (+1366065us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b5400709254. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:10.442685 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:10.442834 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":565307776}
I20260709 12:20:10.443634 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:10.447217 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:10.447682 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:10.447965 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:10.497977 25112 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:10.498422 25117 raft_consensus.cc:2368] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12.
I20260709 12:20:10.449715 28958 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:10.454753 25115 raft_consensus.cc:1240] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:20:10.467907 25082 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:10.469192 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 101965us
I20260709 12:20:10.501605 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:10.502235 24469 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:20:10.502377 24290 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:10.434001 28720 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:10.396030 28978 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:10.489094 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:10.513463 24319 raft_consensus.cc:2393] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 9: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:10.497943 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:10.444432 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:10.501343 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:10.486994 24366 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:10.505846 25082 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:10.508504 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:10.515929 24321 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
I20260709 12:20:10.510681 24474 raft_consensus.cc:1275] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:20:10.513793 24289 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:10.515476 24318 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:20:10.414840 28610 consensus_queue.cc:1059] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 12:20:10.512666 28973 consensus_queue.cc:1048] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:20:10.550138 24317 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
I20260709 12:20:10.520354 28983 raft_consensus.cc:2804] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:10.530241 28752 raft_consensus.cc:2749] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:10.513002 28942 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:10.526048 24366 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:10.567847 24470 raft_consensus.cc:2410] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:20:10.547459 24398 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:10.525954 28742 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:20:10.571632 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 51029.1us
I20260709 12:20:10.528110 24289 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:10.553119 28688 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:10.557780 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:10.584023 24467 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:10.566778 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 64498.1us
I20260709 12:20:10.586198 25112 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
W20260709 12:20:10.590389 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 62378.6us
I20260709 12:20:10.591998 25084 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:10.593233 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:10.593562 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:10.593721 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:10.513471 28958 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:10.594682 24471 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:20:10.596530 24440 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:10.590472 24290 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:10.520493 28498 consensus_queue.cc:1048] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 12:20:10.598829 24398 raft_consensus.cc:2393] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 13: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:10.598449 24290 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:10.597391 24469 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
I20260709 12:20:10.573781 28983 raft_consensus.cc:697] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:10.603119 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:10.585736 28802 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:10.605387 24473 raft_consensus.cc:1275] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:20:10.603869 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:10.527299 28978 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:10.605662 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:10.658349 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:10.608234 24394 raft_consensus.cc:2393] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 11: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
W20260709 12:20:10.618259 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:10.627885 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.607260 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:10.673486 24472 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:20:10.601037 28915 raft_consensus.cc:2749] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:10.681731 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:10.606312 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.682755 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:10.679692 24397 raft_consensus.cc:2410] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:20:10.682854 24471 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
W20260709 12:20:10.684012 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 87590.9us
I20260709 12:20:10.605983 24473 pending_rounds.cc:85] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 8
I20260709 12:20:10.685287 24473 pending_rounds.cc:107] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:20:10.685776 24473 raft_consensus.cc:2889] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:10.597056 28752 raft_consensus.cc:2804] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:10.687918 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:10.599645 28688 raft_consensus.cc:697] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:10.596836 28742 raft_consensus.cc:697] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:10.688838 24467 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:20:10.598706 28720 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.698400 24398 raft_consensus.cc:2393] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 11: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:10.699131 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:10.707882 28742 consensus_queue.cc:237] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:10.709362 28720 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:10.711069 28994 log.cc:927] Time spent T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:20:10.711975 28720 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:10.702033 24469 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:20:10.702077 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:10.714874 28773 raft_consensus.cc:3055] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:10.715411 28773 raft_consensus.cc:740] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:10.657195 28802 raft_consensus.cc:697] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:10.627835 28970 raft_consensus.cc:2749] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:10.706425 28993 log.cc:927] Time spent T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:20:10.604417 28851 raft_consensus.cc:2804] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:20:10.720500 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.604971 28911 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:10.690165 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 161819us
I20260709 12:20:10.688203 28986 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.687692 28967 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:20:10.725627 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.603367 28991 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:10.596380 28610 consensus_queue.cc:1048] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 12:20:10.737712 28851 raft_consensus.cc:697] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:10.722077 24440 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:10.723059 24466 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:20:10.745427 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:10.603463 28887 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:10.752293 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.729626 28752 raft_consensus.cc:697] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:10.755066 24316 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:20:10.757951 24440 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:10.764909 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:10.765475 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.769018 24438 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:10.785288 25083 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:10.760758 28720 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:10.795217 24472 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
W20260709 12:20:10.794153 24290 leader_election.cc:336] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.893s (SENT)
I20260709 12:20:10.799015 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:10.802333 24470 raft_consensus.cc:3055] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:10.803331 25111 raft_consensus.cc:1275] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:20:10.802780 24470 raft_consensus.cc:740] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:10.716492 28773 consensus_queue.cc:260] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:10.809860 24440 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:10.807935 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 110475us
I20260709 12:20:10.793421 28979 raft_consensus.cc:2804] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:10.754735 28986 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:10.754243 28967 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:10.792850 28992 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:10.785519 28926 consensus_queue.cc:1048] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:20:10.822964 24440 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:10.825745 24366 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:20:10.826897 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.829104 24397 raft_consensus.cc:1275] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:20:10.828831 24470 consensus_queue.cc:260] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:10.819212 28802 consensus_queue.cc:237] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:10.797083 28688 consensus_queue.cc:237] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:10.814536 28973 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:10.836725 28967 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:10.859225 28967 consensus_queue.cc:1059] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:10.860561 28967 consensus_queue.cc:1243] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer c711faa13ead43ebbea0192cb74a4756 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:20:10.861131 28967 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:10.861460 28967 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:10.837293 28958 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:10.838176 29002 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.838841 29005 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.863443 29005 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:10.785243 28983 consensus_queue.cc:237] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:10.864987 29004 raft_consensus.cc:3055] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:10.864817 28752 consensus_queue.cc:237] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:10.841243 28998 log.cc:927] Time spent T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:20:10.843568 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.843904 28851 consensus_queue.cc:237] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:10.853235 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.823167 28804 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:10.877177 24470 raft_consensus.cc:3060] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:10.856743 24398 raft_consensus.cc:1275] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:20:10.878213 24398 pending_rounds.cc:85] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a: Aborting all ops after (but not including) 6
I20260709 12:20:10.878546 24398 pending_rounds.cc:107] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:20:10.878870 24398 raft_consensus.cc:2889] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:10.857697 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:10.862545 29002 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:10.865499 29004 raft_consensus.cc:740] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:10.821859 28773 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:10.849584 24366 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:10.861810 28967 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:10.882944 24394 raft_consensus.cc:1240] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:10.848938 28979 raft_consensus.cc:697] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:10.894951 24323 raft_consensus.cc:1275] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:20:10.887974 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 102770us
W20260709 12:20:10.898006 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 75152.9us
W20260709 12:20:10.901614 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 103115us
I20260709 12:20:10.902834 24291 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:10.907043 24395 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:10.903941 28498 raft_consensus.cc:2804] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:10.930428 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:10.930482 24440 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:10.936216 24398 raft_consensus.cc:1240] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:20:10.875924 28982 consensus_queue.cc:1048] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:20:10.907239 29003 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.948897 28992 raft_consensus.cc:2749] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:10.949069 28519 consensus_queue.cc:1048] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:20:10.952378 24399 raft_consensus.cc:1240] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:20:10.952690 24440 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:10.904685 28991 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:10.897171 28958 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.905148 28758 raft_consensus.cc:2749] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:10.944765 28498 raft_consensus.cc:697] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:20:10.958343 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 108901us
I20260709 12:20:10.942687 28926 consensus_queue.cc:1059] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:20:10.929499 28905 consensus_queue.cc:1048] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:20:10.957098 29005 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:10.963021 28942 raft_consensus.cc:2749] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:10.960731 24365 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:10.942535 28883 consensus_queue.cc:1048] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:20:10.965215 28979 consensus_queue.cc:237] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
W20260709 12:20:10.977625 28972 log.cc:927] Time spent T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.964s	user 0.007s	sys 0.000s
I20260709 12:20:10.979094 29002 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:10.957332 29003 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:10.967460 28992 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:20:10.995023 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 93951.8us
I20260709 12:20:10.995338 24470 raft_consensus.cc:1275] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:20:10.996661 24470 pending_rounds.cc:85] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 7
I20260709 12:20:10.996960 24470 pending_rounds.cc:107] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:20:10.997251 24470 raft_consensus.cc:2889] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:10.983470 29005 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:11.015038 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 54456.2us
I20260709 12:20:11.014732 25083 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:11.016571 24365 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:11.018288 24365 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:10.966082 28958 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:10.995441 29002 consensus_queue.cc:1048] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:20:11.146252 24400 raft_consensus.cc:1240] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:10.996678 28758 consensus_queue.cc:1048] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.151s
I20260709 12:20:11.026891 29013 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:11.107758 29003 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:11.104074 28978 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:11.136879 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 47901.3us
I20260709 12:20:11.020320 28992 raft_consensus.cc:697] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:11.083707 28945 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.150832 28945 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:11.139886 24440 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:11.151330 28992 consensus_queue.cc:237] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.3, Last appended by leader: 3, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:11.151716 28758 consensus_queue.cc:1048] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:11.153401 28926 raft_consensus.cc:2749] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:11.154551 28758 consensus_queue.cc:1048] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:11.007339 28988 raft_consensus.cc:3055] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:11.161360 28988 raft_consensus.cc:740] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:11.162683 28988 consensus_queue.cc:260] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:11.164395 28988 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:11.027236 29012 raft_consensus.cc:2764] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:20:11.157510 28945 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:11.172348 28958 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:11.173152 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 155983us
I20260709 12:20:11.174016 25083 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:11.042624 29010 raft_consensus.cc:2749] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:11.175101 28957 raft_consensus.cc:2749] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:20:11.176046 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 94497.3us
I20260709 12:20:11.176570 28742 consensus_queue.cc:1048] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:11.148015 28967 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:11.183427 28967 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:11.092334 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:11.184684 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:11.030733 28887 raft_consensus.cc:2804] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:11.185496 28887 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:11.186093 28887 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:11.108193 28498 consensus_queue.cc:237] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:11.125241 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 156386us
I20260709 12:20:11.189433 24366 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:11.122334 28519 consensus_queue.cc:1059] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:20:11.190310 29002 consensus_queue.cc:1059] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:11.191164 29002 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:11.191232 28720 raft_consensus.cc:3055] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:11.191581 29002 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.191679 28720 raft_consensus.cc:740] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:11.192019 29002 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:11.192900 28967 raft_consensus.cc:3055] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:11.192616 28720 consensus_queue.cc:260] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:11.193871 28720 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:11.056515 24316 raft_consensus.cc:1275] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:20:11.204725 29004 consensus_queue.cc:260] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:11.206588 29004 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:11.009007 29005 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:11.021028 24395 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14.
I20260709 12:20:11.183490 24396 raft_consensus.cc:1240] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:11.193272 28967 raft_consensus.cc:740] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:11.155211 24440 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:11.151489 24365 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:11.217428 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:11.222704 24366 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:11.222626 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 48697us
W20260709 12:20:11.224576 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 73173us
W20260709 12:20:11.225661 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:11.226084 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:11.226495 24365 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:11.227437 24365 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:20:11.230646 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 75548.3us
I20260709 12:20:11.231977 24440 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:11.235234 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:11.237262 24470 raft_consensus.cc:1275] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:11.230705 24366 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:11.239460 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:11.240396 24469 raft_consensus.cc:2393] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 11: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:11.237231 24365 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:11.247736 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:11.248417 24440 leader_election.cc:400] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12.
I20260709 12:20:11.248742 24440 leader_election.cc:403] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:11.232055 29013 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:11.241638 28926 consensus_queue.cc:1059] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:20:11.251376 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:11.143748 28804 raft_consensus.cc:2749] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:11.252333 24469 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:20:11.232821 29003 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:11.233465 28758 raft_consensus.cc:2804] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:11.234863 28802 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:11.260300 24440 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:11.259333 25083 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:11.258005 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 347648us
I20260709 12:20:11.235055 28978 raft_consensus.cc:2749] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:11.243942 28979 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:11.236227 28991 raft_consensus.cc:697] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:11.234092 29010 consensus_queue.cc:1048] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:20:11.250027 29013 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.250021 29005 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:11.256068 29015 raft_consensus.cc:2804] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:11.268790 28688 raft_consensus.cc:2749] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:11.264102 29006 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:11.232940 29012 consensus_queue.cc:1048] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:20:11.270423 25083 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:11.258461 29003 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.262666 28758 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.287922 28804 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:11.281361 29013 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:11.345963 28758 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:11.380388 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 120164us
W20260709 12:20:11.318298 28972 log.cc:927] Time spent T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:20:11.263685 28958 consensus_queue.cc:1048] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 12:20:11.318266 29003 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:11.387609 24440 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:11.289520 29015 raft_consensus.cc:697] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:11.398480 24440 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:11.398986 28986 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:11.404486 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:11.388916 28979 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:11.391115 28957 raft_consensus.cc:2804] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:11.384054 28752 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:11.273051 28967 consensus_queue.cc:260] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:11.399588 28926 raft_consensus.cc:2749] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:11.425025 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 194414us
I20260709 12:20:11.431663 24366 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:11.432982 24366 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:11.434429 24366 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:11.435844 24366 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:11.436885 28802 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:11.437541 28802 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.437907 28802 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:11.439443 29006 raft_consensus.cc:2749] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:11.440807 28967 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:11.442265 29012 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:11.442798 29012 raft_consensus.cc:697] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:11.443732 29012 consensus_queue.cc:237] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:11.426968 28688 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.444916 28688 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:11.445695 29015 consensus_queue.cc:237] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:11.447304 28688 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:11.448237 28688 raft_consensus.cc:2749] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:11.453006 28688 raft_consensus.cc:2749] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:11.422258 28979 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:11.425417 28986 raft_consensus.cc:2749] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:11.427282 29022 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:11.480679 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 227378us
W20260709 12:20:11.427310 28985 log.cc:927] Time spent T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.114s	user 0.000s	sys 0.009s
I20260709 12:20:11.481662 24365 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:11.420764 28957 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:11.427296 29011 log.cc:927] Time spent T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:20:11.484261 24290 leader_election.cc:336] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.222s (SENT)
I20260709 12:20:11.486691 24290 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:11.462940 28979 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:11.503841 28802 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:11.515276 28802 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:11.515892 28802 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.504168 28916 raft_consensus.cc:2749] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:11.528481 29002 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:11.490468 28957 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:11.540534 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:11.457578 28752 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:11.552465 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:11.530380 29003 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:11.560262 29037 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:11.560444 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 78867.8us
I20260709 12:20:11.574991 24365 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:11.551898 29013 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:11.561107 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 130572us
I20260709 12:20:11.562440 29022 raft_consensus.cc:2749] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12.
I20260709 12:20:11.429847 28991 consensus_queue.cc:237] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:11.566262 28752 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:11.571386 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:11.516347 28802 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:11.580678 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:11.606402 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:11.607640 24472 raft_consensus.cc:2393] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 14: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
W20260709 12:20:11.606997 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 171238us
W20260709 12:20:11.610322 24290 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.244s (SENT) [suppressed 29 similar messages]
I20260709 12:20:11.614683 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:11.553999 29034 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:11.598897 28688 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:11.588351 28882 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.620322 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:11.625521 24472 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:20:11.622524 24440 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:11.633940 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:11.614739 29008 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.564517 28758 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:11.637576 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:11.583310 28887 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:11.634717 24468 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:20:11.618796 28986 consensus_queue.cc:1048] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:20:11.660101 29013 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:11.621444 28988 consensus_queue.cc:1059] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:20:11.642390 28997 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.642333 29008 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:11.643064 29031 consensus_queue.cc:1059] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:20:11.643312 28926 raft_consensus.cc:2749] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:11.644810 29030 consensus_queue.cc:1048] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:20:11.681689 28997 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:11.645197 29003 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:11.647544 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:11.636107 28804 raft_consensus.cc:2749] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:11.650383 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:11.690423 24316 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:20:11.653223 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:11.654496 24472 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 14.
I20260709 12:20:11.657039 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:11.691798 24323 raft_consensus.cc:2376] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9. Re-sending same reply.
I20260709 12:20:11.657732 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:11.636566 28882 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:11.658550 28802 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:11.658442 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:11.599552 29037 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:11.631065 28688 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:11.694692 28688 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:11.668378 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:11.675364 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:11.636762 29004 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.696385 24319 raft_consensus.cc:2393] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 10: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:11.696435 29004 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:11.698909 29016 log.cc:927] Time spent T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.533s	user 0.000s	sys 0.003s
I20260709 12:20:11.699043 29004 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:11.638173 29034 raft_consensus.cc:697] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:11.677577 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:11.657745 24440 leader_election.cc:400] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 election: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10.
I20260709 12:20:11.682219 29033 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.700485 29034 consensus_queue.cc:237] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:11.701047 29033 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:11.719338 24467 raft_consensus.cc:1240] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:20:11.682873 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:11.683511 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:11.683619 28916 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.681355 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:11.692433 28804 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.674355 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:11.744928 25113 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
W20260709 12:20:11.772732 29018 log.cc:927] Time spent T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.639s	user 0.002s	sys 0.000s
I20260709 12:20:11.672227 28957 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:11.807808 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:20:11.786224 24290 leader_election.cc:336] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 2.249s (SENT)
I20260709 12:20:11.808524 24323 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:11.790048 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 132556us
I20260709 12:20:11.809639 24440 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:11.796695 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:11.799989 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:11.801273 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:11.811012 24320 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
I20260709 12:20:11.801549 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:20:11.793879 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:11.811975 25117 raft_consensus.cc:1275] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:20:11.815475 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:11.816121 24319 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
W20260709 12:20:11.818511 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:11.821194 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:11.822468 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:11.822780 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:11.824005 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:11.824683 24317 raft_consensus.cc:2468] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:20:11.826174 24320 raft_consensus.cc:1275] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:20:11.826623 24320 pending_rounds.cc:85] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756: Aborting all ops after (but not including) 10
I20260709 12:20:11.826907 24320 pending_rounds.cc:107] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:20:11.827251 24320 raft_consensus.cc:2889] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:11.830143 25116 raft_consensus.cc:1240] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:11.832710 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:11.833348 24319 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:11.817426 29004 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.764348 28804 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:11.829600 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 163613us
I20260709 12:20:11.834880 28802 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:11.861060 25082 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:11.829595 28926 raft_consensus.cc:2749] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:11.871392 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:11.863772 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 77615.3us
I20260709 12:20:11.858513 24400 raft_consensus.cc:2955] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 3 to 7, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:11.829135 28915 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:11.874054 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 43780.8us
I20260709 12:20:11.875671 24440 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:11.836339 29013 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:11.877822 24393 raft_consensus.cc:1275] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:20:11.870915 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 49483.4us
I20260709 12:20:11.829833 28887 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:11.877847 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:11.829679 28758 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:11.885376 24394 raft_consensus.cc:2368] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 13. Current term is 14.
I20260709 12:20:11.885187 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:11.762010 28916 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:11.890632 24319 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 14.
I20260709 12:20:11.893079 25082 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:11.893261 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:11.898409 24469 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:11.901726 24365 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:11.905580 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:11.880976 28991 raft_consensus.cc:2749] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:11.909160 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:11.913308 24472 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:11.916361 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:11.864313 29004 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:11.947670 24440 leader_election.cc:400] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12.
I20260709 12:20:11.934754 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:11.937220 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:11.944136 24472 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:20:11.944312 24323 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
I20260709 12:20:11.949755 24440 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:11.924161 24469 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
I20260709 12:20:11.916879 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:11.955430 24470 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:11.956192 24473 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:20:11.959363 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:11.983333 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:11.984213 24472 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:11.912417 29030 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.979964 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:11.981554 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 79860.7us
I20260709 12:20:11.886675 28915 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:11.982031 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 198877us
I20260709 12:20:11.960831 24394 raft_consensus.cc:2393] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 11: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:11.983429 24397 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:11.909147 28997 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:11.890786 29013 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:11.996126 24365 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:12.019085 24365 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:11.907995 28773 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.912745 28882 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:11.878916 28802 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:11.999425 25084 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:12.027396 24472 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:20:11.938489 29033 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:12.021768 24470 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:20:11.909471 28926 consensus_queue.cc:1059] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.087s
W20260709 12:20:12.023799 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 130824us
I20260709 12:20:11.912289 28883 consensus_queue.cc:1059] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 12:20:11.917048 29037 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:12.042470 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:12.024209 24365 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:11.997951 29045 raft_consensus.cc:2804] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:12.029440 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:12.046819 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:12.047550 24469 raft_consensus.cc:2376] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11. Re-sending same reply.
I20260709 12:20:12.036181 25082 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:12.002554 28988 raft_consensus.cc:2749] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:11.982307 28742 consensus_queue.cc:1048] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:20:12.048604 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:12.028167 28997 raft_consensus.cc:2804] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:12.031390 29036 raft_consensus.cc:2804] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:12.029762 28758 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:12.062026 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:12.054302 24365 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:12.069777 24393 raft_consensus.cc:1275] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:20:12.076129 24472 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:12.070699 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:20:12.077672 28983 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.941s	user 0.019s	sys 0.016s
I20260709 12:20:12.009433 29030 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:12.083010 24469 raft_consensus.cc:2393] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:12.146297 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:12.084596 24365 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:12.047037 28882 raft_consensus.cc:2749] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:12.031795 28773 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:12.046237 29045 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.153824 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:12.155998 29048 log.cc:927] Time spent T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
W20260709 12:20:12.078107 28983 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.019s	sys 0.016s
I20260709 12:20:12.046044 29049 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.062083 28926 consensus_queue.cc:1243] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer c855242ec9d34a5397741ef20db9de8a log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:20:12.153704 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:12.042899 28752 consensus_queue.cc:1048] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.109s
W20260709 12:20:12.157617 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 139742us
I20260709 12:20:12.071928 29037 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:12.173058 24473 raft_consensus.cc:1275] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:20:12.188669 24473 pending_rounds.cc:85] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 6
I20260709 12:20:12.188974 24473 pending_rounds.cc:107] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:20:12.189261 24473 raft_consensus.cc:2889] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:12.075062 28997 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:20:12.174957 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 92735.1us
I20260709 12:20:12.078620 28957 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:12.087126 29034 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:12.179857 24472 raft_consensus.cc:2410] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 12:20:12.172497 28773 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:12.150141 29036 raft_consensus.cc:697] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:20:12.184340 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 140121us
I20260709 12:20:12.220954 24290 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:12.220809 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:12.223270 24469 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:20:12.216351 24365 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:12.158427 28758 raft_consensus.cc:697] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:12.083936 29052 consensus_queue.cc:1048] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.104s
I20260709 12:20:12.242436 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:12.243117 24472 raft_consensus.cc:2376] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12. Re-sending same reply.
I20260709 12:20:12.178639 29030 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:12.249505 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:12.216164 28997 raft_consensus.cc:3060] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:12.251212 24393 raft_consensus.cc:1240] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:12.183197 28882 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:12.250157 24472 raft_consensus.cc:2393] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 14: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:12.183740 29045 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:12.252914 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 62758.8us
W20260709 12:20:12.261307 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 72983.2us
I20260709 12:20:12.220772 28804 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:12.221794 29034 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.246775 28773 raft_consensus.cc:2749] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:12.265887 24393 raft_consensus.cc:1275] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:20:12.251025 29037 raft_consensus.cc:697] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:12.268008 29066 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:12.268541 29051 raft_consensus.cc:2804] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:20:12.269634 29053 log.cc:927] Time spent T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 12:20:12.278748 29036 consensus_queue.cc:237] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:12.280054 29013 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:12.253970 28916 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:12.282639 28758 consensus_queue.cc:237] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:12.256413 29003 raft_consensus.cc:2804] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:12.371490 29003 raft_consensus.cc:697] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:12.372555 29003 consensus_queue.cc:237] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:12.325111 29066 raft_consensus.cc:697] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:20:12.285374 29046 log.cc:927] Time spent T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 12:20:12.287339 28802 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:12.293018 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:12.321401 28498 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.297119 28915 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:12.222167 29049 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:12.325309 29051 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.305231 24438 leader_election.cc:400] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 13. Current term is 14.
I20260709 12:20:12.390667 24438 leader_election.cc:403] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:12.312410 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:12.313016 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:20:12.360100 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 93324.2us
I20260709 12:20:12.323760 24400 raft_consensus.cc:1240] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:20:12.328743 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:12.396090 24318 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:20:12.368829 24324 raft_consensus.cc:1275] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:20:12.325462 28997 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:12.321029 29034 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:12.324730 29037 consensus_queue.cc:237] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:12.293812 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:12.384809 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:12.402213 24289 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:12.321687 28883 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:12.364624 28688 consensus_meta.cc:287] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.669s	user 0.013s	sys 0.003s
I20260709 12:20:12.356348 24366 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:12.397439 24290 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:12.367023 29002 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:12.398327 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 93275.7us
I20260709 12:20:12.401698 28992 raft_consensus.cc:2749] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 13. Current term is 14.
W20260709 12:20:12.407562 29009 log.cc:927] Time spent T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 1.364s	user 0.001s	sys 0.009s
I20260709 12:20:12.407918 28915 consensus_queue.cc:1048] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:12.386794 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:12.411762 24317 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:12.391983 29051 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:12.435412 24468 raft_consensus.cc:1275] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:20:12.406852 28997 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:12.402100 29013 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.422533 28883 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:12.452867 29045 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:12.493388 25119 raft_consensus.cc:1240] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12. Ops: [9.9-11.10]
I20260709 12:20:12.493845 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:12.495246 25114 raft_consensus.cc:1275] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:20:12.496546 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:12.459618 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 62241.7us
I20260709 12:20:12.470353 28802 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:12.502084 24290 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:12.505285 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:12.506666 25110 raft_consensus.cc:1240] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 8. Current term is 10. Ops: []
I20260709 12:20:12.509577 24290 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:12.511761 29059 raft_consensus.cc:2749] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:12.514285 25082 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:12.514416 28883 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:12.517135 24440 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:12.518707 24440 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:12.466616 28982 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:12.477237 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:12.532500 24393 raft_consensus.cc:1275] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:20:12.393117 28498 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:12.424477 29062 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:12.422152 28688 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:12.524906 24290 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:12.466524 28915 consensus_queue.cc:1243] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer 99b8650fa8324ac2ac5f75eee9b1a1e3 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:20:12.541474 28926 consensus_queue.cc:1059] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:12.467007 28970 consensus_queue.cc:1059] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:20:12.467732 28916 consensus_queue.cc:1048] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:20:12.521906 28752 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:12.472283 28984 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:12.544725 24290 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:12.518507 28942 consensus_queue.cc:1048] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:20:12.531302 28958 raft_consensus.cc:2749] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:12.536834 29062 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.535989 28883 raft_consensus.cc:2749] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:12.533413 28988 raft_consensus.cc:2749] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:12.535712 28804 consensus_queue.cc:1048] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:20:12.554600 24290 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:12.594273 24290 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:12.471303 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 120422us
I20260709 12:20:12.542232 28688 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:12.490769 24317 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:20:12.499240 29013 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:12.546749 28904 raft_consensus.cc:2749] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:12.532289 28992 consensus_queue.cc:1059] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:20:12.437726 29066 consensus_queue.cc:237] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:12.557672 28970 raft_consensus.cc:2749] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:12.601923 24366 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:12.589028 29062 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:12.611989 29022 raft_consensus.cc:3055] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:12.620332 29004 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:12.603336 29040 consensus_queue.cc:1048] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.199s
I20260709 12:20:12.621773 28498 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:12.622619 29022 raft_consensus.cc:740] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:12.623659 29013 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:12.623680 29022 consensus_queue.cc:260] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:12.625308 29022 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:12.612823 28979 raft_consensus.cc:3055] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:12.625478 24395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2693) took 1774 ms. Trace:
I20260709 12:20:12.625799 28979 raft_consensus.cc:740] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:12.625871 24395 rpcz_store.cc:276] 0709 12:20:10.850889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.851012 (+   123us) service_pool.cc:224] Handling call
0709 12:20:12.625269 (+1774257us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b54001b8d54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:12.625393 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62992768}
I20260709 12:20:12.626753 28979 consensus_queue.cc:260] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:12.628008 28979 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:12.557788 28984 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:12.630292 24467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2315) took 1046 ms. Trace:
I20260709 12:20:12.630697 24467 rpcz_store.cc:276] 0709 12:20:11.584209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.584345 (+   136us) service_pool.cc:224] Handling call
0709 12:20:11.584687 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:11.719983 (+135296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:12.630037 (+910054us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54000fe1d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:12.630234 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308586752}
I20260709 12:20:12.615257 25110 raft_consensus.cc:1240] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:20:12.635810 24366 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:12.632622 24467 raft_consensus.cc:1275] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:20:12.645576 24467 raft_consensus.cc:1275] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:20:12.648525 24467 raft_consensus.cc:1275] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:20:12.649117 24467 pending_rounds.cc:85] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 5
I20260709 12:20:12.649438 24467 pending_rounds.cc:107] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:20:12.649749 24366 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:12.598443 28752 raft_consensus.cc:2749] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:12.618144 29038 log.cc:927] Time spent T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.976s	user 0.002s	sys 0.000s
I20260709 12:20:12.668210 24366 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:12.668831 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 74681.3us
I20260709 12:20:12.664023 29004 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:12.676748 24290 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:12.610679 29045 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:12.664716 29077 raft_consensus.cc:2749] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:12.603083 28904 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:12.615334 29049 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:12.649770 24467 raft_consensus.cc:2889] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:12.673367 28802 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.631220 28984 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:12.671173 24472 raft_consensus.cc:1275] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:20:12.644680 28688 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:12.639500 28926 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:12.696069 29071 log.cc:927] Time spent T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:20:12.705804 28942 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:20:12.707952 25083 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.018s	sys 0.038s
I20260709 12:20:12.708956 29043 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:20:12.709888 29026 log.cc:927] Time spent T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 1.208s	user 0.000s	sys 0.009s
I20260709 12:20:12.713220 24290 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:12.714720 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:12.715005 25118 raft_consensus.cc:1240] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12. Ops: [9.9-11.10]
I20260709 12:20:12.676121 28991 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.720968 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 979) took 1228 ms. Trace:
I20260709 12:20:12.678746 24366 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:12.711166 29059 raft_consensus.cc:2804] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:12.710434 28883 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.730326 25116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 667) took 1076 ms. Trace:
I20260709 12:20:12.750335 29004 raft_consensus.cc:2749] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:12.750537 25116 rpcz_store.cc:276] 0709 12:20:11.653715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.653876 (+   161us) service_pool.cc:224] Handling call
0709 12:20:11.654273 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:11.830695 (+176422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:12.730001 (+899306us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b5400514ad4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:12.730243 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":403818880}
I20260709 12:20:12.724119 28975 raft_consensus.cc:3055] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:12.733302 29060 raft_consensus.cc:3055] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:20:12.751732 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 73038.1us
I20260709 12:20:12.752144 29060 raft_consensus.cc:740] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:12.736079 28926 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:12.753211 24366 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
W20260709 12:20:12.738077 25083 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.018s	sys 0.039s
I20260709 12:20:12.737056 28942 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:12.750108 29059 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:12.775887 29059 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:12.779148 29040 consensus_queue.cc:1048] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:12.750391 28883 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:12.741823 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2314) took 1160 ms. Trace:
I20260709 12:20:12.783391 28988 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:12.784830 24396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2692) took 1956 ms. Trace:
I20260709 12:20:12.784673 28988 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:12.785689 28883 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:12.786520 29037 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.786863 25111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 1298) took 1728 ms. Trace:
I20260709 12:20:12.781245 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:12.787874 24474 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 12.
I20260709 12:20:12.787029 28988 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:12.775897 28983 consensus_queue.cc:1048] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:20:12.787096 29037 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:12.792929 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:12.793396 29037 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:12.793612 24471 rpcz_store.cc:276] 0709 12:20:11.581906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.582127 (+   221us) service_pool.cc:224] Handling call
0709 12:20:11.582607 (+   480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:11.599761 (+ 17154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:11.599816 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:11.611470 (+ 11654us) log.cc:844] Serialized 26 byte log entry
0709 12:20:12.300651 (+689181us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b18004957c0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a94241e07 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425ec02 00007f4a96ee620b 00007f4a96eebd23 00007f4a96eec0d1 00007f4a97307a0f
0709 12:20:12.421407 (+120756us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:12.421483 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:12.421565 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:12.737738 (+316173us) raft_consensus.cc:1685] finished
0709 12:20:12.737758 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:12.741751 (+  3993us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7008,"raft.queue_time_us":202,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":15830,"spinlock_wait_cycles":3042688,"thread_start_us":86746,"threads_started":1,"wal-append.queue_time_us":857878}
W20260709 12:20:12.796510 29079 log.cc:927] Time spent T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:20:12.796912 24399 raft_consensus.cc:1275] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 3. Preceding OpId from leader: term: 11 index: 4. (index mismatch)
I20260709 12:20:12.799292 29081 consensus_queue.cc:1048] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:20:12.800578 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:12.801455 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:12.801738 28498 consensus_queue.cc:1048] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:12.801854 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:12.802863 25113 raft_consensus.cc:2393] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 10: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:12.803530 28979 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:12.804224 28979 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:12.805536 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:12.806193 25117 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:20:12.807515 28979 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:12.785307 24396 rpcz_store.cc:276] 0709 12:20:10.850428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.854191 (+  3763us) service_pool.cc:224] Handling call
0709 12:20:11.057280 (+203089us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:11.219939 (+162659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:12.784532 (+1564593us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54000cdd54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:12.784758 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289794816}
I20260709 12:20:12.810367 25083 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:12.747412 24466 rpcz_store.cc:276] 0709 12:20:11.492661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.492851 (+   190us) service_pool.cc:224] Handling call
0709 12:20:11.502897 (+ 10046us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:11.512831 (+  9934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:11.512866 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:11.513416 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 12:20:11.624190 (+110774us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:11.624251 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:11.624348 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:12.617304 (+992956us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:20:12.716521 (+ 99217us) raft_consensus.cc:1685] finished
0709 12:20:12.716555 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:12.720880 (+  4325us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":269,"raft.queue_time_us":27275,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":140,"spinlock_wait_cycles":17976064,"thread_start_us":110337,"threads_started":1,"wal-append.queue_time_us":128036}
I20260709 12:20:12.757813 24366 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:12.763494 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:12.756152 29004 raft_consensus.cc:2764] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 12:20:12.774188 29080 log.cc:927] Time spent T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:20:12.775089 28942 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:12.752012 28975 raft_consensus.cc:740] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:12.754405 28984 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:12.847048 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:12.847956 24470 raft_consensus.cc:2393] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 13: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:12.816380 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:12.849162 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:12.816788 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 59029.4us
I20260709 12:20:12.818971 24396 raft_consensus.cc:1275] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:20:12.820012 24393 raft_consensus.cc:1217] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Deduplicated request from leader. Original: 6.7->[7.8-11.10]   Dedup: 9.9->[11.10-11.10]
I20260709 12:20:12.850412 24393 raft_consensus.cc:1240] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12. Ops: [7.8-11.10]
I20260709 12:20:12.820894 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:12.851135 24467 raft_consensus.cc:2393] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 11: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:12.851300 24366 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:12.814774 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:12.852813 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:12.826756 25112 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:20:12.830973 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:12.853878 25112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35194 (request call id 674) took 1049 ms. Trace:
I20260709 12:20:12.753309 29060 consensus_queue.cc:260] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:12.833328 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:12.835809 28915 consensus_queue.cc:1048] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:12.818826 29045 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.866770 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:12.867419 24467 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:12.814504 24391 raft_consensus.cc:1275] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:20:12.787374 25111 rpcz_store.cc:276] 0709 12:20:11.058793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.081292 (+ 22499us) service_pool.cc:224] Handling call
0709 12:20:11.104727 (+ 23435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:11.180075 (+ 75348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:11.180122 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:11.180685 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 12:20:11.231544 (+ 50859us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:11.231581 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:11.231647 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:12.709004 (+1477357us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:20:12.786523 (+ 77519us) raft_consensus.cc:1685] finished
0709 12:20:12.786550 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:12.786791 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74536,"raft.queue_time_us":74679,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"spinlock_wait_cycles":3477760,"thread_start_us":50496,"threads_started":1,"wal-append.queue_time_us":219241}
I20260709 12:20:12.844887 24438 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:12.845379 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:12.831223 24399 raft_consensus.cc:1240] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:12.854804 25112 rpcz_store.cc:276] 0709 12:20:11.804137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.804293 (+   156us) service_pool.cc:224] Handling call
0709 12:20:12.792790 (+988497us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b5800004598. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227eee 000000000036eb39 00007f4a9c29b1e0 00007f4a9c3640c4 00007f4a9c364131 00007f4a9c3120a0 00007f4a9c311984 00007f4a9588c6d4 00007f4a9588c662
0709 12:20:12.853815 (+ 61025us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2870016}
I20260709 12:20:12.861894 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:12.865674 24395 raft_consensus.cc:1275] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:20:12.873266 24466 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:20:12.874369 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:12.875824 24466 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:20:12.877211 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:12.878544 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:12.874369 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:12.827337 29054 raft_consensus.cc:2804] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:12.826426 28992 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.882750 24471 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:20:12.826218 28646 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:12.886053 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:12.738046 28802 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:12.887415 24365 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:12.891031 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:12.898530 24470 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:20:12.871145 29037 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:12.757669 28991 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:12.910903 24471 raft_consensus.cc:1275] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:20:12.912447 28975 consensus_queue.cc:260] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:12.913705 28975 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:12.916711 29060 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:12.897004 29036 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:12.917316 24467 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:20:12.896912 28992 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:12.922052 28804 consensus_queue.cc:1048] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:12.923763 28804 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.924667 28986 consensus_queue.cc:1059] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:12.925438 28986 consensus_queue.cc:1243] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer c855242ec9d34a5397741ef20db9de8a log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:20:12.865175 28758 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:12.888195 29054 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.888414 28988 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:12.858517 28979 consensus_queue.cc:1059] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 12:20:12.976842 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 55164.9us
I20260709 12:20:12.886847 29045 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:12.888899 29030 consensus_queue.cc:1048] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:20:12.924302 28804 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:12.987259 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 127850us
I20260709 12:20:12.937824 29054 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:12.892506 29077 consensus_queue.cc:1048] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:20:12.893042 28883 consensus_queue.cc:1059] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:20:12.936182 29040 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:12.933763 28986 consensus_queue.cc:1048] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 12:20:12.905090 28646 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:12.996348 24291 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:13.008991 24470 raft_consensus.cc:1275] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:20:13.004289 29051 consensus_meta.cc:287] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.510s	user 0.006s	sys 0.006s
I20260709 12:20:13.004503 29101 raft_consensus.cc:3055] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:13.021819 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:12.937523 28758 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:12.992727 28988 raft_consensus.cc:697] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
W20260709 12:20:13.039543 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 152218us
I20260709 12:20:13.019387 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:13.019325 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:12.988968 29066 raft_consensus.cc:2804] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:13.022415 24321 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:13.024757 24322 raft_consensus.cc:1240] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 12. Current term is 13. Ops: [9.6-12.8]
I20260709 12:20:13.020670 29036 raft_consensus.cc:697] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:13.026806 24319 raft_consensus.cc:1240] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:12.997758 28992 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:13.018601 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:13.041648 24317 raft_consensus.cc:2368] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 13. Current term is 14.
I20260709 12:20:13.025568 29067 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.042158 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:12.991626 29062 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:13.042797 24365 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:13.045143 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:13.021546 29101 raft_consensus.cc:740] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:13.048408 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:13.006083 28979 consensus_queue.cc:1048] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:20:13.045958 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:13.036412 28915 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:13.068341 24319 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:20:13.072264 24316 raft_consensus.cc:1240] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:13.044334 29066 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:13.071532 24318 raft_consensus.cc:1240] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:13.077950 24365 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:20:13.065013 29034 consensus_meta.cc:287] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.657s	user 0.013s	sys 0.000s
I20260709 12:20:13.078605 29103 raft_consensus.cc:2804] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:13.083283 29103 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:13.083652 29103 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:13.088908 28988 consensus_queue.cc:237] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:13.089861 28646 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:13.089999 29045 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:13.038898 29051 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:13.090919 28991 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:13.091526 28991 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:13.092978 29051 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:13.093070 28802 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:13.094532 25115 raft_consensus.cc:1240] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 9. Current term is 11. Ops: []
I20260709 12:20:13.095245 29101 consensus_queue.cc:260] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:13.097236 29004 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:13.097479 28904 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:13.097793 29004 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:13.098308 29004 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:13.099296 28758 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:13.079784 24322 raft_consensus.cc:1240] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:13.081077 24365 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:20:13.101130 29084 log.cc:927] Time spent T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
W20260709 12:20:13.103667 29095 log.cc:927] Time spent T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:20:13.104983 29005 raft_consensus.cc:2804] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:13.105355 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2216) took 1065 ms. Trace:
I20260709 12:20:13.105518 29005 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:13.105940 29005 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:13.105723 24468 rpcz_store.cc:276] 0709 12:20:12.039749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.475787 (+436038us) service_pool.cc:224] Handling call
0709 12:20:12.476128 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:12.476458 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:12.476486 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:12.492168 (+ 15682us) log.cc:844] Serialized 26 byte log entry
0709 12:20:12.627370 (+135202us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b18000e5300. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a94241e07 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425ec02 00007f4a96ee620b 00007f4a96eebd23 00007f4a96eec0d1 00007f4a97307a0f
0709 12:20:12.716951 (+ 89581us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:12.758365 (+ 41414us) log.cc:844] Serialized 14 byte log entry
0709 12:20:12.779935 (+ 21570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:12.780011 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:13.105049 (+325038us) raft_consensus.cc:1685] finished
0709 12:20:13.105154 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.105295 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4497,"prepare.queue_time_us":163952,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":22397,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":13662,"spinlock_wait_cycles":6130560,"thread_start_us":105816,"threads_started":2,"wal-append.queue_time_us":337084}
I20260709 12:20:13.108007 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:13.078644 28498 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.096539 29101 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:13.077484 29066 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:13.092064 28991 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:13.109386 28498 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:13.123229 29036 consensus_queue.cc:237] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:13.124053 28498 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:13.110107 28926 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:13.108597 24468 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
I20260709 12:20:13.017004 29040 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:13.125535 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:13.135499 24474 raft_consensus.cc:2410] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:20:13.143543 24321 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:13.110905 28758 consensus_queue.cc:1048] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:20:13.154829 24317 raft_consensus.cc:1275] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:20:13.072134 28915 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:13.175606 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:13.176441 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:13.177380 24398 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
W20260709 12:20:13.115628 29089 log.cc:927] Time spent T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.149s	user 0.002s	sys 0.000s
I20260709 12:20:13.180399 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:20:13.147873 29085 log.cc:927] Time spent T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 12:20:13.094642 28804 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:13.121344 29008 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:13.188930 24472 raft_consensus.cc:1275] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:20:13.190188 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:13.191349 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 299279us
I20260709 12:20:13.118865 28991 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:13.199352 24468 raft_consensus.cc:1275] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:20:13.196619 24438 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:13.114405 29062 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:13.182096 28915 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:13.172135 28975 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:13.204721 24366 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:13.073017 29067 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:13.231361 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:13.233042 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:13.220979 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:13.219049 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:13.235077 24318 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:20:13.223027 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:13.236440 24319 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:20:13.146023 29034 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:13.111202 29103 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:13.243914 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:13.244606 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:13.253441 29099 consensus_queue.cc:1048] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 12:20:13.256372 29093 log.cc:927] Time spent T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 12:20:13.258936 29034 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:13.260311 24323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 728) took 1002 ms. Trace:
I20260709 12:20:13.260742 24323 rpcz_store.cc:276] 0709 12:20:12.257951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.258121 (+   170us) service_pool.cc:224] Handling call
0709 12:20:12.258482 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:12.285937 (+ 27455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:12.285974 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:12.286516 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 12:20:12.629464 (+342948us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b180015d540. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a94241e07 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425ec02 00007f4a96ee620b 00007f4a96eebd23 00007f4a96eec0d1 00007f4a97307a0f
0709 12:20:12.669347 (+ 39883us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:12.669402 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:12.669751 (+   349us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:13.259885 (+590134us) raft_consensus.cc:1685] finished
0709 12:20:13.259911 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.260230 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7019,"raft.queue_time_us":8403,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":134,"spinlock_wait_cycles":8825600,"thread_start_us":39637,"threads_started":1,"wal-append.queue_time_us":437662}
I20260709 12:20:13.210243 28979 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:13.252422 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:13.264880 24316 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 8.
I20260709 12:20:13.266189 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:13.241480 28802 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:13.246402 28975 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:13.270292 28979 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:13.263244 29022 consensus_meta.cc:287] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.625s	user 0.012s	sys 0.000s
I20260709 12:20:13.283586 24465 raft_consensus.cc:3055] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:13.287854 24465 raft_consensus.cc:740] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:13.296510 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:13.263739 29046 log.cc:927] Time spent T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:20:13.325788 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:13.329357 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:13.330179 24323 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
W20260709 12:20:13.317920 24440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:13.318938 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:13.319900 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:13.332862 24316 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:13.342209 24366 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:13.350979 24440 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:13.352617 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:13.286998 28979 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:13.284255 28802 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:13.354259 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:13.362654 24469 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:20:13.363034 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:13.363577 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:13.351480 24366 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:13.370675 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:13.371404 24466 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:20:13.373492 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:13.374547 24469 raft_consensus.cc:2410] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 11 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 12:20:13.372371 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:13.354326 24465 consensus_queue.cc:260] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:13.261938 29054 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:13.376817 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:13.353763 28984 raft_consensus.cc:2749] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:13.372092 28802 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:13.383052 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:13.435335 24323 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:20:13.435643 24366 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:13.401233 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:13.436913 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:13.437175 24466 raft_consensus.cc:1240] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:20:13.401726 24473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2205) took 1373 ms. Trace:
I20260709 12:20:13.416730 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:13.440282 24473 rpcz_store.cc:276] 0709 12:20:12.028686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.029205 (+   519us) service_pool.cc:224] Handling call
0709 12:20:12.038461 (+  9256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:12.220429 (+181968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.401500 (+1181071us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b540030e154. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:13.401667 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271531264}
I20260709 12:20:13.403044 24471 pending_rounds.cc:85] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 7
I20260709 12:20:13.441659 24471 pending_rounds.cc:107] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:20:13.442027 24471 raft_consensus.cc:2889] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:13.442662 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:13.413681 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:13.443850 24470 raft_consensus.cc:2410] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:20:13.413951 24396 raft_consensus.cc:1240] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 12:20:13.414378 24397 raft_consensus.cc:1240] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:20:13.438198 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:13.450585 24366 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:13.408983 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:13.384274 24222 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35986 (request call id 183) took 25538 ms (client timeout 15000 ms). Trace:
W20260709 12:20:13.502224 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:13.432763 24469 raft_consensus.cc:1275] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:20:13.416410 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:13.430579 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 49688.8us
W20260709 12:20:13.391645 29090 log.cc:927] Time spent T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.403s	user 0.000s	sys 0.001s
W20260709 12:20:13.398001 29059 consensus_meta.cc:287] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.622s	user 0.013s	sys 0.000s
I20260709 12:20:13.457998 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:13.507987 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:13.509342 24320 raft_consensus.cc:1275] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:20:13.509512 24440 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:13.507406 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 48130.5us
W20260709 12:20:13.486460 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:13.507335 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:13.517460 25115 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:13.512370 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:20:13.426149 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:13.519452 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:13.382467 29113 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:13.410229 29040 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:13.529505 25116 raft_consensus.cc:1240] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:13.530689 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:13.415067 29103 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:13.379184 29110 raft_consensus.cc:2804] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:13.415872 28988 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:13.513120 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:13.527340 25119 raft_consensus.cc:1275] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:20:13.415623 29067 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:13.458185 28945 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.384933 29100 raft_consensus.cc:3055] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:13.531522 25116 raft_consensus.cc:2393] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 13: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:13.395920 28915 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:13.532766 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:13.456926 29022 consensus_queue.cc:1059] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 12:20:13.535187 24440 leader_election.cc:400] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 13. Current term is 14.
I20260709 12:20:13.534677 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:13.580154 25113 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:13.468962 29077 raft_consensus.cc:2749] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:13.580314 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 48912.2us
I20260709 12:20:13.538556 25111 raft_consensus.cc:1240] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:20:13.413136 24220 catalog_manager.cc:5697] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 4 to 8, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 8 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:13.505515 29002 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:13.581532 24440 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:13.382961 29109 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.541648 24392 raft_consensus.cc:1240] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:13.420145 29005 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:13.515554 28975 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:13.568814 29100 raft_consensus.cc:740] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:13.575870 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:13.533339 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 80816us
I20260709 12:20:13.538522 25112 raft_consensus.cc:1275] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:20:13.587560 24325 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14.
I20260709 12:20:13.587639 24440 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:13.588536 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:13.832227 25114 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:13.600854 29109 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:13.820696 29102 consensus_queue.cc:1059] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:20:13.835121 29102 raft_consensus.cc:3055] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:13.835479 29102 raft_consensus.cc:740] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:13.836272 29102 consensus_queue.cc:260] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:13.538388 29036 consensus_queue.cc:1059] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:20:13.837574 29036 raft_consensus.cc:3055] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:13.837958 29036 raft_consensus.cc:740] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:13.838824 29054 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:13.840354 29036 consensus_queue.cc:260] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:13.842597 29012 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.673445 24317 raft_consensus.cc:2393] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 11: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:13.842929 29036 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:13.549377 28519 raft_consensus.cc:2749] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:13.709842 29004 consensus_meta.cc:287] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.583s	user 0.011s	sys 0.002s
I20260709 12:20:13.667347 24469 raft_consensus.cc:2410] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:20:13.845304 29004 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:13.847656 29004 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:13.837564 29102 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:13.794317 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 193869us
I20260709 12:20:13.794708 24398 raft_consensus.cc:2393] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 10: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:13.554591 29110 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:13.805863 24220 catalog_manager.cc:5697] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:13.836468 29109 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:13.710767 28646 consensus_queue.cc:1048] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.128s
W20260709 12:20:13.682722 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 82230.7us
W20260709 12:20:13.827630 29066 consensus_meta.cc:287] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.714s	user 0.017s	sys 0.000s
I20260709 12:20:13.569226 28945 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:13.847824 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 260264us
I20260709 12:20:13.900498 24440 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:13.848361 29022 raft_consensus.cc:2749] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:13.849424 24321 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 14.
I20260709 12:20:13.577502 29101 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.598388 29060 consensus_queue.cc:1059] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 12:20:13.857244 25114 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:20:13.919076 29100 consensus_queue.cc:260] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:13.920512 29100 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:13.926883 29121 log.cc:927] Time spent T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:20:13.940390 25115 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
W20260709 12:20:13.501682 24222 rpcz_store.cc:269] 0709 12:19:47.846042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:47.852988 (+  6946us) service_pool.cc:224] Handling call
0709 12:20:13.384030 (+25531042us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:08.060105 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:08.062448 (+  2343us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:08.062514 (+    66us) write_op.cc:435] Acquired schema lock
0709 12:20:08.062566 (+    52us) tablet.cc:662] Decoding operations
0709 12:20:08.152516 (+ 89950us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:08.185015 (+ 32499us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:08.192139 (+  7124us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:20:08.193739 (+  1600us) tablet.cc:701] Row locks acquired
0709 12:20:08.193817 (+    78us) write_op.cc:260] PREPARE: finished
0709 12:20:08.194097 (+   280us) write_op.cc:270] Start()
0709 12:20:08.194340 (+   243us) write_op.cc:276] Timestamp: P: 1783599608193997 usec, L: 0
0709 12:20:08.194383 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 12:20:08.273717 (+ 79334us) log.cc:844] Serialized 3628 byte log entry
0709 12:20:08.610289 (+336572us) op_driver.cc:464] REPLICATION: finished
0709 12:20:08.881088 (+270799us) write_op.cc:301] APPLY: starting
0709 12:20:08.897874 (+ 16786us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:09.121485 (+223611us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:09.121618 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:09.337823 (+216205us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:09.338251 (+   428us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=0,mrs_lookups=0
0709 12:20:09.338328 (+    77us) write_op.cc:312] APPLY: finished
0709 12:20:09.338779 (+   451us) log.cc:844] Serialized 89 byte log entry
0709 12:20:09.339009 (+   230us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:09.339168 (+   159us) write_op.cc:454] Released schema lock
0709 12:20:09.339236 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:09.339772 (+   536us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:09.339811 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":159768,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":210626,"apply.run_cpu_time_us":19982,"apply.run_wall_time_us":487696,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41783,"num_ops":9,"prepare.queue_time_us":410714,"prepare.run_cpu_time_us":24042,"prepare.run_wall_time_us":317468,"raft.queue_time_us":82024,"raft.run_cpu_time_us":5088,"raft.run_wall_time_us":117754,"replication_time_us":394535,"thread_start_us":618701,"threads_started":4,"wal-append.queue_time_us":152728,"wal-append.run_cpu_time_us":18472,"wal-append.run_wall_time_us":1911907}]]}
W20260709 12:20:13.865532 29119 log.cc:927] Time spent T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.155s	user 0.002s	sys 0.000s
I20260709 12:20:13.869228 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:13.525384 29059 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:13.896986 29110 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:13.903540 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:13.947803 24365 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:20:13.857757 29118 log.cc:927] Time spent T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.269s	user 0.002s	sys 0.005s
W20260709 12:20:13.854934 29117 log.cc:927] Time spent T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.339s	user 0.002s	sys 0.005s
I20260709 12:20:13.952382 25117 raft_consensus.cc:1275] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:20:13.954191 24396 raft_consensus.cc:1217] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Deduplicated request from leader. Original: 6.7->[7.8-11.10]   Dedup: 9.9->[11.10-11.10]
I20260709 12:20:13.915134 24220 catalog_manager.cc:5697] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: config changed from index 3 to 7, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:13.893019 28773 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:13.962857 24396 raft_consensus.cc:1240] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12. Ops: [7.8-11.10]
I20260709 12:20:13.968746 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:13.974095 24365 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:13.975251 24365 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:13.950074 29036 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:13.843170 29012 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:13.985110 25113 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:20:13.958969 28975 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:13.988425 25110 raft_consensus.cc:1275] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:13.950306 29045 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:13.904681 29066 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:13.959931 29022 consensus_queue.cc:1059] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:20:13.997288 24365 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:13.967813 29005 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:13.979485 29113 raft_consensus.cc:2749] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:13.928069 29101 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:13.983014 29003 raft_consensus.cc:2804] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:13.983223 29004 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:13.968602 29077 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:20:14.008860 24400 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.023s	sys 0.020s
I20260709 12:20:14.002229 24220 catalog_manager.cc:5697] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:13.990422 28975 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:14.016899 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:14.033222 24465 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:14.007061 28967 raft_consensus.cc:2749] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:13.973274 28773 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:14.054870 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:14.021714 29004 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.058452 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:13.990952 29036 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:14.052742 25082 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:14.031750 28975 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:14.002825 29045 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:14.040494 24400 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.024s	sys 0.021s
I20260709 12:20:14.064016 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:14.008982 29015 consensus_queue.cc:1048] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:20:14.013918 29002 consensus_queue.cc:1048] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:20:14.066087 25082 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:14.080550 24473 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.015s	sys 0.019s
I20260709 12:20:14.081239 25082 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:14.060215 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:14.055640 25111 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:20:14.064527 29004 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:14.035254 29003 raft_consensus.cc:697] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:14.093581 29003 consensus_queue.cc:237] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:14.095340 29066 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:14.071429 25114 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:14.097744 28773 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:14.081349 28802 consensus_meta.cc:287] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.682s	user 0.010s	sys 0.011s
I20260709 12:20:14.098765 28802 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:14.101188 28802 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:14.101970 29037 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:14.102555 29037 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:14.079391 24465 raft_consensus.cc:1275] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:20:14.105391 24465 pending_rounds.cc:85] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 9
I20260709 12:20:14.087121 24220 catalog_manager.cc:5697] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 7 to 8, leader changed from d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 8 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:14.105964 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.086423 25082 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:14.042193 29005 consensus_queue.cc:1048] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:20:14.112733 29101 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:14.113315 29129 log.cc:927] Time spent T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 12:20:14.114976 29122 log.cc:927] Time spent T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 12:20:14.116343 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2345) took 1009 ms. Trace:
I20260709 12:20:14.117041 24474 rpcz_store.cc:276] 0709 12:20:13.106619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.193603 (+ 86984us) service_pool.cc:224] Handling call
0709 12:20:13.194032 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:13.197913 (+  3881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:13.197941 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:13.198500 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 12:20:13.528139 (+329639us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:13.528202 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.528300 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:14.115973 (+587673us) raft_consensus.cc:1685] finished
0709 12:20:14.116003 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:14.116249 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5487,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":2524,"thread_start_us":267199,"threads_started":1,"wal-append.queue_time_us":421872}
I20260709 12:20:14.118498 29050 raft_consensus.cc:2749] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:14.119307 29050 raft_consensus.cc:2749] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:14.119937 29050 raft_consensus.cc:2749] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:14.122069 29036 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:14.123332 29059 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:14.125747 29012 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:14.071421 29096 consensus_queue.cc:1059] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.061s
W20260709 12:20:14.129736 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.106823 24220 catalog_manager.cc:5697] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:14.138718 28926 raft_consensus.cc:3055] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:14.139307 28926 raft_consensus.cc:740] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:14.142164 24325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2490) took 1124 ms. Trace:
I20260709 12:20:14.142736 24325 rpcz_store.cc:276] 0709 12:20:13.017958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.018198 (+   240us) service_pool.cc:224] Handling call
0709 12:20:14.141927 (+1123729us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b54002dbc54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:14.142076 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":787246464}
I20260709 12:20:14.066933 28915 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:14.067935 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:14.068765 29054 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:14.034664 29077 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:14.130225 28646 raft_consensus.cc:3055] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:14.154520 25113 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
I20260709 12:20:14.105816 24465 pending_rounds.cc:107] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:20:14.162241 24465 raft_consensus.cc:2889] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:14.153723 29002 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:20:14.148530 28979 consensus_meta.cc:287] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.710s	user 0.011s	sys 0.000s
I20260709 12:20:14.167739 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2322) took 2276 ms. Trace:
W20260709 12:20:14.081260 24473 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.016s	sys 0.019s
I20260709 12:20:14.168293 24465 rpcz_store.cc:276] 0709 12:20:11.886534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.886727 (+   193us) service_pool.cc:224] Handling call
0709 12:20:11.909370 (+ 22643us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:13.283429 (+1374059us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b540034d3a0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a972c3dc0 00007f4a9734e1c0 00007f4a9734f231 00007f4a9734bd8f 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c
0709 12:20:14.032988 (+749559us) spinlock_profiling.cc:243] Waited 38 ms on lock 0x7b58008e85d0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a972a80aa 00007f4a9732a447 00007f4a97342fe7 00007f4a973447de 00007f4a9734eb49 00007f4a9734f416 00007f4a9734bd8f 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4
0709 12:20:14.162785 (+129797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:14.162999 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":710606336}
I20260709 12:20:14.173893 25111 raft_consensus.cc:1275] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:20:14.174185 24220 catalog_manager.cc:5697] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 4 to 8, leader changed from d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 8 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:14.153247 29101 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:14.180653 29101 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:14.183492 29101 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:14.184962 28945 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:14.140254 28926 consensus_queue.cc:260] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:14.159962 28646 raft_consensus.cc:740] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:14.186360 28646 consensus_queue.cc:260] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:14.187225 29045 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:14.189437 29077 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:14.164913 29012 consensus_queue.cc:1048] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:20:14.192123 29004 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:14.194816 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:14.164937 29109 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:20:14.170375 28720 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
W20260709 12:20:14.196869 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 190022us
I20260709 12:20:14.208505 24220 catalog_manager.cc:5697] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 8 to 9, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 9 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:14.178375 28883 raft_consensus.cc:2749] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:14.168072 29002 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:14.168459 28979 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:14.234484 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 301496us
W20260709 12:20:14.234339 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 325303us
I20260709 12:20:14.220501 29109 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:14.234258 24220 catalog_manager.cc:5697] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 5 to 10, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193), now has a pending config: VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193), VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194), VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195), VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 10 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:14.262880 24391 raft_consensus.cc:1240] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:14.264132 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:14.264489 29141 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:20:14.268354 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.271783 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:14.264621 29059 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.282550 24398 raft_consensus.cc:1240] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12. Ops: []
W20260709 12:20:14.275826 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 268412us
I20260709 12:20:14.308408 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:14.309989 29136 consensus_queue.cc:1059] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:14.311690 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:14.312484 24322 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:14.303215 29059 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:14.315091 29059 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:14.315727 29059 raft_consensus.cc:3055] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:14.316018 29059 raft_consensus.cc:740] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:14.316386 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:14.307937 29010 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:14.319074 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:20:14.319679 29123 log.cc:927] Time spent T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:20:14.321031 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:20:14.321352 29128 log.cc:927] Time spent T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:20:14.322360 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:14.312091 29136 consensus_queue.cc:1059] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:14.332898 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:14.344219 29004 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:14.353951 24319 raft_consensus.cc:1275] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:20:14.334975 29059 consensus_queue.cc:260] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:14.346712 29098 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.330855 28883 consensus_queue.cc:1059] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:20:14.368546 24396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:20:14.370209 24396 raft_consensus.cc:606] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:14.370770 24396 raft_consensus.cc:614] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:20:14.372114 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 125713us
I20260709 12:20:14.377453 24317 raft_consensus.cc:1275] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:20:14.379733 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:14.380298 24317 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:14.381528 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:14.382189 24324 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:14.382768 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:14.383715 24320 raft_consensus.cc:1275] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:20:14.268064 29141 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:14.366340 29098 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:14.317893 29010 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:14.394289 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:14.398203 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:14.399082 29109 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:14.399281 29037 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:14.399890 29109 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:14.400616 29109 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:14.402477 29037 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:14.409111 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:14.413470 24470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2238) took 1064 ms. Trace:
I20260709 12:20:14.426777 24400 raft_consensus.cc:1240] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:14.414024 24470 rpcz_store.cc:276] 0709 12:20:13.349200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.456037 (+106837us) service_pool.cc:224] Handling call
0709 12:20:13.515139 (+ 59102us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:13.557632 (+ 42493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:13.576277 (+ 18645us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:13.822401 (+246124us) log.cc:844] Serialized 52 byte log entry
0709 12:20:14.230529 (+408128us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:14.230581 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:14.230653 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:14.413197 (+182544us) raft_consensus.cc:1685] finished
0709 12:20:14.413222 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:14.413391 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30343,"raft.queue_time_us":27852,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":13585,"thread_start_us":301441,"threads_started":1,"wal-append.queue_time_us":464097}
W20260709 12:20:14.432471 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 58425.8us
I20260709 12:20:14.433377 24440 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:14.366564 28975 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:14.434556 24319 raft_consensus.cc:1275] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:20:14.435055 24440 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:14.437534 29141 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:14.440027 28519 consensus_queue.cc:1048] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:14.441821 28519 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:14.442176 28519 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:14.442525 28519 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:14.443248 29098 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:14.445112 28984 raft_consensus.cc:3055] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:20:14.435405 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 127794us
I20260709 12:20:14.452026 24322 raft_consensus.cc:2468] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
I20260709 12:20:14.389742 29002 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:14.453430 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:14.462669 24324 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:20:14.379223 28883 consensus_queue.cc:1059] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 11.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:20:14.465737 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:14.471596 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:14.460165 29102 consensus_meta.cc:287] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.001s
W20260709 12:20:14.472230 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.445497 28984 raft_consensus.cc:740] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:14.475376 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:14.475278 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:14.476867 24318 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.003s	sys 0.011s
I20260709 12:20:14.477092 24396 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:14.481005 24290 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:14.482115 24290 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:14.482476 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:14.483148 24290 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:14.478609 24325 raft_consensus.cc:2410] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 12:20:14.477259 24318 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.003s	sys 0.011s
I20260709 12:20:14.487428 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:14.489125 24317 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:20:14.489217 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:14.493196 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:14.493964 24467 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:14.503623 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:14.459410 29006 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.506429 24469 raft_consensus.cc:1275] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:20:14.507893 24290 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:14.452215 29109 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:14.514657 24290 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:14.516671 24471 raft_consensus.cc:1275] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:20:14.519891 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:14.521055 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 356891us
I20260709 12:20:14.521354 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:14.523622 24320 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:14.522668 24470 raft_consensus.cc:2410] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 13 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:20:14.525213 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:14.526305 24324 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:14.528030 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:14.529691 24395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:20:14.530668 24395 raft_consensus.cc:606] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:14.530714 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:14.531292 24395 raft_consensus.cc:614] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:14.459534 29098 consensus_queue.cc:1059] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:20:14.532016 24470 raft_consensus.cc:1275] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:20:14.465734 29162 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:14.537712 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:14.543704 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:14.517915 29102 raft_consensus.cc:2749] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:14.549612 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 371390us
I20260709 12:20:14.544600 24394 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 12.
I20260709 12:20:14.510875 28970 raft_consensus.cc:2804] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:14.510555 28773 raft_consensus.cc:2764] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:20:14.525411 29010 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:14.557116 24469 raft_consensus.cc:1275] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:14.536140 24290 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:14.547093 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:14.556038 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:14.560083 24324 raft_consensus.cc:2393] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 10: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:14.561038 24470 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:14.562958 24467 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:20:14.535422 29109 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.563297 28804 raft_consensus.cc:3055] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:14.566541 24366 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:14.576534 25084 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:14.508790 29003 consensus_queue.cc:1048] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:20:14.582746 24366 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:14.583608 24472 raft_consensus.cc:1275] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:20:14.584187 25084 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:14.553074 29142 raft_consensus.cc:2749] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:14.600306 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:14.597235 24470 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:20:14.551847 28970 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.565522 29163 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.632772 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:14.574913 28804 raft_consensus.cc:740] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:14.526437 29006 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:14.641856 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 73270.4us
I20260709 12:20:14.642711 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:14.650218 24440 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:14.588791 29137 raft_consensus.cc:2749] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:14.646024 25084 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:14.590104 29131 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:14.603755 28970 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:14.662604 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 79944.2us
I20260709 12:20:14.661851 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:14.670110 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:14.675267 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.671206 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:14.676764 24467 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
W20260709 12:20:14.676152 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.671603 24318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 2167) took 1311 ms. Trace:
I20260709 12:20:14.637933 29047 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:14.583345 29109 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:14.670120 29100 raft_consensus.cc:3055] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:14.693526 29100 raft_consensus.cc:740] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:14.693656 29141 consensus_queue.cc:1048] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:14.694602 29100 consensus_queue.cc:260] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:14.655368 29163 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:14.697669 29163 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:14.681864 24397 raft_consensus.cc:1275] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:14.700991 28982 consensus_queue.cc:1048] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:14.683075 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:14.703227 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:14.670022 29077 raft_consensus.cc:2749] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:14.705634 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:14.705806 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:14.706382 25115 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:14.706560 24471 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:20:14.603189 29004 consensus_queue.cc:1048] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
W20260709 12:20:14.689069 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.711310 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:14.641516 28916 raft_consensus.cc:2749] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:14.706705 29110 consensus_meta.cc:287] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.735s	user 0.008s	sys 0.004s
I20260709 12:20:14.712064 24474 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
I20260709 12:20:14.714300 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:14.680434 24318 rpcz_store.cc:276] 0709 12:20:13.343849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.446890 (+103041us) service_pool.cc:224] Handling call
0709 12:20:13.447304 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:13.447561 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:20:13.942236 (+494675us) log.cc:844] Serialized 14 byte log entry
0709 12:20:14.654203 (+711967us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:14.654288 (+    85us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:14.654389 (+   101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:14.654564 (+   175us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:14.654772 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21128,"prepare.queue_time_us":594061,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":23567,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":19485,"thread_start_us":1068322,"threads_started":3}
I20260709 12:20:14.729792 25116 raft_consensus.cc:1240] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:14.730576 25115 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:14.733815 24320 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
I20260709 12:20:14.689376 29067 raft_consensus.cc:2804] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:14.739795 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:14.744730 25082 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:14.748466 25116 raft_consensus.cc:1275] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:20:14.769578 25082 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:14.770979 24471 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 15.
I20260709 12:20:14.631886 28984 consensus_queue.cc:260] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:14.775010 29141 consensus_queue.cc:1048] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:20:14.776474 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:14.779311 25115 raft_consensus.cc:2393] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 7: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:14.737860 28975 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:14.768677 29163 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:14.772775 29012 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:14.720279 29110 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:14.776562 29047 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:14.788385 29172 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.777053 28804 consensus_queue.cc:260] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.4, Last appended by leader: 4, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:14.805218 29109 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:14.805549 29006 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:14.806119 28984 raft_consensus.cc:3060] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:14.809639 29012 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:14.815791 29124 log.cc:927] Time spent T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.787s	user 0.002s	sys 0.001s
W20260709 12:20:14.826116 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 176052us
I20260709 12:20:14.795245 29169 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:14.845075 24440 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:14.840684 24393 raft_consensus.cc:2393] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 9: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:14.840723 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:14.842875 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:14.852018 24396 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
I20260709 12:20:14.825984 29133 raft_consensus.cc:2749] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:14.823908 29047 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:20:14.843518 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 284345us
W20260709 12:20:14.842227 29159 log.cc:927] Time spent T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 12:20:14.868721 24290 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:14.870534 24440 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:14.868727 29047 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:14.829173 29172 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:14.840291 29147 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:14.878276 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:14.879693 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:14.888680 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:14.867486 28804 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:14.853565 29160 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.921084 29160 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:14.889410 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:14.925086 25117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 677) took 1478 ms. Trace:
I20260709 12:20:14.926018 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:14.926924 24474 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 14.
I20260709 12:20:14.927979 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:14.925735 25117 rpcz_store.cc:276] 0709 12:20:13.446855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.447035 (+   180us) service_pool.cc:224] Handling call
0709 12:20:13.458052 (+ 11017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:13.956672 (+498620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:14.924702 (+968030us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b54007085d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:14.924986 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1135728512}
W20260709 12:20:14.935561 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.938735 29160 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:14.897027 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:14.940986 24322 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:14.944068 25110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 683) took 1261 ms. Trace:
I20260709 12:20:14.944499 25110 rpcz_store.cc:276] 0709 12:20:13.682958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.686451 (+  3493us) service_pool.cc:224] Handling call
0709 12:20:13.985822 (+299371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:13.991200 (+  5378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:14.943884 (+952684us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54005b18d0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:14.944009 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":366112640}
I20260709 12:20:14.870811 29109 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:14.898711 28742 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:14.947140 28742 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:14.891801 29147 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:14.950856 28646 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:14.951294 29147 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:14.866904 29169 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:14.901129 29180 consensus_queue.cc:1048] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:14.903878 29172 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:14.892143 28883 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:14.953666 28883 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.954104 28883 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:14.954169 29169 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:14.955871 29140 raft_consensus.cc:3055] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:14.956342 29140 raft_consensus.cc:740] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:14.957397 29140 consensus_queue.cc:260] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:14.958398 28742 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:14.958925 29140 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:14.963197 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:14.966285 28979 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:14.975584 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:14.976069 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:14.984388 28720 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.986027 28720 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:14.989730 24438 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:14.990891 29005 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.991618 29005 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:14.993122 24399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2718) took 1871 ms. Trace:
I20260709 12:20:14.993822 29022 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:14.910871 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2239) took 1561 ms. Trace:
I20260709 12:20:14.894766 24318 raft_consensus.cc:2393] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 12: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:14.994210 29005 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:14.881031 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:14.939457 29162 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.995117 29005 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:14.995648 29162 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:14.994530 29022 raft_consensus.cc:697] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:14.997642 29022 consensus_queue.cc:237] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:14.998123 29162 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:14.997752 28926 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:14.993551 24399 rpcz_store.cc:276] 0709 12:20:13.121917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.126264 (+  4347us) service_pool.cc:224] Handling call
0709 12:20:13.126647 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:13.127082 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:13.127116 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:13.127524 (+   408us) log.cc:844] Serialized 26 byte log entry
0709 12:20:13.318021 (+190497us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:13.320964 (+  2943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.321035 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:14.991765 (+1670730us) spinlock_profiling.cc:243] Waited 9.35 ms on lock 0x7b24000fd958. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a940e59c4 00007f4a940e3acb 00007f4a9429edc9 00007f4a9429ea55 00007f4a9429dfb0 00007f4a96f14488 00007f4a96f14be8 00007f4a96eec398 00007f4a96ee776a 00007f4a96ee6bb6
0709 12:20:14.992771 (+  1006us) raft_consensus.cc:1685] finished
0709 12:20:14.992794 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:14.993052 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7602,"raft.queue_time_us":17743,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":24625,"spinlock_wait_cycles":21497600,"thread_start_us":131887,"threads_started":1,"wal-append.queue_time_us":274472}
I20260709 12:20:15.001279 24365 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:15.000018 24466 rpcz_store.cc:276] 0709 12:20:13.349469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.840594 (+491125us) service_pool.cc:224] Handling call
0709 12:20:13.840961 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:13.847106 (+  6145us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:14.235621 (+388515us) log.cc:844] Serialized 14 byte log entry
0709 12:20:14.360417 (+124796us) log.cc:844] Serialized 14 byte log entry
0709 12:20:14.545150 (+184733us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:14.818620 (+273470us) spinlock_profiling.cc:243] Waited 6.38 ms on lock 0x7b2c0003d3d8. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a95c45a11 00007f4a95c55372 00007f4a97387a01 00007f4a9734c43a 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2
0709 12:20:14.819050 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 12:20:14.819197 (+   147us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:14.819234 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:14.819303 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:14.910578 (+ 91275us) raft_consensus.cc:1685] finished
0709 12:20:14.910625 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:14.910801 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69028,"prepare.queue_time_us":154749,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":98,"raft.queue_time_us":126831,"raft.run_cpu_time_us":416,"raft.run_wall_time_us":16757,"spinlock_wait_cycles":14681344,"thread_start_us":547776,"threads_started":3,"wal-append.queue_time_us":114982}
I20260709 12:20:15.003209 29141 raft_consensus.cc:2749] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:15.003219 29003 consensus_queue.cc:1048] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:15.004848 29141 consensus_queue.cc:1048] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:15.005571 24398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:20:15.006575 24398 raft_consensus.cc:606] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Received request to transfer leadership to TS c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:15.007580 24365 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:15.008872 29141 raft_consensus.cc:2749] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:20:15.009975 24393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2371) took 1567 ms (client timeout 1629 ms). Trace:
W20260709 12:20:15.010385 24393 rpcz_store.cc:269] 0709 12:20:13.442262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.442376 (+   114us) service_pool.cc:224] Handling call
0709 12:20:15.009731 (+1567355us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54000df054. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:15.009913 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3207855488}
I20260709 12:20:15.015514 29141 consensus_queue.cc:1048] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:15.017097 24365 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:15.018482 29103 consensus_queue.cc:1048] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:15.020033 29103 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:15.020922 29103 raft_consensus.cc:697] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:15.021176 29102 raft_consensus.cc:3055] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:15.021606 29102 raft_consensus.cc:740] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:15.021690 24398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ae0187acc6343ef874010bc79580048"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:20:15.022591 24398 raft_consensus.cc:606] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:15.022485 29103 consensus_queue.cc:237] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:15.023439 24398 raft_consensus.cc:614] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:15.022929 29102 consensus_queue.cc:260] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:15.025871 24440 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:15.026911 28979 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.027432 28979 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:15.027976 24398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:20:15.028868 24398 raft_consensus.cc:606] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Received request to transfer leadership to TS c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:15.026021 29059 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:15.030136 28720 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:15.016932 24394 raft_consensus.cc:1240] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:15.030252 28979 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:15.035825 24365 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:15.035740 29002 consensus_queue.cc:1048] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:15.037207 24365 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:15.038790 29131 raft_consensus.cc:2749] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:15.040460 29134 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:15.037464 29002 raft_consensus.cc:2804] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:15.041332 29134 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:15.042083 28979 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:15.042342 29002 raft_consensus.cc:697] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:15.042652 28979 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:15.043768 29002 consensus_queue.cc:237] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:15.044664 29134 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:15.055063 29134 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:14.995868 29005 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:15.056092 29134 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:15.057799 29102 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:15.038754 24365 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:15.044977 28979 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:15.062201 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 83872.4us
W20260709 12:20:15.063897 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.094538 29134 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:14.885828 29170 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:15.089154 24322 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 15.
I20260709 12:20:15.100983 24289 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:15.089896 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 51201.6us
I20260709 12:20:15.060881 29142 raft_consensus.cc:2749] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:15.109213 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:15.114552 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:15.115950 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:15.126775 24391 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:15.124351 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:15.109098 24393 raft_consensus.cc:1275] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:20:15.130537 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:15.106607 29124 log.cc:927] Time spent T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
I20260709 12:20:15.131579 29008 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:15.141034 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:15.144965 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:15.149166 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:15.150025 29171 log.cc:927] Time spent T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:20:15.151175 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:15.134531 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:15.150194 24399 raft_consensus.cc:2393] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 13: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:15.159360 24391 raft_consensus.cc:2393] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 12: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:15.160085 24438 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:15.106072 29141 raft_consensus.cc:2804] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:15.165975 28970 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:15.166603 29005 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:15.167259 24320 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:20:15.169078 28970 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:15.172237 28883 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:15.177970 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:15.176755 24438 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:15.199280 25084 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:15.184330 28926 raft_consensus.cc:2749] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:15.170771 29141 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:20:15.187546 29150 log.cc:927] Time spent T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
W20260709 12:20:15.201565 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 471899us
I20260709 12:20:15.160672 29047 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:15.213027 29141 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:15.207882 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2232) took 1864 ms. Trace:
I20260709 12:20:15.208124 29176 raft_consensus.cc:2804] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:15.218470 25112 raft_consensus.cc:1240] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:15.221161 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:15.222163 24391 raft_consensus.cc:1240] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:15.216296 24468 rpcz_store.cc:276] 0709 12:20:13.343883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.381288 (+ 37405us) service_pool.cc:224] Handling call
0709 12:20:13.381831 (+   543us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:13.382272 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:13.382302 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:13.382949 (+   647us) log.cc:844] Serialized 26 byte log entry
0709 12:20:13.814507 (+431558us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:13.891644 (+ 77137us) log.cc:844] Serialized 14 byte log entry
0709 12:20:13.894004 (+  2360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.894077 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:14.815158 (+921081us) spinlock_profiling.cc:243] Waited 5.96 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:20:15.202807 (+387649us) raft_consensus.cc:1685] finished
0709 12:20:15.207586 (+  4779us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:15.207796 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32679,"prepare.queue_time_us":144566,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":5845,"raft.queue_time_us":887,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":11532,"spinlock_wait_cycles":13712768,"thread_start_us":431101,"threads_started":1,"wal-append.queue_time_us":597714}
I20260709 12:20:15.224740 24471 raft_consensus.cc:2393] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 11: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:15.217535 29176 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:15.226800 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:15.213615 29134 raft_consensus.cc:2804] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:15.214879 29012 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:15.216696 29047 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:15.231529 29176 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:15.225426 29175 consensus_queue.cc:1048] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:20:15.212958 29110 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:15.242651 29134 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:15.255437 24316 raft_consensus.cc:1275] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:20:15.252673 29179 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:15.259317 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:15.259176 29179 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:15.260092 24322 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:15.262094 29179 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:15.240149 29067 raft_consensus.cc:697] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:15.274231 24322 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:15.265116 29134 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:15.314159 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:15.314792 24322 raft_consensus.cc:1240] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:20:15.316373 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:15.317086 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:15.314924 24316 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14.
I20260709 12:20:15.370564 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:15.370693 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:15.376168 24316 raft_consensus.cc:2393] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 10: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:15.377755 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:15.378710 24325 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
I20260709 12:20:15.380609 24291 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:20:15.381637 24467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.019s	sys 0.020s
W20260709 12:20:15.382089 24467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.019s	sys 0.021s
I20260709 12:20:15.387454 24291 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:15.388993 25081 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.021s	sys 0.018s
W20260709 12:20:15.394176 25081 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.021s	sys 0.018s
W20260709 12:20:15.389587 25082 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.011s	sys 0.027s
W20260709 12:20:15.372699 28519 consensus_meta.cc:287] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.930s	user 0.015s	sys 0.000s
W20260709 12:20:15.395479 25082 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.012s	sys 0.027s
W20260709 12:20:15.401810 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 632285us
W20260709 12:20:15.396083 24317 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.000s	sys 0.024s
W20260709 12:20:15.403467 24317 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.000s	sys 0.025s
W20260709 12:20:15.409633 24366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.001s	sys 0.025s
W20260709 12:20:15.410297 24366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.001s	sys 0.026s
W20260709 12:20:15.392648 29062 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.007s	sys 0.053s
W20260709 12:20:15.395226 28984 consensus_meta.cc:287] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.003s
I20260709 12:20:15.386938 29172 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:15.387145 29133 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:15.389824 29179 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:15.389808 29081 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:20:15.410720 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 643347us
W20260709 12:20:15.395516 29165 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.012s	sys 0.042s
I20260709 12:20:15.446033 24323 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:20:15.407843 28519 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:15.443670 28945 consensus_queue.cc:1048] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:20:15.450867 29059 consensus_queue.cc:1059] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:15.467175 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:15.419049 29067 consensus_queue.cc:237] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:15.470342 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.462005 25110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa"
dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:47070
I20260709 12:20:15.471896 25110 raft_consensus.cc:606] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:15.472350 25110 raft_consensus.cc:614] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:20:15.472327 24469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.004s	sys 0.032s
I20260709 12:20:15.473742 24366 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:20:15.455449 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:15.442034 29062 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.010s	sys 0.054s
I20260709 12:20:15.467957 25114 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
W20260709 12:20:15.468726 24321 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.904s	user 0.016s	sys 0.035s
W20260709 12:20:15.470495 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.476436 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:15.478760 25112 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
W20260709 12:20:15.465291 29165 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.012s	sys 0.043s
W20260709 12:20:15.462972 24290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.015s	sys 0.029s
W20260709 12:20:15.483486 24290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.015s	sys 0.029s
I20260709 12:20:15.483660 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:15.480108 24366 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:15.484452 25114 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
W20260709 12:20:15.480706 24437 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.012s	sys 0.018s
W20260709 12:20:15.474313 24469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.004s	sys 0.032s
I20260709 12:20:15.483016 24465 raft_consensus.cc:1240] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 9. Current term is 10. Ops: []
W20260709 12:20:15.479882 24321 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.016s	sys 0.035s
W20260709 12:20:15.487366 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:15.487422 24437 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.012s	sys 0.018s
I20260709 12:20:15.488912 24321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 743) took 1176 ms. Trace:
I20260709 12:20:15.491699 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:15.492753 24471 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
I20260709 12:20:15.464841 28742 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:15.500494 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:15.500988 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:15.498288 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:15.501376 25114 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:15.501914 25111 raft_consensus.cc:2393] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 11: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:15.467677 28883 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:15.511111 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:20:15.511243 29172 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:15.511874 29172 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:15.513558 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:15.514783 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:15.516222 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2350) took 1026 ms. Trace:
I20260709 12:20:15.516711 24465 rpcz_store.cc:276] 0709 12:20:14.490074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.490212 (+   138us) service_pool.cc:224] Handling call
0709 12:20:14.490584 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:15.487851 (+997267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:15.515978 (+ 28127us) spinlock_profiling.cc:243] Waited 992 ms on lock 0x7b540029ed54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:15.516157 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2281761152}
I20260709 12:20:15.479290 29003 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:15.489322 24321 rpcz_store.cc:276] 0709 12:20:14.312761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.317892 (+  5131us) service_pool.cc:224] Handling call
0709 12:20:14.318173 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:14.318376 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:20:14.469343 (+150967us) log.cc:844] Serialized 14 byte log entry
0709 12:20:15.488435 (+1019092us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:15.488509 (+    74us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:15.488575 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:15.488683 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:15.488841 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2321,"prepare.queue_time_us":2192,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":206916,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":10494,"thread_start_us":1166041,"threads_started":3,"wal-append.queue_time_us":235372}
I20260709 12:20:15.503203 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:15.520701 24471 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:20:15.468410 29012 consensus_queue.cc:1048] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:20:15.525374 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:15.481777 28983 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.010s	sys 0.040s
I20260709 12:20:15.528839 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:15.496604 28688 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:15.502424 29143 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.009s	sys 0.017s
I20260709 12:20:15.478812 29005 consensus_queue.cc:1048] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:20:15.485585 29179 raft_consensus.cc:697] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:15.477144 29110 consensus_queue.cc:1048] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 12:20:15.486202 29037 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.007s	sys 0.029s
I20260709 12:20:15.531311 25083 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:15.463428 29133 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:15.550938 24471 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
I20260709 12:20:15.496901 29131 raft_consensus.cc:2749] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:20:15.550705 28983 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.011s	sys 0.040s
W20260709 12:20:15.569927 29022 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.017s	sys 0.011s
I20260709 12:20:15.526820 29008 raft_consensus.cc:2749] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:15.558787 29037 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.008s	sys 0.029s
I20260709 12:20:15.532214 28519 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:15.579914 24290 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:15.507573 28742 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:15.568806 29143 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.009s	sys 0.019s
W20260709 12:20:15.605373 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 74156.8us
W20260709 12:20:15.578758 29022 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.017s	sys 0.011s
I20260709 12:20:15.564381 29002 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:15.575402 28975 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.009s	sys 0.011s
I20260709 12:20:15.696185 29130 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:20:15.697827 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 118045us
I20260709 12:20:15.567246 28688 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:15.715898 28610 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:15.717314 24440 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.015s	sys 0.038s
W20260709 12:20:15.757344 25118 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.024s	sys 0.050s
W20260709 12:20:15.777112 24440 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.015s	sys 0.038s
W20260709 12:20:15.777256 25118 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.024s	sys 0.050s
W20260709 12:20:15.777596 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 689875us
I20260709 12:20:15.574122 29003 consensus_queue.cc:1048] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 12:20:15.579610 29141 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:15.780041 24440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.780260 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:15.781045 25114 raft_consensus.cc:2393] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 11: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:15.781701 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:15.782335 24323 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:15.789819 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:15.794835 24466 pending_rounds.cc:85] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 6
I20260709 12:20:15.795279 24466 pending_rounds.cc:107] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:20:15.795507 24466 raft_consensus.cc:2889] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:15.796051 24440 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:15.824590 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:15.825294 24474 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:15.825994 24440 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:15.708032 29100 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:15.625603 29047 raft_consensus.cc:2804] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:20:15.715272 28975 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.009s	sys 0.012s
I20260709 12:20:15.827019 24440 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:15.709909 28646 raft_consensus.cc:2749] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:15.762231 24290 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:15.839424 24323 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
W20260709 12:20:15.857959 29188 log.cc:927] Time spent T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928: Append to log took a long time: real 0.357s	user 0.001s	sys 0.001s
I20260709 12:20:15.859251 28688 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:15.860078 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:15.871069 24465 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 13.
I20260709 12:20:15.869789 24392 raft_consensus.cc:1240] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 9. Current term is 10. Ops: []
W20260709 12:20:15.874238 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.843191 29047 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:15.843653 29179 consensus_queue.cc:237] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:15.842108 29164 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:15.918478 29164 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:15.919034 29164 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:15.928400 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.887434 29133 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:15.888805 28688 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.897192 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:15.946548 24465 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 10: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:15.898083 28742 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:15.766368 29130 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:15.899080 29101 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:15.901108 29102 consensus_meta.cc:287] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.842s	user 0.012s	sys 0.003s
I20260709 12:20:15.903059 29141 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:15.908599 29191 log.cc:927] Time spent T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 12:20:15.824193 28979 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:15.823824 29175 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.911170 24474 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
W20260709 12:20:15.915372 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 153270us
I20260709 12:20:15.963685 24290 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:15.823683 28610 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:15.914170 29022 raft_consensus.cc:2749] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:15.916796 29047 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:15.958385 24391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.022s	sys 0.080s
W20260709 12:20:15.983982 24391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.023s	sys 0.081s
W20260709 12:20:15.959188 24319 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.005s	sys 0.024s
I20260709 12:20:15.755533 29002 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:15.946380 29167 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:15.947636 29186 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:16.020359 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 56783.1us
I20260709 12:20:15.948668 29110 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:20:15.985339 24319 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.005s	sys 0.024s
W20260709 12:20:15.960459 29195 log.cc:927] Time spent T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:20:15.949432 28688 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:16.087754 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.019647 29167 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:16.092727 25112 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.006s	sys 0.031s
I20260709 12:20:16.022710 28646 raft_consensus.cc:2749] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:16.093497 24365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.012s	sys 0.025s
W20260709 12:20:16.120587 24365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.012s	sys 0.025s
W20260709 12:20:16.116261 25112 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.006s	sys 0.031s
W20260709 12:20:16.093181 24366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.001s	sys 0.036s
W20260709 12:20:16.077049 29191 log.cc:927] Time spent T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 12:20:16.123185 24366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.002s	sys 0.036s
W20260709 12:20:16.123646 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 617799us
I20260709 12:20:15.993461 29141 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:15.969475 28979 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:15.978773 29175 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:16.119546 29176 consensus_meta.cc:287] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.853s	user 0.007s	sys 0.006s
I20260709 12:20:16.132493 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2367) took 1431 ms. Trace:
I20260709 12:20:16.120218 29167 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:16.034554 29110 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:16.129823 24366 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:16.134868 24469 rpcz_store.cc:276] 0709 12:20:14.700992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.704813 (+  3821us) service_pool.cc:224] Handling call
0709 12:20:14.705176 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:14.755046 (+ 49870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:14.755085 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:14.772843 (+ 17758us) log.cc:844] Serialized 26 byte log entry
0709 12:20:15.487936 (+715093us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:15.487979 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:15.488054 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:16.132248 (+644194us) raft_consensus.cc:1685] finished
0709 12:20:16.132276 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:16.132416 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93496,"raft.queue_time_us":83709,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":5637,"thread_start_us":666858,"threads_started":1,"wal-append.queue_time_us":964084}
I20260709 12:20:16.131407 24365 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:16.033406 29186 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:16.150746 24365 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:16.153458 29186 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:16.154407 24472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2360) took 1566 ms. Trace:
I20260709 12:20:16.154894 24472 rpcz_store.cc:276] 0709 12:20:14.588126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.592811 (+  4685us) service_pool.cc:224] Handling call
0709 12:20:14.638296 (+ 45485us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:15.060599 (+422303us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:20:15.460823 (+400224us) log.cc:844] Serialized 14 byte log entry
0709 12:20:15.954434 (+493611us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:15.955011 (+   577us) log.cc:844] Serialized 52 byte log entry
0709 12:20:15.955145 (+   134us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:15.960563 (+  5418us) log.cc:844] Serialized 14 byte log entry
0709 12:20:15.962348 (+  1785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:15.962436 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:16.154124 (+191688us) raft_consensus.cc:1685] finished
0709 12:20:16.154144 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:16.154305 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1526,"prepare.queue_time_us":519385,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":96,"raft.queue_time_us":98757,"raft.run_cpu_time_us":400,"raft.run_wall_time_us":51906,"spinlock_wait_cycles":243524864,"thread_start_us":1075994,"threads_started":3,"wal-append.queue_time_us":644947}
I20260709 12:20:16.157708 28688 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:16.158547 28688 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:16.159138 28688 raft_consensus.cc:697] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 15 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:16.161722 28610 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:16.149266 24366 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:16.171790 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 691) took 1417 ms. Trace:
I20260709 12:20:16.138202 29176 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:16.141861 29175 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:16.177450 25118 rpcz_store.cc:276] 0709 12:20:14.754728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.756219 (+  1491us) service_pool.cc:224] Handling call
0709 12:20:14.756725 (+   506us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:15.198539 (+441814us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:15.198571 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:15.210301 (+ 11730us) log.cc:844] Serialized 52 byte log entry
0709 12:20:15.777875 (+567574us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:16.145303 (+367428us) log.cc:844] Serialized 14 byte log entry
0709 12:20:16.147012 (+  1709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:16.147091 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:16.147131 (+    40us) raft_consensus.cc:1685] finished
0709 12:20:16.147144 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:16.171699 (+ 24555us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17164,"raft.queue_time_us":31706,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":26385,"thread_start_us":1262764,"threads_started":3,"wal-append.queue_time_us":824109}
I20260709 12:20:16.133776 29141 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:20:16.214293 28610 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:16.215957 29191 log.cc:927] Time spent T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:20:16.176079 29143 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.160261 28688 consensus_queue.cc:237] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:16.255470 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 428518us
I20260709 12:20:16.217168 29183 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:16.266875 24317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44278 (request call id 2518) took 1745 ms. Trace:
W20260709 12:20:16.269794 29170 consensus_meta.cc:287] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.135s	user 0.009s	sys 0.003s
I20260709 12:20:16.267616 24317 rpcz_store.cc:276] 0709 12:20:14.520996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.541979 (+ 20983us) service_pool.cc:224] Handling call
0709 12:20:14.542356 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:14.602858 (+ 60502us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:14.807266 (+204408us) spinlock_profiling.cc:243] Waited 8.21 ms on lock 0x7b18001d7f40. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a941d9c0a 00007f4a9d919219 00007f4a94261a40 00007f4a9425c4e4 00007f4a9425c455 00007f4a9ad443c7 00007f4a973569a7 00007f4a973660bf 00007f4a97366038
0709 12:20:14.807566 (+   300us) log.cc:844] Serialized 14 byte log entry
0709 12:20:15.444888 (+637322us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:15.447839 (+  2951us) log.cc:844] Serialized 26 byte log entry
0709 12:20:15.448009 (+   170us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:15.448515 (+   506us) log.cc:844] Serialized 14 byte log entry
0709 12:20:15.454984 (+  6469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:15.455103 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:16.266449 (+811346us) raft_consensus.cc:1685] finished
0709 12:20:16.266504 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:16.266769 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98407,"prepare.queue_time_us":206225,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":85,"raft.queue_time_us":147824,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":7594,"spinlock_wait_cycles":18878208,"thread_start_us":655841,"threads_started":2,"wal-append.queue_time_us":769244}
I20260709 12:20:16.273463 24319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 2183) took 1396 ms. Trace:
I20260709 12:20:16.274222 24319 rpcz_store.cc:276] 0709 12:20:14.877196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.877338 (+   142us) service_pool.cc:224] Handling call
0709 12:20:14.877661 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:14.878011 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:14.878037 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:14.895787 (+ 17750us) log.cc:844] Serialized 26 byte log entry
0709 12:20:16.034793 (+1139006us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:16.034853 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:16.034964 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:16.273070 (+238106us) raft_consensus.cc:1685] finished
0709 12:20:16.273106 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:16.273362 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22773,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":138,"thread_start_us":914348,"threads_started":1,"wal-append.queue_time_us":1069788}
I20260709 12:20:16.259704 24440 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:16.270360 29170 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:16.222960 28610 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:16.276976 24440 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:16.259572 29130 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:16.258603 29005 raft_consensus.cc:2749] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:16.277447 29134 consensus_meta.cc:287] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.974s	user 0.012s	sys 0.001s
I20260709 12:20:16.286074 24440 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:16.255295 29143 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:16.277974 29175 raft_consensus.cc:2749] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:16.289389 24440 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:16.279809 29002 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:16.277366 29022 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:16.295984 24440 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:16.284199 29210 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:16.260123 29183 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:16.299933 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 149274us
I20260709 12:20:16.288239 29192 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:16.310992 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:16.293258 28519 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:16.330020 29214 raft_consensus.cc:2804] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:16.330513 29214 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:16.330677 28610 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:16.330884 29214 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:16.334496 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 185334us
I20260709 12:20:16.334715 29216 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.317569 29192 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:16.340986 29192 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:16.325316 28519 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:16.345047 28519 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:16.318109 29213 log.cc:927] Time spent T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 12:20:16.365782 29218 consensus_queue.cc:1059] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:16.369287 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:16.368870 29216 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:16.370010 25115 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:20:16.371436 29141 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:20:16.372066 29216 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:16.300673 28979 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:16.349611 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:16.349800 24319 raft_consensus.cc:1240] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 9. Current term is 10. Ops: []
W20260709 12:20:16.380086 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 84174us
I20260709 12:20:16.351493 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:16.380939 24323 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 14.
I20260709 12:20:16.355122 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:16.356750 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:16.363026 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:16.372433 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:16.372852 28610 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.373159 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:16.373579 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:16.381707 24440 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:16.303732 29002 raft_consensus.cc:2804] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:16.387315 29002 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:16.387773 29002 raft_consensus.cc:3060] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:16.290525 29134 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:16.389120 24440 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:16.390589 29134 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:16.391723 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:16.392928 24324 raft_consensus.cc:2410] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:20:16.394115 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:16.395494 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:16.307920 29210 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:16.372123 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:16.396991 29210 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:16.376251 24322 raft_consensus.cc:1240] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:16.399080 24322 raft_consensus.cc:1240] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:16.319440 29175 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:16.400344 29175 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:16.400902 29175 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:16.401047 25119 raft_consensus.cc:2368] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 10. Current term is 11.
I20260709 12:20:16.403790 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:16.407629 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:16.408609 24323 raft_consensus.cc:2410] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:20:16.408432 24440 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:16.414613 29233 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:16.415558 24440 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:16.417426 28975 consensus_queue.cc:1048] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:16.419631 28975 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:16.379714 25118 raft_consensus.cc:2376] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11. Re-sending same reply.
I20260709 12:20:16.396215 24324 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
I20260709 12:20:16.384584 28610 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:16.431510 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:16.302321 29022 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:16.429021 29110 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:16.442726 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:16.446264 24440 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:16.327405 29005 consensus_queue.cc:1059] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.111s
I20260709 12:20:16.429273 28979 raft_consensus.cc:2749] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:16.452378 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:16.457469 24398 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:20:16.455618 24325 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 9.
I20260709 12:20:16.459875 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:16.443804 29207 log.cc:927] Time spent T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 12:20:16.442121 28975 raft_consensus.cc:697] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:16.465386 29237 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:16.472652 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:16.435803 29239 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:16.422495 29109 raft_consensus.cc:476] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Not starting pre-election -- already a leader
I20260709 12:20:16.461958 24398 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:20:16.480252 29233 raft_consensus.cc:2749] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:20:16.457499 29172 consensus_meta.cc:287] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.945s	user 0.009s	sys 0.006s
I20260709 12:20:16.456696 29176 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:16.488601 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:16.492823 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:16.472245 29237 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:16.495697 29219 log.cc:927] Time spent T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:20:16.491194 29183 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:16.491447 29172 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:16.501474 28975 consensus_queue.cc:237] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:16.504879 29100 consensus_meta.cc:287] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.664s	user 0.010s	sys 0.003s
I20260709 12:20:16.492861 24366 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:16.513511 25112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48252 (request call id 665) took 1046 ms. Trace:
I20260709 12:20:16.516378 29110 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:16.516813 29231 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:16.517225 29231 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:16.517601 29231 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:16.495728 29240 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:16.521147 29240 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:16.523942 29240 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:16.495709 29237 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:16.535243 29164 consensus_meta.cc:287] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.616s	user 0.012s	sys 0.000s
I20260709 12:20:16.537833 28610 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:16.541567 28688 consensus_queue.cc:1048] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:16.541772 29110 consensus_queue.cc:1048] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:16.543268 28688 consensus_queue.cc:1048] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:16.485770 29047 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:16.544018 29182 raft_consensus.cc:3055] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:16.541610 24366 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:16.544950 28688 raft_consensus.cc:2804] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:16.545372 28688 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:16.545789 28688 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:16.545778 29047 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:16.546682 29143 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:16.548472 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:16.549168 24395 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:20:16.549952 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:16.550807 24398 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 13.
I20260709 12:20:16.553442 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2745) took 1261 ms. Trace:
I20260709 12:20:16.553839 29008 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.554428 24320 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
I20260709 12:20:16.561244 24317 raft_consensus.cc:1240] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:16.550094 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:16.562804 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:16.553867 24391 rpcz_store.cc:276] 0709 12:20:15.291708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.291942 (+   234us) service_pool.cc:224] Handling call
0709 12:20:15.292486 (+   544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:15.294897 (+  2411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:15.294936 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:15.295561 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 12:20:15.984651 (+689090us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:15.984712 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:15.984815 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:16.553244 (+568429us) raft_consensus.cc:1685] finished
0709 12:20:16.553263 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:16.553389 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":12163,"thread_start_us":608046,"threads_started":1,"wal-append.queue_time_us":831837}
I20260709 12:20:16.564311 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:16.535938 29164 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:16.585636 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:16.586681 24324 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:20:16.587478 24470 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:20:16.554386 29008 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:16.591580 29008 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:16.544545 29182 raft_consensus.cc:740] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:16.596184 29175 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:16.598882 29175 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:16.605854 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:16.610234 24366 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:16.579520 29096 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.576900 28984 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.486805 29239 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:16.516125 25112 rpcz_store.cc:276] 0709 12:20:15.481917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.482827 (+   910us) service_pool.cc:224] Handling call
0709 12:20:15.508607 (+ 25780us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:15.508859 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:20:16.122359 (+613500us) log.cc:844] Serialized 14 byte log entry
0709 12:20:16.513076 (+390717us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:16.513135 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:16.513198 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:16.513287 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:16.513438 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47943,"prepare.queue_time_us":746012,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":1319,"raft.queue_time_us":50570,"spinlock_wait_cycles":8814336,"thread_start_us":955198,"threads_started":3,"wal-append.queue_time_us":333746}
I20260709 12:20:16.576622 29142 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:16.614148 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:16.614885 24324 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:16.579160 28773 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:16.620112 24366 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:16.611138 29101 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:16.623660 29110 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:16.630151 24366 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:16.618062 29096 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:16.636022 29228 consensus_queue.cc:1059] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:20:16.650547 29239 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:16.652887 29237 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:16.628096 29110 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:16.655148 29237 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:16.635630 29101 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:16.626576 29229 consensus_queue.cc:1059] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:20:16.657521 29101 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:16.636494 29141 consensus_queue.cc:1059] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:20:16.658784 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:16.621483 28773 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:16.658941 29141 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:16.659794 24289 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:16.625833 29012 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:16.667770 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 62224.8us
I20260709 12:20:16.667155 24324 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
I20260709 12:20:16.619478 29142 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:16.620110 28984 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:16.687209 24289 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:20:16.689893 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 243880us
W20260709 12:20:16.692453 29242 log.cc:927] Time spent T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:20:16.693449 29142 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:16.694142 28519 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:16.695981 29002 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:16.696520 28519 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:16.691395 24440 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:16.698254 29002 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:16.699097 24396 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 7.
I20260709 12:20:16.706791 29096 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:16.709378 28610 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:16.709997 28610 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:16.710413 28610 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:16.683633 29167 consensus_meta.cc:287] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.535s	user 0.011s	sys 0.000s
I20260709 12:20:16.713322 29167 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:16.717201 29164 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:16.720991 28984 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:16.722991 24320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2521) took 1409 ms. Trace:
I20260709 12:20:16.723412 29210 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:16.723688 24320 rpcz_store.cc:276] 0709 12:20:15.313108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.316839 (+  3731us) service_pool.cc:224] Handling call
0709 12:20:16.722686 (+1405847us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540025b7d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:16.722885 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2844100864}
I20260709 12:20:16.655165 29110 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:16.690973 29008 raft_consensus.cc:2804] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:20:16.727739 29194 log.cc:927] Time spent T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 1.014s	user 0.003s	sys 0.000s
I20260709 12:20:16.733551 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35188 (request call id 1342) took 1507 ms. Trace:
I20260709 12:20:16.734190 24400 raft_consensus.cc:1240] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:16.736147 29210 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:16.736788 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2388) took 1435 ms. Trace:
I20260709 12:20:16.745703 28742 raft_consensus.cc:3055] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:16.748494 29192 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:16.753379 24318 raft_consensus.cc:1240] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:20:16.756259 24465 raft_consensus.cc:1240] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:16.757367 24473 raft_consensus.cc:1240] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:20:16.777854 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:16.758327 24471 raft_consensus.cc:1275] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:20:16.763589 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 72279.3us
I20260709 12:20:16.779198 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:16.779285 24440 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:16.765759 24466 raft_consensus.cc:1240] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:20:16.772336 24392 rpcz_store.cc:276] 0709 12:20:15.301882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.302048 (+   166us) service_pool.cc:224] Handling call
0709 12:20:15.304024 (+  1976us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:15.872070 (+568046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:16.736424 (+864354us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b5400364cd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:16.736702 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1300345728}
I20260709 12:20:16.779834 24471 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:20:16.770848 25119 rpcz_store.cc:276] 0709 12:20:15.226388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.226517 (+   129us) service_pool.cc:224] Handling call
0709 12:20:16.733254 (+1506737us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540069a5d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:16.733464 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2688033152}
W20260709 12:20:16.775300 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 83945.8us
I20260709 12:20:16.780608 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:16.781419 24466 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:20:16.782398 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:16.783823 29231 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:16.785544 24466 raft_consensus.cc:1275] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:20:16.790110 29231 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:16.795344 24290 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:16.799188 24290 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:16.799325 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:16.799378 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:16.800276 24324 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:16.797966 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:16.811880 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:16.812690 24473 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:16.813345 24440 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:16.813540 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:16.815706 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:16.760524 29022 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:16.762173 28773 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:16.821054 24290 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:16.821584 24466 raft_consensus.cc:1240] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:16.822520 29164 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:16.823549 29239 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.825170 29109 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:16.826540 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:16.839668 24465 raft_consensus.cc:2410] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:20:16.831511 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:16.832302 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:16.841389 24398 raft_consensus.cc:2410] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:20:16.769811 29008 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:16.840386 24393 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:20:16.833014 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:16.773430 28519 raft_consensus.cc:2749] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:16.833465 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:16.831699 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:16.773723 28742 raft_consensus.cc:740] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:16.847913 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:16.843429 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:16.686477 29214 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:16.851392 24471 raft_consensus.cc:1240] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:20:16.855505 24466 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:20:16.827423 29175 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.869880 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:16.857630 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:16.819977 29179 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:16.819804 28975 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:16.833721 29167 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:16.877986 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:16.877604 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:16.881726 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:16.886714 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:16.887439 24465 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:16.881944 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:16.889040 24466 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:20:16.890067 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:16.890674 24466 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:16.848834 29176 raft_consensus.cc:2749] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:16.835980 29193 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:16.883204 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:16.893967 24324 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:20:16.888525 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:16.896317 24465 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 12.
I20260709 12:20:16.897452 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:16.847859 29098 raft_consensus.cc:2764] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:20:16.848866 29008 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:16.902092 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:16.904569 24469 raft_consensus.cc:1240] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:20:16.916020 24323 raft_consensus.cc:1275] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:20:16.917783 24440 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:16.919754 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:16.920662 24324 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:16.880115 29179 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:16.919713 24440 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:16.848021 29142 consensus_queue.cc:1059] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
W20260709 12:20:16.929390 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 299273us
I20260709 12:20:16.856818 29164 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:16.857096 29239 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:16.943626 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:16.945019 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:16.900482 28975 raft_consensus.cc:697] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:16.857221 29109 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:16.953640 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:16.959784 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:20:16.953665 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 393129us
I20260709 12:20:16.955263 24466 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
I20260709 12:20:16.951122 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:16.884222 29175 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:16.963243 25110 raft_consensus.cc:2393] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 7: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:16.931329 29179 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:16.960538 24320 raft_consensus.cc:1275] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:20:16.962030 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:16.942219 29176 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:16.965860 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:16.975729 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:16.976544 24392 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
I20260709 12:20:16.966638 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:16.966751 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:16.969362 24317 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
I20260709 12:20:16.972399 24322 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 7.
I20260709 12:20:16.958587 24366 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:16.979315 24324 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14.
I20260709 12:20:16.835850 29182 consensus_queue.cc:260] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:16.983404 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:16.985257 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:16.955379 29022 raft_consensus.cc:2804] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:16.999702 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:16.986131 24366 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:16.982405 24440 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:16.987916 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:16.951902 29007 raft_consensus.cc:3055] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:17.003665 24473 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:20:17.002943 24440 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:17.009758 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:17.008770 24392 raft_consensus.cc:2393] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 10: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:16.973902 29176 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:17.013280 29176 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:16.928821 28688 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:17.017988 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:17.020028 24398 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:17.021299 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:17.029162 24392 raft_consensus.cc:2393] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 12: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:17.029649 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:17.003468 29022 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:16.941826 28742 consensus_queue.cc:260] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:17.009188 29007 raft_consensus.cc:740] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:17.013516 29250 consensus_queue.cc:1048] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:20:17.026801 29233 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:17.031029 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:17.016570 29237 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:17.041806 24399 raft_consensus.cc:1240] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:17.041947 24366 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:17.030115 24394 raft_consensus.cc:1275] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 12:20:17.093842 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 51976.1us
I20260709 12:20:17.034397 24398 raft_consensus.cc:3055] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:17.018283 29254 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:17.031858 29210 raft_consensus.cc:2804] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:17.048115 29258 consensus_queue.cc:1048] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:17.053848 28742 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:17.036423 29136 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:20:17.057165 29255 log.cc:927] Time spent T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:20:17.061460 29101 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:17.027297 29192 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:17.065143 29214 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:17.065483 29239 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:17.066136 29185 log.cc:927] Time spent T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 1.355s	user 0.005s	sys 0.000s
I20260709 12:20:17.067225 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:17.068069 29007 consensus_queue.cc:260] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:17.071189 29175 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:17.072805 29233 raft_consensus.cc:697] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:17.074030 29172 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:17.075687 28688 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:17.039495 29022 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:17.100069 29254 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:17.112918 29215 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.138672 29215 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:17.141309 25083 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:17.142356 25083 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:17.143982 28945 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:17.144587 28945 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:17.081856 29164 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:17.087088 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:17.049731 29109 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:17.108505 29256 raft_consensus.cc:2804] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:17.161707 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:17.163203 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:17.163965 24317 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
I20260709 12:20:17.094887 24398 raft_consensus.cc:740] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:17.096447 24324 raft_consensus.cc:1240] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:17.096720 24366 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:17.097566 24322 raft_consensus.cc:1240] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 9. Current term is 10. Ops: []
W20260709 12:20:17.167120 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 70501.4us
I20260709 12:20:17.097611 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:17.100270 24316 raft_consensus.cc:1275] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:20:17.102646 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 540120us
I20260709 12:20:17.105729 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:17.170949 25113 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:17.101850 24438 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:17.108316 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:17.080464 29182 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:17.119936 29133 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:17.079996 24469 raft_consensus.cc:1275] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:20:17.151036 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 313166us
I20260709 12:20:17.115296 29210 raft_consensus.cc:697] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:17.106351 29130 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.050182 28975 consensus_queue.cc:237] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:17.168022 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:17.177832 25082 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:17.188023 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:17.179376 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:17.151413 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:17.188710 24440 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
W20260709 12:20:17.184478 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 82701.9us
I20260709 12:20:17.137828 29254 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:17.165423 24398 consensus_queue.cc:260] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:17.108757 29237 raft_consensus.cc:697] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:17.146242 29186 raft_consensus.cc:2804] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:17.208319 24322 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 15.
I20260709 12:20:17.208868 29186 raft_consensus.cc:697] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:17.207448 25082 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:17.208137 24438 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:17.209169 29237 consensus_queue.cc:237] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:17.210214 29216 raft_consensus.cc:2749] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:17.209981 29186 consensus_queue.cc:237] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:17.208324 24398 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:17.210554 25082 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:17.116425 29101 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:17.233330 25082 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:17.234670 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:17.245568 24398 raft_consensus.cc:1275] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:20:17.237598 29131 raft_consensus.cc:993] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a: : Instructing follower c711faa13ead43ebbea0192cb74a4756 to start an election
W20260709 12:20:17.180089 29243 log.cc:927] Time spent T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:20:17.248543 25082 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:17.250826 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 65982.8us
I20260709 12:20:17.252898 24438 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:17.260146 29192 raft_consensus.cc:2749] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:17.260695 24438 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:17.261065 24440 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:17.261778 29192 raft_consensus.cc:2804] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:17.262375 29192 raft_consensus.cc:697] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:17.258576 25082 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:20:17.256124 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 112665us
I20260709 12:20:17.187182 29175 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:17.182633 28688 raft_consensus.cc:2749] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:17.263979 24290 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:17.270007 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:17.274705 24467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2365) took 2595 ms. Trace:
I20260709 12:20:17.206823 29256 raft_consensus.cc:697] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:20:17.256042 29247 log.cc:927] Time spent T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:20:17.286109 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 233776us
W20260709 12:20:17.307494 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 43606.2us
I20260709 12:20:17.118898 29136 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:17.235064 29134 raft_consensus.cc:2749] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:17.297380 24291 leader_election.cc:400] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 10. Current term is 11.
I20260709 12:20:17.299480 25116 raft_consensus.cc:1240] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:17.327819 25116 raft_consensus.cc:1275] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:20:17.248826 29183 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:17.300588 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:17.187592 29022 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:17.275089 25113 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:20:17.308790 24290 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:17.238238 29130 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:17.315611 29256 consensus_queue.cc:237] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:17.332175 28883 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:17.290490 29172 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:17.300280 29067 raft_consensus.cc:2749] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:17.300083 29215 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:17.312532 29233 consensus_queue.cc:237] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:17.318564 28916 raft_consensus.cc:2804] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:17.272882 29098 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:17.263872 29100 raft_consensus.cc:2749] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:17.292469 29192 consensus_queue.cc:237] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:17.311457 29218 raft_consensus.cc:2804] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:17.289625 29258 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.322196 28688 consensus_queue.cc:1059] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:17.322719 25084 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:17.323622 29190 consensus_queue.cc:1059] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:17.324047 29136 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:17.301819 29141 raft_consensus.cc:1081] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Signalling peer c711faa13ead43ebbea0192cb74a4756 to start an election
W20260709 12:20:17.329361 24470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 2370) took 2606 ms (client timeout 1940 ms). Trace:
I20260709 12:20:17.303814 24467 rpcz_store.cc:276] 0709 12:20:14.679625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.679845 (+   220us) service_pool.cc:224] Handling call
0709 12:20:14.680325 (+   480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:14.689101 (+  8776us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:14.689137 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:14.689653 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 12:20:15.383168 (+693515us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:15.383234 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:15.383350 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:17.043687 (+1660337us) spinlock_profiling.cc:243] Waited 38.9 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:20:17.274372 (+230685us) raft_consensus.cc:1685] finished
0709 12:20:17.274396 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:17.274631 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15959,"raft.queue_time_us":88191,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":7203,"spinlock_wait_cycles":89462528,"thread_start_us":605755,"threads_started":1,"wal-append.queue_time_us":830961}
I20260709 12:20:17.267961 29184 raft_consensus.cc:2804] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:17.378820 29175 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:17.344741 25117 raft_consensus.cc:1240] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:17.204839 29133 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:17.264031 29250 raft_consensus.cc:2804] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:17.327849 29005 raft_consensus.cc:993] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a: : Instructing follower c711faa13ead43ebbea0192cb74a4756 to start an election
I20260709 12:20:17.350873 24290 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:17.348387 28883 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:17.351735 29096 raft_consensus.cc:2804] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:17.359393 25119 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 13.
W20260709 12:20:17.379916 24470 rpcz_store.cc:269] 0709 12:20:14.701985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.702963 (+   978us) service_pool.cc:224] Handling call
0709 12:20:17.308420 (+2605457us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b5400243454. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:17.308533 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4143401344}
W20260709 12:20:17.368359 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 45715.5us
I20260709 12:20:17.350713 29172 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:17.360045 28945 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:17.363438 29218 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:17.380172 29258 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:17.401846 29218 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:17.386209 24324 raft_consensus.cc:1275] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:20:17.404152 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:20:17.383285 29077 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:20:17.395264 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:17.400892 29130 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:17.401033 28883 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:17.362572 28916 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:17.394279 28610 consensus_meta.cc:287] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.683s	user 0.012s	sys 0.003s
I20260709 12:20:17.381819 29137 raft_consensus.cc:2804] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:20:17.397948 29110 consensus_meta.cc:287] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.619s	user 0.008s	sys 0.004s
I20260709 12:20:17.381003 29067 raft_consensus.cc:2804] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:17.410095 25084 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:17.352669 29210 consensus_queue.cc:237] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:17.407848 29005 raft_consensus.cc:1081] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Signalling peer c711faa13ead43ebbea0192cb74a4756 to start an election
I20260709 12:20:17.413471 29002 raft_consensus.cc:3055] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:17.414288 29133 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:17.409592 29008 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:17.415668 29264 log.cc:927] Time spent T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 12:20:17.418320 29231 consensus_queue.cc:1048] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:20:17.383875 29175 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:17.419625 24318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 2194) took 1061 ms. Trace:
I20260709 12:20:17.531560 24318 rpcz_store.cc:276] 0709 12:20:16.358345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.358520 (+   175us) service_pool.cc:224] Handling call
0709 12:20:16.358975 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:16.776273 (+417298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:17.419234 (+642961us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b540025ab54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:17.419538 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":906229632}
I20260709 12:20:17.397485 29182 raft_consensus.cc:2749] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:17.382368 29184 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:17.395490 29096 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:17.421628 29176 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:17.404517 29172 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:17.392232 29022 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:17.395287 29250 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:20:17.423751 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 115196us
W20260709 12:20:17.425995 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 160617us
I20260709 12:20:17.392568 29179 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:17.377202 29098 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:17.621135 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:17.422995 28916 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:17.641475 24365 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:20:17.469587 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 202511us
I20260709 12:20:17.465795 29131 raft_consensus.cc:3055] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:17.545316 24321 raft_consensus.cc:2368] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
I20260709 12:20:17.424978 29067 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:17.701849 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 60457.9us
I20260709 12:20:17.703548 24365 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:17.520887 28945 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:20:17.557067 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 290981us
I20260709 12:20:17.517956 29258 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:17.468647 29002 raft_consensus.cc:740] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:17.436720 28883 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:17.407665 29268 raft_consensus.cc:3055] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:20:17.639099 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:17.470534 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 60538.9us
W20260709 12:20:17.539259 29267 log.cc:927] Time spent T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:20:17.643330 25083 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:17.638590 25082 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:17.730073 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:17.544044 29184 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:17.772651 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 421820us
I20260709 12:20:17.614961 29101 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:17.424696 29110 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:17.644436 29250 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:17.779338 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:17.780927 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:20:17.781354 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 64360.9us
W20260709 12:20:17.783222 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 144715us
W20260709 12:20:17.792577 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 149316us
I20260709 12:20:17.744758 28519 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.794632 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:17.700614 29182 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.789433 29101 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.796456 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:17.810308 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:17.810942 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:17.799634 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:17.800604 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:17.718250 29067 raft_consensus.cc:3060] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:17.789810 29142 consensus_queue.cc:1059] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:20:17.808655 25110 raft_consensus.cc:1240] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:17.809269 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:17.547808 29096 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:17.812292 24469 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:20:17.833523 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:17.832501 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:17.842953 25116 raft_consensus.cc:2393] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 11: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:17.744239 29228 raft_consensus.cc:2749] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:17.765434 29268 raft_consensus.cc:740] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:17.848112 24467 raft_consensus.cc:3060] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:17.850301 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:17.859519 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:17.860411 25113 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:17.754393 29103 consensus_queue.cc:1048] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 12:20:17.717319 29005 consensus_queue.cc:1059] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 12:20:17.868268 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:17.775426 29278 raft_consensus.cc:2749] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:17.817191 29186 raft_consensus.cc:2749] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:17.809502 29167 consensus_queue.cc:1048] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:20:17.817193 29110 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:17.841579 29216 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:17.775086 28883 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:17.885910 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:17.811271 29258 consensus_queue.cc:1059] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:20:17.816809 29182 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:17.894537 25110 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:17.614312 29143 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:17.831939 29101 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:17.907433 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:17.775596 29275 consensus_queue.cc:1048] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.171s
I20260709 12:20:17.832672 28519 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:17.899752 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 186758us
I20260709 12:20:17.424505 28610 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:17.893162 24469 raft_consensus.cc:1275] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 12:20:17.947782 24469 pending_rounds.cc:85] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 10
I20260709 12:20:17.948127 24469 pending_rounds.cc:107] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 9.11
I20260709 12:20:17.893901 29279 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:17.932817 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:17.886945 29077 consensus_queue.cc:1048] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:20:17.911252 24467 raft_consensus.cc:1275] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:20:17.962332 24467 pending_rounds.cc:85] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 9
I20260709 12:20:17.894200 29141 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:17.948436 24469 raft_consensus.cc:2889] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:17.648027 29131 raft_consensus.cc:740] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:17.905431 29256 consensus_queue.cc:1059] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
W20260709 12:20:17.946906 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 136474us
I20260709 12:20:17.871459 29002 consensus_queue.cc:260] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:17.905797 29277 consensus_queue.cc:1059] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:20:17.936201 25113 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14.
I20260709 12:20:17.945663 24365 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:18.005810 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:18.007684 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:17.962774 24467 pending_rounds.cc:107] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:20:18.010270 24467 raft_consensus.cc:2889] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:17.952476 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:17.974320 24325 raft_consensus.cc:2368] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 13. Current term is 14.
W20260709 12:20:17.976513 29283 log.cc:927] Time spent T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 12:20:17.977252 29281 log.cc:927] Time spent T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 12:20:17.978101 29282 log.cc:927] Time spent T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:20:17.979451 29289 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:17.980924 25111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 702) took 1031 ms. Trace:
W20260709 12:20:18.036226 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 90698us
I20260709 12:20:18.036600 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:17.966194 29278 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:17.984711 29176 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:17.947858 29285 raft_consensus.cc:3055] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:17.943944 29268 consensus_queue.cc:260] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:17.915057 29180 consensus_queue.cc:1059] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:20:17.993093 29098 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:17.964093 29279 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:17.994599 29131 consensus_queue.cc:260] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:17.995119 29175 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:17.949373 29022 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:17.996353 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:18.050781 24398 raft_consensus.cc:2410] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:20:17.997601 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:18.011827 25110 raft_consensus.cc:2410] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:20:18.053328 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:18.014690 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:18.022570 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2380) took 1256 ms. Trace:
I20260709 12:20:18.022598 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:18.055127 24471 rpcz_store.cc:276] 0709 12:20:16.765762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.814680 (+ 48918us) service_pool.cc:224] Handling call
0709 12:20:16.815062 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:16.871125 (+ 56063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.022278 (+1151153us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b540029d454. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:18.022502 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50039040}
I20260709 12:20:18.037540 24324 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:20:17.931071 29143 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:17.974761 29008 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:18.035422 25111 rpcz_store.cc:276] 0709 12:20:16.949017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.949855 (+   838us) service_pool.cc:224] Handling call
0709 12:20:16.952296 (+  2441us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:17.373789 (+421493us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:17.373840 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:17.374693 (+   853us) log.cc:844] Serialized 52 byte log entry
0709 12:20:17.638579 (+263886us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:17.638616 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:17.638695 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:17.980695 (+342000us) raft_consensus.cc:1685] finished
0709 12:20:17.980718 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:17.980868 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":159281,"raft.queue_time_us":186316,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":56,"thread_start_us":431956,"threads_started":2,"wal-append.queue_time_us":412442}
I20260709 12:20:18.044139 29231 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.056761 29268 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:18.042678 29285 raft_consensus.cc:740] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:18.035580 29110 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.061379 29250 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:18.041996 29186 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:17.984195 29254 consensus_meta.cc:287] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.728s	user 0.010s	sys 0.000s
I20260709 12:20:18.045890 29002 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:18.063099 29275 raft_consensus.cc:2749] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:18.071245 24324 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
I20260709 12:20:17.975297 29141 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:18.078225 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:18.081521 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:18.081842 24465 raft_consensus.cc:2410] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:20:18.082234 24400 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:18.082741 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:18.083833 24324 raft_consensus.cc:2410] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:20:18.090179 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:18.092018 24398 raft_consensus.cc:2393] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 13: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
W20260709 12:20:18.085145 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 89633.9us
I20260709 12:20:18.093709 24366 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:18.094820 24324 raft_consensus.cc:1275] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:20:18.063517 29022 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:18.103816 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:18.106526 25082 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:18.070603 29231 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:18.111694 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:18.042840 29289 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:18.113656 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 76352.1us
I20260709 12:20:18.073887 29110 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:18.046684 29278 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:18.097142 29180 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.073488 29254 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:18.075421 29186 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:18.131913 24322 raft_consensus.cc:1275] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:20:18.134529 24400 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:18.120357 24365 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:18.103101 29258 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:18.151726 29187 raft_consensus.cc:2749] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:18.153973 29231 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:18.160197 29137 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:18.160725 29137 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:18.162557 29096 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:18.163872 24320 raft_consensus.cc:2368] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
I20260709 12:20:18.165903 29254 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:18.166566 24395 raft_consensus.cc:2368] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 13. Current term is 14.
W20260709 12:20:18.187587 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.199275 29254 raft_consensus.cc:2804] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:18.204857 29254 raft_consensus.cc:697] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:18.206277 24471 raft_consensus.cc:1275] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:20:18.214082 29096 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:18.215734 29022 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:18.219170 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:18.220088 24400 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:18.227244 24318 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:44280
I20260709 12:20:18.227962 24318 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:18.228459 24318 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:18.230857 29130 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.231594 29130 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:18.236757 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:18.237610 24471 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 14.
I20260709 12:20:18.150161 29258 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:18.144181 29180 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:18.110378 29285 consensus_queue.cc:260] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:18.201696 29277 consensus_queue.cc:1059] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:20:18.243119 29130 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:18.249792 29137 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:18.269933 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 149634us
W20260709 12:20:18.254853 29295 log.cc:927] Time spent T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:20:18.247851 29298 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.266350 29307 raft_consensus.cc:2749] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:18.263015 29254 consensus_queue.cc:237] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:18.272384 29308 raft_consensus.cc:3055] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:18.275884 24400 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:18.248900 29279 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:18.273705 29143 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:18.291993 29110 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:18.294334 29258 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:18.301430 29218 consensus_meta.cc:287] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.899s	user 0.013s	sys 0.002s
I20260709 12:20:18.302627 29180 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:18.304311 29186 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:18.283582 29141 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:18.306123 29289 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:18.307698 29260 log.cc:927] Time spent T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 1.076s	user 0.008s	sys 0.008s
I20260709 12:20:18.276806 29250 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:18.313225 29067 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:18.317121 29307 consensus_queue.cc:1048] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:18.318312 29137 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:18.281646 29308 raft_consensus.cc:740] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:18.320999 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:18.321666 24469 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:18.302160 29218 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:18.281208 29298 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:18.307724 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:18.323671 24471 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
I20260709 12:20:18.324254 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:18.324887 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:18.326627 24391 raft_consensus.cc:2368] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
W20260709 12:20:18.326977 29172 consensus_meta.cc:287] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.683s	user 0.011s	sys 0.001s
I20260709 12:20:18.330304 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:18.330606 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:18.331270 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:18.331877 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:18.332564 24398 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:18.333105 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:18.333885 24391 raft_consensus.cc:1240] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:18.334177 24392 raft_consensus.cc:2368] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
I20260709 12:20:18.334517 24469 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 13.
I20260709 12:20:18.327427 29172 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:18.336589 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:18.337448 24392 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
I20260709 12:20:18.339780 25116 raft_consensus.cc:1240] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:18.341259 29218 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:18.341792 29172 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:18.343279 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2379) took 1577 ms. Trace:
I20260709 12:20:18.343837 24474 rpcz_store.cc:276] 0709 12:20:16.765458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.765613 (+   155us) service_pool.cc:224] Handling call
0709 12:20:16.768315 (+  2702us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:16.773716 (+  5401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:16.773745 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:16.776877 (+  3132us) log.cc:844] Serialized 26 byte log entry
0709 12:20:17.038916 (+262039us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:17.038952 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:17.039013 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:17.050440 (+ 11427us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b48001a01d8. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9c275aa1 00007f4a9c26cb37 00007f4a9c26c9ca 00007f4a9c36426f 00007f4a9c363f37 00007f4a9c37855c 00007f4a9c378508 00007f4a9c378488 00007f4a9c378443 00007f4a9c3776ec 00007f4a9b2a1a96
0709 12:20:18.271636 (+1221196us) spinlock_profiling.cc:243] Waited 7.98 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:20:18.343028 (+ 71392us) raft_consensus.cc:1685] finished
0709 12:20:18.343059 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:18.343212 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4984,"raft.queue_time_us":6477,"raft.run_cpu_time_us":2485,"raft.run_wall_time_us":273402,"spinlock_wait_cycles":54246656,"thread_start_us":260902,"threads_started":1,"wal-append.queue_time_us":341361}
I20260709 12:20:18.346066 24396 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
W20260709 12:20:18.349771 29184 consensus_meta.cc:287] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.531s	user 0.011s	sys 0.002s
W20260709 12:20:18.350935 28916 consensus_meta.cc:287] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.631s	user 0.006s	sys 0.006s
I20260709 12:20:18.350543 29184 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:18.351529 28916 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:18.352337 25110 raft_consensus.cc:1240] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:18.359831 29280 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.363945 29067 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:18.321808 29308 consensus_queue.cc:260] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:18.374159 29308 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:18.367112 29280 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:18.370082 29298 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:18.379901 28916 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:18.421676 24318 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:18.426586 24289 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.522s (SENT) [suppressed 6 similar messages]
I20260709 12:20:18.427075 24318 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:18.427215 24317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb"
dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:44280
I20260709 12:20:18.461373 29180 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.462572 29180 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:18.471634 24400 raft_consensus.cc:2410] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:20:18.478724 24324 raft_consensus.cc:1240] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:18.489482 24323 raft_consensus.cc:2393] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 14: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:18.489125 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:18.490680 24394 raft_consensus.cc:2393] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 10: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:18.428598 24317 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:18.492549 24317 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:18.510813 29308 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:18.511253 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:18.512481 24394 raft_consensus.cc:2393] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 14: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
W20260709 12:20:18.492298 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 65984us
I20260709 12:20:18.511966 29308 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:18.522313 29215 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:18.526196 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:18.527226 24395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2756) took 1525 ms (client timeout 1737 ms). Trace:
W20260709 12:20:18.527776 24395 rpcz_store.cc:269] 0709 12:20:17.002089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.013957 (+ 11868us) service_pool.cc:224] Handling call
0709 12:20:18.526697 (+1512740us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400208fd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:18.526999 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2473698560}
I20260709 12:20:18.541296 29180 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:18.537781 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.542719 29298 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:18.553207 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:18.554432 24469 raft_consensus.cc:2376] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12. Re-sending same reply.
I20260709 12:20:18.555023 24290 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:18.523777 29215 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:18.544157 24399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2393) took 1998 ms. Trace:
I20260709 12:20:18.570475 24474 raft_consensus.cc:1240] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:18.571094 29215 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:18.572882 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:18.562536 24399 rpcz_store.cc:276] 0709 12:20:16.545803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.589568 (+ 43765us) service_pool.cc:224] Handling call
0709 12:20:16.616609 (+ 27041us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:17.093362 (+476753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.543444 (+1450082us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b54001b9754. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:18.543897 (+   453us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":977343232}
I20260709 12:20:18.579371 29308 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:18.572923 29254 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:18.589691 29254 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:18.574833 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:18.596464 29254 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:18.597518 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 103704us
I20260709 12:20:18.606699 25115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 1357) took 1315 ms. Trace:
I20260709 12:20:18.607234 25115 rpcz_store.cc:276] 0709 12:20:17.291335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.295653 (+  4318us) service_pool.cc:224] Handling call
0709 12:20:17.333288 (+ 37635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:17.451198 (+117910us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:17.451238 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:17.451286 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:17.451347 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.606088 (+1154741us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b540044d4d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:18.606165 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:18.606455 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270522624}
I20260709 12:20:18.610098 25119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35188 (request call id 1352) took 1375 ms. Trace:
I20260709 12:20:18.610662 25119 rpcz_store.cc:276] 0709 12:20:17.234058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.234259 (+   201us) service_pool.cc:224] Handling call
0709 12:20:18.609458 (+1375199us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400709ed4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:18.609757 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":273705216}
I20260709 12:20:18.613188 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:18.613516 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:18.612980 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:18.615381 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:18.616461 25111 raft_consensus.cc:1240] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:18.622210 29098 raft_consensus.cc:2749] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:18.625945 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:18.627207 29012 raft_consensus.cc:3055] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:18.627764 29012 raft_consensus.cc:740] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:18.637344 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:18.638091 24474 raft_consensus.cc:1240] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 12:20:18.640594 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.641393 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:18.642681 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:18.642869 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:18.643779 25115 raft_consensus.cc:2393] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 12: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:18.643695 24469 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:20:18.645303 24472 raft_consensus.cc:2393] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 15: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
W20260709 12:20:18.645588 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 91028.6us
I20260709 12:20:18.646590 29012 consensus_queue.cc:260] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:18.648579 29109 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.638397 24466 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:20:18.623234 29298 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:18.651432 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:18.651973 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:18.652501 25117 raft_consensus.cc:2393] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 13: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:18.656203 25118 raft_consensus.cc:1275] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:20:18.658396 29179 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:18.649400 29109 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:18.662216 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:18.663421 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:18.664350 24397 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:18.641203 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:18.667407 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:18.670117 29109 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:18.683468 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:18.688977 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.693821 28945 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:18.694927 28945 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:18.697587 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:20:18.691438 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 68026.1us
I20260709 12:20:18.675320 29136 consensus_queue.cc:1048] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:20:18.707041 24466 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 14.
I20260709 12:20:18.709803 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:18.703943 29012 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:18.714309 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:18.710897 24317 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:18.717044 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:18.717742 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:18.721099 24391 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:18.724264 29231 consensus_queue.cc:1048] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:18.728314 24317 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:18.729693 25118 raft_consensus.cc:1240] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:18.729844 29294 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:18.732420 29254 consensus_queue.cc:1059] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:20:18.733007 24325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2537) took 1851 ms (client timeout 1737 ms). Trace:
I20260709 12:20:18.743913 29294 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:18.746032 29308 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:18.747223 29294 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:18.747911 29077 consensus_queue.cc:1048] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:20:18.749008 29077 consensus_queue.cc:1243] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer c711faa13ead43ebbea0192cb74a4756 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:20:18.749738 28610 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:18.744427 29254 raft_consensus.cc:3055] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:18.750865 29254 raft_consensus.cc:740] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:18.751948 28945 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:18.752857 24469 raft_consensus.cc:1240] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:18.752455 29254 consensus_queue.cc:260] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:18.754207 28883 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:18.754678 29254 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:18.746961 29308 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:18.758356 29005 raft_consensus.cc:3055] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:18.758704 29308 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:18.758960 29005 raft_consensus.cc:740] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:18.760260 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:18.760316 25115 raft_consensus.cc:1275] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:20:18.761211 25117 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:20:18.761313 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:18.762678 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:18.762840 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:18.763890 24318 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
W20260709 12:20:18.742971 24325 rpcz_store.cc:269] 0709 12:20:16.881292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.881454 (+   162us) service_pool.cc:224] Handling call
0709 12:20:18.732375 (+1850921us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400361fd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:18.732707 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2502485248}
I20260709 12:20:18.764248 24289 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:18.768277 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:18.763638 24393 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:20:18.775012 29298 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:18.775385 29322 log.cc:927] Time spent T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:20:18.752368 28519 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:18.778097 24289 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:18.774081 29136 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.780833 29062 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:18.781068 28519 consensus_queue.cc:1048] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:18.781559 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:18.782085 29062 raft_consensus.cc:2749] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:18.780779 29136 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:18.795017 29136 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:18.797158 29003 consensus_queue.cc:1059] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:20:18.787158 24394 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:18.802062 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:18.803730 24391 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
I20260709 12:20:18.811182 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:18.816973 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:18.824287 24317 raft_consensus.cc:2393] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 14: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:18.828413 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:18.760519 29005 consensus_queue.cc:260] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:18.820590 29003 raft_consensus.cc:3055] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:18.846671 24469 raft_consensus.cc:1275] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:20:18.844972 24438 leader_election.cc:400] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
I20260709 12:20:18.849267 24438 leader_election.cc:403] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:18.853201 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:18.855269 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:18.858335 29190 consensus_queue.cc:1048] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:20:18.858839 29005 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:18.846487 29003 raft_consensus.cc:740] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:18.850099 29062 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.866771 24471 raft_consensus.cc:1240] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 12:20:18.867429 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 51605.2us
I20260709 12:20:18.865998 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:18.868386 24366 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:18.873183 24474 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:18.872170 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:18.875224 28519 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:20:18.874935 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 54367.4us
I20260709 12:20:18.878993 29003 consensus_queue.cc:260] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:18.883457 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.880455 24323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57702 (request call id 771) took 1101 ms. Trace:
I20260709 12:20:18.887729 24323 rpcz_store.cc:276] 0709 12:20:17.778626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.780689 (+  2063us) service_pool.cc:224] Handling call
0709 12:20:18.880144 (+1099455us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b5400339d54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:18.880370 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1516075904}
W20260709 12:20:18.892761 29323 log.cc:927] Time spent T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:20:18.890810 29062 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:18.896065 29062 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:18.897505 24316 raft_consensus.cc:1275] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:20:18.900862 29179 consensus_queue.cc:1059] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:18.901278 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:18.901458 25083 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:18.902568 28610 raft_consensus.cc:3055] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:18.902856 29241 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:18.907220 29241 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:18.907742 25083 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:18.908172 29101 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:18.904265 25116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 1362) took 1019 ms. Trace:
I20260709 12:20:18.904680 24289 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:18.906576 28610 raft_consensus.cc:740] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:20:18.910485 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.912020 28610 consensus_queue.cc:260] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:18.913619 28610 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:18.905956 24438 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:18.917454 29134 raft_consensus.cc:2749] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:18.918597 29218 raft_consensus.cc:2804] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:18.886274 29190 raft_consensus.cc:2804] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:18.919042 29218 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:18.921506 29218 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:18.923008 29184 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:18.927896 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:18.929344 29003 raft_consensus.cc:3060] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:18.909578 25116 rpcz_store.cc:276] 0709 12:20:17.885239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.885448 (+   209us) service_pool.cc:224] Handling call
0709 12:20:17.885849 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:18.340283 (+454434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.903764 (+563481us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b540065d1d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:18.904045 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1043436288}
I20260709 12:20:18.933573 29241 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:18.933964 29278 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:18.934017 29190 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:20:18.920138 24398 consensus_meta.cc:287] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.515s	user 0.016s	sys 0.008s
W20260709 12:20:18.932390 29274 log.cc:927] Time spent T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 1.214s	user 0.000s	sys 0.003s
W20260709 12:20:18.950907 24473 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 2262) took 2145 ms (client timeout 2085 ms). Trace:
I20260709 12:20:18.956332 25112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 701) took 2007 ms. Trace:
I20260709 12:20:18.957760 29007 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:18.956943 25112 rpcz_store.cc:276] 0709 12:20:16.948565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.948717 (+   152us) service_pool.cc:224] Handling call
0709 12:20:16.973984 (+ 25267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:17.118369 (+144385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:17.118406 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:17.157910 (+ 39504us) log.cc:844] Serialized 26 byte log entry
0709 12:20:17.375458 (+217548us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:17.375507 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:17.375604 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:18.931082 (+1555478us) spinlock_profiling.cc:243] Waited 84.7 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:20:18.955721 (+ 24639us) raft_consensus.cc:1685] finished
0709 12:20:18.955749 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:18.956114 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":143970,"raft.queue_time_us":164822,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":55,"spinlock_wait_cycles":194865408,"thread_start_us":142200,"threads_started":1,"wal-append.queue_time_us":342248}
I20260709 12:20:18.959028 29134 consensus_queue.cc:1048] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:18.961196 29276 consensus_queue.cc:1048] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:20:18.962127 29325 log.cc:927] Time spent T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
W20260709 12:20:18.955968 24473 rpcz_store.cc:269] 0709 12:20:16.805237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.869553 (+ 64316us) service_pool.cc:224] Handling call
0709 12:20:18.950460 (+2080907us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54001225d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:18.950684 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300537600}
I20260709 12:20:18.946979 29190 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:18.966926 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 62381.1us
I20260709 12:20:18.969336 29297 raft_consensus.cc:2804] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:18.970099 29297 raft_consensus.cc:697] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:18.970438 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:18.971277 24473 raft_consensus.cc:2393] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 14: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
W20260709 12:20:18.972137 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 94404.8us
I20260709 12:20:18.975734 29241 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:18.976472 29241 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:18.980285 24323 pending_rounds.cc:85] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756: Aborting all ops after (but not including) 7
I20260709 12:20:18.980758 24323 pending_rounds.cc:107] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:20:18.981138 24323 raft_consensus.cc:2889] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:18.984979 24321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2542) took 1824 ms (client timeout 2236 ms). Trace:
W20260709 12:20:18.985402 24321 rpcz_store.cc:269] 0709 12:20:17.160206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.161214 (+  1008us) service_pool.cc:224] Handling call
0709 12:20:18.984542 (+1823328us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b54000a8554. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:18.984797 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":777596288}
I20260709 12:20:18.986609 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:18.987370 24470 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:18.993289 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:18.983237 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:18.998332 25116 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:19.001546 29186 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:19.002414 29186 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:19.002930 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:19.003970 24469 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:20:19.007516 29182 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:19.008363 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:19.009138 24473 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:19.011337 29285 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:19.013496 25115 raft_consensus.cc:1275] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:20:19.015939 29284 raft_consensus.cc:3055] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:18.971287 29297 consensus_queue.cc:237] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:19.019227 29131 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:19.021260 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:19.016465 29284 raft_consensus.cc:740] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:19.024021 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:19.025722 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:19.026837 24289 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:19.027936 29170 raft_consensus.cc:2804] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:19.028525 29170 raft_consensus.cc:697] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:19.029340 29280 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:19.029753 29170 consensus_queue.cc:237] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:19.031467 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:19.032135 24320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2549) took 1637 ms. Trace:
I20260709 12:20:19.032599 24320 rpcz_store.cc:276] 0709 12:20:17.394741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.394903 (+   162us) service_pool.cc:224] Handling call
0709 12:20:19.031682 (+1636779us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b5400256cd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:19.031922 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1737925504}
I20260709 12:20:19.033195 24289 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:19.033936 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:19.034297 25110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 1363) took 1034 ms. Trace:
I20260709 12:20:19.034801 24395 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 13.
I20260709 12:20:19.034741 25110 rpcz_store.cc:276] 0709 12:20:18.000109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.059848 (+ 59739us) service_pool.cc:224] Handling call
0709 12:20:18.060158 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:18.352953 (+292795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.033826 (+680873us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b540050d7d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:19.034130 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":671327104}
I20260709 12:20:19.032166 24399 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 14.
I20260709 12:20:19.036427 28773 raft_consensus.cc:2804] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:19.037880 28773 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.038278 28773 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:18.966032 24398 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
I20260709 12:20:19.041175 24324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 2214) took 1066 ms. Trace:
I20260709 12:20:18.961113 25083 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:19.041644 24324 rpcz_store.cc:276] 0709 12:20:17.975004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.095938 (+120934us) service_pool.cc:224] Handling call
0709 12:20:18.478108 (+382170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:18.479451 (+  1343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.040940 (+561489us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b540019fd50. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:19.041105 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":799607680}
I20260709 12:20:19.042363 29280 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:19.043119 29280 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.043547 29280 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:19.045178 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 84225.8us
I20260709 12:20:19.046058 25083 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:19.046964 25083 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:19.050916 29272 log.cc:927] Time spent T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 1.735s	user 0.000s	sys 0.005s
I20260709 12:20:19.052601 25114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 703) took 2103 ms. Trace:
I20260709 12:20:19.052991 25114 rpcz_store.cc:276] 0709 12:20:16.949310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.949937 (+   627us) service_pool.cc:224] Handling call
0709 12:20:16.950213 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:17.110485 (+160272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:17.110517 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:17.111125 (+   608us) log.cc:844] Serialized 26 byte log entry
0709 12:20:17.266320 (+155195us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:17.266370 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:17.266443 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:19.050058 (+1783615us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:20:19.052107 (+  2049us) raft_consensus.cc:1685] finished
0709 12:20:19.052126 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:19.052407 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":159891,"raft.queue_time_us":188024,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":103,"spinlock_wait_cycles":37788928,"thread_start_us":111770,"threads_started":1,"wal-append.queue_time_us":177642}
I20260709 12:20:19.055611 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:19.056391 24472 raft_consensus.cc:3055] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:19.056855 24472 raft_consensus.cc:740] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:19.057725 24440 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:19.058323 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:19.058069 24472 consensus_queue.cc:260] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:19.058805 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:19.059283 24472 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:19.062129 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:19.062832 24324 raft_consensus.cc:1240] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:19.063501 24320 raft_consensus.cc:1275] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:20:19.064514 24471 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:19.066885 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.035089 24289 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:19.079902 24397 raft_consensus.cc:2468] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
I20260709 12:20:19.091146 28646 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.091888 28646 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:19.098949 29239 raft_consensus.cc:2749] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:19.101503 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:19.101626 29256 consensus_queue.cc:1048] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:19.103205 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:19.103940 24322 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:20:19.104015 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:20:19.113747 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 56289.6us
I20260709 12:20:19.116925 24316 raft_consensus.cc:1275] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:20:19.078189 29241 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:19.104717 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:19.117833 24440 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:19.111552 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:19.119225 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:19.119791 24324 raft_consensus.cc:3060] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:19.120289 25115 raft_consensus.cc:2393] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 8: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:19.121425 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:19.122210 25112 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 13.
I20260709 12:20:19.123979 29214 raft_consensus.cc:2749] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:19.111042 25110 raft_consensus.cc:1240] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:19.113994 29298 raft_consensus.cc:2749] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:19.127921 24222 catalog_manager.cc:5697] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a reported cstate change: config changed from index 4 to 6, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193), VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194), VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195), VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 10 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:19.130300 28519 raft_consensus.cc:2749] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
I20260709 12:20:19.130200 24222 catalog_manager.cc:5697] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 6 to 9, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 9 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:19.131795 24222 catalog_manager.cc:5697] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 3 to 10. New cstate: current_term: 10 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:19.135224 29218 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:19.133234 24222 catalog_manager.cc:5697] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.137487 24440 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:19.138127 25114 raft_consensus.cc:1240] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:19.110965 28646 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:19.061383 29290 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:19.149173 29290 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:19.149387 24440 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:19.151772 29290 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:19.153381 28519 raft_consensus.cc:2749] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:19.153312 28975 raft_consensus.cc:2749] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:19.154227 24468 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:19.155342 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:19.156145 24320 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
I20260709 12:20:19.157791 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:19.161316 24440 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:19.162103 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 115200us
I20260709 12:20:19.163425 25083 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:19.164276 29241 raft_consensus.cc:2749] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:19.079316 29179 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:19.165330 29179 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.165729 29179 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:19.166337 28773 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:19.168856 24365 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
W20260709 12:20:19.170217 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 72764.5us
I20260709 12:20:19.170449 29256 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:19.171063 29256 raft_consensus.cc:697] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:19.171576 24365 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:19.171872 24324 raft_consensus.cc:2468] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
W20260709 12:20:19.109562 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 222547us
I20260709 12:20:19.175865 25116 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 14.
W20260709 12:20:19.178897 24366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.182543 24440 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:19.181998 25082 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:19.189844 24222 catalog_manager.cc:5697] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.191884 24222 catalog_manager.cc:5697] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:19.193926 24222 catalog_manager.cc:5697] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 5 to 13. New cstate: current_term: 13 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:19.195989 24470 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 14.
I20260709 12:20:19.206760 24465 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 13.
W20260709 12:20:19.209088 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.210510 24471 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:20:19.211570 24473 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:19.213502 25082 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:19.214973 29134 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:19.215230 29239 raft_consensus.cc:2749] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:19.214999 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:19.216215 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:19.217128 25082 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:19.215672 29134 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:19.217864 29134 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:19.217669 29284 consensus_queue.cc:260] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:19.218202 29241 raft_consensus.cc:2804] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:19.219899 29241 raft_consensus.cc:697] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:19.220132 24438 leader_election.cc:400] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
I20260709 12:20:19.220490 24438 leader_election.cc:403] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:20:19.221129 29239 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
I20260709 12:20:19.221374 24438 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:19.222302 29239 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:19.222474 24438 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:19.222788 29239 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:19.223868 29239 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:19.223346 29101 raft_consensus.cc:2749] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:19.225422 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 60902us
I20260709 12:20:19.225871 29101 consensus_queue.cc:1059] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:19.227253 29101 raft_consensus.cc:3055] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:19.227775 29101 raft_consensus.cc:740] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:19.229005 29189 consensus_queue.cc:1059] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:19.215032 29229 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.231133 29229 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:19.227133 24440 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:19.232080 29101 consensus_queue.cc:260] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:19.233376 28975 raft_consensus.cc:2749] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:19.233603 29229 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:19.109803 28945 raft_consensus.cc:2804] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:19.234522 28945 raft_consensus.cc:697] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 13 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:19.235944 29101 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:19.235628 28945 consensus_queue.cc:237] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:19.106546 29215 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:20:19.237320 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 65853us
W20260709 12:20:19.238109 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 51446.6us
I20260709 12:20:19.256836 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:19.257725 24470 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:19.242082 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:19.260591 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:19.240658 29215 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:19.262203 29215 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:19.263127 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:19.263698 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.269579 29218 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:19.250677 29284 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:19.271080 29311 raft_consensus.cc:2749] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:19.270777 24222 catalog_manager.cc:5697] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 5 to 10, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 10 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:19.272559 24222 catalog_manager.cc:5697] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 10 to 13, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 13 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.276219 24222 catalog_manager.cc:5697] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 2 to 9, leader changed from d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 9 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:19.279573 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:19.277980 25110 raft_consensus.cc:1240] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 13 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:19.280401 24222 catalog_manager.cc:5697] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 8 to 9, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 9 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } }
I20260709 12:20:19.281176 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:19.281919 24398 raft_consensus.cc:3055] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:19.282279 24398 raft_consensus.cc:740] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:19.282490 24222 catalog_manager.cc:5697] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 7 to 9, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 9 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:19.279001 25084 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:19.284320 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:19.284111 24222 catalog_manager.cc:5697] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:19.284787 29229 consensus_queue.cc:1059] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:19.285897 24365 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:19.286303 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:19.285831 24222 catalog_manager.cc:5697] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 4 to 6, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 6 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:19.241366 29186 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:19.287462 24365 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:19.289894 29228 raft_consensus.cc:2804] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:19.290356 29228 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:19.290729 29228 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:19.247488 29190 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:19.297694 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:19.298952 24397 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:20:19.283110 24398 consensus_queue.cc:260] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:19.301182 24398 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:19.287768 24222 catalog_manager.cc:5697] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 9 to 10, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 10 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.305429 24222 catalog_manager.cc:5697] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 1 to 10, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 10 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:19.307054 29192 raft_consensus.cc:2749] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:19.307838 24400 raft_consensus.cc:2393] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 11: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:19.285943 24395 raft_consensus.cc:1240] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 10. Current term is 11. Ops: []
W20260709 12:20:19.314913 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 71182.5us
I20260709 12:20:19.285081 24399 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:19.315135 24394 raft_consensus.cc:2410] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:20:19.288503 24365 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:19.327572 24398 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
W20260709 12:20:19.279579 24220 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54244 (request call id 272) took 25041 ms (client timeout 15000 ms). Trace:
I20260709 12:20:19.240828 29276 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:19.340358 24472 raft_consensus.cc:2410] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:20:19.337797 24366 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:19.172513 29256 consensus_queue.cc:237] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:19.342311 24465 raft_consensus.cc:2393] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 14: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:19.240211 29241 consensus_queue.cc:237] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:19.344008 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:19.296533 29190 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:19.345625 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 66860.3us
I20260709 12:20:19.346957 24222 catalog_manager.cc:5697] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 8 to 10, leader changed from d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 10 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.348183 25084 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:19.348820 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.340658 29192 consensus_queue.cc:1048] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:20:19.352722 29276 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:19.353294 28945 raft_consensus.cc:2749] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:19.353606 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:19.364289 24290 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:19.365221 29326 log.cc:927] Time spent T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.265s	user 0.003s	sys 0.000s
I20260709 12:20:19.365971 29007 raft_consensus.cc:2749] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:19.367050 29215 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:19.355176 29134 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:19.368866 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:19.369701 25110 raft_consensus.cc:2393] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 11: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:19.369838 29134 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:19.371238 29280 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:19.372316 24290 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:19.372722 24394 raft_consensus.cc:1240] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:19.342550 29179 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:19.373682 28610 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:19.374167 28610 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:19.374534 28610 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:19.375324 29179 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:19.363262 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:19.363559 24395 raft_consensus.cc:1240] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:19.377893 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:19.378525 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:19.363790 29276 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:19.379132 24320 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14.
I20260709 12:20:19.380029 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:19.365224 24469 raft_consensus.cc:2393] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 13: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
W20260709 12:20:19.372782 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 120977us
I20260709 12:20:19.378532 24316 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:20:19.381126 24222 catalog_manager.cc:5697] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 7 to 9, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 9 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:19.382503 24438 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:19.381001 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:19.383728 29101 raft_consensus.cc:2804] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:19.384142 29101 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.383507 24222 catalog_manager.cc:5697] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 7 to 10, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 10 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.335165 29308 raft_consensus.cc:2749] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:19.355000 29239 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:19.338681 24220 rpcz_store.cc:269] 0709 12:19:54.238019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.238185 (+   166us) service_pool.cc:224] Handling call
0709 12:19:54.325300 (+ 87115us) spinlock_profiling.cc:243] Waited 5.7 ms on lock 0x7b5400002490. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a942280b2 00007f4a9d1a1759 00007f4a9d139a76 00007f4a9d10ad58 00007f4a9d20904e 00007f4a9b6ca2a4 00007f4a9b6ca232 00007f4a9b6ca161 00007f4a9b6ca0dc
0709 12:20:19.279274 (+24953974us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:14.706338 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:14.706946 (+   608us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:14.706984 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:20:14.707000 (+    16us) tablet.cc:662] Decoding operations
0709 12:20:14.707965 (+   965us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:14.708029 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:14.708057 (+    28us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:20:14.772529 (+ 64472us) tablet.cc:701] Row locks acquired
0709 12:20:14.776292 (+  3763us) write_op.cc:260] PREPARE: finished
0709 12:20:14.789451 (+ 13159us) write_op.cc:270] Start()
0709 12:20:14.797704 (+  8253us) write_op.cc:276] Timestamp: P: 1783599614785708 usec, L: 0
0709 12:20:14.799655 (+  1951us) op_driver.cc:348] REPLICATION: starting
0709 12:20:14.801774 (+  2119us) log.cc:844] Serialized 4016 byte log entry
0709 12:20:16.339785 (+1538011us) op_driver.cc:464] REPLICATION: finished
0709 12:20:16.526186 (+186401us) write_op.cc:301] APPLY: starting
0709 12:20:16.526266 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:16.601632 (+ 75366us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:16.601740 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:16.650839 (+ 49099us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:16.651066 (+   227us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=0,mrs_lookups=0
0709 12:20:16.651108 (+    42us) write_op.cc:312] APPLY: finished
0709 12:20:16.651403 (+   295us) log.cc:844] Serialized 89 byte log entry
0709 12:20:16.652384 (+   981us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:16.652555 (+   171us) write_op.cc:454] Released schema lock
0709 12:20:16.652601 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:16.658254 (+  5653us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:16.658286 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1560114,"reported_tablets":48,"spinlock_wait_cycles":13100800,"child_traces":[["op",{"apply.queue_time_us":186118,"apply.run_cpu_time_us":12683,"apply.run_wall_time_us":132030,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41783,"num_ops":9,"prepare.queue_time_us":305891,"prepare.run_cpu_time_us":60071,"prepare.run_wall_time_us":792733,"raft.queue_time_us":480344,"raft.run_cpu_time_us":51405,"raft.run_wall_time_us":137102,"replication_time_us":1539864,"thread_start_us":1379423,"threads_started":4,"wal-append.queue_time_us":667768,"wal-append.run_cpu_time_us":17105,"wal-append.run_wall_time_us":2179760}]]}
W20260709 12:20:19.416267 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.362592 24470 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
W20260709 12:20:19.386415 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 97976.9us
I20260709 12:20:19.384606 29101 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:19.385192 29005 raft_consensus.cc:2749] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:19.417114 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:19.385070 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:20:19.420413 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 58549us
I20260709 12:20:19.444403 24321 raft_consensus.cc:2368] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 13. Current term is 14.
I20260709 12:20:19.386893 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:19.414247 29215 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:19.386090 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:19.399893 24222 catalog_manager.cc:5697] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 7 to 10, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 10 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:19.447590 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:19.383553 24438 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:19.443065 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 94992.3us
I20260709 12:20:19.451273 24319 raft_consensus.cc:2393] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 11: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:20:19.451812 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 114131us
I20260709 12:20:19.452792 24322 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
I20260709 12:20:19.420883 24466 raft_consensus.cc:1240] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 13. Current term is 14. Ops: []
W20260709 12:20:19.443642 29326 log.cc:927] Time spent T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.077s	user 0.001s	sys 0.001s
I20260709 12:20:19.448736 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:19.458911 29179 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:19.471580 24469 raft_consensus.cc:2393] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 14: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:19.461280 29239 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:19.461890 29182 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:19.464840 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:19.467182 29002 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:19.483435 24398 raft_consensus.cc:2393] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 15: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:19.483722 25083 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:20:19.488130 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 104690us
I20260709 12:20:19.489441 24365 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:19.471630 28773 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:19.421240 29189 consensus_queue.cc:1059] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:20:19.482378 24222 catalog_manager.cc:5697] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 9 to 12, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 12 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:19.478281 29192 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:19.481698 29002 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:19.498625 24392 raft_consensus.cc:1275] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:20:19.493485 24366 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:19.499017 29189 raft_consensus.cc:3055] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:19.499601 29189 raft_consensus.cc:740] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:19.498684 29002 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:19.446120 29180 consensus_queue.cc:1059] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 12:20:19.514117 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 65812.4us
I20260709 12:20:19.538255 24290 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:19.484463 29179 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:19.550429 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 57030.6us
I20260709 12:20:19.551234 24366 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:19.490046 29182 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:19.553180 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 83573.4us
I20260709 12:20:19.555645 24366 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:19.552604 29297 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:19.557778 24324 raft_consensus.cc:1275] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:20:19.531278 29134 raft_consensus.cc:2804] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:19.563246 24365 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:19.498687 29291 consensus_queue.cc:1059] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 12:20:19.550025 29131 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:19.565354 24290 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:19.495500 29276 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:19.568914 29211 raft_consensus.cc:2749] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:19.562407 29210 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.570128 29280 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:19.570182 29210 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:19.568259 29134 raft_consensus.cc:697] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:19.570865 29276 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:19.568363 29278 consensus_queue.cc:1059] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:20:19.563282 29005 raft_consensus.cc:2749] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:19.557152 29190 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:19.576889 25113 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.017s	sys 0.020s
W20260709 12:20:19.606277 25113 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.017s	sys 0.021s
I20260709 12:20:19.506156 29189 consensus_queue.cc:260] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:19.576717 24291 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:20:19.574695 29237 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.015s	sys 0.017s
I20260709 12:20:19.557269 28945 consensus_queue.cc:1048] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 12:20:19.616015 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 121839us
I20260709 12:20:19.579200 29278 raft_consensus.cc:3055] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:19.577821 29210 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:19.576133 29182 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:19.602154 29308 raft_consensus.cc:2749] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:20:19.616438 29237 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.016s	sys 0.017s
W20260709 12:20:19.634550 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 69274.4us
I20260709 12:20:19.607954 29131 raft_consensus.cc:697] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:19.621799 29284 raft_consensus.cc:2749] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:19.577080 29101 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:19.622435 29278 raft_consensus.cc:740] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:19.651641 25084 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:19.664310 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:19.667290 29096 raft_consensus.cc:2804] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:19.667996 29096 raft_consensus.cc:697] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 14 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:19.674636 29096 consensus_queue.cc:237] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:19.639801 29210 consensus_queue.cc:1048] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:20:19.673098 29130 raft_consensus.cc:2804] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:19.671252 29189 raft_consensus.cc:3060] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:19.576223 29134 consensus_queue.cc:237] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:19.682778 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 50683.6us
I20260709 12:20:19.649245 29228 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:19.681847 29186 raft_consensus.cc:2804] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:19.699301 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:20:19.702500 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.702773 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:19.703572 25116 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:19.708505 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 61551.8us
I20260709 12:20:19.728680 25112 raft_consensus.cc:1240] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:19.730015 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:19.699314 28945 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.736383 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:19.685801 29278 consensus_queue.cc:260] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:19.742048 24289 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:19.744742 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.733026 29186 raft_consensus.cc:697] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:19.768173 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:19.773382 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:19.773802 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:19.775040 24323 raft_consensus.cc:2410] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:20:19.775214 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:19.776091 24320 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 11: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:19.744040 29131 consensus_queue.cc:237] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:19.782017 24290 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:19.783211 28773 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:19.783783 28773 raft_consensus.cc:697] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:19.783874 24290 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:19.784552 29186 consensus_queue.cc:237] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:19.785064 28773 consensus_queue.cc:237] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:19.758829 29284 consensus_queue.cc:1059] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:20:19.789115 29284 raft_consensus.cc:3055] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:20:19.785224 29333 log.cc:927] Time spent T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 12:20:19.801528 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.804774 24398 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 14.
I20260709 12:20:19.807490 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:19.808421 24395 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:19.789505 29284 raft_consensus.cc:740] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:19.772017 29291 raft_consensus.cc:2749] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:19.783732 29228 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:19.845774 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 362319us
I20260709 12:20:19.773375 29210 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:19.745747 28945 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:19.851619 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:19.856523 24398 raft_consensus.cc:1240] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:19.864018 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:19.864985 24398 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:19.869227 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 133092us
I20260709 12:20:19.870621 24289 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:19.873631 24440 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:19.876498 25082 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:19.825726 29278 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:19.882681 25116 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 14.
I20260709 12:20:19.883961 24291 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:19.894119 25082 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:19.813670 29308 consensus_queue.cc:1059] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 12:20:19.846927 29190 consensus_queue.cc:1048] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:20:19.914115 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:20:19.924167 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 65419.2us
I20260709 12:20:19.900815 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2772) took 1569 ms. Trace:
I20260709 12:20:19.924388 24400 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:20:19.925194 24392 rpcz_store.cc:276] 0709 12:20:18.331512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.338215 (+  6703us) service_pool.cc:224] Handling call
0709 12:20:18.338620 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:19.499014 (+1160394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.874188 (+375174us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54000e47d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:19.900734 (+ 26546us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2656772992}
I20260709 12:20:19.901180 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:19.874009 29229 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:19.942533 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 379326us
I20260709 12:20:19.897563 29290 raft_consensus.cc:2804] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:19.872711 28610 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:19.900857 29215 raft_consensus.cc:2749] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:19.914304 29211 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:19.958027 24474 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.030s	sys 0.084s
W20260709 12:20:19.958444 24474 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.030s	sys 0.084s
I20260709 12:20:19.899691 29291 raft_consensus.cc:2804] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:19.910086 29096 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:19.910647 29237 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:19.951601 29308 consensus_queue.cc:1243] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer d99d5d772cfe4a96afcab3d3b009a281 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:20:19.961138 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:19.954867 29003 consensus_queue.cc:1048] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:20:19.898281 29210 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:20:19.978698 24440 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:20.025089 24398 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:19.975862 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:20.027438 24391 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:19.992273 24392 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:20.038178 24393 raft_consensus.cc:1275] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:20:20.010636 29332 log.cc:927] Time spent T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.194s	user 0.002s	sys 0.000s
I20260709 12:20:19.966449 29291 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:20.052987 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 182454us
I20260709 12:20:19.964581 29290 raft_consensus.cc:697] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:19.955971 29229 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:20.033164 29096 raft_consensus.cc:697] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 14 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:20.041729 29216 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:20.072755 24289 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:20.041535 29192 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:20.081243 24289 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
W20260709 12:20:20.082062 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 186176us
I20260709 12:20:19.958644 29284 consensus_queue.cc:260] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:20.061669 29291 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:20.086567 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 138041us
W20260709 12:20:20.085125 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 201217us
I20260709 12:20:20.000859 29211 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:20.091548 24365 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:20.084867 25082 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:20.078506 29179 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:20.088039 28646 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:20.106225 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:20:20.091176 29339 log.cc:927] Time spent T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:20:20.110921 24467 raft_consensus.cc:2393] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 13: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:20.084793 28773 raft_consensus.cc:2749] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:20.096969 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:20.077173 29007 consensus_queue.cc:1059] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:20:20.133018 28610 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:20.114382 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 54496.8us
W20260709 12:20:20.117245 29343 log.cc:927] Time spent T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:20:20.117877 24469 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:20.118257 29338 log.cc:927] Time spent T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
W20260709 12:20:20.118981 29341 log.cc:927] Time spent T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:20:20.120015 29096 consensus_queue.cc:237] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:20.121641 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:20.111562 29284 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:20.126511 29229 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:20.130373 24317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 2231) took 1235 ms. Trace:
I20260709 12:20:20.099257 28945 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:20.091176 29256 consensus_queue.cc:1059] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:20:20.106222 28646 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.179939 28646 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:20.181619 29130 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:20.094367 29285 consensus_queue.cc:1059] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:20:20.140879 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:20:20.137598 29002 consensus_meta.cc:287] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.636s	user 0.007s	sys 0.007s
I20260709 12:20:20.142462 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2288) took 1086 ms. Trace:
I20260709 12:20:20.144130 29210 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:20:20.144801 24395 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 15.
W20260709 12:20:20.145646 24366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.146766 29216 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:20.147257 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:20.091807 29186 consensus_queue.cc:1059] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:20:20.106714 29170 raft_consensus.cc:3055] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:20:20.158313 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.151623 29190 raft_consensus.cc:2749] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:20.136121 29062 raft_consensus.cc:3055] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:20.161864 24471 raft_consensus.cc:1275] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:20:20.114969 29215 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:20:20.162813 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 71360.7us
W20260709 12:20:20.165819 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 202035us
W20260709 12:20:20.171401 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.173601 24400 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 14.
I20260709 12:20:20.177564 29211 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:20.178694 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:20.113541 29290 consensus_queue.cc:237] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:20.182227 29130 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:20.169510 24317 rpcz_store.cc:276] 0709 12:20:18.876872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.884801 (+  7929us) service_pool.cc:224] Handling call
0709 12:20:18.943761 (+ 58960us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:19.053573 (+109812us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:19.053604 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:19.054170 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 12:20:19.517285 (+463115us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:19.517345 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.517436 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:20.109844 (+592408us) raft_consensus.cc:1685] finished
0709 12:20:20.109863 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:20.109997 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7612,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":162,"thread_start_us":462675,"threads_started":1,"wal-append.queue_time_us":706199}
I20260709 12:20:20.115152 29179 consensus_queue.cc:1059] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:20:20.198091 25082 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:20.206794 24469 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 15.
I20260709 12:20:20.190904 24474 rpcz_store.cc:276] 0709 12:20:19.056480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.056590 (+   110us) service_pool.cc:224] Handling call
0709 12:20:19.056968 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:19.110155 (+ 53187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:19.110190 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:19.110880 (+   690us) log.cc:844] Serialized 26 byte log entry
0709 12:20:19.194994 (+ 84114us) spinlock_profiling.cc:243] Waited 63.3 ms on lock 0x7b1800402520. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a94241e07 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425ec02 00007f4a96ee620b 00007f4a96eebd23 00007f4a96eec0d1 00007f4a97307a0f
0709 12:20:19.958873 (+763879us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:19.958929 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.959015 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:20.142062 (+183047us) raft_consensus.cc:1685] finished
0709 12:20:20.142089 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:20.142362 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21697,"raft.queue_time_us":40124,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":127,"spinlock_wait_cycles":145830656,"thread_start_us":763654,"threads_started":1,"wal-append.queue_time_us":954698}
I20260709 12:20:20.237751 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:20.208688 29062 raft_consensus.cc:740] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:20.245970 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:20.246904 24466 raft_consensus.cc:2410] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:20:20.246958 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:20.198968 29002 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:20.249579 29002 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:20.208639 29170 raft_consensus.cc:740] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:20.254973 29170 consensus_queue.cc:260] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:20.257342 29101 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:20.258147 29189 consensus_meta.cc:287] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.579s	user 0.010s	sys 0.001s
I20260709 12:20:20.258390 24394 raft_consensus.cc:1240] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:20.259210 29280 raft_consensus.cc:3055] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:20.259670 29280 raft_consensus.cc:740] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:20.261063 29002 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.261180 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:20.261721 29002 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:20.264194 29002 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:20.269286 24468 raft_consensus.cc:1240] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:20:20.270496 29215 raft_consensus.cc:697] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 14 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:20.273109 29355 raft_consensus.cc:3055] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:20.273557 29355 raft_consensus.cc:740] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:20.274725 29355 consensus_queue.cc:260] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:20.271912 29215 consensus_queue.cc:237] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:20.282846 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 179328us
I20260709 12:20:20.282598 24399 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 13.
I20260709 12:20:20.291915 24289 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:20.294939 25084 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:20:20.292785 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 94853.1us
I20260709 12:20:20.297801 25114 raft_consensus.cc:1240] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:20.256484 29170 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:20.284209 29351 log.cc:927] Time spent T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:20:20.201857 29192 raft_consensus.cc:697] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:20.308990 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:20.306820 25084 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:20:20.313975 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 66890.2us
I20260709 12:20:20.322912 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:20.323670 24320 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 14.
I20260709 12:20:20.297209 29218 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:20.297361 29361 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:20.308311 29241 raft_consensus.cc:2749] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:20.301730 29285 raft_consensus.cc:2804] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:20.330516 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:20.332311 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:20.336259 29228 raft_consensus.cc:3055] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:20.336839 29228 raft_consensus.cc:740] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:20.313941 29182 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.342630 24440 leader_election.cc:400] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
I20260709 12:20:20.314721 29189 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.294132 28945 consensus_queue.cc:1048] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:20:20.350243 24366 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:20.351624 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:20.351994 25082 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:20.353690 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:20.354948 24394 raft_consensus.cc:2393] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 11: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:20.328354 29003 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.361900 24400 raft_consensus.cc:1275] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:20:20.363160 24289 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:20.364677 24289 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:20.365741 28610 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:20.366460 28610 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:20.367012 28610 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:20.369015 29356 consensus_queue.cc:1048] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:20.371850 29179 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:20.372510 29179 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:20.373095 29179 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:20.378391 29348 log.cc:927] Time spent T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.312s	user 0.004s	sys 0.000s
I20260709 12:20:20.380276 28610 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:20.407588 29062 consensus_queue.cc:260] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:20.384061 29098 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.411283 29098 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:20.412611 29297 raft_consensus.cc:3055] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:20.413082 29297 raft_consensus.cc:740] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:20.413981 29297 consensus_queue.cc:260] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:20.415287 29297 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:20.337905 29228 consensus_queue.cc:260] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:20.290155 29280 consensus_queue.cc:260] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:20.420493 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.423472 24366 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:20:20.424731 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 72824.9us
I20260709 12:20:20.340751 29256 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.331990 29229 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.347358 29285 raft_consensus.cc:697] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:20.437592 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:20.439549 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.456465 28646 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:20.458604 29037 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:20.357437 29186 raft_consensus.cc:2749] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:20:20.460121 29359 log.cc:927] Time spent T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:20:20.342206 29361 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:20.356732 29346 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:20.468760 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:20.469870 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:20.483462 29254 raft_consensus.cc:3055] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:20:20.483973 29134 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.004s	sys 0.011s
I20260709 12:20:20.494886 24440 leader_election.cc:400] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
I20260709 12:20:20.466631 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:20.516247 24393 raft_consensus.cc:2393] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 12: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:20.504468 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:20.503947 24394 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
I20260709 12:20:20.438388 29189 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:20.350907 29182 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:20.526054 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 45939.5us
I20260709 12:20:20.484923 29037 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.429075 29003 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:20.514588 29134 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.005s	sys 0.011s
W20260709 12:20:20.555204 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 118878us
I20260709 12:20:20.557003 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:20.463111 29256 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:20.557859 24398 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:20:20.510767 29254 raft_consensus.cc:740] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:20.556035 24440 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:20.566752 25110 raft_consensus.cc:1240] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:20.564256 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:20.569667 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:20.570080 24393 raft_consensus.cc:2393] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 11: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:20.529441 29218 raft_consensus.cc:697] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 15 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
W20260709 12:20:20.570935 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 131633us
I20260709 12:20:20.564307 24289 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:20.503997 29180 consensus_queue.cc:1048] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:20:20.509166 29229 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:20.549926 29037 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:20.602089 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:20.605057 24391 raft_consensus.cc:2376] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13. Re-sending same reply.
I20260709 12:20:20.601565 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:20.607005 24395 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 13.
I20260709 12:20:20.615732 24396 raft_consensus.cc:1240] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 10. Current term is 11. Ops: []
W20260709 12:20:20.615658 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 51484.4us
W20260709 12:20:20.619269 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:20.619925 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.503583 29192 consensus_queue.cc:237] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.4, Last appended by leader: 4, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:20.630348 29003 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:20.622215 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 298336us
W20260709 12:20:20.638119 29278 consensus_meta.cc:287] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.737s	user 0.008s	sys 0.006s
I20260709 12:20:20.647640 24397 raft_consensus.cc:1275] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:20.570580 29186 consensus_queue.cc:1059] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 12:20:20.603251 29189 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:20.669973 24323 raft_consensus.cc:1240] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:20.673332 24317 raft_consensus.cc:1275] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:20:20.684476 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 128517us
I20260709 12:20:20.647295 29190 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.654045 29308 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.679625 29189 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:20.710826 29308 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:20.689713 29357 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:20.747251 24440 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:20.749809 29379 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:20.751581 28646 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:20.752604 29256 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:20.837604 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:20.753806 29229 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:20.754933 29284 consensus_meta.cc:287] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.586s	user 0.007s	sys 0.003s
I20260709 12:20:20.849143 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:20.756021 29386 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:20.757467 29384 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:20.873222 24391 raft_consensus.cc:1275] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:20.757959 25114 raft_consensus.cc:1217] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 13 LEADER]: Deduplicated request from leader. Original: 10.9->[12.10-12.10]   Dedup: 12.10->[]
I20260709 12:20:20.744848 29187 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.786011 24365 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:20:20.817471 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.822127 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:20.841194 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:20.836912 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 194859us
I20260709 12:20:20.848845 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:20.882313 25083 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:20.849105 24465 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:20:20.761859 29189 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.856177 29182 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:20.839720 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 277613us
W20260709 12:20:20.913143 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 127282us
I20260709 12:20:20.914757 24365 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:20.874864 25114 raft_consensus.cc:1240] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 13 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:20:20.652933 29285 consensus_queue.cc:237] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:20.853377 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:20.852767 25112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "400165817fe74ada9a4793982993a5e3"
dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:47070
I20260709 12:20:20.917306 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:20.918644 25112 raft_consensus.cc:606] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:20.918896 24472 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
I20260709 12:20:20.919020 25112 raft_consensus.cc:614] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:20.886256 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:20.884910 24400 raft_consensus.cc:1275] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:20:20.920090 24400 pending_rounds.cc:85] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a: Aborting all ops after (but not including) 6
I20260709 12:20:20.920944 24400 pending_rounds.cc:107] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:20:20.853785 29386 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.921896 24400 raft_consensus.cc:2889] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:20.920352 24467 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
W20260709 12:20:20.855443 29329 log.cc:927] Time spent T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.162s	user 0.003s	sys 0.004s
I20260709 12:20:20.707700 29190 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:20.923765 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.925781 24366 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:20.883908 29189 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:20.925459 25118 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:20:20.884804 29357 raft_consensus.cc:697] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:20.961903 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:20.963024 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 78490.7us
I20260709 12:20:20.969189 24467 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 15.
I20260709 12:20:20.925004 29131 raft_consensus.cc:2749] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:20.949030 29237 consensus_meta.cc:287] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.976s	user 0.008s	sys 0.005s
I20260709 12:20:20.973730 24472 raft_consensus.cc:1275] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:20:20.911425 29241 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:20.974465 24393 raft_consensus.cc:1275] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:20:20.947084 29229 raft_consensus.cc:2749] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:20.822860 29218 consensus_queue.cc:237] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:20.954698 29388 log.cc:927] Time spent T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
W20260709 12:20:20.973066 29291 consensus_meta.cc:287] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.883s	user 0.013s	sys 0.000s
I20260709 12:20:20.986606 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:20.941092 29404 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.989122 24324 raft_consensus.cc:1275] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:20:20.993104 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 110881us
I20260709 12:20:20.922317 29386 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:20.989027 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 241892us
I20260709 12:20:20.838169 29379 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:20.954356 29361 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:20.997757 24440 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:20.974069 29186 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:21.002408 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 72563.7us
I20260709 12:20:20.940750 29346 consensus_queue.cc:1059] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:20:21.004230 24365 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:20.984604 29237 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:21.003811 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.923475 29187 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:20.923237 29384 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:20.992372 29002 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:20:21.045090 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.047930 24365 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:21.068177 24365 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:20:21.086014 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 88369.6us
I20260709 12:20:21.086988 24440 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:21.041833 29329 log.cc:927] Time spent T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:20:21.010586 29361 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:21.062989 29339 log.cc:927] Time spent T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:20:21.043229 29229 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:21.091403 25114 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:20.991995 29241 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.042590 29365 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:20:21.050707 29130 consensus_meta.cc:287] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.743s	user 0.008s	sys 0.003s
W20260709 12:20:21.093168 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 203937us
I20260709 12:20:21.047515 29400 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.138929 29130 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.139276 29400 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.002523 29404 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:21.143512 29393 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:21.142458 29400 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:20.997300 29291 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:21.052767 24210 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 97dd30b21cc14958a91b2da522e4bbe9 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c711faa13ead43ebbea0192cb74a4756 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:21.145016 29404 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:21.145490 24210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 162369us
I20260709 12:20:21.146891 29291 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:21.147754 29384 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:21.089833 29002 raft_consensus.cc:2804] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:21.043550 29382 consensus_queue.cc:1059] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 12:20:21.148455 29002 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.149017 29002 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:21.105645 29361 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:21.149547 29372 log.cc:927] Time spent T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 12:20:21.151046 29361 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:21.152483 29392 log.cc:927] Time spent T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:20:21.090857 29131 raft_consensus.cc:2749] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:21.054433 29379 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:21.133219 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 61966.5us
I20260709 12:20:21.153843 29187 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:21.154330 24365 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:21.155854 24365 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:21.156018 29308 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:21.156471 29098 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:21.156680 29308 raft_consensus.cc:2804] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:21.157140 29308 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.157531 29308 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:21.156848 29346 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:21.159034 29346 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.159446 29346 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:21.160337 29190 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:21.126713 29357 consensus_queue.cc:237] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:21.162222 29037 consensus_meta.cc:287] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.000s
I20260709 12:20:21.162688 29037 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:21.110160 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 184447us
I20260709 12:20:21.053378 29371 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:20:21.172950 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 86057us
I20260709 12:20:21.162784 29409 consensus_queue.cc:1048] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:20:21.053984 29380 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:21.165959 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:21.185053 24467 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:20:21.144182 29393 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.172233 25112 raft_consensus.cc:1240] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 9. Current term is 10. Ops: []
W20260709 12:20:21.174994 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.184245 25113 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:20:21.054358 29186 consensus_queue.cc:1048] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 12:20:21.191262 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:21.186385 24366 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:21.134605 29237 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:21.197276 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:21.200035 24440 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:21.218657 24438 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:21.221189 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 51234.9us
I20260709 12:20:21.183045 29404 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:21.219851 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 174646us
I20260709 12:20:21.159031 29210 consensus_queue.cc:1048] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:20:21.193699 29101 raft_consensus.cc:2749] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:21.181401 29130 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:21.343815 24438 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:21.239079 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:21.277842 29284 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:21.293087 29096 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:20:21.362108 29179 consensus_meta.cc:287] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.988s	user 0.012s	sys 0.001s
I20260709 12:20:21.362365 29002 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.362668 29179 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:21.293790 29170 consensus_meta.cc:287] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.981s	user 0.012s	sys 0.003s
I20260709 12:20:21.202103 29237 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:20:21.326045 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 126120us
I20260709 12:20:21.373199 24440 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:21.184863 29371 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.226981 29384 raft_consensus.cc:2804] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:21.385964 29384 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:21.294952 29393 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:21.286970 29398 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:21.386452 29395 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:21.386480 29384 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:21.211941 29190 raft_consensus.cc:2804] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:21.201761 29379 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:21.388203 29190 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.388696 29190 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:21.388402 29379 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.390689 29379 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:21.301877 29241 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:21.187106 29131 consensus_queue.cc:1059] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:20:21.325470 24394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:20:21.361690 29096 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.391629 29131 consensus_queue.cc:1243] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer d99d5d772cfe4a96afcab3d3b009a281 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:20:21.187862 29361 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:21.392549 29361 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.393716 29096 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:21.394670 29361 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:21.368799 29297 consensus_meta.cc:287] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.953s	user 0.007s	sys 0.008s
I20260709 12:20:21.400707 29422 raft_consensus.cc:2749] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:21.380445 29237 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:21.401849 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 58087.7us
I20260709 12:20:21.404942 29002 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:21.405879 29425 log.cc:927] Time spent T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:20:21.405937 29101 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:21.192404 29365 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:21.379437 24440 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:21.408835 29422 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:21.329836 29192 raft_consensus.cc:2749] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:21.385179 29371 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:21.387102 29398 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.287590 29402 consensus_queue.cc:1048] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:20:21.237910 29404 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.408392 24440 leader_election.cc:400] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 13. Current term is 14.
I20260709 12:20:21.405957 28610 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:21.193498 29380 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.409296 29422 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.420053 24440 leader_election.cc:403] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:20:21.412293 29229 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:21.432585 24394 raft_consensus.cc:606] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Received request to transfer leadership to TS 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:21.433240 24394 raft_consensus.cc:614] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:21.425375 29422 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:21.416821 29308 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:21.444198 29308 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:21.420792 29346 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:21.446482 29346 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:21.446995 29386 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:21.447525 29402 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:21.449983 24440 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:21.448084 29402 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:21.452570 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 219554us
I20260709 12:20:21.415166 29284 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.417999 29189 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:21.462338 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
W20260709 12:20:21.462836 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.463301 24317 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:21.464219 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:21.466149 25112 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 14.
I20260709 12:20:21.467113 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:21.468268 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:21.473409 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:21.475507 25112 raft_consensus.cc:2393] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 10: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:21.477270 28610 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:21.477996 28610 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:21.467984 24323 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 12.
I20260709 12:20:21.482522 24291 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:21.489627 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:21.492677 24468 raft_consensus.cc:1240] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:21.493646 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:21.459683 29380 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:21.497509 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:21.501675 24467 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 15.
I20260709 12:20:21.503037 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:21.498672 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:21.487226 29297 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:21.506824 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:21.508642 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:21.491405 29229 consensus_queue.cc:1059] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:20:21.511212 29229 raft_consensus.cc:3055] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:21.511574 29229 raft_consensus.cc:740] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:21.511593 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:21.512647 24470 raft_consensus.cc:2410] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:20:21.512679 29229 consensus_queue.cc:260] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.513636 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:21.514231 29229 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:21.514721 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:21.516288 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:21.516774 29428 raft_consensus.cc:2749] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 13. Current term is 14.
I20260709 12:20:21.516913 24470 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:21.517716 29405 raft_consensus.cc:2749] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:21.518127 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:21.518256 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:21.519006 24470 raft_consensus.cc:2410] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:20:21.519498 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:21.519989 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:21.522532 24470 raft_consensus.cc:1275] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:20:21.524607 29241 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:21.524879 29381 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:21.525210 29241 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.525367 29381 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.527350 29381 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:21.524554 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.524583 29409 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:21.528934 29297 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:21.528810 29409 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.529464 29297 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:21.530076 29398 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:21.531152 25084 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:21.505151 24468 raft_consensus.cc:2393] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 11: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
W20260709 12:20:21.535462 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 347216us
I20260709 12:20:21.499469 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:20:21.539171 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.541110 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:21.543355 29409 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:21.543929 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:21.544875 24321 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
I20260709 12:20:21.546563 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:21.547468 24321 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
I20260709 12:20:21.547060 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:21.542424 29241 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:21.550083 29189 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:21.551250 29284 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:21.538136 29386 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:21.561209 29254 consensus_queue.cc:260] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.562752 29254 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:21.579294 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:21.580693 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:21.581564 24468 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 12.
I20260709 12:20:21.582171 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:21.584297 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:21.584955 24467 raft_consensus.cc:1275] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:20:21.552022 29380 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.553990 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:21.546849 29424 raft_consensus.cc:2804] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:20:21.556164 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.556262 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:21.589648 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:21.603694 24466 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 8.
I20260709 12:20:21.591593 24317 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:20:21.592219 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:21.552018 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:21.558032 29285 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.605929 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:21.606022 29285 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.607599 24317 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
I20260709 12:20:21.588949 29386 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.606021 24321 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 12: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:21.609335 29386 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:21.610152 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:21.611584 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:21.611732 29386 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:21.602197 29003 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.612728 29285 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:21.612223 24321 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14.
I20260709 12:20:21.614219 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:21.615531 24321 raft_consensus.cc:1240] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:21.616887 24321 raft_consensus.cc:1240] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:21.603575 24440 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:21.618809 24440 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:21.619956 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:21.623869 24440 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:21.632095 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:21.632721 24318 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:20:21.633008 24469 raft_consensus.cc:1275] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:20:21.589841 29192 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.634341 24474 raft_consensus.cc:2393] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 12: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:21.636777 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:21.636821 29415 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:21.637964 29415 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:21.640177 29434 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:21.640672 29434 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:21.631671 24440 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:21.602710 29424 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.648474 24290 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:21.651491 29368 raft_consensus.cc:2804] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:21.652079 29368 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:21.652500 29368 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:21.646559 24440 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:21.654363 29395 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:21.654527 25083 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:21.654913 29395 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.655386 29395 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:21.656052 29433 consensus_queue.cc:1048] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:21.641108 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:21.658090 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:21.620272 29184 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.623386 29386 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.661900 24290 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:21.658825 25119 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:21.619611 29285 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:21.611845 29384 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:21.646910 29434 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:21.612577 29003 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:21.657642 29361 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:21.618049 29380 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:21.695060 29435 log.cc:927] Time spent T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:20:21.696516 29380 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:21.697059 29363 log.cc:927] Time spent T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 1.167s	user 0.003s	sys 0.007s
I20260709 12:20:21.697351 29380 raft_consensus.cc:2749] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:21.658160 29424 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:21.689781 29427 raft_consensus.cc:2749] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:21.680557 29386 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.714514 29386 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:21.664073 29393 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:21.685859 29379 consensus_queue.cc:1059] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:20:21.645655 29192 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:21.681106 29237 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:21.684923 29396 consensus_queue.cc:1048] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:20:21.669533 29409 raft_consensus.cc:2804] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:21.703212 24465 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:20:21.704519 24316 raft_consensus.cc:2368] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 13. Current term is 14.
I20260709 12:20:21.706287 24322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 2246) took 1701 ms. Trace:
I20260709 12:20:21.709241 29426 consensus_queue.cc:1059] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.028s
W20260709 12:20:21.743245 29440 log.cc:927] Time spent T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:20:21.720813 29379 raft_consensus.cc:3055] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:21.698658 29361 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:21.744656 29379 raft_consensus.cc:740] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:21.744818 29361 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:21.745721 29379 consensus_queue.cc:260] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:21.746996 29379 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:21.731616 29409 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:21.748680 29409 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:21.732090 29424 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.737393 24397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2790) took 1226 ms. Trace:
W20260709 12:20:21.751881 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 90091.3us
I20260709 12:20:21.742616 29237 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:21.705176 29415 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:21.743954 29426 raft_consensus.cc:3055] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:21.753757 29426 raft_consensus.cc:740] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:21.754798 29424 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:21.754671 29426 consensus_queue.cc:260] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:21.755959 29426 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:21.757025 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:21.757643 24323 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:21.722560 29422 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:21.701426 29404 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:21.723016 29384 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:21.763260 29190 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.765527 29190 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:21.766920 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:21.767567 25119 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:21.751752 24397 rpcz_store.cc:276] 0709 12:20:20.511261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.511423 (+   162us) service_pool.cc:224] Handling call
0709 12:20:20.543148 (+ 31725us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:20.648189 (+105041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:21.737046 (+1088857us) spinlock_profiling.cc:243] Waited 94.6 ms on lock 0x7b54002a3d54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:21.737296 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217486592}
I20260709 12:20:21.769820 29368 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:21.720196 29003 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:21.722247 29402 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:21.775496 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.726148 24321 raft_consensus.cc:1240] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:21.740271 29192 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:21.761269 29422 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:21.819536 25119 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:20:21.668975 29184 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.728690 24322 rpcz_store.cc:276] 0709 12:20:20.004522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.004758 (+   236us) service_pool.cc:224] Handling call
0709 12:20:20.038893 (+ 34135us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:20.043679 (+  4786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:20.043725 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:20.077613 (+ 33888us) log.cc:844] Serialized 26 byte log entry
0709 12:20:20.282521 (+204908us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:20.282576 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.282661 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:21.696486 (+1413825us) spinlock_profiling.cc:243] Waited 6.44 ms on lock 0x7b2400172c28. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a940e59c4 00007f4a940e3acb 00007f4a9429edc9 00007f4a9429ea55 00007f4a9429e09d 00007f4a96ed010e 00007f4a96ee788c 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221
0709 12:20:21.699022 (+  2536us) raft_consensus.cc:1685] finished
0709 12:20:21.699054 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:21.706199 (+  7145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1589,"raft.queue_time_us":147,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":7130,"spinlock_wait_cycles":14815616,"thread_start_us":181249,"threads_started":1,"wal-append.queue_time_us":263265}
I20260709 12:20:21.753005 24290 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
W20260709 12:20:21.823303 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 70392.6us
I20260709 12:20:21.821626 24366 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:21.686691 29285 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:21.828308 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:21.828712 24289 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
W20260709 12:20:21.829344 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.778985 29368 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:21.834621 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.841914 29393 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:21.842420 29393 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.842756 29393 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:21.849808 24323 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 13.
I20260709 12:20:21.851488 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:21.853497 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:21.852497 25110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 1380) took 1577 ms. Trace:
I20260709 12:20:21.855525 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:21.856112 24323 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:21.855824 25110 rpcz_store.cc:276] 0709 12:20:20.275592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.290279 (+ 14687us) service_pool.cc:224] Handling call
0709 12:20:20.311863 (+ 21584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:20.569338 (+257475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:21.852265 (+1282927us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b540050d7d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:21.852438 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":584234752}
I20260709 12:20:21.830511 29003 raft_consensus.cc:2804] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:21.861480 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:21.862360 24397 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:21.863050 24366 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:21.863816 24290 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:21.870436 24290 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:21.873890 29007 raft_consensus.cc:2749] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:21.874490 24396 raft_consensus.cc:1240] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:20:21.853013 29311 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.876399 29311 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:21.863531 29002 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.877753 29003 raft_consensus.cc:697] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:21.878111 29002 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.878724 29003 consensus_queue.cc:237] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.880234 29002 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:21.859448 29190 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.881114 29190 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:21.881242 29297 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.883448 29297 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:21.883895 29190 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:21.851917 29375 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.884912 29285 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:21.878760 29311 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:21.885329 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:21.887027 24322 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 15.
I20260709 12:20:21.832245 29356 consensus_queue.cc:1048] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:20:21.894263 24397 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 13.
I20260709 12:20:21.852061 29380 raft_consensus.cc:2764] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:20:21.895084 24320 raft_consensus.cc:1240] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:20:21.857853 29210 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:21.904340 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:21.908013 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:21.884052 29297 raft_consensus.cc:2749] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:21.909631 24323 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 15.
I20260709 12:20:21.911029 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:21.913121 24396 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:21.915084 24289 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:21.917999 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:21.919210 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:21.919822 24322 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:21.917999 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:21.920647 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:21.920753 24398 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:20:21.906206 29409 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.921825 29422 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:21.922537 29422 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.923815 29409 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:21.925326 29184 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:21.926527 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:21.930878 24392 raft_consensus.cc:2393] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 14: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:21.907254 29002 raft_consensus.cc:2749] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:21.935185 24289 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:21.932868 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 62538.2us
I20260709 12:20:21.941269 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:21.932090 29311 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:21.907107 29434 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:21.949116 29311 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.950695 29434 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:21.951490 29422 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:21.913443 29210 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.952414 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:21.953040 24473 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:21.912168 29375 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:21.956149 29297 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:21.893347 29361 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:21.966071 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:21.972283 29449 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:21.973202 29449 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:21.969740 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:21.976692 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.977134 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:21.978933 29297 raft_consensus.cc:697] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:21.979811 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:21.980700 24396 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:21.980741 24473 raft_consensus.cc:2410] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:20:21.976281 29449 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:21.983109 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:21.983755 24323 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:20:21.985685 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:21.987322 24469 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:21.990155 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:21.944520 29395 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:21.998042 29385 raft_consensus.cc:3055] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:21.998567 29385 raft_consensus.cc:740] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:21.999574 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:22.000964 24473 raft_consensus.cc:2393] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 12: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:21.992352 29449 raft_consensus.cc:2749] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:22.003898 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.004614 29448 consensus_queue.cc:1059] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:20:22.005774 29426 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:22.006340 29297 consensus_queue.cc:237] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:22.006613 29426 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:22.009799 24467 raft_consensus.cc:2368] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 15. Current term is 16.
W20260709 12:20:22.012166 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 109526us
I20260709 12:20:22.012744 25113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35194 (request call id 728) took 1254 ms. Trace:
I20260709 12:20:22.013135 25113 rpcz_store.cc:276] 0709 12:20:20.758766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.799706 (+ 40940us) service_pool.cc:224] Handling call
0709 12:20:22.012543 (+1212837us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54005b18d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:22.012678 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":611225984}
W20260709 12:20:22.019457 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 84396.1us
I20260709 12:20:22.021893 29179 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:22.024860 29356 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:22.025828 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:22.024888 29458 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:22.029067 29448 raft_consensus.cc:3055] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:22.029472 29448 raft_consensus.cc:740] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:22.029435 29458 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:22.030128 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:22.030539 29448 consensus_queue.cc:260] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:22.031739 29448 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:22.031780 24323 raft_consensus.cc:1275] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:20:22.032089 29458 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:22.027712 29356 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:22.033545 24321 raft_consensus.cc:1275] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:20:22.035625 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:22.034698 24322 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 16.
I20260709 12:20:22.037680 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:22.037947 24366 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:22.038354 24469 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 14.
I20260709 12:20:22.038934 24366 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:22.036319 25113 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
I20260709 12:20:22.042068 29005 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:22.064934 24366 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:22.065917 24290 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:21.999603 29385 consensus_queue.cc:260] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:22.068125 29385 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:22.063802 29402 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:22.073221 29402 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:22.075553 29402 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:22.079243 29005 raft_consensus.cc:697] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 15 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:22.080403 29005 consensus_queue.cc:237] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:22.081305 25114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35188 (request call id 1381) took 1108 ms. Trace:
I20260709 12:20:22.081727 25114 rpcz_store.cc:276] 0709 12:20:20.972679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.972844 (+   165us) service_pool.cc:224] Handling call
0709 12:20:22.081105 (+1108261us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b5400501c54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:22.081236 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230891264}
I20260709 12:20:22.083433 29308 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:22.084151 29311 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:22.085625 29228 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:22.087849 24366 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:22.093164 29211 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:22.093699 29211 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.094214 29211 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:22.094887 29375 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:22.097677 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 746) took 1449 ms. Trace:
I20260709 12:20:22.098593 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:22.099598 24322 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 14.
I20260709 12:20:22.099740 24316 raft_consensus.cc:1240] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:22.098099 24391 rpcz_store.cc:276] 0709 12:20:20.648488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.648770 (+   282us) service_pool.cc:224] Handling call
0709 12:20:20.676782 (+ 28012us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:20.873688 (+196906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:22.097392 (+1223704us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b5400207bd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:22.097607 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397269248}
I20260709 12:20:22.063181 29426 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:22.062917 29003 raft_consensus.cc:2749] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:22.102308 24366 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:22.108063 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:22.121958 24366 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:22.098696 29179 raft_consensus.cc:2749] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:22.122224 29346 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:22.126683 29254 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:22.127149 29254 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:22.127494 29254 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:22.130141 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.132512 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:22.108160 29308 consensus_queue.cc:1048] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:20:22.134009 24366 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:22.125072 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:22.134537 29346 raft_consensus.cc:697] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 16 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:20:22.142167 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:22.250458 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.138341 29423 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:22.274427 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:22.275225 25113 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:20:22.269140 29375 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.270843 29386 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.268502 29361 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:22.271518 29423 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.283453 29356 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:22.302563 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.304692 29216 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.305636 29216 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:22.308889 29216 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:22.286777 29396 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:22.311641 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:22.312321 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:22.330209 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.289984 29401 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:22.349171 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:22.350205 24323 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:20:22.359411 29311 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:22.360327 29311 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:22.364460 29311 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:22.369562 29459 log.cc:927] Time spent T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:20:22.298174 29423 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:22.291603 29375 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:22.405601 29229 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.292718 29386 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:22.496937 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:22.352504 29396 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:22.315857 29346 consensus_queue.cc:237] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:22.476881 29228 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:22.488247 29362 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:22.406970 29401 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:22.665868 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.562567 29361 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:20:22.686205 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.502508 29229 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:22.697759 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.577912 29362 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:22.588975 29228 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:22.700731 29361 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:22.719782 29385 consensus_meta.cc:287] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.651s	user 0.013s	sys 0.000s
W20260709 12:20:22.733405 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:22.735204 24316 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.107s	sys 0.224s
W20260709 12:20:22.736670 24316 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.108s	sys 0.225s
W20260709 12:20:22.731215 29254 consensus_meta.cc:287] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.602s	user 0.011s	sys 0.001s
I20260709 12:20:22.739652 29308 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:20:22.745193 29393 consensus_meta.cc:287] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.886s	user 0.010s	sys 0.003s
I20260709 12:20:22.759248 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:22.740692 29254 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:22.767978 29386 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:22.784224 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.771237 29375 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:22.778127 29396 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:22.797299 29254 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:22.764943 29393 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:22.808743 29393 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:22.810170 29401 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:22.811098 29228 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:22.800323 29002 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:22.811357 29423 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:22.812249 29002 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:22.814658 29002 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:22.815764 29362 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:22.767680 29308 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:22.805740 29361 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:22.827754 29211 consensus_meta.cc:287] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.733s	user 0.009s	sys 0.003s
I20260709 12:20:22.827991 29423 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:22.828523 29211 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:22.836400 24394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:49122 (request call id 32) took 1605 ms. Trace:
I20260709 12:20:22.835865 29308 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:22.842669 24394 rpcz_store.cc:276] 0709 12:20:21.274406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.325259 (+ 50853us) service_pool.cc:224] Handling call
0709 12:20:22.836138 (+1510879us) spinlock_profiling.cc:243] Waited 40.8 ms on lock 0x7b54000e47d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a97346853 00007f4a9c31460a 00007f4a9589a7d4 00007f4a9589a762 00007f4a9589a691 00007f4a9589a60c 00007f4a958998c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:22.836289 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93890816}
I20260709 12:20:22.843282 25112 raft_consensus.cc:1275] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:20:22.848941 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:22.849584 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:22.850361 25110 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:22.851205 25119 raft_consensus.cc:1240] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:22.852743 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:22.837991 29448 consensus_meta.cc:287] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.806s	user 0.010s	sys 0.005s
I20260709 12:20:22.838536 24321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 2254) took 1061 ms. Trace:
I20260709 12:20:22.869840 24321 rpcz_store.cc:276] 0709 12:20:21.777523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.942518 (+164995us) service_pool.cc:224] Handling call
0709 12:20:22.033209 (+ 90691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:22.033926 (+   717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:22.838282 (+804356us) spinlock_profiling.cc:243] Waited 90.3 ms on lock 0x7b5400361fd0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:22.838458 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207751040}
I20260709 12:20:22.875058 24291 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:22.880692 29448 consensus_queue.cc:1048] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:22.880903 29189 consensus_queue.cc:1059] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:22.881605 29284 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:22.882062 29284 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.882341 29448 raft_consensus.cc:3055] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:22.882834 29448 raft_consensus.cc:740] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:22.882423 29284 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:22.897899 28610 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:22.906268 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:22.906164 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:22.906847 24210 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 97dd30b21cc14958a91b2da522e4bbe9 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c711faa13ead43ebbea0192cb74a4756 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:22.907328 24391 raft_consensus.cc:2368] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 12. Current term is 13.
I20260709 12:20:22.908145 24400 raft_consensus.cc:1275] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:20:22.907825 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:22.909040 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:22.910054 24394 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:22.911844 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:22.915809 24325 raft_consensus.cc:2368] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 14. Current term is 15.
I20260709 12:20:22.916405 25084 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:22.918120 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:22.918931 24322 raft_consensus.cc:2368] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
I20260709 12:20:22.918407 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:22.919185 29448 consensus_queue.cc:260] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:22.919844 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:22.920013 24325 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:22.923928 29395 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:22.925729 29402 raft_consensus.cc:2804] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:22.926337 29402 raft_consensus.cc:697] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 10 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:22.927336 29402 consensus_queue.cc:237] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:22.929759 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:22.931290 24318 raft_consensus.cc:1240] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:22.937067 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:22.946607 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:22.947431 24316 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:22.947968 24289 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:22.949331 24400 raft_consensus.cc:1275] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:20:22.949703 24289 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:22.953449 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:22.951166 25084 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:22.954113 24398 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:22.954201 28610 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:22.955914 24289 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:22.961135 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:22.920534 29448 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:22.963531 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:22.966310 24289 leader_election.cc:400] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 12. Current term is 13.
I20260709 12:20:22.966614 24289 leader_election.cc:403] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:22.965716 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:22.967052 24391 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:22.969851 29402 consensus_queue.cc:1059] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:22.974946 29229 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:22.960841 29170 raft_consensus.cc:2764] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:20:22.982273 24398 raft_consensus.cc:1275] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:20:22.982499 24391 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 14.
I20260709 12:20:22.989459 24289 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:22.983791 25110 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 15.
I20260709 12:20:22.980115 24325 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
W20260709 12:20:22.993098 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.993726 24322 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
I20260709 12:20:22.966095 29189 raft_consensus.cc:2804] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:22.965710 29462 raft_consensus.cc:2804] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:22.965770 29211 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:22.981721 29406 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:20:23.007869 25084 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:23.016378 28610 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:23.016665 24291 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:23.003046 29393 raft_consensus.cc:2804] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:22.998956 29428 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:23.043511 29393 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:22.994117 29291 consensus_queue.cc:1048] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:20:23.010360 29189 raft_consensus.cc:697] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:23.024382 29395 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:23.023970 29365 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:23.043607 28646 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:23.042641 29462 raft_consensus.cc:697] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:23.049235 29393 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:23.017565 29170 consensus_queue.cc:1048] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:20:23.042944 29471 raft_consensus.cc:2804] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:23.074959 29284 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:23.088071 24399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2451) took 1224 ms. Trace:
I20260709 12:20:23.048810 29428 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:23.088313 24320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44278 (request call id 2576) took 1548 ms. Trace:
I20260709 12:20:23.097765 24320 rpcz_store.cc:276] 0709 12:20:21.540034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.623028 (+ 82994us) service_pool.cc:224] Handling call
0709 12:20:21.640074 (+ 17046us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:21.899415 (+259341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:23.082626 (+1183211us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b540025b7d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:23.088257 (+  5631us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":567418240}
I20260709 12:20:23.088851 24399 rpcz_store.cc:276] 0709 12:20:21.864078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.864252 (+   174us) service_pool.cc:224] Handling call
0709 12:20:21.877516 (+ 13264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:21.953049 (+ 75533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:21.953098 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:21.953155 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:21.953200 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:23.077225 (+1124025us) spinlock_profiling.cc:243] Waited 75.2 ms on lock 0x7b54001a7554. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:23.087772 (+ 10547us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:23.087986 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173011200}
I20260709 12:20:23.092778 25117 raft_consensus.cc:1217] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 13 LEADER]: Deduplicated request from leader. Original: 10.9->[12.10-12.10]   Dedup: 12.10->[]
I20260709 12:20:23.099946 25117 raft_consensus.cc:1240] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 13 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:20:23.100802 25117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 739) took 1533 ms. Trace:
I20260709 12:20:23.101218 25117 rpcz_store.cc:276] 0709 12:20:21.566962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.567126 (+   164us) service_pool.cc:224] Handling call
0709 12:20:21.601902 (+ 34776us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:23.086126 (+1484224us) spinlock_profiling.cc:243] Waited 43.2 ms on lock 0x7b5400709520. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a972c3dc0 00007f4a9734e1c0 00007f4a9734f231 00007f4a9734bd8f 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c
0709 12:20:23.100407 (+ 14281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:23.100727 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99428608}
I20260709 12:20:23.101336 29361 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:23.103734 29462 consensus_queue.cc:237] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:23.066099 29395 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:23.102675 29411 consensus_queue.cc:1048] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:20:23.107609 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 748) took 2256 ms. Trace:
I20260709 12:20:23.106218 29062 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:23.109838 29428 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:23.106092 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.115049 29284 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:23.104113 29361 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:23.108878 29189 consensus_queue.cc:237] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:23.069260 28646 raft_consensus.cc:697] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 15 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:23.069047 29471 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:23.179313 29471 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:23.179668 28646 consensus_queue.cc:237] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:23.128297 24393 rpcz_store.cc:276] 0709 12:20:20.851124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.851296 (+   172us) service_pool.cc:224] Handling call
0709 12:20:20.851640 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:20.979566 (+127926us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:23.107313 (+2127747us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b540027e054. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:23.107504 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281641856}
W20260709 12:20:23.186820 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 84931.7us
I20260709 12:20:23.211702 24394 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:23.214561 24471 raft_consensus.cc:1240] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 12. Current term is 13. Ops: []
W20260709 12:20:23.215420 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.217631 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:23.218288 25113 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:23.219764 29361 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:23.220731 29455 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.221343 29455 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:23.223049 24324 raft_consensus.cc:1275] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:20:23.224982 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2415) took 2496 ms. Trace:
I20260709 12:20:23.229334 29280 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:23.234668 24319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 2253) took 1457 ms. Trace:
I20260709 12:20:23.235194 24319 rpcz_store.cc:276] 0709 12:20:21.777194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.777506 (+   312us) service_pool.cc:224] Handling call
0709 12:20:21.777847 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:21.849162 (+ 71315us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:21.893051 (+ 43889us) log.cc:844] Serialized 14 byte log entry
0709 12:20:21.989555 (+ 96504us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:21.989621 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:21.989682 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:23.234413 (+1244731us) spinlock_profiling.cc:243] Waited 71 ms on lock 0x7b54000555d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:23.234466 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:23.234603 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":107466,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":48330,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":4438,"spinlock_wait_cycles":163382528,"thread_start_us":125476,"threads_started":3,"wal-append.queue_time_us":154909,"wal-append.run_cpu_time_us":7807,"wal-append.run_wall_time_us":1122245}
I20260709 12:20:23.228137 24471 rpcz_store.cc:276] 0709 12:20:20.719204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.755190 (+ 35986us) service_pool.cc:224] Handling call
0709 12:20:23.129653 (+2374463us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b58001c3e98. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227e9c 00007f4a94227a5b 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c325fc0 00007f4a9c310929 00007f4a9c3103d2 00007f4a95887bd4
0709 12:20:23.214367 (+ 84714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:23.215389 (+  1022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:23.215648 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32086144}
W20260709 12:20:23.246066 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.270040 29395 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:23.270843 29406 raft_consensus.cc:2749] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 12. Current term is 13.
I20260709 12:20:23.273571 29393 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:23.276170 29393 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:23.277187 24289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.281127 29371 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.281848 29371 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:23.323580 24325 raft_consensus.cc:1240] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 11. Current term is 12. Ops: []
W20260709 12:20:23.344744 29478 log.cc:927] Time spent T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:20:23.356160 24325 raft_consensus.cc:1240] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 12. Current term is 13. Ops: []
W20260709 12:20:23.372386 29475 log.cc:927] Time spent T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 12:20:23.381323 29187 raft_consensus.cc:3055] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:23.381865 29187 raft_consensus.cc:740] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:23.383060 29355 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:23.387477 29471 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:23.393368 24323 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
I20260709 12:20:23.393970 29356 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.394380 24324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57702 (request call id 803) took 1942 ms. Trace:
I20260709 12:20:23.394863 24324 rpcz_store.cc:276] 0709 12:20:21.452514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.452671 (+   157us) service_pool.cc:224] Handling call
0709 12:20:21.457343 (+  4672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:23.223422 (+1766079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:23.394104 (+170682us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b540019f354. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:23.394312 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4059914496}
I20260709 12:20:23.404860 29451 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.405652 29451 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:23.411845 29210 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:23.419179 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:23.420512 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:23.421132 25110 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 14.
I20260709 12:20:23.425101 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:23.425836 25117 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:23.425859 24465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 2292) took 1933 ms (client timeout 2109 ms). Trace:
W20260709 12:20:23.426683 24465 rpcz_store.cc:269] 0709 12:20:21.492161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.493375 (+  1214us) service_pool.cc:224] Handling call
0709 12:20:23.425594 (+1932219us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54003863d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:23.425765 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":480448384}
I20260709 12:20:23.443260 25117 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 14.
I20260709 12:20:23.444113 29037 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:23.446601 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:23.463151 24438 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.842s (SENT) [suppressed 16 similar messages]
I20260709 12:20:23.467207 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:23.472370 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:23.458297 24290 leader_election.cc:400] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453) with higher term. Message: Invalid argument: T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 15. Current term is 16.
I20260709 12:20:23.477298 24290 leader_election.cc:403] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:23.485024 25113 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 13.
I20260709 12:20:23.488670 29405 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:23.489344 29405 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:23.491568 29405 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:23.492920 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:23.494274 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:23.494904 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:23.495332 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:23.495594 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:23.496305 24469 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:20:23.496829 24468 raft_consensus.cc:1240] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:23.496889 24466 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:23.496577 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:23.498400 24324 raft_consensus.cc:2368] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 12. Current term is 13.
I20260709 12:20:23.495695 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:23.500327 24474 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:23.501514 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:23.502097 24465 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:23.505002 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:20:23.506047 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 47983.5us
I20260709 12:20:23.506593 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:23.506805 24290 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:23.505148 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:23.507704 24317 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:20:23.511330 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:23.512116 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:23.512662 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:23.516793 24468 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:20:23.513792 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:23.517418 24469 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 14.
I20260709 12:20:23.514139 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:23.468973 29451 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:23.517697 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:23.394418 29356 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:23.499447 29405 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.522636 24322 raft_consensus.cc:2393] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 13: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:23.521611 24466 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 15.
I20260709 12:20:23.524876 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:23.524914 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:23.529623 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:23.531307 24321 raft_consensus.cc:1240] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 12. Current term is 13. Ops: [11.8-12.9]
I20260709 12:20:23.533689 24290 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:23.558805 24469 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:20:23.567747 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:23.568790 24319 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 15.
I20260709 12:20:23.514012 29479 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.572019 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:23.582319 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:23.583074 24393 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 16.
I20260709 12:20:23.731170 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:23.732476 24466 raft_consensus.cc:2393] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 16: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:23.745682 24317 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 16.
I20260709 12:20:23.750268 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:23.761410 24469 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
W20260709 12:20:23.782045 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 248405us
I20260709 12:20:23.783063 24395 raft_consensus.cc:1275] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:20:23.529733 29411 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:23.532433 29451 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:23.790637 24465 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
I20260709 12:20:23.791756 24325 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
I20260709 12:20:23.565414 29403 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:23.538281 29361 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:23.800326 29482 log.cc:927] Time spent T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.478s	user 0.001s	sys 0.000s
W20260709 12:20:23.801597 29483 log.cc:927] Time spent T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:20:23.803644 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 260526us
I20260709 12:20:23.939669 24289 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:20:23.805099 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.805562 29457 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:23.561406 29428 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:23.817374 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:23.909900 25082 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.038s	sys 0.062s
I20260709 12:20:23.718748 29405 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:23.738873 29395 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.784919 29007 raft_consensus.cc:2749] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:23.972393 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:23.973603 24468 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
I20260709 12:20:23.782174 29355 raft_consensus.cc:2749] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453) with higher term. Message: Invalid argument: T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 15. Current term is 16.
I20260709 12:20:23.810300 29403 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:23.804412 29374 consensus_queue.cc:1048] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:20:23.524217 29187 consensus_queue.cc:260] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:23.818353 29451 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:20:23.948876 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:23.958032 24465 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 15.
W20260709 12:20:23.958065 25082 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.039s	sys 0.063s
I20260709 12:20:23.755014 29479 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:23.943822 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:20:23.959519 29448 consensus_meta.cc:287] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.991s	user 0.013s	sys 0.008s
I20260709 12:20:23.980537 24466 raft_consensus.cc:2393] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 14: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:23.797847 29411 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:23.970638 29182 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:24.008824 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:24.009661 24466 raft_consensus.cc:2393] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 16: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:24.023702 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:24.036302 25116 raft_consensus.cc:1240] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:24.037528 25117 raft_consensus.cc:1240] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 14. Current term is 15. Ops: [12.9-14.10]
I20260709 12:20:23.852950 29361 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:23.980024 29403 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:23.978799 29284 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.042371 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:24.064167 25117 raft_consensus.cc:2368] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 12. Current term is 13.
I20260709 12:20:23.964578 29457 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:23.997391 29464 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:24.082021 29464 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:24.085597 29411 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:24.086553 29411 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:24.087203 29411 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:24.094931 24471 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.121s	sys 0.239s
W20260709 12:20:24.095541 24471 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.122s	sys 0.239s
W20260709 12:20:24.044214 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 318153us
I20260709 12:20:24.096393 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:24.093235 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:20:24.055711 29486 log.cc:927] Time spent T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.232s	user 0.003s	sys 0.001s
I20260709 12:20:23.974361 29395 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:24.101580 29451 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:24.102809 24473 raft_consensus.cc:1275] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:20:24.103477 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:24.103973 29361 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:24.102880 29395 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:24.097695 24466 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:24.105389 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:24.105969 24467 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:23.977120 29428 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:24.030045 29471 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:24.111603 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:24.029701 29455 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:24.119576 25117 raft_consensus.cc:2368] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
I20260709 12:20:24.123649 24466 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
I20260709 12:20:24.068502 29182 raft_consensus.cc:697] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 14 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:24.126490 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:24.163761 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:24.132884 25110 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14.
I20260709 12:20:24.068936 29187 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:24.144070 24474 consensus_meta.cc:287] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.643s	user 0.012s	sys 0.000s
I20260709 12:20:24.165868 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:24.166014 24474 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 16.
I20260709 12:20:24.166855 25114 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:20:24.151661 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:24.153657 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:24.154074 24467 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 13.
I20260709 12:20:24.112407 29361 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:24.079879 29284 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:24.155882 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:24.131739 29493 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:24.171413 24470 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:24.150100 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 197892us
I20260709 12:20:24.131182 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:24.164417 24469 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 16.
I20260709 12:20:24.169538 25112 raft_consensus.cc:2368] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 12. Current term is 13.
I20260709 12:20:24.173163 24289 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:24.181170 29182 consensus_queue.cc:237] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.4, Last appended by leader: 4, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:24.181789 29479 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:24.184666 29493 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:24.186007 29491 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.186224 29284 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:24.186640 29491 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:24.187140 29455 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:24.162839 29448 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.189306 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:24.189306 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:24.195400 24469 raft_consensus.cc:2410] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:20:24.174404 29361 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:24.203562 29361 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:24.203905 29493 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:24.190616 29455 raft_consensus.cc:697] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:24.195791 24289 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:24.218495 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:24.220685 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:24.210055 29405 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:24.197520 29448 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:24.217741 29464 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:24.235504 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:24.236963 29471 consensus_queue.cc:1048] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:24.238469 29471 consensus_queue.cc:1048] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:24.244079 24470 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:20:24.223551 29284 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:24.232897 29411 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:24.233743 29374 consensus_queue.cc:1048] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:20:24.245555 29428 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:24.257192 24440 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.031s	sys 0.044s
W20260709 12:20:24.261940 24440 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.032s	sys 0.044s
I20260709 12:20:24.247922 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:24.250810 29491 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:24.263244 24470 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:20:24.265465 24471 raft_consensus.cc:1275] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:20:24.255343 29498 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:24.248185 29284 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:24.280813 24440 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:24.264361 29457 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:24.263430 29428 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:24.283335 24440 leader_election.cc:400] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 13. Current term is 14.
I20260709 12:20:24.285879 24440 leader_election.cc:403] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:24.287189 24440 leader_election.cc:400] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 14. Current term is 15.
I20260709 12:20:24.287700 24440 leader_election.cc:403] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:20:24.288529 24440 leader_election.cc:400] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
I20260709 12:20:24.288923 24440 leader_election.cc:403] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:20:24.272796 29284 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:24.291034 24440 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:24.286381 29405 consensus_queue.cc:1059] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:20:24.293176 29493 consensus_queue.cc:1059] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:24.293459 29405 raft_consensus.cc:2764] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:20:24.285030 29411 raft_consensus.cc:2804] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:24.294772 29395 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:24.294198 29361 raft_consensus.cc:3055] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:24.295433 29361 raft_consensus.cc:740] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:24.296321 29361 consensus_queue.cc:260] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:24.297691 29361 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:24.261354 29455 consensus_queue.cc:237] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:24.289891 29492 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 13. Current term is 14.
I20260709 12:20:24.291019 29496 raft_consensus.cc:2749] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 14. Current term is 15.
I20260709 12:20:24.302587 24440 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:24.294266 29493 raft_consensus.cc:3055] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:24.310886 29254 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.311543 29254 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:24.313921 29254 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:24.314441 29254 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.314878 29254 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:24.316874 29002 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:24.317600 29448 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:24.317796 29002 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:24.319597 29228 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.320194 29228 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:24.322490 29228 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:24.325344 29375 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:24.325862 29375 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:20:24.326503 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:24.327319 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:24.328074 29375 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:20:24.328156 24393 raft_consensus.cc:1275] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:20:24.328608 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:24.331686 24397 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
I20260709 12:20:24.329804 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:24.330689 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:24.333532 24394 raft_consensus.cc:2368] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 12. Current term is 13.
I20260709 12:20:24.303447 24440 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:24.337632 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:24.339048 29491 raft_consensus.cc:2804] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:24.339445 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:24.339094 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:24.341434 24396 raft_consensus.cc:2393] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 14: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:24.341657 24394 raft_consensus.cc:1275] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:20:24.340205 24397 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9.
I20260709 12:20:24.344235 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:24.340196 29002 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:24.348831 24399 raft_consensus.cc:1240] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:24.348865 24400 raft_consensus.cc:1275] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:20:24.294798 29411 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:24.354308 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:24.329273 29496 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:20:24.355688 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 95482.4us
I20260709 12:20:24.356256 24469 raft_consensus.cc:1275] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:20:24.305111 29493 raft_consensus.cc:740] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:24.358685 24473 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:24.359570 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:24.359998 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:24.288314 29428 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:24.273130 29498 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:24.364310 24396 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 14.
I20260709 12:20:24.348435 29211 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:24.353332 29448 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.348276 29377 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:24.371083 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.372309 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:24.374495 24366 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:24.380453 24395 raft_consensus.cc:1275] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:24.353245 29398 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:24.383090 24467 raft_consensus.cc:1240] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:24.361878 29411 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:24.356885 29374 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.386912 29493 consensus_queue.cc:260] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.5, Last appended by leader: 5, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:24.388213 29498 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:24.391685 29403 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:24.365221 29297 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.370891 29254 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:24.353874 29500 consensus_queue.cc:1059] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:20:24.356530 29491 raft_consensus.cc:697] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:24.393169 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:24.393392 29002 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:24.376063 29448 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:24.368481 29457 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.404485 24366 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:24.410398 24473 raft_consensus.cc:2393] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 14: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:24.376442 29496 raft_consensus.cc:697] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:24.411778 24469 raft_consensus.cc:1275] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:20:24.411175 29002 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:24.413071 29491 consensus_queue.cc:237] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:24.384768 29256 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.416580 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:24.426214 24467 raft_consensus.cc:2393] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 16: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:24.395076 29229 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.415707 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:24.432646 24466 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:24.420194 24395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:20:24.422657 24470 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 13.
I20260709 12:20:24.434405 24395 raft_consensus.cc:606] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Received request to transfer leadership to TS c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:24.434762 24395 raft_consensus.cc:614] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:24.427107 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:24.427968 29506 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:24.428014 24366 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:24.402153 29374 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:24.447752 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:24.370489 29211 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:24.448578 24473 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:24.455257 24466 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 13.
I20260709 12:20:24.407081 29297 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:24.408577 29395 raft_consensus.cc:2749] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
W20260709 12:20:24.436506 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 132494us
I20260709 12:20:24.444435 24472 raft_consensus.cc:1240] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:24.416668 29492 raft_consensus.cc:3055] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:24.420603 29493 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:24.399082 29398 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:24.382014 29377 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:24.425393 29002 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:24.465113 24473 raft_consensus.cc:1275] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:20:24.464696 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:24.463160 24365 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:24.469857 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:24.470985 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:24.471724 25113 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:20:24.473417 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:24.474026 24325 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 14.
I20260709 12:20:24.473887 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:24.475711 25113 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 14.
I20260709 12:20:24.478452 25082 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:24.481940 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:24.482287 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:24.482802 24325 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:20:24.467955 24469 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:24.484786 25082 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:24.485167 24365 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:24.461130 29254 raft_consensus.cc:2749] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:24.487056 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:24.480784 29134 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:24.488158 24316 raft_consensus.cc:2393] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 12: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:24.488540 24365 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:24.488829 29228 raft_consensus.cc:2804] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:24.496500 29228 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:24.496964 29228 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:24.497628 29210 raft_consensus.cc:2804] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:24.498078 29210 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:24.498485 29210 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:24.489042 29005 consensus_queue.cc:1059] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:20:24.501801 29005 raft_consensus.cc:3055] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:24.502048 29374 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:24.502148 29005 raft_consensus.cc:740] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:24.461316 29506 raft_consensus.cc:697] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:24.425660 29457 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:24.492955 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:24.462809 29492 raft_consensus.cc:740] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:24.511073 25082 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:24.514511 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:24.509516 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:24.515170 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:24.516031 24325 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
I20260709 12:20:24.515213 24317 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:24.510696 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:24.510774 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:24.519043 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:24.511344 25116 raft_consensus.cc:1240] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 13. Current term is 14. Ops: []
W20260709 12:20:24.484227 29511 log.cc:927] Time spent T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:20:24.523141 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:24.448664 29229 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:24.448776 29256 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:24.532557 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 44087.7us
I20260709 12:20:24.534292 24365 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:24.527840 25082 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:24.536180 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:24.536895 24318 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
I20260709 12:20:24.530239 24325 raft_consensus.cc:1275] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:20:24.530675 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:24.537719 25082 leader_election.cc:400] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 12. Current term is 13.
I20260709 12:20:24.529503 24290 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:24.503347 29308 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:24.538210 24322 raft_consensus.cc:2393] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 13: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:24.538265 25082 leader_election.cc:403] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:24.467401 29037 consensus_queue.cc:1059] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:20:24.541092 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:24.542565 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:24.544396 29005 consensus_queue.cc:260] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:24.546025 24322 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 9.
I20260709 12:20:24.541721 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:24.514365 29432 raft_consensus.cc:2749] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:24.542677 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:24.546648 25082 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:24.550981 24290 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:24.539074 29134 raft_consensus.cc:2804] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:24.554294 24318 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:20:24.542647 24440 leader_election.cc:400] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 12. Current term is 13.
I20260709 12:20:24.557847 24440 leader_election.cc:403] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:20:24.556843 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:24.554781 24290 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:24.539440 29385 raft_consensus.cc:2749] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:24.544461 29377 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:24.545789 29182 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:24.533468 29498 consensus_queue.cc:1048] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
W20260709 12:20:24.612830 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 48362.6us
W20260709 12:20:24.575614 24438 leader_election.cc:336] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.569s (SENT)
I20260709 12:20:24.548856 29357 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:20:24.554739 29005 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:24.539122 29499 consensus_queue.cc:1048] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:20:24.560716 29189 raft_consensus.cc:2804] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:20:24.623601 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 63003.7us
I20260709 12:20:24.616297 25082 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:24.552992 29187 consensus_queue.cc:1048] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 12:20:24.560537 29096 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:20:24.624150 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 48566.9us
I20260709 12:20:24.627745 24391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
mode: GRACEFUL
new_leader_uuid: "c711faa13ead43ebbea0192cb74a4756"
 from {username='slave'} at 127.0.0.1:49122
I20260709 12:20:24.668675 24391 raft_consensus.cc:606] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Received request to transfer leadership to TS c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:24.669154 24391 raft_consensus.cc:614] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:24.551769 29395 consensus_queue.cc:1059] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:20:24.551625 29500 consensus_queue.cc:1059] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.064s
W20260709 12:20:24.674906 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 116420us
I20260709 12:20:24.557778 29134 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.561853 29516 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:24.567301 29479 raft_consensus.cc:2804] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:20:24.671803 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 55636.2us
I20260709 12:20:24.566478 29464 consensus_queue.cc:1048] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.102s
I20260709 12:20:24.667673 29189 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.626127 29428 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:24.612803 29471 consensus_queue.cc:1048] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 12:20:24.624313 29455 consensus_queue.cc:1059] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:20:24.688333 24366 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:24.693526 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 142785us
I20260709 12:20:24.695091 24365 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:24.688908 29395 raft_consensus.cc:2749] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 12. Current term is 13.
I20260709 12:20:24.697793 24365 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:24.704252 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 142834us
I20260709 12:20:24.680991 29134 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:24.552801 29496 consensus_queue.cc:237] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:24.679006 29432 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:24.702313 24366 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:24.710492 24365 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:24.680794 29516 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:24.679584 29479 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:24.690613 29189 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:24.725226 29037 raft_consensus.cc:2804] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:24.738847 29037 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:24.739256 29037 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:24.740959 29211 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:24.751423 29037 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:24.754014 29037 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:24.759765 24321 raft_consensus.cc:1275] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:24.695736 29403 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:24.730177 24365 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:24.728196 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 62404.6us
I20260709 12:20:24.685518 29510 consensus_queue.cc:1048] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:20:24.723275 29432 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.725662 29297 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:24.736958 29479 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:24.773456 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:24.730633 29516 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:24.777032 24290 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:24.764405 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:24.561254 29506 consensus_queue.cc:237] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:24.780512 24316 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:24.762598 29457 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:24.764685 29517 raft_consensus.cc:2804] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:24.728672 29399 consensus_queue.cc:1048] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:20:24.737463 29398 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:24.772255 29308 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:20:24.766065 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 86182.4us
I20260709 12:20:24.765329 29187 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:24.737207 29518 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:24.771515 29432 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:24.774155 24321 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 14.
W20260709 12:20:24.790782 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 88566.7us
I20260709 12:20:24.766927 29522 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:24.775862 29371 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:24.766247 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 223789us
I20260709 12:20:24.794997 29308 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:24.780458 29229 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:24.811652 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:24.803449 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 73374us
I20260709 12:20:24.812645 25116 raft_consensus.cc:2410] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:20:24.813726 24365 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:24.774259 29415 consensus_queue.cc:1048] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 12:20:24.809978 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.810927 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:24.815708 25112 raft_consensus.cc:2393] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 9: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:24.811249 24366 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:24.809264 29403 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:24.817030 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:24.817816 24469 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:24.817654 29403 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:24.809412 29451 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.820263 29403 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:24.811432 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:24.804229 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:24.820966 24438 leader_election.cc:336] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.509s (SENT)
I20260709 12:20:24.821482 25118 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
I20260709 12:20:24.793339 29256 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:24.824371 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:20:24.824898 24438 leader_election.cc:336] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.552s (SENT)
I20260709 12:20:24.825099 24469 raft_consensus.cc:2376] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 13. Re-sending same reply.
I20260709 12:20:24.805672 29398 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:24.835573 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:24.828820 29229 raft_consensus.cc:2749] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:24.805796 29517 raft_consensus.cc:697] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:24.830295 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:24.831673 29356 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:24.834321 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:24.854396 24472 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 13.
I20260709 12:20:24.834836 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:24.801033 29521 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:24.809082 29308 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:24.820358 29451 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:24.837747 24438 leader_election.cc:336] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.564s (SENT)
I20260709 12:20:24.886636 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:24.887372 25117 raft_consensus.cc:2368] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
I20260709 12:20:24.841035 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:24.888015 24470 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 15.
I20260709 12:20:24.829074 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:24.887372 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 49743.2us
I20260709 12:20:24.842800 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:24.889189 24438 leader_election.cc:336] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.704s (SENT)
W20260709 12:20:24.889952 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.843446 24366 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:24.812110 29518 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:24.816239 29211 consensus_queue.cc:1059] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 12:20:24.845881 29361 consensus_meta.cc:287] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.003s
I20260709 12:20:24.845811 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:24.846182 29528 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:24.801259 29187 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:24.851487 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:24.852898 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:24.862322 24395 raft_consensus.cc:2393] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 16: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:24.878335 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:24.917846 25113 raft_consensus.cc:2368] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 12. Current term is 13.
I20260709 12:20:24.872339 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:24.866565 24290 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:24.884184 24440 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:24.836046 29398 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:24.927048 29382 consensus_queue.cc:1048] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:24.927737 29398 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:24.928954 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:24.929208 29464 consensus_queue.cc:1048] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:24.894179 29518 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:24.890640 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 47283.6us
I20260709 12:20:24.931005 29518 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:24.931931 24366 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:24.893230 24397 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 12: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:24.893477 24398 raft_consensus.cc:2393] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 13: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:24.897284 24471 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
W20260709 12:20:24.861958 29512 log.cc:927] Time spent T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
W20260709 12:20:24.888088 29513 log.cc:927] Time spent T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:20:24.949790 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:24.950217 24324 raft_consensus.cc:1240] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:20:24.901257 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:24.903540 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:24.951833 24393 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:24.909164 24210 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 97dd30b21cc14958a91b2da522e4bbe9 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c711faa13ead43ebbea0192cb74a4756 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:20:24.952576 24210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 43524.8us
I20260709 12:20:24.913748 24469 raft_consensus.cc:1275] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 14 index: 5. (term mismatch)
I20260709 12:20:24.953382 24469 pending_rounds.cc:85] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 4
I20260709 12:20:24.953685 24469 pending_rounds.cc:107] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 13.5
I20260709 12:20:24.953964 24469 raft_consensus.cc:2889] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:24.889739 29284 consensus_meta.cc:287] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.549s	user 0.010s	sys 0.002s
I20260709 12:20:24.915622 24467 raft_consensus.cc:1275] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:20:24.915910 24400 raft_consensus.cc:1240] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:24.967823 24467 pending_rounds.cc:85] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 7
I20260709 12:20:24.968220 24467 pending_rounds.cc:107] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:20:24.985562 24467 raft_consensus.cc:2889] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:24.924983 24440 leader_election.cc:400] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 pre-election: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
I20260709 12:20:24.917193 24473 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:20:24.874897 29521 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:24.936003 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 69543.7us
I20260709 12:20:24.943390 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:24.987742 24320 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:20:24.988577 24290 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:24.989864 24290 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:24.945323 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:24.946272 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:24.948562 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:24.955646 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:24.991364 24397 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:24.898406 29346 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:24.845093 29411 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:24.997555 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:24.951236 29531 raft_consensus.cc:2749] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:24.984016 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:20:24.990435 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 65647.5us
I20260709 12:20:24.991418 24318 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:20:25.005177 24321 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
I20260709 12:20:24.822165 29526 consensus_queue.cc:1059] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.102s
I20260709 12:20:24.993059 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:25.006676 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:25.007819 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:25.008478 25113 raft_consensus.cc:2376] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14. Re-sending same reply.
I20260709 12:20:24.993929 24290 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:24.950362 29361 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:24.985718 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:24.956187 29377 raft_consensus.cc:2804] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:25.006381 24320 raft_consensus.cc:2376] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 16. Re-sending same reply.
I20260709 12:20:25.013016 24398 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:25.010339 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:24.956135 29096 raft_consensus.cc:697] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:20:25.023093 24440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.024391 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:25.027649 24290 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:25.025853 24468 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:20:25.027096 24320 raft_consensus.cc:1240] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 15 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:20:25.029960 24472 raft_consensus.cc:1240] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 12:20:25.030763 24394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.019s	sys 0.031s
W20260709 12:20:25.031174 24394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.019s	sys 0.031s
I20260709 12:20:25.032891 24440 leader_election.cc:400] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 12. Current term is 13.
W20260709 12:20:25.030342 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 103160us
I20260709 12:20:25.002436 29523 raft_consensus.cc:2804] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:24.998940 29346 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.046080 29523 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:25.046242 29346 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:25.046720 29523 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:24.997099 29521 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:24.964751 29284 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:25.069633 24472 raft_consensus.cc:1275] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:20:25.035068 24290 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:25.070261 24472 pending_rounds.cc:85] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 5
I20260709 12:20:25.070652 24472 pending_rounds.cc:107] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:20:25.070962 24472 raft_consensus.cc:2889] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:25.002255 29403 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:20:25.015441 29210 consensus_meta.cc:287] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.517s	user 0.008s	sys 0.004s
I20260709 12:20:25.071406 24290 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:25.033790 24440 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:25.062400 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:25.064620 24398 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:25.040338 29356 raft_consensus.cc:2804] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:25.012329 29361 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:25.045352 29534 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:24.955843 29532 consensus_queue.cc:1059] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.098s
I20260709 12:20:25.019572 29377 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
W20260709 12:20:25.080461 24438 leader_election.cc:336] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.792s (SENT)
I20260709 12:20:25.101383 24438 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:25.104907 29375 raft_consensus.cc:3055] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:25.105536 29375 raft_consensus.cc:740] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:25.106391 29375 consensus_queue.cc:260] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:25.107800 29375 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:25.110709 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:25.111918 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:25.112958 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:25.113860 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:25.114913 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:25.115998 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:25.117030 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:25.118813 29532 raft_consensus.cc:3055] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:25.119203 29532 raft_consensus.cc:740] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:25.129585 29451 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:25.131526 29002 consensus_meta.cc:287] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.001s
I20260709 12:20:25.082279 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:25.133816 29411 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:25.134060 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:25.134843 29284 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:25.135896 24317 raft_consensus.cc:2410] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:20:25.083309 29210 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:25.137394 29398 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:25.137981 29210 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:25.139891 29398 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:25.140827 29096 consensus_queue.cc:237] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:25.096530 29534 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.145155 29534 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:25.145738 29228 consensus_meta.cc:287] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.648s	user 0.012s	sys 0.000s
I20260709 12:20:25.146212 29228 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:25.148322 29228 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:25.083277 29356 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.092139 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:25.093006 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 59273.4us
I20260709 12:20:25.094650 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:25.093801 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:25.099643 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:25.134999 24400 raft_consensus.cc:2393] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 13: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:25.170389 24440 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:25.084143 29531 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:25.149564 29187 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:25.096566 29403 raft_consensus.cc:697] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:25.096349 29361 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:25.085441 24289 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:25.132122 29002 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:25.202962 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 117632us
I20260709 12:20:25.104852 29491 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:25.152341 24393 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14.
I20260709 12:20:25.205235 24440 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:25.154481 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.155597 24316 raft_consensus.cc:2468] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
I20260709 12:20:25.157116 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:25.158022 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:25.211498 24466 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:20:25.159845 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:25.212924 24472 raft_consensus.cc:2376] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 9. Re-sending same reply.
I20260709 12:20:25.160530 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:25.096891 29526 raft_consensus.cc:2749] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:25.097395 29528 raft_consensus.cc:697] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:25.090667 24366 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:25.150704 29256 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.150923 29377 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:25.165159 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:25.117993 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:25.092478 29529 raft_consensus.cc:2804] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:25.177102 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:25.177515 29356 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:25.179028 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:25.183027 29189 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:25.183820 29357 consensus_meta.cc:287] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.531s	user 0.010s	sys 0.001s
W20260709 12:20:25.189908 29469 log.cc:927] Time spent T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 2.173s	user 0.013s	sys 0.000s
I20260709 12:20:25.289765 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:25.200817 24438 leader_election.cc:336] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.667s (SENT)
I20260709 12:20:25.290860 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:25.291045 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 90256.4us
I20260709 12:20:25.291388 24392 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:25.212453 25084 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:20:25.292282 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 79920.9us
I20260709 12:20:24.804617 29522 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:25.194151 29182 consensus_meta.cc:287] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.001s
I20260709 12:20:25.217639 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:25.218173 25116 raft_consensus.cc:1240] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12. Ops: [10.9-11.10]
I20260709 12:20:25.164258 29479 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:25.231806 29415 consensus_queue.cc:1048] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:25.232591 29451 consensus_queue.cc:1048] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:25.233381 29284 consensus_queue.cc:1048] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:25.011179 29517 consensus_queue.cc:237] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:25.113274 29492 consensus_queue.cc:260] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:25.120081 29532 consensus_queue.cc:260] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:25.140090 29432 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:25.346733 29432 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:25.219211 29395 raft_consensus.cc:2749] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:25.214241 29411 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:25.348593 29411 raft_consensus.cc:697] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:25.349766 29411 consensus_queue.cc:237] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:25.244160 24365 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:51474 dropped due to backpressure: service queue is full with 50 items
I20260709 12:20:25.223497 29391 consensus_queue.cc:1059] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:25.193976 29531 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.356319 29531 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:25.245265 29134 consensus_meta.cc:287] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.515s	user 0.011s	sys 0.000s
I20260709 12:20:25.356945 29134 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:25.357501 29002 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:25.359369 29134 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:25.246059 29403 consensus_queue.cc:237] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:25.224623 25115 raft_consensus.cc:1240] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:25.297432 29276 raft_consensus.cc:2804] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:25.361263 29276 raft_consensus.cc:697] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:25.227012 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:25.362247 29276 consensus_queue.cc:237] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:25.259275 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:25.266160 24399 raft_consensus.cc:2393] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 13: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:25.265172 24320 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:20:25.268607 29448 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:25.273383 29518 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:25.273659 29256 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:25.276656 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 186094us
I20260709 12:20:25.218286 29398 raft_consensus.cc:2804] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:20:25.266508 29005 consensus_meta.cc:287] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.602s	user 0.008s	sys 0.004s
I20260709 12:20:25.190681 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:25.291596 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.216590 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:25.364549 24473 raft_consensus.cc:2393] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 16: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:25.222568 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:25.303089 29357 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for earlier term 12. Current term is 13.
I20260709 12:20:25.300760 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:25.372941 24467 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:25.373464 29537 log.cc:927] Time spent T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:20:25.284089 29510 raft_consensus.cc:2804] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:25.374264 29510 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.374711 29510 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:25.330111 24324 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:25.325124 29182 raft_consensus.cc:2749] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:25.329947 29526 consensus_queue.cc:1059] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:20:25.377458 29526 consensus_queue.cc:1059] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:25.275157 29529 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.378698 29529 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:25.378931 29522 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:25.373399 24392 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 14.
I20260709 12:20:25.302460 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:25.364936 29528 consensus_queue.cc:237] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:25.372387 24391 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14.
W20260709 12:20:25.336375 24438 leader_election.cc:336] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.842s (SENT)
W20260709 12:20:25.383730 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 47445.3us
I20260709 12:20:25.331753 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:25.303896 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:25.381297 29479 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:25.385437 24316 raft_consensus.cc:2368] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
I20260709 12:20:25.368266 29398 raft_consensus.cc:697] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:25.410399 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:25.411195 29398 consensus_queue.cc:237] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:25.412355 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:25.413019 24400 raft_consensus.cc:2410] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:20:25.413175 25114 raft_consensus.cc:2393] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 14: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:25.364114 29523 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:25.414446 24318 raft_consensus.cc:2393] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 12: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:25.352181 24365 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:51474 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2813)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2493)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2488)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2489)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2829)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2828)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2480)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2495)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2827)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2497)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2799)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2836)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2491)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2801)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2479)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2481)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2483)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2800)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2487)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2802)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2494)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2816)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 772)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 774)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 776)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 777)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 778)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 779)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2826)
I20260709 12:20:25.416682 29523 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:25.417389 24467 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 13.
W20260709 12:20:25.385473 24438 leader_election.cc:336] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.879s (SENT)
I20260709 12:20:25.418452 24438 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:25.418284 24365 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:51474 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2488)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2489)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2829)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2828)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2480)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2844)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2495)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2827)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2497)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2799)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2845)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2839)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2842)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2841)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2491)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2843)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2479)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2481)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2483)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2800)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2487)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2802)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2494)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2816)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 772)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 774)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 776)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 777)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 778)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 779)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2826)
W20260709 12:20:25.424181 24323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57702 (request call id 825) took 2677 ms (client timeout 2992 ms). Trace:
W20260709 12:20:25.424731 24323 rpcz_store.cc:269] 0709 12:20:22.746527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.753234 (+  6707us) service_pool.cc:224] Handling call
0709 12:20:25.423954 (+2670720us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b5400339354. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:25.424076 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1454645504}
I20260709 12:20:25.426072 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:25.428975 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:25.399085 24394 raft_consensus.cc:2393] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 13: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:25.435237 24366 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:25.436744 24366 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:25.425398 24365 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:51474 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2488)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2489)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2829)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2828)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2480)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2844)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2495)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2827)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2497)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2799)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2845)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2839)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2842)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2841)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2491)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2843)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2479)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2481)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2483)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2800)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2487)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2802)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2494)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2816)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 772)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 774)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 776)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 777)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 778)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 779)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2826)
I20260709 12:20:25.441947 25116 raft_consensus.cc:1240] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 9. Current term is 10. Ops: []
W20260709 12:20:25.445463 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 226114us
I20260709 12:20:25.451195 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:25.451522 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:25.453342 25114 raft_consensus.cc:1240] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 10. Current term is 12. Ops: []
I20260709 12:20:25.454499 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:25.365865 29189 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:25.367358 29518 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:25.367758 29256 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:25.466674 25083 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:25.440621 29211 raft_consensus.cc:2804] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:25.472956 29211 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.473378 29211 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:25.476835 29382 raft_consensus.cc:2749] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:25.441483 29002 consensus_queue.cc:1059] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:20:25.479038 29002 raft_consensus.cc:3055] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:25.479511 29002 raft_consensus.cc:740] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:25.440938 29375 consensus_queue.cc:1048] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:20:25.496078 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:25.497150 25113 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 13.
I20260709 12:20:25.498966 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:25.480538 29002 consensus_queue.cc:260] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:25.506266 29002 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:25.507532 29527 raft_consensus.cc:2749] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:25.451812 29479 consensus_queue.cc:1048] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:20:25.510339 29382 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.511086 29382 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:25.512374 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.512842 29377 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:20:25.515501 24397 raft_consensus.cc:2393] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 12: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:25.518178 29518 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.518748 29518 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:25.451591 29542 raft_consensus.cc:2804] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:20:25.531174 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 161013us
I20260709 12:20:25.533474 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:25.521389 29492 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:25.536370 24290 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:25.538646 24440 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:25.542239 24440 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:25.531111 29542 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.548666 24440 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:25.444178 24366 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:50950 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2489)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2829)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2828)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2480)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2844)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2495)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2827)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2497)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2799)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2845)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2839)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2842)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 781)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 780)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 782)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2841)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2491)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2843)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2479)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2481)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2483)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2800)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2487)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2802)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2494)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2816)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 772)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 774)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 776)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 777)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 778)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 779)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2826)
I20260709 12:20:25.559334 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:25.561131 24366 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:50950 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2489)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2829)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2828)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2480)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2844)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2495)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2827)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2497)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2847)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2799)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2845)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2839)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2842)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 781)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 780)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2841)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2491)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2843)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2479)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2481)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2483)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2800)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2487)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2802)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2494)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2816)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 772)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 774)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 776)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 777)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 778)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 779)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2826)
W20260709 12:20:25.540956 29516 consensus_meta.cc:287] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.749s	user 0.004s	sys 0.007s
I20260709 12:20:25.476503 29510 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:25.530802 29471 consensus_queue.cc:1048] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:20:25.576995 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:25.558270 29542 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:25.543948 29374 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:25.543931 29527 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:25.592350 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:25.593339 25118 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 9.
I20260709 12:20:25.545703 29534 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:25.583225 29411 raft_consensus.cc:2804] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:20:25.594596 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 60451us
I20260709 12:20:25.600396 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:25.588034 29527 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.587858 29518 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:25.593756 29374 raft_consensus.cc:697] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:25.569554 29516 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:25.607246 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:25.607848 29510 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:25.608256 24392 raft_consensus.cc:2368] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
I20260709 12:20:25.598677 29553 raft_consensus.cc:2749] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:25.611469 29346 consensus_meta.cc:287] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.565s	user 0.013s	sys 0.000s
I20260709 12:20:25.611927 29346 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:25.583580 29521 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:25.623266 29346 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:25.624787 29521 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:25.626160 29374 consensus_queue.cc:237] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:25.596890 29411 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:25.628841 29411 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:25.629240 29382 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:25.614140 29534 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:25.614483 29529 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:25.614902 29516 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:25.604162 29527 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:25.618804 29356 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:25.620385 29520 raft_consensus.cc:3055] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:25.636355 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:25.638811 29297 raft_consensus.cc:3055] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:25.644562 25118 raft_consensus.cc:2393] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 12: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
W20260709 12:20:25.648273 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 48811.3us
I20260709 12:20:25.651436 25083 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:25.642742 29520 raft_consensus.cc:740] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:25.653694 29520 consensus_queue.cc:260] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:25.655114 29520 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:25.656709 29411 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:25.657689 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:25.639875 29189 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.658886 29189 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:25.645040 29549 log.cc:927] Time spent T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:20:25.661302 29411 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:25.668677 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 121236us
I20260709 12:20:25.650936 29297 raft_consensus.cc:740] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:25.642163 29377 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:20:25.671620 24440 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:25.692785 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:25.695823 24440 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:25.577991 24366 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:50950 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2489)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2829)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2828)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2480)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2844)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2495)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2827)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2497)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2847)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2799)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2845)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2839)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2842)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 781)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 780)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2841)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2491)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2843)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2479)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2481)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2483)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2800)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2487)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2802)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2494)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2816)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 772)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 774)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 776)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 777)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 778)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 779)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2826)
I20260709 12:20:25.652506 29529 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:25.616073 29531 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:25.686266 29308 consensus_meta.cc:287] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.788s	user 0.008s	sys 0.004s
I20260709 12:20:25.699846 25082 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:25.700426 24440 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:25.705861 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:25.706507 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:25.710404 25114 raft_consensus.cc:1275] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:20:25.686240 29556 raft_consensus.cc:2804] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:20:25.711846 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.712735 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:25.715632 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:25.717512 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:25.718286 24322 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:25.719499 25116 raft_consensus.cc:2393] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 12: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:25.719760 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:25.720883 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:25.702680 29491 raft_consensus.cc:2804] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:25.732939 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:25.705695 29553 raft_consensus.cc:2749] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:25.733567 24325 raft_consensus.cc:3060] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:25.732079 25111 raft_consensus.cc:2393] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 15: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:25.742044 24440 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:25.711117 29471 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:25.752621 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:25.691468 29542 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:25.756779 29557 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:25.757432 29557 raft_consensus.cc:697] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:25.758169 29542 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:25.758385 29557 consensus_queue.cc:237] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:25.713840 29556 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:25.703176 29361 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:25.708386 29308 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:25.741487 29491 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:25.770479 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:25.761480 29471 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.784143 25110 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:25.769451 29554 log.cc:927] Time spent T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:20:25.742477 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:25.792488 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:25.796614 24291 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:25.764339 29553 raft_consensus.cc:2764] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:20:25.803122 24291 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:25.769273 29556 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:25.804962 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.805932 24291 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:25.785835 29471 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:25.786020 29491 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:25.811861 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:25.814447 24324 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:25.819360 29398 consensus_queue.cc:1048] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:20:25.821853 29189 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:25.823495 29361 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:25.823737 29356 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:25.825053 29531 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:25.804697 29499 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:25.742350 29297 consensus_queue.cc:260] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:25.829195 29297 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:25.833930 29308 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:25.836367 29405 raft_consensus.cc:3055] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:25.836880 29405 raft_consensus.cc:740] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:25.837903 29405 consensus_queue.cc:260] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:25.839110 29405 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:25.840679 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:20:25.841395 29562 log.cc:927] Time spent T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:20:25.782965 29374 consensus_queue.cc:1059] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:20:25.842705 29374 raft_consensus.cc:3055] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:25.843086 29374 raft_consensus.cc:740] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:25.847913 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:25.843945 29374 consensus_queue.cc:260] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:25.812156 29457 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:20:25.856186 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 114243us
I20260709 12:20:25.860001 25110 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:20:25.862927 24291 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:25.865579 24440 leader_election.cc:400] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
I20260709 12:20:25.869237 24440 leader_election.cc:403] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:20:25.870476 24440 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:25.883128 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.891528 24325 raft_consensus.cc:2468] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:20:25.895265 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2328) took 1535 ms. Trace:
I20260709 12:20:25.904094 24474 rpcz_store.cc:276] 0709 12:20:24.359546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.364255 (+  4709us) service_pool.cc:224] Handling call
0709 12:20:24.364607 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:24.385149 (+ 20542us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:24.418104 (+ 32955us) log.cc:844] Serialized 14 byte log entry
0709 12:20:24.555326 (+137222us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:24.555783 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 12:20:24.555910 (+   127us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:24.556126 (+   216us) log.cc:844] Serialized 14 byte log entry
0709 12:20:24.632200 (+ 76074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:24.751940 (+119740us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b18004a60e0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9425f3f3 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd 0000000000388634 0000000000388479 00007f4a9424283a
0709 12:20:24.948162 (+196222us) spinlock_profiling.cc:243] Waited 45.7 ms on lock 0x7b18004a60e0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9425f522 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd 0000000000388634 0000000000388479 00007f4a9424283a
0709 12:20:25.397066 (+448904us) spinlock_profiling.cc:243] Waited 48.7 ms on lock 0x7b18004a60e0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9425f3f3 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd 0000000000388634 0000000000388479 00007f4a9424283a
0709 12:20:25.894878 (+497812us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b54001225d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:25.894938 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:25.894990 (+    52us) raft_consensus.cc:1685] finished
0709 12:20:25.895008 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:25.895191 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26320,"prepare.queue_time_us":34301,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":91,"raft.queue_time_us":127251,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":10338,"spinlock_wait_cycles":269979392,"thread_start_us":165129,"threads_started":2,"wal-append.queue_time_us":114603}
I20260709 12:20:25.907117 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:25.907876 24474 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:25.813841 29403 raft_consensus.cc:2749] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:25.897866 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.909368 24324 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 14.
I20260709 12:20:25.910678 24366 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:25.911898 29377 raft_consensus.cc:2804] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:25.912585 29377 raft_consensus.cc:697] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:25.913265 25110 raft_consensus.cc:1275] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:20:25.913727 29377 consensus_queue.cc:237] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:25.914886 29542 consensus_queue.cc:1048] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:25.861039 29211 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:25.916677 29374 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:25.899639 29553 raft_consensus.cc:3060] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:25.861791 29457 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.918947 29457 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:25.899411 29529 raft_consensus.cc:2804] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:25.920867 29529 raft_consensus.cc:697] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:25.921747 29529 consensus_queue.cc:237] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:25.918877 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:25.925909 24467 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:25.928011 29570 log.cc:927] Time spent T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:20:25.928242 24465 raft_consensus.cc:1275] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 12:20:25.928740 24465 pending_rounds.cc:85] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 9
I20260709 12:20:25.928953 24465 pending_rounds.cc:107] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 12:20:25.929174 24465 raft_consensus.cc:2889] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:25.931262 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2354) took 1086 ms. Trace:
I20260709 12:20:25.931596 24465 rpcz_store.cc:276] 0709 12:20:24.845383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.861392 (+ 16009us) service_pool.cc:224] Handling call
0709 12:20:24.861785 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:25.929587 (+1067802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.931022 (+  1435us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001504d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:25.931204 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2451766144}
I20260709 12:20:25.933542 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:25.934245 24397 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
I20260709 12:20:25.934623 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:25.936661 24465 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
W20260709 12:20:25.944250 24440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.947283 24319 raft_consensus.cc:1240] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:25.947422 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:25.937629 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:25.947852 24290 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:25.948385 24323 raft_consensus.cc:2368] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 12. Current term is 13.
I20260709 12:20:25.918449 29211 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:25.948982 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:25.949883 24397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2480) took 1031 ms. Trace:
I20260709 12:20:25.949829 24467 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
I20260709 12:20:25.950392 24397 rpcz_store.cc:276] 0709 12:20:24.918414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.934863 (+1016449us) service_pool.cc:224] Handling call
0709 12:20:25.949812 (+ 14949us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:25.935627 24365 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:50950 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2844)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2495)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2827)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2497)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2847)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2799)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2845)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2839)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2842)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 781)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 780)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2841)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2491)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2843)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 787)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2479)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2481)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2483)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2800)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2487)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2802)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2494)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2816)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 772)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 774)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 776)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 777)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 778)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 779)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2826)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 786)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 788)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 790)
I20260709 12:20:25.924065 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:25.951496 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:20:25.952513 24440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.939435 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:25.954128 24472 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:25.957504 29573 raft_consensus.cc:2804] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:25.957865 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:25.958508 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:25.960529 24290 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:25.962677 24290 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:25.898568 24322 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 15.
I20260709 12:20:25.966217 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:25.966976 24465 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:25.968099 24440 leader_election.cc:400] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 12. Current term is 13.
I20260709 12:20:25.968485 24440 leader_election.cc:403] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:20:25.971889 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:25.976328 24473 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 16.
I20260709 12:20:25.980916 24290 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:25.981042 29398 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:25.983616 24366 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:25.983565 24438 leader_election.cc:336] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.607s (SENT)
I20260709 12:20:25.990487 24438 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:25.991000 24472 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 16.
I20260709 12:20:25.970307 29403 raft_consensus.cc:2764] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:20:25.996863 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:25.993813 24465 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:25.993928 24290 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:25.970520 29493 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.000844 29493 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:26.001754 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:26.002332 29471 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:26.003221 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.003746 29493 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:26.004016 24397 raft_consensus.cc:2393] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 12: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:25.973153 29568 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.978077 29524 raft_consensus.cc:2804] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:25.977866 29531 consensus_queue.cc:1048] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:20:26.000226 29356 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:26.005093 25113 raft_consensus.cc:1240] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:26.008785 24290 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:26.006211 24474 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 13.
I20260709 12:20:25.989444 29398 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.013065 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.013955 24394 raft_consensus.cc:2393] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 12: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:26.014894 24290 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:25.995891 29211 raft_consensus.cc:2749] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:26.004738 29571 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.970553 29411 consensus_queue.cc:1059] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:20:26.018363 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:26.022588 24394 raft_consensus.cc:2368] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 16. Current term is 17.
I20260709 12:20:26.022461 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:26.023681 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:25.996656 29557 raft_consensus.cc:2749] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:26.021869 24471 raft_consensus.cc:2410] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:20:26.026916 24394 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:20:26.026355 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:26.035188 24397 raft_consensus.cc:2376] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14. Re-sending same reply.
I20260709 12:20:26.015681 29189 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:26.012563 29524 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:26.041038 24470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2357) took 1176 ms. Trace:
I20260709 12:20:26.021694 29284 raft_consensus.cc:2804] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:26.018056 29534 raft_consensus.cc:2804] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:26.015808 29361 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 12. Current term is 13.
I20260709 12:20:26.015861 29568 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:26.065047 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.041505 24470 rpcz_store.cc:276] 0709 12:20:24.864513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.914799 (+ 50286us) service_pool.cc:224] Handling call
0709 12:20:24.965777 (+ 50978us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:24.986011 (+ 20234us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:25.597132 (+611121us) spinlock_profiling.cc:243] Waited 5.51 ms on lock 0x7b180000dc60. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a94241e07 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425c455 00007f4a9ad443c7 00007f4a973569a7 00007f4a973660bf 00007f4a97366038
0709 12:20:25.743767 (+146635us) log.cc:844] Serialized 14 byte log entry
0709 12:20:25.860799 (+117032us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:25.904592 (+ 43793us) log.cc:844] Serialized 26 byte log entry
0709 12:20:25.904789 (+   197us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:25.904826 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.904901 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:26.040664 (+135763us) raft_consensus.cc:1685] finished
0709 12:20:26.040800 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:26.040964 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71700,"prepare.queue_time_us":33134,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":19938,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":44666,"spinlock_wait_cycles":12661632,"thread_start_us":251520,"threads_started":2,"wal-append.queue_time_us":257381}
I20260709 12:20:26.062399 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.067271 24394 raft_consensus.cc:2393] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 11: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:26.071595 24394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2799) took 1121 ms. Trace:
I20260709 12:20:26.072248 24394 rpcz_store.cc:276] 0709 12:20:24.950256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.061900 (+1111644us) service_pool.cc:224] Handling call
0709 12:20:26.071467 (+  9567us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:26.049229 29524 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:26.049989 29520 raft_consensus.cc:3055] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:26.037058 29471 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:26.021330 29398 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:26.024678 29571 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:26.098124 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:26.070214 29284 raft_consensus.cc:697] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:26.071571 29534 raft_consensus.cc:697] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:26.064872 29527 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:26.092291 29211 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:26.137068 29211 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:26.138384 29398 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:26.139855 29211 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:26.096122 29520 raft_consensus.cc:740] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:26.141517 29520 consensus_queue.cc:260] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:26.147156 29553 raft_consensus.cc:2749] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
I20260709 12:20:26.106818 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.156495 24397 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:20:26.157603 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:26.157989 29571 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:26.158385 24397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2806) took 1114 ms. Trace:
I20260709 12:20:26.158563 29571 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:26.158802 24397 rpcz_store.cc:276] 0709 12:20:25.044012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.157290 (+1113278us) service_pool.cc:224] Handling call
0709 12:20:26.158333 (+  1043us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:26.159089 29571 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:26.159853 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.109735 29568 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:26.161005 29556 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:26.162098 29571 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:26.113823 29527 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:26.163367 29556 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:26.163213 29284 consensus_queue.cc:237] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:26.164077 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:26.164829 24392 raft_consensus.cc:2368] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 10. Current term is 11.
I20260709 12:20:26.165216 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2828) took 1005 ms. Trace:
I20260709 12:20:26.165517 24392 rpcz_store.cc:276] 0709 12:20:25.159453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.936511 (+777058us) service_pool.cc:224] Handling call
0709 12:20:26.163919 (+227408us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b58001c9e98. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c3120a0 00007f4a9c311984 00007f4a9588c6d4 00007f4a9588c662
0709 12:20:26.165152 (+  1233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35673856}
I20260709 12:20:26.166612 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.114732 29534 consensus_queue.cc:237] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:26.116214 24467 raft_consensus.cc:2393] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 13: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:26.116964 29189 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:26.169003 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:26.160531 24397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2820) took 1003 ms. Trace:
W20260709 12:20:26.126654 29574 log.cc:927] Time spent T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:20:26.123167 25114 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
I20260709 12:20:26.162029 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:20:26.111368 29550 log.cc:927] Time spent T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.633s	user 0.004s	sys 0.000s
I20260709 12:20:26.168203 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2834) took 1005 ms. Trace:
I20260709 12:20:26.178496 24392 rpcz_store.cc:276] 0709 12:20:25.162393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.166349 (+1003956us) service_pool.cc:224] Handling call
0709 12:20:26.168147 (+  1798us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:26.179806 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:26.125510 29576 log.cc:927] Time spent T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:20:26.170215 24397 rpcz_store.cc:276] 0709 12:20:25.156983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.159569 (+1002586us) service_pool.cc:224] Handling call
0709 12:20:26.160474 (+   905us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:26.173431 29189 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:26.176509 24391 raft_consensus.cc:2410] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:20:26.179729 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.202016 24392 raft_consensus.cc:2393] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 11: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:26.203094 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:26.163275 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.182385 29529 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.183111 24400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2822) took 1025 ms. Trace:
I20260709 12:20:26.186890 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:26.210238 24317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2604) took 1687 ms. Trace:
I20260709 12:20:26.204873 24398 raft_consensus.cc:2393] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 11: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:26.201416 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2489) took 1189 ms. Trace:
I20260709 12:20:26.210842 24317 rpcz_store.cc:276] 0709 12:20:24.522784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.523832 (+  1048us) service_pool.cc:224] Handling call
0709 12:20:26.209950 (+1686118us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b54000d39d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:26.210148 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1359370112}
I20260709 12:20:26.211588 24391 rpcz_store.cc:276] 0709 12:20:25.012109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.940034 (+927925us) service_pool.cc:224] Handling call
0709 12:20:26.161866 (+221832us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b58001c9e98. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c3120a0 00007f4a9c311984 00007f4a9588c6d4 00007f4a9588c662
0709 12:20:26.201327 (+ 39461us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25701120}
I20260709 12:20:26.213615 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.208398 29529 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:26.201354 29553 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.235452 24392 raft_consensus.cc:2410] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:20:26.235709 24398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2809) took 1190 ms. Trace:
W20260709 12:20:26.236544 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:26.221037 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2361) took 1009 ms. Trace:
I20260709 12:20:26.221699 29491 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:26.224159 29189 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:26.225517 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:26.229609 24440 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:26.240721 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:26.230273 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:26.208987 24400 rpcz_store.cc:276] 0709 12:20:25.157715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.171164 (+ 13449us) service_pool.cc:224] Handling call
0709 12:20:26.182833 (+1011669us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b540038ac54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:26.183029 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315933440}
I20260709 12:20:26.236140 24398 rpcz_store.cc:276] 0709 12:20:25.044957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.937892 (+892935us) service_pool.cc:224] Handling call
0709 12:20:26.163120 (+225228us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b58001c9e98. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c3120a0 00007f4a9c311984 00007f4a9588c6d4 00007f4a9588c662
0709 12:20:26.235630 (+ 72510us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30973184}
I20260709 12:20:26.237869 24469 rpcz_store.cc:276] 0709 12:20:25.211875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.211982 (+   107us) service_pool.cc:224] Handling call
0709 12:20:25.212393 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:25.220476 (+  8083us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:25.220529 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:25.221368 (+   839us) log.cc:844] Serialized 26 byte log entry
0709 12:20:25.431720 (+210352us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:25.431766 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.431838 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:26.110798 (+678960us) spinlock_profiling.cc:243] Waited 43.3 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:20:26.220711 (+109913us) raft_consensus.cc:1685] finished
0709 12:20:26.220736 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:26.220971 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7545,"raft.queue_time_us":8036,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":17255,"spinlock_wait_cycles":99579776,"thread_start_us":129937,"threads_started":1,"wal-append.queue_time_us":193609}
I20260709 12:20:26.265520 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.273280 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:26.273582 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:26.274492 24469 raft_consensus.cc:2393] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 13: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:26.275254 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:26.275698 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.276736 24392 raft_consensus.cc:2393] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 16: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:26.277685 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:26.285059 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2812) took 1239 ms. Trace:
I20260709 12:20:26.285646 24392 rpcz_store.cc:276] 0709 12:20:25.045866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.275416 (+1229550us) service_pool.cc:224] Handling call
0709 12:20:26.284963 (+  9547us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:26.286955 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.287580 24392 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 14.
I20260709 12:20:26.289143 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:26.289932 24400 raft_consensus.cc:2393] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 15: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:26.291471 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:26.293521 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.294499 24398 raft_consensus.cc:2393] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 11: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:26.293650 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2831) took 1133 ms. Trace:
I20260709 12:20:26.295553 24391 rpcz_store.cc:276] 0709 12:20:25.160468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.212811 (+1052343us) service_pool.cc:224] Handling call
0709 12:20:26.293565 (+ 80754us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:26.235908 29403 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:26.319036 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:26.319981 24391 raft_consensus.cc:2393] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 12: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:26.322643 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.321928 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.324272 24398 raft_consensus.cc:2410] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:20:26.279665 29571 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:26.325860 24398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2801) took 1310 ms. Trace:
I20260709 12:20:26.326400 24398 rpcz_store.cc:276] 0709 12:20:25.015849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.295197 (+1279348us) service_pool.cc:224] Handling call
0709 12:20:26.325782 (+ 30585us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:26.323282 24392 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:26.272330 29356 raft_consensus.cc:697] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 16 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:26.321172 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.337543 24400 raft_consensus.cc:2393] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 11: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:26.328464 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2491) took 1298 ms. Trace:
I20260709 12:20:26.264292 29553 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:26.344394 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:26.336910 29571 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:26.345870 29356 consensus_queue.cc:237] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:26.334721 24397 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14.
I20260709 12:20:26.301275 29527 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.336308 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.351643 24398 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:20:26.351796 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.338961 24392 rpcz_store.cc:276] 0709 12:20:25.029646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.294470 (+1264824us) service_pool.cc:224] Handling call
0709 12:20:26.327985 (+ 33515us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:26.283244 29405 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:26.341470 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.354526 24391 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
I20260709 12:20:26.357656 24395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2796) took 1523 ms. Trace:
I20260709 12:20:26.358251 24395 rpcz_store.cc:276] 0709 12:20:24.834372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.834530 (+   158us) service_pool.cc:224] Handling call
0709 12:20:26.357362 (+1522832us) spinlock_profiling.cc:243] Waited 6.17 ms on lock 0x7b54001b8d54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:26.357564 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14184832}
I20260709 12:20:26.359360 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:26.365026 24398 raft_consensus.cc:3060] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:26.349416 24471 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:20:26.362277 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.366709 24391 raft_consensus.cc:2410] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:20:26.318221 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:26.370630 24400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2479) took 1459 ms. Trace:
W20260709 12:20:26.371497 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:26.371131 24400 rpcz_store.cc:276] 0709 12:20:24.911311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.369774 (+1458463us) service_pool.cc:224] Handling call
0709 12:20:26.370105 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.370290 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:26.370318 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:26.370360 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:26.370394 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.370447 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:26.370573 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:26.362952 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.372692 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:26.373323 24392 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:26.373391 24395 raft_consensus.cc:2393] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 16: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:26.324913 29403 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:26.378557 24400 raft_consensus.cc:1240] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 13. Current term is 14. Ops: [12.7-13.8]
I20260709 12:20:26.378798 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.379413 24400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2483) took 1428 ms. Trace:
I20260709 12:20:26.380123 24400 rpcz_store.cc:276] 0709 12:20:24.950895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.377863 (+1426968us) service_pool.cc:224] Handling call
0709 12:20:26.378300 (+   437us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:26.379131 (+   831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.379353 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:26.381560 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:26.376466 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:26.351100 29527 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:26.384662 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:26.385764 24470 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:26.360849 29405 raft_consensus.cc:697] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:26.387960 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2481) took 1451 ms. Trace:
I20260709 12:20:26.360719 29524 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:26.395123 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:26.398046 24398 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:20:26.394448 24391 rpcz_store.cc:276] 0709 12:20:24.936906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.377418 (+1440512us) service_pool.cc:224] Handling call
0709 12:20:26.387266 (+  9848us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.387511 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:26.387553 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:26.387616 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:26.387664 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.387747 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:26.387884 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:26.409152 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:26.409523 24398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2487) took 1408 ms. Trace:
I20260709 12:20:26.413966 29553 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:26.416507 29395 consensus_queue.cc:1059] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:26.417843 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:26.418694 25082 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
W20260709 12:20:26.478610 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 60024.7us
I20260709 12:20:26.479949 25082 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:26.419003 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:26.419713 24391 raft_consensus.cc:1275] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 11 index: 4. Preceding OpId from leader: term: 14 index: 5. (index mismatch)
I20260709 12:20:26.481364 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2492) took 1447 ms. Trace:
I20260709 12:20:26.481674 24391 rpcz_store.cc:276] 0709 12:20:25.034372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.406506 (+1372134us) service_pool.cc:224] Handling call
0709 12:20:26.419364 (+ 12858us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.481066 (+ 61702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.481301 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:26.420531 24470 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 17.
I20260709 12:20:26.420765 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:26.482873 24399 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2488) took 1478 ms (client timeout 1893 ms). Trace:
W20260709 12:20:26.483333 24399 rpcz_store.cc:269] 0709 12:20:25.004465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.420441 (+1415976us) service_pool.cc:224] Handling call
0709 12:20:26.482805 (+ 62364us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:26.425482 29491 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:26.410295 29581 log.cc:927] Time spent T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 12:20:26.428619 24366 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:26.493417 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 64932.9us
I20260709 12:20:26.494282 24366 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:26.485852 29189 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:26.495162 29377 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:26.495767 29377 raft_consensus.cc:697] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 15 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:26.496847 29308 raft_consensus.cc:2804] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:26.497342 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:26.497488 29308 raft_consensus.cc:697] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:20:26.430197 24210 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 97dd30b21cc14958a91b2da522e4bbe9 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c711faa13ead43ebbea0192cb74a4756 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:26.431514 29211 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.433312 29532 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:26.498489 29211 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:26.434700 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:26.501116 29211 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:26.501860 24466 raft_consensus.cc:2410] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:20:26.500583 29308 consensus_queue.cc:237] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:26.437323 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:26.437206 29405 consensus_queue.cc:237] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:26.438637 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.439432 24318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44278 (request call id 2617) took 1329 ms. Trace:
I20260709 12:20:26.439954 24320 raft_consensus.cc:1240] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:26.440703 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:26.450009 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:26.411491 29529 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:26.410290 24398 rpcz_store.cc:276] 0709 12:20:25.001313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.398927 (+1397614us) service_pool.cc:224] Handling call
0709 12:20:26.399326 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.409170 (+  9844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:26.409196 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:26.409237 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:26.409274 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.409331 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:26.409458 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:26.514580 24365 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:26.471035 25110 raft_consensus.cc:1275] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:20:26.484591 24392 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 15.
I20260709 12:20:26.477618 24471 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 13.
I20260709 12:20:26.505788 24318 rpcz_store.cc:276] 0709 12:20:25.109570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.112733 (+  3163us) service_pool.cc:224] Handling call
0709 12:20:26.439240 (+1326507us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b540019f854. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:26.439374 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":691511040}
I20260709 12:20:26.518263 24396 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 12: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:20:26.430953 29583 log.cc:927] Time spent T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.109s	user 0.003s	sys 0.000s
I20260709 12:20:26.486897 29586 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.487409 29491 raft_consensus.cc:3055] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:26.488467 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:26.489020 29134 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:26.489500 29471 raft_consensus.cc:2804] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:26.490159 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:26.527287 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:26.527526 24391 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:26.492515 29457 consensus_meta.cc:287] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.573s	user 0.011s	sys 0.000s
I20260709 12:20:26.532075 24321 raft_consensus.cc:1275] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:20:26.507432 24393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2493) took 1456 ms (client timeout 1807 ms). Trace:
W20260709 12:20:26.533449 24393 rpcz_store.cc:269] 0709 12:20:25.050808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.440445 (+1389637us) service_pool.cc:224] Handling call
0709 12:20:26.507363 (+ 66918us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:26.508167 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:26.509989 24289 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:26.511211 25117 raft_consensus.cc:1275] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:20:26.512532 25112 raft_consensus.cc:1275] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:20:26.519761 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:20:26.523316 24396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51474 (request call id 2825) took 1364 ms (client timeout 1792 ms). Trace:
I20260709 12:20:26.526571 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:26.498389 24210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 68264.7us
I20260709 12:20:26.529404 24470 raft_consensus.cc:1275] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:20:26.530604 24318 raft_consensus.cc:1240] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:26.542243 24398 raft_consensus.cc:2410] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:20:26.543190 24289 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:26.546983 24471 raft_consensus.cc:1240] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 12:20:26.540956 24396 rpcz_store.cc:269] 0709 12:20:25.158552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.937191 (+778639us) service_pool.cc:224] Handling call
0709 12:20:26.438496 (+501305us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b58001c9e98. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c3120a0 00007f4a9c311984 00007f4a9588c6d4 00007f4a9588c662
0709 12:20:26.523251 (+ 84755us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32599808}
I20260709 12:20:26.549113 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:26.550071 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:26.550941 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:26.552719 24470 raft_consensus.cc:1240] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:26.553583 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:26.554632 24466 raft_consensus.cc:1240] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:26.555446 24289 leader_election.cc:400] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 election: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 16. Current term is 17.
I20260709 12:20:26.557510 24316 raft_consensus.cc:1240] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 16 LEADER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:26.555898 24289 leader_election.cc:403] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:20:26.521978 29491 raft_consensus.cc:740] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:26.561517 24289 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:26.524557 29134 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:26.593099 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.553236 29529 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:26.556937 29471 raft_consensus.cc:697] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:26.527793 29586 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:26.572540 29134 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:26.522748 29189 consensus_queue.cc:1048] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:20:26.557081 29499 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:26.617107 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 55733.1us
I20260709 12:20:26.623332 24471 raft_consensus.cc:1275] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:20:26.569795 29096 raft_consensus.cc:3060] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:26.623504 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:26.634974 24399 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:20:26.552839 29457 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:26.619498 24391 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 13.
W20260709 12:20:26.636999 29561 log.cc:927] Time spent T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.065s	user 0.000s	sys 0.006s
I20260709 12:20:26.644240 29491 consensus_queue.cc:260] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:26.645875 29491 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:26.636956 29005 raft_consensus.cc:2749] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:26.650369 29457 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:26.650818 24395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2485) took 1681 ms. Trace:
I20260709 12:20:26.651288 24395 rpcz_store.cc:276] 0709 12:20:24.969177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.380360 (+1411183us) service_pool.cc:224] Handling call
0709 12:20:26.380723 (+   363us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:20:26.381162 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:26.381189 (+    27us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:20:26.383900 (+  2711us) log.cc:844] Serialized 78 byte log entry
0709 12:20:26.525386 (+141486us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:26.525527 (+   141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.525633 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:26.650566 (+124933us) raft_consensus.cc:1685] finished
0709 12:20:26.650588 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:26.650755 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":3487,"thread_start_us":133805,"threads_started":1,"wal-append.queue_time_us":257395}
I20260709 12:20:26.653275 24395 raft_consensus.cc:1240] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:26.653853 24395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2802) took 1611 ms. Trace:
I20260709 12:20:26.558910 29377 consensus_queue.cc:237] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:26.654134 24395 rpcz_store.cc:276] 0709 12:20:25.042762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.652784 (+1610022us) service_pool.cc:224] Handling call
0709 12:20:26.653105 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.653643 (+   538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.653804 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:26.655316 24395 raft_consensus.cc:1240] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:26.655879 24395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2494) took 1581 ms. Trace:
I20260709 12:20:26.656769 24397 raft_consensus.cc:1240] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:26.656929 24319 raft_consensus.cc:2368] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 13. Current term is 14.
W20260709 12:20:26.661327 29589 log.cc:927] Time spent T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.230s	user 0.000s	sys 0.000s
I20260709 12:20:26.661204 29471 consensus_queue.cc:237] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:26.625418 29356 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:26.666615 29586 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:26.668552 24393 raft_consensus.cc:1240] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:26.672710 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2816) took 1592 ms. Trace:
I20260709 12:20:26.673111 24393 rpcz_store.cc:276] 0709 12:20:25.080432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.668017 (+1587585us) service_pool.cc:224] Handling call
0709 12:20:26.668373 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.672337 (+  3964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.672612 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:26.671766 24471 raft_consensus.cc:1275] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:20:26.676508 24289 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:26.656159 24395 rpcz_store.cc:276] 0709 12:20:25.074279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.654899 (+1580620us) service_pool.cc:224] Handling call
0709 12:20:26.655160 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.655680 (+   520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.655832 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:26.683005 24395 raft_consensus.cc:1240] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:20:26.683615 29586 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:26.694411 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.694449 24395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 775) took 1605 ms. Trace:
I20260709 12:20:26.699364 24398 raft_consensus.cc:1240] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:20:26.700127 24398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 772) took 1618 ms. Trace:
I20260709 12:20:26.700440 24398 rpcz_store.cc:276] 0709 12:20:25.081457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.669727 (+1588270us) service_pool.cc:224] Handling call
0709 12:20:26.699132 (+ 29405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:26.699844 (+   712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.700076 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:26.705927 24391 raft_consensus.cc:1240] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:26.706740 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 777) took 1617 ms. Trace:
I20260709 12:20:26.707111 24391 rpcz_store.cc:276] 0709 12:20:25.089638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.705341 (+1615703us) service_pool.cc:224] Handling call
0709 12:20:26.705707 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.706482 (+   775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.706686 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:26.720109 24399 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 13.
I20260709 12:20:26.718694 24391 raft_consensus.cc:1240] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:20:26.726336 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 778) took 1636 ms. Trace:
I20260709 12:20:26.697099 24395 rpcz_store.cc:276] 0709 12:20:25.088952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.682426 (+1593474us) service_pool.cc:224] Handling call
0709 12:20:26.682782 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:26.694110 (+ 11328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.694384 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:26.731282 24438 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.018s	sys 0.004s
W20260709 12:20:26.731629 24438 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.018s	sys 0.004s
W20260709 12:20:26.731899 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 738533us
W20260709 12:20:26.732378 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:26.735105 24438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:26.736871 24438 leader_election.cc:336] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.782s (SENT)
I20260709 12:20:26.737310 24438 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:26.738437 24438 leader_election.cc:336] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.097s (SENT)
I20260709 12:20:26.739444 29361 raft_consensus.cc:2749] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:26.728962 24391 rpcz_store.cc:276] 0709 12:20:25.089967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.718101 (+1628134us) service_pool.cc:224] Handling call
0709 12:20:26.718474 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:26.724080 (+  5606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.726257 (+  2177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:26.727353 24399 raft_consensus.cc:1240] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:26.743821 24399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 779) took 1653 ms. Trace:
I20260709 12:20:26.744159 24399 rpcz_store.cc:276] 0709 12:20:25.090284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.724585 (+1634301us) service_pool.cc:224] Handling call
0709 12:20:26.727141 (+  2556us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.743561 (+ 16420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.743763 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:26.745469 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:26.746495 24323 raft_consensus.cc:1275] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:20:26.746726 24317 raft_consensus.cc:2393] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 13: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:26.747426 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:26.747502 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:26.747921 24317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:26.748275 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:26.748876 24317 raft_consensus.cc:2393] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 15: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:26.749681 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:26.732375 24395 raft_consensus.cc:1240] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:20:26.750994 24395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2826) took 1592 ms. Trace:
I20260709 12:20:26.760381 24395 rpcz_store.cc:276] 0709 12:20:25.158873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.731653 (+1572780us) service_pool.cc:224] Handling call
0709 12:20:26.732003 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:26.750672 (+ 18669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.750935 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:26.759651 24397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51474 (request call id 2800) took 1765 ms. Trace:
I20260709 12:20:26.764065 24397 rpcz_store.cc:276] 0709 12:20:24.994690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.384325 (+1389635us) service_pool.cc:224] Handling call
0709 12:20:26.656571 (+272246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.657194 (+   623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.759442 (+102248us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b5400324bd0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:26.759589 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601629568}
I20260709 12:20:26.765753 24397 raft_consensus.cc:1240] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:26.766825 24320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44280 (request call id 2290) took 1395 ms. Trace:
I20260709 12:20:26.767212 24320 rpcz_store.cc:276] 0709 12:20:25.371120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.373024 (+  1904us) service_pool.cc:224] Handling call
0709 12:20:26.439783 (+1066759us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.513522 (+ 73739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.766637 (+253115us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540019f850. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:26.766766 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2452557568}
I20260709 12:20:26.767665 24397 raft_consensus.cc:1275] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:20:26.747449 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:26.769577 24397 raft_consensus.cc:1275] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:20:26.764379 29524 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:26.771220 24397 raft_consensus.cc:1240] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:26.773054 24397 raft_consensus.cc:1275] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:20:26.774791 24395 raft_consensus.cc:1275] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:20:26.761587 24438 leader_election.cc:336] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:51474 dropped due to backpressure: service queue is full with 50 items
I20260709 12:20:26.762864 24399 raft_consensus.cc:1240] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 14. Current term is 15. Ops: []
W20260709 12:20:26.779044 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 265973us
I20260709 12:20:26.780400 25082 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:20:26.782150 24440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:26.786901 24366 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:26.788028 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 86191.5us
I20260709 12:20:26.789119 29605 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:26.795902 29529 raft_consensus.cc:2749] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:26.776930 24438 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:26.796993 24398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 776) took 1707 ms. Trace:
I20260709 12:20:26.797494 25113 raft_consensus.cc:1240] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11. Ops: []
W20260709 12:20:26.799158 25083 leader_election.cc:336] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Timed out: RequestConsensusVote RPC to 127.22.155.195:44453 timed out after 1.662s (SENT)
I20260709 12:20:26.836985 25083 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:20:26.837998 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 49401.1us
I20260709 12:20:26.836515 24398 rpcz_store.cc:276] 0709 12:20:25.089312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.701189 (+1611877us) service_pool.cc:224] Handling call
0709 12:20:26.710117 (+  8928us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:26.710604 (+   487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:26.710647 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:26.725926 (+ 15279us) log.cc:844] Serialized 26 byte log entry
0709 12:20:26.735944 (+ 10018us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:26.737139 (+  1195us) log.cc:844] Serialized 14 byte log entry
0709 12:20:26.737392 (+   253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.737491 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:26.796715 (+ 59224us) raft_consensus.cc:1685] finished
0709 12:20:26.796742 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:26.796919 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":497,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":14897,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":191,"thread_start_us":9608,"threads_started":1,"wal-append.queue_time_us":67075}
I20260709 12:20:26.809732 24440 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:26.842339 24440 leader_election.cc:400] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Vote denied by peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951) with higher term. Message: Invalid argument: T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 13. Current term is 14.
I20260709 12:20:26.812912 24289 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:26.804237 29403 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:26.825567 29356 raft_consensus.cc:2749] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:26.827668 29524 consensus_queue.cc:1048] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:26.830816 29553 consensus_queue.cc:1048] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:26.833247 29520 raft_consensus.cc:3060] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:26.834412 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:26.840546 25115 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
W20260709 12:20:26.847256 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 85700.2us
W20260709 12:20:26.847572 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 333066us
I20260709 12:20:26.860940 24321 raft_consensus.cc:1240] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:26.861493 24365 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:20:26.851058 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 64289.7us
I20260709 12:20:26.862315 24438 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:26.863903 24438 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:26.860528 24289 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:26.879598 29617 raft_consensus.cc:2749] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:26.848073 29586 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:26.866990 29556 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.884207 29556 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:26.859705 29432 raft_consensus.cc:2749] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:26.859057 29361 raft_consensus.cc:2749] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:26.845396 29491 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:26.886356 29134 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:26.873605 24438 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:26.890982 24365 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:26.890780 24400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2486) took 1900 ms. Trace:
I20260709 12:20:26.894543 29617 raft_consensus.cc:2749] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:26.896813 29377 consensus_queue.cc:1048] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:26.897516 29603 raft_consensus.cc:2749] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:26.899067 29524 raft_consensus.cc:2749] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:26.892788 25083 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:26.905900 24438 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:26.907575 24438 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:26.911653 24438 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:26.910041 24365 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:26.863813 29605 raft_consensus.cc:697] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:26.876250 29496 raft_consensus.cc:2749] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:26.916507 24365 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:26.917006 24438 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:26.919435 24440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:26.894376 24400 rpcz_store.cc:276] 0709 12:20:24.990039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.381270 (+1391231us) service_pool.cc:224] Handling call
0709 12:20:26.382396 (+  1126us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.382694 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:20:26.570804 (+188110us) log.cc:844] Serialized 14 byte log entry
0709 12:20:26.890114 (+319310us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:26.890292 (+   178us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:26.890374 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.890487 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:26.890669 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17877,"prepare.queue_time_us":264634,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":19253,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":450081,"threads_started":2}
I20260709 12:20:26.918370 29395 raft_consensus.cc:2804] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:26.913350 29134 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:26.893399 29618 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.918081 29603 raft_consensus.cc:2749] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:26.867836 29532 consensus_queue.cc:1059] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
W20260709 12:20:26.960546 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 44123.1us
I20260709 12:20:26.937776 24289 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:26.910830 29491 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:26.913488 29361 raft_consensus.cc:2749] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:26.961584 24365 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:26.976488 29597 log.cc:927] Time spent T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.489s	user 0.000s	sys 0.001s
I20260709 12:20:26.978431 24473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2367) took 1082 ms. Trace:
I20260709 12:20:26.978859 24473 rpcz_store.cc:276] 0709 12:20:25.896482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.010893 (+114411us) service_pool.cc:224] Handling call
0709 12:20:26.011314 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:26.261667 (+250353us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:20:26.261713 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:26.262397 (+   684us) log.cc:844] Serialized 26 byte log entry
0709 12:20:26.393593 (+131196us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:26.393630 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.393701 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:26.975851 (+582150us) spinlock_profiling.cc:243] Waited 39.8 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:20:26.978079 (+  2228us) raft_consensus.cc:1685] finished
0709 12:20:26.978106 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:26.978360 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20851,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":6591,"spinlock_wait_cycles":91643776,"thread_start_us":380523,"threads_started":2,"wal-append.queue_time_us":224960}
I20260709 12:20:26.900744 29432 consensus_queue.cc:1059] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 12:20:26.900216 29308 consensus_queue.cc:1048] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:20:26.989786 29605 consensus_queue.cc:237] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:26.991173 24365 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:26.971572 29377 raft_consensus.cc:2749] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:26.992842 29544 raft_consensus.cc:2749] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:26.993434 29377 raft_consensus.cc:2749] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:26.949544 29529 consensus_queue.cc:1059] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:20:26.996254 29529 raft_consensus.cc:3055] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:26.996668 29529 raft_consensus.cc:740] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:26.997108 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.997514 29529 consensus_queue.cc:260] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:26.998888 29529 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:27.000044 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:27.000249 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:26.939285 29395 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:27.000710 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:27.001008 24400 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 15.
I20260709 12:20:27.002435 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:27.003000 24395 raft_consensus.cc:1240] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:27.003160 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2371) took 1101 ms. Trace:
I20260709 12:20:27.004364 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:27.004590 29096 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893) with higher term. Message: Invalid argument: T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 16. Current term is 17.
I20260709 12:20:27.004961 24467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 2378) took 1063 ms. Trace:
I20260709 12:20:27.005316 24467 rpcz_store.cc:276] 0709 12:20:25.941505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.952372 (+ 10867us) service_pool.cc:224] Handling call
0709 12:20:27.004733 (+1052361us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b540010f254. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:27.004896 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271647104}
I20260709 12:20:27.003629 24474 rpcz_store.cc:276] 0709 12:20:25.901524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.021590 (+120066us) service_pool.cc:224] Handling call
0709 12:20:26.021942 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:26.094928 (+ 72986us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:26.094984 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:26.095479 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 12:20:26.239813 (+144334us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:26.239871 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:27.002751 (+762880us) spinlock_profiling.cc:243] Waited 72.6 ms on lock 0x7b5400200dd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:27.002809 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:27.002863 (+    54us) raft_consensus.cc:1685] finished
0709 12:20:27.002876 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:27.003094 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":351,"raft.queue_time_us":1073,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":2933,"spinlock_wait_cycles":166920064,"thread_start_us":143967,"threads_started":1,"wal-append.queue_time_us":286603}
W20260709 12:20:27.007887 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 157770us
I20260709 12:20:26.900558 29229 consensus_queue.cc:1059] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
W20260709 12:20:26.965185 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 48282.1us
I20260709 12:20:26.967281 29496 raft_consensus.cc:2804] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:26.935098 29608 consensus_queue.cc:1048] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.067s
W20260709 12:20:26.967880 29593 log.cc:927] Time spent T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.535s	user 0.003s	sys 0.000s
W20260709 12:20:26.969276 29591 log.cc:927] Time spent T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.556s	user 0.000s	sys 0.002s
I20260709 12:20:26.959815 29618 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:26.998780 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:27.007807 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 70135.7us
I20260709 12:20:27.018365 24398 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14.
I20260709 12:20:26.893836 29585 raft_consensus.cc:2804] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:26.911867 29553 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:27.010659 24438 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:27.000882 24396 raft_consensus.cc:2393] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 13: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:27.000993 29395 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:27.011613 24321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:20:27.024595 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.003654 29622 raft_consensus.cc:3055] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:27.023209 24438 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:27.025444 24440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:26.914875 29617 consensus_queue.cc:1059] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.104s
I20260709 12:20:27.031407 24438 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:27.013576 29496 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:27.046604 24321 raft_consensus.cc:1275] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:20:27.040597 29189 consensus_queue.cc:1059] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:20:27.040912 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.051280 24438 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:27.041288 29297 consensus_queue.cc:1048] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:27.041456 29398 consensus_queue.cc:1048] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:27.014483 29491 consensus_queue.cc:1059] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:20:27.018813 29229 consensus_queue.cc:1243] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer c711faa13ead43ebbea0192cb74a4756 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:20:27.044653 24316 raft_consensus.cc:1240] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:27.016394 29356 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:27.026074 29585 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:27.041955 29588 consensus_queue.cc:1048] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:27.026911 29621 raft_consensus.cc:2749] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:27.026721 29492 raft_consensus.cc:2749] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:27.027628 29622 raft_consensus.cc:740] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
W20260709 12:20:27.063661 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 144465us
I20260709 12:20:27.074038 29556 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:27.081737 29356 raft_consensus.cc:697] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:27.041314 29499 consensus_queue.cc:1048] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 12:20:27.208300 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 117083us
I20260709 12:20:27.217368 24363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:49122 (request call id 35) took 1682 ms. Trace:
I20260709 12:20:27.235230 24317 raft_consensus.cc:1275] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:27.238657 24396 raft_consensus.cc:3055] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:27.239192 24396 raft_consensus.cc:740] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:27.239384 24323 raft_consensus.cc:1240] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:27.224958 24363 rpcz_store.cc:276] 0709 12:20:25.535336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.217298 (+1681962us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:20:27.240924 24363 service_pool.cc:136] LeaderStepDown request on kudu.consensus.ConsensusService from 127.0.0.1:49122 dropped due to backpressure: service queue is full with 50 items [suppressed 6 similar messages]
I20260709 12:20:27.241206 24363 service_pool.cc:137] LeaderStepDown request on kudu.consensus.ConsensusService from 127.0.0.1:49122 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
I20260709 12:20:27.243383 24400 raft_consensus.cc:3055] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:27.243919 24400 raft_consensus.cc:740] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:27.085043 29585 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:27.044723 29618 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:27.034999 29532 consensus_queue.cc:1059] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:20:27.089529 25116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 1420) took 1253 ms. Trace:
I20260709 12:20:27.255744 25116 rpcz_store.cc:276] 0709 12:20:25.835711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.835870 (+   159us) service_pool.cc:224] Handling call
0709 12:20:25.836287 (+   417us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:25.837007 (+   720us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:25.837039 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:26.145941 (+308902us) spinlock_profiling.cc:243] Waited 8.39 ms on lock 0x7b2c000809d8. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a95c45a11 00007f4a95c55372 00007f4a97387a01 00007f4a9734c43a 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2
0709 12:20:26.146742 (+   801us) log.cc:844] Serialized 52 byte log entry
0709 12:20:26.360997 (+214255us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:26.361035 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.361109 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:26.967272 (+606163us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:20:27.089308 (+122036us) raft_consensus.cc:1685] finished
0709 12:20:27.089331 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:27.089465 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":62003712,"thread_start_us":213730,"threads_started":1,"wal-append.queue_time_us":285237}
I20260709 12:20:27.057379 29405 raft_consensus.cc:2749] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:27.107371 24321 raft_consensus.cc:1240] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:27.112960 24316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:27.259325 24316 raft_consensus.cc:2393] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 15: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:27.116034 24320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:27.260098 24320 raft_consensus.cc:2393] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 12: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:27.122581 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:27.246937 24324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:27.247152 24400 consensus_queue.cc:260] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:27.261006 24400 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:27.203994 29617 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.268313 24398 raft_consensus.cc:3055] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:27.268754 24398 raft_consensus.cc:740] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:27.269549 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:27.204458 29229 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.049533 29496 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:27.274835 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 223652us
W20260709 12:20:27.328392 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 298284us
I20260709 12:20:27.238971 29492 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:27.333994 24438 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:27.337092 24438 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:27.338410 24398 consensus_queue.cc:260] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:27.269749 24396 consensus_queue.cc:260] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:27.339808 24396 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:27.349045 24398 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:27.356033 24438 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:27.360106 24400 raft_consensus.cc:1275] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 12:20:27.360844 24400 pending_rounds.cc:85] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a: Aborting all ops after (but not including) 7
I20260709 12:20:27.361142 24400 pending_rounds.cc:107] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 12:20:27.361361 24400 raft_consensus.cc:2889] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:27.217483 29625 consensus_queue.cc:1059] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.249s
W20260709 12:20:27.368400 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:27.368990 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.391230 29625 raft_consensus.cc:3055] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:27.391486 29633 consensus_queue.cc:1059] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:20:27.392550 29616 log.cc:927] Time spent T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.358s	user 0.000s	sys 0.001s
W20260709 12:20:27.394232 29627 log.cc:927] Time spent T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:20:27.394434 29377 raft_consensus.cc:3055] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:27.394850 29377 raft_consensus.cc:740] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:27.395606 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 774) took 2307 ms. Trace:
I20260709 12:20:27.395825 24396 raft_consensus.cc:1275] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:20:27.396066 24393 rpcz_store.cc:276] 0709 12:20:25.088479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.674084 (+1585605us) service_pool.cc:224] Handling call
0709 12:20:26.674447 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:26.681690 (+  7243us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:26.681721 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:26.684989 (+  3268us) log.cc:844] Serialized 26 byte log entry
0709 12:20:26.730436 (+ 45447us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:26.730479 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.730552 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:27.395340 (+664788us) raft_consensus.cc:1685] finished
0709 12:20:27.395368 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:27.395539 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":117,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":132,"thread_start_us":45008,"threads_started":1,"wal-append.queue_time_us":332321}
I20260709 12:20:27.391814 29625 raft_consensus.cc:740] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:27.398268 24398 raft_consensus.cc:1275] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:20:27.362612 29491 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:27.399513 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 146479us
I20260709 12:20:27.402084 29625 consensus_queue.cc:260] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:27.329883 29229 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:27.373499 29556 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:27.332083 29617 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:27.399789 29633 raft_consensus.cc:2749] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:27.410252 29532 raft_consensus.cc:3055] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:27.426858 24392 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 16.
I20260709 12:20:27.429991 24474 raft_consensus.cc:1275] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:20:27.423280 29625 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:27.433066 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:27.434341 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:27.467854 24473 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:27.449380 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.431742 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:27.464691 24290 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:27.466100 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 110206us
I20260709 12:20:27.408943 29491 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:27.347533 29622 consensus_queue.cc:260] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:27.423228 29632 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:27.471748 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:27.479568 24470 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:27.377988 29356 consensus_queue.cc:237] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:27.471148 24438 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:27.483702 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:27.483995 24438 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:27.457307 29499 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.480533 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:27.487604 25115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35188 (request call id 1402) took 2050 ms (client timeout 2018 ms). Trace:
I20260709 12:20:27.487867 25118 raft_consensus.cc:1275] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:20:27.497148 25115 rpcz_store.cc:269] 0709 12:20:25.436811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.436934 (+   123us) service_pool.cc:224] Handling call
0709 12:20:27.487327 (+2050393us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b540065de54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:27.487503 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3163415424}
I20260709 12:20:27.414575 29556 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:27.499963 24438 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:27.464960 29532 raft_consensus.cc:740] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:27.467804 29635 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:27.524664 24466 raft_consensus.cc:1275] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:20:27.526418 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 317214us
I20260709 12:20:27.539410 25083 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:27.541947 24466 raft_consensus.cc:1275] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:20:27.527591 24473 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:27.476548 29189 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:27.543577 29189 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:27.544178 29189 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:27.478929 29632 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:27.494094 29633 raft_consensus.cc:2749] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:20:27.572966 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 73118us
I20260709 12:20:27.570767 29645 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:27.554492 29626 raft_consensus.cc:2749] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:27.558444 24466 raft_consensus.cc:1275] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:20:27.596117 24473 raft_consensus.cc:1275] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:20:27.563581 29632 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:27.570178 29635 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:27.629957 29635 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:27.630505 29635 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:27.588330 29645 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:27.633771 29617 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:27.511348 29499 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:27.634748 29622 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:27.636294 29499 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:27.609711 29641 raft_consensus.cc:2749] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:27.476948 29377 consensus_queue.cc:260] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:27.623454 29609 log.cc:927] Time spent T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.676s	user 0.001s	sys 0.005s
W20260709 12:20:27.624353 29592 log.cc:927] Time spent T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 1.215s	user 0.000s	sys 0.008s
W20260709 12:20:27.632061 29603 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
W20260709 12:20:27.657807 29596 log.cc:927] Time spent T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 1.226s	user 0.000s	sys 0.008s
I20260709 12:20:27.536115 29639 consensus_queue.cc:1048] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 12:20:27.661100 29377 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:27.661482 29611 log.cc:927] Time spent T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.979s	user 0.008s	sys 0.013s
W20260709 12:20:27.668066 29520 consensus_meta.cc:287] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.799s	user 0.005s	sys 0.005s
I20260709 12:20:27.645882 29641 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.646522 29647 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:27.641489 24470 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 17.
I20260709 12:20:27.729216 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:27.674219 29645 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:27.675478 29556 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:27.732878 24468 raft_consensus.cc:2410] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:20:27.647982 29532 consensus_queue.cc:260] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:27.747197 29532 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:27.747862 25112 raft_consensus.cc:1275] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:20:27.677769 29628 log.cc:927] Time spent T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 12:20:27.748837 29629 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.749132 29647 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:27.749766 29629 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:27.751744 29647 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:27.751959 29629 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:27.752339 29457 consensus_queue.cc:1048] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:27.681874 29524 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.682792 29462 raft_consensus.cc:3055] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:27.684922 29229 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:27.755872 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:27.685734 29527 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:27.688072 29615 log.cc:927] Time spent T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.807s	user 0.000s	sys 0.008s
I20260709 12:20:27.688483 29573 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:27.698580 24472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2366) took 1802 ms. Trace:
W20260709 12:20:27.700057 29529 consensus_meta.cc:287] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.701s	user 0.011s	sys 0.000s
I20260709 12:20:27.732775 29633 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.700947 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:20:27.706043 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.781690 24318 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
I20260709 12:20:27.784140 24365 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:27.706854 29642 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:27.641465 24319 raft_consensus.cc:2468] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:20:27.719142 24396 raft_consensus.cc:1275] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:20:27.730029 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:27.730109 24470 raft_consensus.cc:2410] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:20:27.786672 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:27.787145 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:27.787580 24396 raft_consensus.cc:2393] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 12: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:27.784675 29496 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:27.676509 29491 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:27.788885 29374 raft_consensus.cc:3055] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:27.789371 29374 raft_consensus.cc:740] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:27.789067 29642 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:27.790359 29496 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:27.737367 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 1422) took 1566 ms. Trace:
I20260709 12:20:27.790880 29189 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:27.791067 25118 rpcz_store.cc:276] 0709 12:20:26.170538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.170754 (+   216us) service_pool.cc:224] Handling call
0709 12:20:27.487502 (+1316748us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:27.497331 (+  9829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:27.729683 (+232352us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540065de50. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:27.737280 (+  7597us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3027244416}
I20260709 12:20:27.791597 29642 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:27.740550 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:27.743554 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:27.741874 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:27.788476 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:27.760154 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:27.794281 24467 raft_consensus.cc:2410] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:20:27.786048 24400 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 14.
I20260709 12:20:27.794458 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:27.795261 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:27.795557 24467 raft_consensus.cc:1275] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:27.795907 24400 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14.
I20260709 12:20:27.793226 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:27.748733 29641 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:27.727823 29096 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.797206 24400 raft_consensus.cc:1240] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:27.797286 29096 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:27.798509 24400 raft_consensus.cc:1240] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:20:27.798521 29641 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:27.700134 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:27.799487 29037 raft_consensus.cc:2749] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:27.771787 24472 rpcz_store.cc:276] 0709 12:20:25.896202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.993209 (+ 97007us) service_pool.cc:224] Handling call
0709 12:20:26.010732 (+ 17523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:26.011045 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:20:26.021458 (+ 10413us) log.cc:844] Serialized 14 byte log entry
0709 12:20:26.119161 (+ 97703us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b1800410860. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a94241e07 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425ec02 00007f4a96ee620b 00007f4a96eebd23 00007f4a96eec23a 00007f4a97356a2a
0709 12:20:26.279119 (+159958us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:26.280201 (+  1082us) log.cc:844] Serialized 26 byte log entry
0709 12:20:26.280376 (+   175us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:26.280422 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.280513 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:27.623693 (+1343180us) spinlock_profiling.cc:243] Waited 48.7 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:20:27.698358 (+ 74665us) raft_consensus.cc:1685] finished
0709 12:20:27.698379 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:27.698509 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11659,"prepare.queue_time_us":10912,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":28637,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":25183,"spinlock_wait_cycles":114662912,"thread_start_us":147818,"threads_started":1,"wal-append.queue_time_us":350881}
W20260709 12:20:27.704607 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.801241 24396 raft_consensus.cc:2368] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 12. Current term is 13.
I20260709 12:20:27.747205 29398 consensus_queue.cc:1048] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:20:27.795931 24466 raft_consensus.cc:1240] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:27.772306 29646 consensus_queue.cc:1048] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:20:27.813587 29556 consensus_queue.cc:1048] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:27.792929 29635 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:27.795604 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:27.817989 24399 raft_consensus.cc:2393] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 17: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
W20260709 12:20:27.820806 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:27.824112 29553 consensus_meta.cc:287] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.797s	user 0.011s	sys 0.000s
I20260709 12:20:27.824767 29553 raft_consensus.cc:2749] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:27.826125 24469 raft_consensus.cc:1240] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:27.829783 24472 raft_consensus.cc:1240] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:27.830886 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:27.790207 29374 consensus_queue.cc:260] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:27.794135 24365 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:27.832088 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:27.705372 29395 consensus_meta.cc:287] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.671s	user 0.011s	sys 0.001s
I20260709 12:20:27.832485 24365 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:27.832932 29395 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:27.833820 24365 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:27.761986 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.834973 24365 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:27.835927 29638 raft_consensus.cc:2804] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:27.836304 29638 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:27.836702 29638 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:27.801631 24400 raft_consensus.cc:1240] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12. Ops: []
W20260709 12:20:27.837706 29585 consensus_meta.cc:287] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.508s	user 0.007s	sys 0.003s
I20260709 12:20:27.838393 29585 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:27.839946 24474 raft_consensus.cc:1240] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:27.831087 24472 raft_consensus.cc:1240] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:27.840412 29229 raft_consensus.cc:2749] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:20:27.840014 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:27.864017 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.744941 24289 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:27.838982 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:27.865630 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 120797us
I20260709 12:20:27.867092 24467 raft_consensus.cc:1275] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:20:27.761819 29462 raft_consensus.cc:740] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:27.785928 29633 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:27.859609 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.891111 24289 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:27.767023 29524 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:27.863128 24365 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:27.868413 24319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756"
I20260709 12:20:27.869529 24467 raft_consensus.cc:1240] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:27.870124 24318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:27.870177 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
W20260709 12:20:27.895784 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 389167us
I20260709 12:20:27.776228 29573 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:27.877713 29096 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:27.878408 29395 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:27.879503 24472 raft_consensus.cc:1275] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:20:27.897105 24472 pending_rounds.cc:85] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 9
I20260709 12:20:27.885398 29462 consensus_queue.cc:260] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:27.886372 29585 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:27.886978 29640 raft_consensus.cc:2749] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:27.886783 29625 consensus_queue.cc:1059] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:27.888209 24323 raft_consensus.cc:1240] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:27.860915 25084 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:27.874080 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:27.907712 25083 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:27.897436 24472 pending_rounds.cc:107] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 11.10
W20260709 12:20:27.910306 24394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.021s	sys 0.018s
I20260709 12:20:27.921443 24472 raft_consensus.cc:2889] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:27.921684 24394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.021s	sys 0.018s
W20260709 12:20:27.893512 29492 consensus_meta.cc:287] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.003s
I20260709 12:20:27.890659 29457 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:27.926680 24470 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 13.
W20260709 12:20:27.924940 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 64086.7us
I20260709 12:20:27.930107 25084 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:27.893855 29553 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.927712 24290 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:27.937570 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:27.924068 29636 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.941061 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:27.904263 29646 consensus_queue.cc:1048] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:20:27.926940 29382 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:27.926748 29462 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:27.929704 29556 raft_consensus.cc:2749] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:27.930015 29229 raft_consensus.cc:2749] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:27.933010 29457 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:20:27.931089 29492 raft_consensus.cc:2749] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:27.926760 29096 consensus_queue.cc:1048] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
W20260709 12:20:27.976112 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 232393us
I20260709 12:20:27.974751 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:27.934300 29625 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:27.919683 29632 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:27.990913 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:28.075505 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 84747.4us
I20260709 12:20:27.969444 29617 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:28.078967 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:27.969451 29189 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:27.940369 29553 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:28.110136 25112 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:28.084923 24366 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:20:28.104034 25081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.993213 29457 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:28.114913 29616 log.cc:927] Time spent T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260709 12:20:28.117883 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 226894us
I20260709 12:20:28.006408 29403 raft_consensus.cc:2749] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:28.088265 29464 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:20:28.135149 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 50344.3us
I20260709 12:20:28.180377 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:28.181867 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:28.182631 24323 raft_consensus.cc:2393] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 14: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:28.183137 24325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c711faa13ead43ebbea0192cb74a4756" is_pre_election: true
I20260709 12:20:28.186965 25113 raft_consensus.cc:1275] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:20:28.107522 29471 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.426s	user 0.023s	sys 0.020s
I20260709 12:20:28.121269 24472 raft_consensus.cc:1275] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 12:20:28.103826 29356 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:28.249148 29037 consensus_queue.cc:1048] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:20:28.258179 29037 consensus_queue.cc:1048] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:20:28.260833 29553 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:28.087435 29496 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.087231 29532 consensus_queue.cc:1048] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 12:20:28.263931 29632 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:28.179816 29585 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:454: Failure
Failed
Bad status: Remote error: Service unavailable: LeaderStepDown request on kudu.consensus.ConsensusService from 127.0.0.1:49122 dropped due to backpressure: service queue is full with 50 items
I20260709 12:20:28.265239 29585 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:28.266083 23151 tablet_server.cc:179] TabletServer@127.22.155.193:0 shutting down...
I20260709 12:20:28.173863 29229 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:28.269692 29229 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:28.270264 29594 log.cc:927] Time spent T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 1.847s	user 0.004s	sys 0.005s
I20260709 12:20:28.246618 29633 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:28.101812 29640 consensus_queue.cc:1059] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.120s
I20260709 12:20:28.273870 29640 raft_consensus.cc:3055] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:28.274359 29640 raft_consensus.cc:740] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:28.275817 29640 consensus_queue.cc:260] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:27.969929 29636 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:28.228176 24472 pending_rounds.cc:85] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 10
I20260709 12:20:28.229821 29472 consensus_queue.cc:1059] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:28.246750 24394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2514) took 1009 ms. Trace:
I20260709 12:20:28.127750 29641 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:28.108738 29655 consensus_queue.cc:1048] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.162s
W20260709 12:20:28.176568 29622 consensus_meta.cc:287] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.004s
I20260709 12:20:28.277709 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:28.277840 25117 raft_consensus.cc:1275] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:20:28.277951 25113 raft_consensus.cc:1240] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 14. Current term is 15. Ops: []
W20260709 12:20:28.228664 29471 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.553s	user 0.023s	sys 0.020s
I20260709 12:20:28.270319 29229 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:28.281863 24222 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54252 (request call id 256) took 13295 ms (client timeout 15000 ms). Trace:
I20260709 12:20:28.118024 29492 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:28.285172 29642 raft_consensus.cc:3055] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:28.333561 29642 raft_consensus.cc:740] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:28.251004 29356 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:28.339535 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 476493us
I20260709 12:20:28.322513 24472 pending_rounds.cc:107] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:20:28.343513 24365 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:28.343843 24472 raft_consensus.cc:2889] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:28.262622 29496 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:28.288954 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 361318us
I20260709 12:20:28.359422 24290 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:28.306627 24394 rpcz_store.cc:276] 0709 12:20:27.237304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.237509 (+   205us) service_pool.cc:224] Handling call
0709 12:20:27.237982 (+   473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:27.238453 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:20:27.238493 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:27.267759 (+ 29266us) log.cc:844] Serialized 26 byte log entry
0709 12:20:27.922392 (+654633us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:27.922459 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:27.922566 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:28.246499 (+323933us) raft_consensus.cc:1685] finished
0709 12:20:28.246523 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.246684 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":575,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":7061,"thread_start_us":560684,"threads_started":1,"wal-append.queue_time_us":747404}
I20260709 12:20:28.268009 29585 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:28.336390 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:28.321148 29595 log.cc:927] Time spent T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 1.864s	user 0.023s	sys 0.011s
W20260709 12:20:28.353927 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:28.370457 25082 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:28.375676 24365 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:28.381148 25082 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:28.396795 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:28.359906 29356 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:28.250672 29464 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:28.405438 25082 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:28.328284 24222 rpcz_store.cc:269] 0709 12:20:14.986786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.986995 (+   209us) service_pool.cc:224] Handling call
0709 12:20:15.600554 (+613559us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b540008ff54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b6090 00007f4a97354f3a 00007f4a9d10ae9c 00007f4a9d20904e 00007f4a9b6ca2a4 00007f4a9b6ca232 00007f4a9b6ca161 00007f4a9b6ca0dc 00007f4a9b6c9392 00007f4a9568748c 00007f4a956868c6
0709 12:20:28.281752 (+12681198us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:20.520138 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:20.521266 (+  1128us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:20.521339 (+    73us) write_op.cc:435] Acquired schema lock
0709 12:20:20.521360 (+    21us) tablet.cc:662] Decoding operations
0709 12:20:20.664190 (+142830us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:20.664341 (+   151us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:20.664386 (+    45us) tablet.cc:685] Acquiring locks for 21 operations
0709 12:20:20.666716 (+  2330us) tablet.cc:701] Row locks acquired
0709 12:20:20.666775 (+    59us) write_op.cc:260] PREPARE: finished
0709 12:20:20.667028 (+   253us) write_op.cc:270] Start()
0709 12:20:20.667251 (+   223us) write_op.cc:276] Timestamp: P: 1783599620666941 usec, L: 0
0709 12:20:20.667297 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 12:20:20.680446 (+ 13149us) log.cc:844] Serialized 8375 byte log entry
0709 12:20:21.589294 (+908848us) op_driver.cc:464] REPLICATION: finished
0709 12:20:21.929567 (+340273us) write_op.cc:301] APPLY: starting
0709 12:20:21.937706 (+  8139us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:22.141596 (+203890us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:22.144265 (+  2669us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:22.831232 (+686967us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:22.831744 (+   512us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=0,mrs_lookups=0
0709 12:20:22.831843 (+    99us) write_op.cc:312] APPLY: finished
0709 12:20:22.832564 (+   721us) log.cc:844] Serialized 188 byte log entry
0709 12:20:22.963196 (+130632us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:22.971940 (+  8744us) write_op.cc:454] Released schema lock
0709 12:20:22.972062 (+   122us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:22.972592 (+   530us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:22.972650 (+    58us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":128554,"reported_tablets":45,"spinlock_wait_cycles":1167110528,"child_traces":[["op",{"apply.queue_time_us":278999,"apply.run_cpu_time_us":99632,"apply.run_wall_time_us":1065499,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91991,"num_ops":21,"prepare.queue_time_us":342466,"prepare.run_cpu_time_us":27646,"prepare.run_wall_time_us":266822,"raft.queue_time_us":527751,"raft.run_cpu_time_us":36181,"raft.run_wall_time_us":338157,"replication_time_us":872743,"thread_start_us":913342,"threads_started":5,"wal-append.queue_time_us":250884,"wal-append.run_cpu_time_us":31991,"wal-append.run_wall_time_us":2755580}]]}
I20260709 12:20:28.379153 29640 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:28.375385 29524 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:28.328858 29641 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:28.389961 29618 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:28.398638 29603 raft_consensus.cc:2804] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:28.337466 29492 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:28.334707 29642 consensus_queue.cc:260] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:28.402204 29626 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:28.404390 29398 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.409744 29648 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:28.427704 29524 raft_consensus.cc:2804] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:28.429442 29377 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.415740 29631 consensus_queue.cc:1048] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 12:20:28.487246 24288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.046s	sys 0.095s
W20260709 12:20:28.487664 24288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.046s	sys 0.095s
I20260709 12:20:28.420239 29403 consensus_queue.cc:1048] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 12:20:28.468607 29659 log.cc:927] Time spent T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:20:28.463650 29667 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.428977 29529 consensus_queue.cc:1048] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:20:28.489744 29603 raft_consensus.cc:697] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 17 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:20:28.490548 24465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.010s	sys 0.037s
W20260709 12:20:28.517517 24465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.010s	sys 0.037s
I20260709 12:20:28.426759 29664 consensus_queue.cc:1059] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
W20260709 12:20:28.512723 24391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.016s	sys 0.010s
W20260709 12:20:28.523090 24391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.016s	sys 0.010s
I20260709 12:20:28.520610 25083 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:28.474455 29398 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:28.502411 29642 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:28.491631 29524 raft_consensus.cc:697] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:28.534508 25112 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 14.
I20260709 12:20:28.492790 29377 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:28.550863 25083 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:28.526587 29636 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:28.507711 29667 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:28.547612 29472 raft_consensus.cc:2749] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:28.559263 29585 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:28.569511 29638 consensus_meta.cc:287] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.732s	user 0.014s	sys 0.000s
I20260709 12:20:28.562162 29134 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:28.542285 29382 consensus_queue.cc:1059] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:20:28.559545 29632 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:28.551627 29556 consensus_queue.cc:1059] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
W20260709 12:20:28.636646 29462 consensus_meta.cc:287] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.644s	user 0.008s	sys 0.004s
I20260709 12:20:28.552431 29663 consensus_queue.cc:1048] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.100s
I20260709 12:20:28.635818 29618 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:28.566269 29625 consensus_queue.cc:1048] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 12:20:28.643934 29134 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:28.644121 29496 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:28.636984 29308 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:28.646221 29664 raft_consensus.cc:3055] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:28.758073 29492 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:28.749078 29653 log.cc:927] Time spent T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
W20260709 12:20:28.717384 29662 log.cc:927] Time spent T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260709 12:20:28.739777 29639 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.646119 29638 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:28.712847 29636 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:28.795130 29658 log.cc:927] Time spent T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 12:20:28.646341 29585 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:28.784806 29660 log.cc:927] Time spent T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 12:20:28.658174 29524 consensus_queue.cc:237] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:28.819339 29585 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:28.646274 29603 consensus_queue.cc:237] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:28.790534 29664 raft_consensus.cc:740] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:28.653558 29632 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:28.823269 29664 consensus_queue.cc:260] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:28.825637 29664 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:28.820062 29634 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.009s	sys 0.016s
I20260709 12:20:28.747056 29618 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:28.842322 29667 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:28.845698 29464 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:28.847574 29672 log.cc:927] Time spent T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 12:20:28.850404 29629 raft_consensus.cc:3055] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:20:28.853763 29657 log.cc:927] Time spent T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.882s	user 0.003s	sys 0.001s
W20260709 12:20:28.848495 29671 log.cc:927] Time spent T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 12:20:28.811648 29639 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:28.831840 29634 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.009s	sys 0.017s
W20260709 12:20:28.871420 29573 consensus_meta.cc:287] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.947s	user 0.013s	sys 0.002s
W20260709 12:20:28.871645 29652 log.cc:927] Time spent T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.601s	user 0.002s	sys 0.001s
I20260709 12:20:28.863950 29629 raft_consensus.cc:740] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:28.877982 29639 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:28.878722 29629 consensus_queue.cc:260] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:28.883419 29635 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:28.816216 29636 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:28.888993 29636 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:28.891535 29641 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:28.903681 29654 log.cc:927] Time spent T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.931s	user 0.001s	sys 0.003s
I20260709 12:20:28.893705 29638 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:28.909591 29618 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:28.912184 29629 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:28.717020 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 493423us
I20260709 12:20:28.949528 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2531) took 1056 ms. Trace:
I20260709 12:20:28.950387 24391 rpcz_store.cc:276] 0709 12:20:27.892396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.892564 (+   168us) service_pool.cc:224] Handling call
0709 12:20:27.892885 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:27.894963 (+  2078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:27.895011 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:27.895553 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 12:20:28.524183 (+628630us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:28.524224 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:28.524292 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:28.948307 (+424015us) raft_consensus.cc:1685] finished
0709 12:20:28.948415 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.949064 (+   649us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1677,"raft.queue_time_us":33790,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":2355,"thread_start_us":558096,"threads_started":1,"wal-append.queue_time_us":613735}
I20260709 12:20:28.954564 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:28.956979 24290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.031s	sys 0.052s
W20260709 12:20:28.957691 24290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.031s	sys 0.052s
W20260709 12:20:28.958225 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 597862us
W20260709 12:20:28.961078 24393 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.017s	sys 0.031s
W20260709 12:20:28.961760 24393 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.017s	sys 0.031s
W20260709 12:20:28.962846 24365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.009s	sys 0.028s
W20260709 12:20:28.963498 24365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.009s	sys 0.028s
I20260709 12:20:28.963864 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2522) took 1253 ms. Trace:
I20260709 12:20:28.964393 24392 rpcz_store.cc:276] 0709 12:20:27.710383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.718770 (+  8387us) service_pool.cc:224] Handling call
0709 12:20:27.758894 (+ 40124us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:27.768341 (+  9447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:27.768375 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:27.769035 (+   660us) log.cc:844] Serialized 26 byte log entry
0709 12:20:28.128296 (+359261us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:28.128336 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:28.128412 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:28.963210 (+834798us) raft_consensus.cc:1685] finished
0709 12:20:28.963265 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.963638 (+   373us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1224,"raft.queue_time_us":6394,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":7076,"thread_start_us":311550,"threads_started":1,"wal-append.queue_time_us":591098}
I20260709 12:20:28.965729 24398 raft_consensus.cc:1275] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:20:28.769841 24395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 801) took 1026 ms. Trace:
I20260709 12:20:28.969909 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2370) took 3072 ms. Trace:
W20260709 12:20:28.763729 24469 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.030s	sys 0.051s
I20260709 12:20:28.970911 24397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2523) took 1260 ms. Trace:
I20260709 12:20:28.973623 24399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2532) took 1080 ms. Trace:
I20260709 12:20:28.974480 24399 rpcz_store.cc:276] 0709 12:20:27.892868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.908984 (+ 16116us) service_pool.cc:224] Handling call
0709 12:20:27.909436 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:28.107825 (+198389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:28.107871 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:28.108351 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 12:20:28.341003 (+232652us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:28.341047 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:28.341153 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:28.972924 (+631771us) raft_consensus.cc:1685] finished
0709 12:20:28.972975 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.973386 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18705,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":5463,"thread_start_us":414436,"threads_started":2,"wal-append.queue_time_us":451567}
I20260709 12:20:28.976539 25115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 779) took 1240 ms. Trace:
I20260709 12:20:28.977953 24400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2530) took 1086 ms. Trace:
W20260709 12:20:28.963919 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 580296us
I20260709 12:20:28.993227 25115 rpcz_store.cc:276] 0709 12:20:27.735874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.736022 (+   148us) service_pool.cc:224] Handling call
0709 12:20:27.736395 (+   373us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:27.736813 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:27.736836 (+    23us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:27.756656 (+ 19820us) log.cc:844] Serialized 52 byte log entry
0709 12:20:28.224280 (+467624us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:28.326835 (+102555us) log.cc:844] Serialized 14 byte log entry
0709 12:20:28.341912 (+ 15077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:28.341991 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:28.975764 (+633773us) raft_consensus.cc:1685] finished
0709 12:20:28.975842 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.976267 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14737,"prepare.queue_time_us":97648,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":6295,"raft.queue_time_us":37674,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":217,"thread_start_us":436550,"threads_started":1,"wal-append.queue_time_us":645469}
I20260709 12:20:28.963915 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2525) took 1247 ms. Trace:
W20260709 12:20:28.782095 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 448119us
I20260709 12:20:28.996865 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:28.998059 24470 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 14.
W20260709 12:20:28.971527 24469 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.031s	sys 0.051s
I20260709 12:20:28.993526 24400 rpcz_store.cc:276] 0709 12:20:27.891986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.892232 (+   246us) service_pool.cc:224] Handling call
0709 12:20:27.892646 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:27.893742 (+  1096us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:27.893790 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:27.894376 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 12:20:28.160081 (+265705us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:28.160137 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:28.160264 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:28.977008 (+816744us) raft_consensus.cc:1685] finished
0709 12:20:28.977081 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.977609 (+   528us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":671,"raft.queue_time_us":5492,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":13415,"thread_start_us":265361,"threads_started":1,"wal-append.queue_time_us":486104}
I20260709 12:20:28.969363 24395 rpcz_store.cc:276] 0709 12:20:27.743181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.797921 (+ 54740us) service_pool.cc:224] Handling call
0709 12:20:27.798225 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:27.798455 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:20:27.798800 (+   345us) log.cc:844] Serialized 14 byte log entry
0709 12:20:27.861977 (+ 63177us) log.cc:844] Serialized 14 byte log entry
0709 12:20:27.900133 (+ 38156us) log.cc:844] Serialized 14 byte log entry
0709 12:20:28.270948 (+370815us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b1800447a60. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9425f3f3 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd 0000000000388634 0000000000388479 00007f4a9424283a
0709 12:20:28.405997 (+135049us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b1800447a60. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a941d9c0a 00007f4a9d919219 00007f4a94261a40 00007f4a9425c4e4 00007f4a9425c455 00007f4a9ad443c7 00007f4a973569a7 00007f4a973660bf 00007f4a97366038
0709 12:20:28.413285 (+  7288us) log.cc:844] Serialized 14 byte log entry
0709 12:20:28.768055 (+354770us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:28.768331 (+   276us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:28.768693 (+   362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:28.768968 (+   275us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.769555 (+   587us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":178358,"prepare.queue_time_us":533265,"prepare.run_cpu_time_us":154,"prepare.run_wall_time_us":160,"raft.queue_time_us":212205,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":19630,"spinlock_wait_cycles":79741440,"thread_start_us":345490,"threads_started":1}
I20260709 12:20:28.968039 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:28.971655 24397 rpcz_store.cc:276] 0709 12:20:27.710698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.713874 (+  3176us) service_pool.cc:224] Handling call
0709 12:20:27.714246 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:27.714629 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:20:27.714659 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:27.715144 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 12:20:27.967348 (+252204us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:27.967416 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:27.967522 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:28.893513 (+925991us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:20:28.970185 (+ 76672us) raft_consensus.cc:1685] finished
0709 12:20:28.970223 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.970705 (+   482us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1079,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":93,"spinlock_wait_cycles":8765824,"thread_start_us":251808,"threads_started":1,"wal-append.queue_time_us":257460}
I20260709 12:20:29.003206 29211 raft_consensus.cc:2749] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:29.005266 24365 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:20:29.007119 24468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 2472) took 2831 ms (client timeout 2962 ms). Trace:
I20260709 12:20:29.010038 24467 raft_consensus.cc:1275] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 12:20:29.010573 24467 pending_rounds.cc:85] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 9
I20260709 12:20:29.010910 24467 pending_rounds.cc:107] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:20:29.011289 24467 raft_consensus.cc:2889] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:28.970561 24465 rpcz_store.cc:276] 0709 12:20:25.897317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.009297 (+111980us) service_pool.cc:224] Handling call
0709 12:20:26.009791 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:26.010223 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:26.010251 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:26.010928 (+   677us) log.cc:844] Serialized 26 byte log entry
0709 12:20:27.753511 (+1742583us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b1800334240. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a94241e07 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425ec02 00007f4a96ee620b 00007f4a96eebd23 00007f4a96eec0d1 00007f4a97307a0f
0709 12:20:28.518021 (+764510us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:28.968042 (+450021us) log.cc:844] Serialized 14 byte log entry
0709 12:20:28.968807 (+   765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:28.968999 (+   192us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:28.969101 (+   102us) raft_consensus.cc:1685] finished
0709 12:20:28.969264 (+   163us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.969529 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3995,"prepare.queue_time_us":355393,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":58,"raft.queue_time_us":82,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":6128,"spinlock_wait_cycles":2825088,"thread_start_us":1213644,"threads_started":2,"wal-append.queue_time_us":2768007}
W20260709 12:20:28.986687 24363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:28.786084 29134 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:29.013825 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:29.016786 24366 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 46 similar messages]
I20260709 12:20:29.018841 24365 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:29.026046 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:29.027520 24474 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:28.993161 29189 consensus_queue.cc:1048] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:20:28.794731 29308 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:29.030334 24470 raft_consensus.cc:1275] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:20:29.007753 24468 rpcz_store.cc:269] 0709 12:20:26.175539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.497055 (+321516us) service_pool.cc:224] Handling call
0709 12:20:29.006464 (+2509409us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54002bbbd4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:29.006821 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2839126912}
I20260709 12:20:29.036487 29308 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:29.045528 24467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2483) took 1213 ms. Trace:
I20260709 12:20:29.046025 29361 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:29.046309 24467 rpcz_store.cc:276] 0709 12:20:27.831628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.910721 (+ 79093us) service_pool.cc:224] Handling call
0709 12:20:29.008880 (+1098159us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:29.012115 (+  3235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:29.045129 (+ 33014us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54002bbbd0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:29.045419 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2524236032}
I20260709 12:20:29.002563 24393 rpcz_store.cc:276] 0709 12:20:27.716423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.716585 (+   162us) service_pool.cc:224] Handling call
0709 12:20:27.716924 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:27.717334 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:27.717608 (+   274us) log.cc:844] Serialized 14 byte log entry
0709 12:20:27.989520 (+271912us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:28.086214 (+ 96694us) log.cc:844] Serialized 26 byte log entry
0709 12:20:28.086771 (+   557us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:28.852881 (+766110us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:20:28.962507 (+109626us) log.cc:844] Serialized 14 byte log entry
0709 12:20:28.963135 (+   628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:28.963362 (+   227us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:28.963579 (+   217us) raft_consensus.cc:1685] finished
0709 12:20:28.963594 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.963846 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":319325,"prepare.queue_time_us":324787,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":86,"raft.queue_time_us":13674,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":40136,"spinlock_wait_cycles":28390144,"thread_start_us":825343,"threads_started":2,"wal-append.queue_time_us":253885}
I20260709 12:20:28.834846 29398 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:29.061914 29398 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.062261 29377 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:29.062867 29398 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:20:29.063448 29377 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.065469 29377 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:29.070601 29297 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:29.071655 29297 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:29.074069 29096 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.074983 29096 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:29.077986 29096 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:29.078610 29096 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.079421 29096 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:29.045643 29308 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.081681 29374 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:29.081974 29398 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:29.082702 29398 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.083401 29398 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:29.084583 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:29.085129 29211 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.086690 24397 raft_consensus.cc:1275] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:20:29.088382 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:29.089159 29377 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:29.089489 24394 raft_consensus.cc:2410] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:20:29.090124 29377 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.090926 29377 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:29.095614 29457 consensus_meta.cc:287] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.907s	user 0.011s	sys 0.004s
I20260709 12:20:29.096352 29457 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:29.097675 29405 raft_consensus.cc:3055] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:29.098207 29405 raft_consensus.cc:740] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:29.097575 29492 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.099834 29037 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:29.099679 29405 consensus_queue.cc:260] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:20:29.109197 29405 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:29.113077 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:29.114507 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:29.115691 24465 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 14.
I20260709 12:20:29.088337 29211 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:29.118528 29403 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:29.119508 29211 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:29.119366 29403 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:29.120357 29211 consensus_queue.cc:1048] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:29.121500 29532 raft_consensus.cc:3055] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:29.122094 29532 raft_consensus.cc:740] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:29.123534 29532 consensus_queue.cc:260] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:29.143370 29377 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:29.100807 29037 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:29.101943 29496 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.102210 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:20:29.103619 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 104138us
I20260709 12:20:29.106776 29297 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:29.107111 29471 raft_consensus.cc:3055] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:29.123564 29573 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:29.124877 29211 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:29.125231 29544 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.125713 29585 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:29.081969 29308 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:29.130605 29608 raft_consensus.cc:2749] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:29.100131 29457 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:29.035809 29189 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:29.144068 29532 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:29.100018 29492 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:29.144381 29636 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.048432 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:29.220747 29471 raft_consensus.cc:740] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:29.287106 24217 catalog_manager.cc:5697] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 5 to 10, leader changed from d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 10 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:29.138682 29635 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:29.317396 29134 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:29.318872 29398 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:29.321372 24471 raft_consensus.cc:1240] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 11. Current term is 13. Ops: []
I20260709 12:20:29.323582 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 1101) took 1602 ms. Trace:
I20260709 12:20:29.325441 29496 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:29.326197 29096 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:29.290112 29471 consensus_queue.cc:260] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:29.329597 29471 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:29.332512 29585 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:29.333604 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.334482 29457 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.335295 29457 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:29.335634 29297 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.337311 29632 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:29.338457 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.339367 24467 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 13.
I20260709 12:20:29.340953 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:29.341403 29657 log.cc:927] Time spent T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:20:29.341866 24467 raft_consensus.cc:2410] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:20:29.342737 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:29.343303 24467 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 14.
I20260709 12:20:29.344188 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:29.336486 29297 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:29.344900 29189 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:29.347074 29571 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:29.346943 24217 catalog_manager.cc:5697] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:29.349023 29573 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:29.349352 29636 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:29.350548 29635 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:29.324031 24471 rpcz_store.cc:276] 0709 12:20:27.721128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.721285 (+   157us) service_pool.cc:224] Handling call
0709 12:20:27.721641 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:29.322125 (+1600484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:29.323126 (+  1001us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b5400243954. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:29.323453 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3656131968}
I20260709 12:20:29.355295 24397 raft_consensus.cc:1240] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:29.355559 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:29.346946 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.360215 29632 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:29.360987 29632 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:29.355082 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:29.369087 25083 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:29.373350 29641 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.374185 29641 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:29.356472 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:29.384230 24393 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:29.353982 24217 catalog_manager.cc:5697] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:29.471855 24474 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 14.
I20260709 12:20:29.442689 29573 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:29.418797 29496 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:29.503938 24467 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:29.453156 29134 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:29.515131 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:29.445715 29571 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:20:29.560765 24391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.003s	sys 0.013s
W20260709 12:20:29.568161 24391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.004s	sys 0.013s
I20260709 12:20:29.512985 29361 raft_consensus.cc:2749] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:29.356870 29544 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:29.509011 29457 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:29.512498 29641 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:29.577148 24366 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.010s	sys 0.027s
W20260709 12:20:29.587738 24366 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.010s	sys 0.027s
W20260709 12:20:29.588127 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 590344us
I20260709 12:20:29.605772 24474 raft_consensus.cc:1240] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:29.604043 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 1108) took 1697 ms. Trace:
I20260709 12:20:29.602375 24394 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
W20260709 12:20:29.598573 24470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.009s	sys 0.019s
W20260709 12:20:29.630110 24470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.010s	sys 0.019s
I20260709 12:20:29.581542 29636 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:29.635854 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 498158us
I20260709 12:20:29.647118 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:29.599486 29308 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:29.599769 29037 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:29.590370 29573 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:29.688066 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 679712us
I20260709 12:20:29.692150 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:29.702044 29432 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:29.702944 29432 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:29.704713 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:29.705480 24396 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:29.706429 29629 consensus_meta.cc:287] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.793s	user 0.013s	sys 0.000s
I20260709 12:20:29.603018 29571 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:29.708791 29189 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:29.654054 29635 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:29.717612 24210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 308112us
W20260709 12:20:29.718636 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:29.719368 24472 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.015s	sys 0.013s
W20260709 12:20:29.719784 24472 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.015s	sys 0.013s
W20260709 12:20:29.721714 29229 consensus_meta.cc:287] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 1.381s	user 0.011s	sys 0.015s
I20260709 12:20:29.722232 29229 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:29.723683 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:29.690951 24291 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.228s	user 0.014s	sys 0.017s
I20260709 12:20:29.724609 24470 raft_consensus.cc:2468] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 17.
W20260709 12:20:29.725314 24291 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.449s	user 0.014s	sys 0.017s
W20260709 12:20:29.725852 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 1.44978e+06us
I20260709 12:20:29.726024 24217 catalog_manager.cc:5697] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 5 to 11, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 11 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:29.727703 29586 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:20:29.727981 24473 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.006s	sys 0.008s
W20260709 12:20:29.728422 24473 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.006s	sys 0.008s
I20260709 12:20:29.728485 29586 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:29.729264 29603 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.011s	sys 0.019s
W20260709 12:20:29.729760 29603 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.011s	sys 0.019s
I20260709 12:20:29.731299 29586 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:29.732084 29544 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:29.732892 29544 consensus_queue.cc:1048] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:20:29.734978 29664 consensus_meta.cc:287] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.758s	user 0.007s	sys 0.013s
I20260709 12:20:29.734912 29544 consensus_queue.cc:1048] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:29.735802 29648 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.736562 29648 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:29.742493 29696 log.cc:927] Time spent T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:20:29.743067 29648 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:29.687270 29403 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:29.746202 29356 consensus_meta.cc:287] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 1.328s	user 0.009s	sys 0.019s
I20260709 12:20:29.746836 29356 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:29.752688 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:29.753894 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.760670 29632 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:29.763336 24472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 1112) took 1207 ms. Trace:
W20260709 12:20:29.763844 24438 leader_election.cc:336] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.728s (SENT)
I20260709 12:20:29.763782 24472 rpcz_store.cc:276] 0709 12:20:28.556144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:28.556329 (+   185us) service_pool.cc:224] Handling call
0709 12:20:28.574287 (+ 17958us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:28.629263 (+ 54976us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:28.629304 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:28.642000 (+ 12696us) log.cc:844] Serialized 26 byte log entry
0709 12:20:29.720353 (+1078353us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:29.720422 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:29.720544 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:29.763022 (+ 42478us) raft_consensus.cc:1685] finished
0709 12:20:29.763056 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:29.763272 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":5845,"thread_start_us":980772,"threads_started":1,"wal-append.queue_time_us":1106033}
I20260709 12:20:29.765120 29626 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:29.766044 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:29.765843 29626 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:29.766723 24472 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
W20260709 12:20:29.782063 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 132561us
W20260709 12:20:29.783809 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:29.784508 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:29.784775 29524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.009s	sys 0.026s
W20260709 12:20:29.785224 29524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.009s	sys 0.026s
I20260709 12:20:29.786329 29625 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.787308 29573 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:29.787000 29625 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:29.785120 29297 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:29.788546 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.768250 29626 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:29.790364 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 98738.8us
W20260709 12:20:29.691154 29612 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.019s	sys 0.040s
I20260709 12:20:29.728116 24217 catalog_manager.cc:5697] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 3 to 8, leader changed from d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 8 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:29.817556 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.643406 29457 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:29.784621 29462 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.795074 29374 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:20:29.832182 29612 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.976s	user 0.019s	sys 0.041s
W20260709 12:20:29.850297 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 86667.6us
W20260709 12:20:29.833675 24210 catalog_manager.cc:4755] TS c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): ChangeConfig:REMOVE_PEER RPC failed for tablet 97dd30b21cc14958a91b2da522e4bbe9: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:29.876171 24210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 44803.5us
W20260709 12:20:29.888572 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.852614 29134 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.880072 24291 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:29.906818 24466 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.006s	sys 0.030s
W20260709 12:20:29.921469 24466 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.007s	sys 0.030s
I20260709 12:20:29.839330 29297 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:29.901269 29472 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:20:29.940853 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 208562us
I20260709 12:20:29.876605 29229 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:29.946760 29642 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:29.947512 29499 consensus_queue.cc:1048] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.130s
I20260709 12:20:29.949184 29432 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:29.957248 29636 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:29.920270 25084 consensus_peers.cc:597] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:29.854146 29462 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:29.968005 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 62690.2us
I20260709 12:20:29.877079 29457 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:30.135859 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 295846us
W20260709 12:20:30.139850 29471 consensus_meta.cc:287] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.810s	user 0.008s	sys 0.004s
I20260709 12:20:30.140411 29462 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:30.141341 29462 consensus_queue.cc:1048] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:30.145413 24217 catalog_manager.cc:5697] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 7 to 8, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 8 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:29.916342 29374 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:30.169538 29629 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:30.169823 29697 log.cc:927] Time spent T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
W20260709 12:20:30.175081 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:30.184069 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 77944us
I20260709 12:20:29.979609 29134 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:30.026309 24396 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 17.
W20260709 12:20:30.099736 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 219607us
W20260709 12:20:30.234259 29706 log.cc:927] Time spent T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.327s	user 0.002s	sys 0.000s
I20260709 12:20:30.234582 29356 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:30.235869 25084 consensus_peers.cc:597] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:30.213487 29405 consensus_meta.cc:287] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 1.104s	user 0.013s	sys 0.006s
I20260709 12:20:30.170411 29629 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:30.250694 29636 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:30.153777 29297 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:30.181180 29403 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:30.255832 25084 consensus_peers.cc:597] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:30.255928 29625 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:30.157920 29642 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:30.281965 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 45306us
I20260709 12:20:30.257668 29374 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:30.258185 29639 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:30.158486 29211 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.251688 29646 raft_consensus.cc:2749] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:30.249429 29229 consensus_queue.cc:1048] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:30.271759 24471 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
W20260709 12:20:30.277383 29532 consensus_meta.cc:287] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.999s	user 0.004s	sys 0.015s
W20260709 12:20:30.293457 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:30.294384 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:30.299182 25084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:30.306770 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.320251 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:30.314886 25084 consensus_peers.cc:597] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:30.322223 29211 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:30.322803 25084 consensus_peers.cc:597] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:30.323452 25084 consensus_peers.cc:597] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:30.323904 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:30.324534 25084 consensus_peers.cc:597] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:30.331248 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:30.285799 24217 catalog_manager.cc:5697] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 4 to 9, leader changed from d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 9 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:30.324791 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:30.340142 25084 consensus_peers.cc:597] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:30.326891 25083 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:30.338104 24398 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
I20260709 12:20:30.315459 29612 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:30.288779 29403 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:30.348572 25084 leader_election.cc:336] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:30.349442 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 255055us
I20260709 12:20:30.327049 29211 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:30.356350 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:30.319761 29603 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:20:30.361846 25084 leader_election.cc:336] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:30.336462 29532 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:20:30.371176 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 466074us
W20260709 12:20:30.364298 29634 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.011s	sys 0.019s
I20260709 12:20:30.374559 24391 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:20:30.372210 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:30.374017 24467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.014s	sys 0.015s
W20260709 12:20:30.389211 24467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.014s	sys 0.015s
W20260709 12:20:30.393420 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 133771us
I20260709 12:20:30.399036 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:30.381783 29634 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.011s	sys 0.020s
W20260709 12:20:30.395713 25084 leader_election.cc:336] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:30.402526 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:30.410694 24393 raft_consensus.cc:1240] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 10. Current term is 11. Ops: []
W20260709 12:20:30.417268 25081 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.012s	sys 0.011s
W20260709 12:20:30.417656 25081 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.012s	sys 0.012s
I20260709 12:20:30.418442 29629 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:30.405730 29603 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:30.415726 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:30.420965 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 104973us
I20260709 12:20:30.424321 24398 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 14.
I20260709 12:20:30.429894 29405 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.430703 29405 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:30.431432 29721 log.cc:927] Time spent T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:20:30.399364 29588 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:30.433379 29405 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:30.433175 29588 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:30.433821 24217 catalog_manager.cc:5697] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:30.435611 29588 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:30.437153 29585 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:30.437538 29464 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.438192 29464 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:30.439857 29727 log.cc:927] Time spent T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.293s	user 0.002s	sys 0.000s
I20260709 12:20:30.440083 24396 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 15.
I20260709 12:20:30.440909 29134 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:30.408479 29462 raft_consensus.cc:2804] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:30.375252 29612 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:30.409519 29457 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:30.366560 29639 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:30.448707 24400 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
I20260709 12:20:30.459339 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2408) took 1339 ms. Trace:
I20260709 12:20:30.462994 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:30.464005 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:30.465286 24217 catalog_manager.cc:5697] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:30.467185 29734 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.407634 29532 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:30.468430 29571 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:30.474730 24474 rpcz_store.cc:276] 0709 12:20:29.120400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.644828 (+524428us) service_pool.cc:224] Handling call
0709 12:20:29.672543 (+ 27715us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:29.738163 (+ 65620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:29.738205 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:29.826281 (+ 88076us) log.cc:844] Serialized 26 byte log entry
0709 12:20:30.283870 (+457589us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:30.283924 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:30.283987 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:30.458979 (+174992us) raft_consensus.cc:1685] finished
0709 12:20:30.459018 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:30.459240 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9829,"raft.queue_time_us":232456,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":34360,"thread_start_us":374406,"threads_started":1,"wal-append.queue_time_us":574919}
I20260709 12:20:30.489599 29603 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:30.491771 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:30.450479 29462 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:30.493098 29462 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:30.494242 29639 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:30.495426 29472 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:30.495921 29472 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:30.496307 29457 consensus_queue.cc:1048] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:20:30.499691 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 70556.6us
I20260709 12:20:30.492549 24394 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:30.503788 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:30.506364 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:30.507244 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:30.507783 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:30.509552 24398 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:30.508512 24396 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:30.514001 24400 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:30.515614 24217 catalog_manager.cc:5697] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:30.519521 29229 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.483093 29464 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:30.520130 29229 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:30.537446 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:30.538879 29229 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:30.539485 29698 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:30.539772 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:30.546936 29403 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:29.610003 24469 rpcz_store.cc:276] 0709 12:20:27.906816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.973816 (+ 67000us) service_pool.cc:224] Handling call
0709 12:20:27.974173 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:27.974462 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:20:28.999988 (+1025526us) log.cc:844] Serialized 14 byte log entry
0709 12:20:29.510466 (+510478us) log.cc:844] Serialized 14 byte log entry
0709 12:20:29.513922 (+  3456us) log.cc:844] Serialized 14 byte log entry
0709 12:20:29.563630 (+ 49708us) log.cc:844] Serialized 14 byte log entry
0709 12:20:29.573946 (+ 10316us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:29.580258 (+  6312us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:29.580333 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:29.592714 (+ 12381us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:29.603971 (+ 11257us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3056,"prepare.queue_time_us":902365,"prepare.run_cpu_time_us":161,"prepare.run_wall_time_us":165,"raft.queue_time_us":55647,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":34647,"thread_start_us":1407105,"threads_started":2,"wal-append.queue_time_us":587882}
I20260709 12:20:30.547953 24291 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:30.551229 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 1117) took 1509 ms. Trace:
I20260709 12:20:30.552994 29571 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:30.553965 29571 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:30.554486 29639 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:30.561156 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:30.529567 24217 catalog_manager.cc:5697] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 4 to 9, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 9 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:30.568876 24393 raft_consensus.cc:2410] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:20:30.569111 24474 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 14.
I20260709 12:20:30.551748 24465 rpcz_store.cc:276] 0709 12:20:29.042094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.118921 (+ 76827us) service_pool.cc:224] Handling call
0709 12:20:29.119234 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:29.418132 (+298898us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:29.418176 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:29.512327 (+ 94151us) log.cc:844] Serialized 26 byte log entry
0709 12:20:29.825630 (+313303us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:29.825697 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:30.550747 (+725050us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54000339d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:30.550805 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:30.550867 (+    62us) raft_consensus.cc:1685] finished
0709 12:20:30.550881 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:30.551144 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65564,"raft.queue_time_us":160379,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":42736,"spinlock_wait_cycles":535482112,"thread_start_us":237759,"threads_started":1,"wal-append.queue_time_us":734748}
I20260709 12:20:30.573966 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:30.523933 29734 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:30.540338 29698 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:30.532459 29636 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:30.532740 29297 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:30.580725 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:30.576764 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:30.590734 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:30.586854 25084 leader_election.cc:336] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:30.599282 25083 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:30.599002 24469 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 15.
W20260709 12:20:30.575626 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 44502.2us
I20260709 12:20:30.576424 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:30.603648 24396 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:30.604840 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:30.606137 24400 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 11: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:30.604827 24465 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:20:30.534137 29457 consensus_queue.cc:1059] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.068s
I20260709 12:20:30.568444 29639 raft_consensus.cc:697] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 14 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:30.614917 24470 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 14.
I20260709 12:20:30.578729 29729 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.581913 29532 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:30.620575 24474 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 11: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:30.607206 29648 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:30.638031 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:30.656308 24469 raft_consensus.cc:2393] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 15: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:30.661204 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:30.662145 24469 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 10.
I20260709 12:20:30.663317 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:30.664021 24469 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
I20260709 12:20:30.668203 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:30.669588 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:30.633862 29605 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:30.608836 29297 consensus_queue.cc:1048] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:20:30.666116 29229 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:30.679517 29571 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:30.688436 24438 leader_election.cc:336] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.243s (SENT)
I20260709 12:20:30.690927 24470 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 16.
I20260709 12:20:30.695545 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:30.696138 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.696573 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:30.697887 24469 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 13.
I20260709 12:20:30.665212 29729 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:30.705243 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:30.707129 24470 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:30.706444 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:30.725905 25115 raft_consensus.cc:2410] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:20:30.728879 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:30.729583 24469 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 14.
I20260709 12:20:30.701095 29532 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:30.729096 24474 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 12.
I20260709 12:20:30.698959 29229 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:30.738080 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:30.684698 29605 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:30.729388 29735 log.cc:927] Time spent T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.214s	user 0.001s	sys 0.001s
I20260709 12:20:30.742334 25112 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 15.
W20260709 12:20:30.750286 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 46168.8us
I20260709 12:20:30.698616 29472 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:30.756165 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 269469us
I20260709 12:20:30.726925 29612 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:30.753645 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:30.759999 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:30.760998 24474 raft_consensus.cc:2410] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:20:30.758105 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:30.759534 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 71166us
I20260709 12:20:30.762480 24469 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:20:30.765409 25115 raft_consensus.cc:2410] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:20:30.696049 29639 consensus_queue.cc:237] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:30.767094 29698 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:30.774237 29733 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:30.775252 29737 log.cc:927] Time spent T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:20:30.775065 29733 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:30.776365 29736 log.cc:927] Time spent T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:20:30.777052 24472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2412) took 1500 ms. Trace:
I20260709 12:20:30.777480 24472 rpcz_store.cc:276] 0709 12:20:29.291416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.776108 (+1484692us) service_pool.cc:224] Handling call
0709 12:20:30.776460 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:30.776684 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:30.776710 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:30.776758 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:30.776799 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:30.776862 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:30.776971 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:30.782110 29728 log.cc:927] Time spent T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.637s	user 0.001s	sys 0.001s
W20260709 12:20:30.789732 29730 log.cc:927] Time spent T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:20:30.791136 24467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2407) took 1671 ms. Trace:
I20260709 12:20:30.791613 24467 rpcz_store.cc:276] 0709 12:20:29.120040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.559375 (+439335us) service_pool.cc:224] Handling call
0709 12:20:29.591584 (+ 32209us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:29.738763 (+147179us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:29.738806 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:29.828302 (+ 89496us) log.cc:844] Serialized 26 byte log entry
0709 12:20:30.389640 (+561338us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:30.389685 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:30.389763 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:30.790857 (+401094us) raft_consensus.cc:1685] finished
0709 12:20:30.790883 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:30.791062 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":191654,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":57747,"thread_start_us":527822,"threads_started":1,"wal-append.queue_time_us":766900}
I20260709 12:20:30.793421 29229 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:30.793883 24467 raft_consensus.cc:1275] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:20:30.794162 29631 raft_consensus.cc:3055] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:30.794518 29631 raft_consensus.cc:740] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:30.794629 24467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2416) took 1346 ms. Trace:
I20260709 12:20:30.794981 24467 rpcz_store.cc:276] 0709 12:20:29.468189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.793174 (+1324985us) service_pool.cc:224] Handling call
0709 12:20:30.793525 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:30.794354 (+   829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:30.794578 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:30.795396 29631 consensus_queue.cc:260] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:30.796860 29722 log.cc:927] Time spent T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.199s	user 0.001s	sys 0.001s
I20260709 12:20:30.798498 29648 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.799268 29648 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:30.803655 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2421) took 1092 ms. Trace:
I20260709 12:20:30.804066 24468 rpcz_store.cc:276] 0709 12:20:29.711205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.802785 (+1091580us) service_pool.cc:224] Handling call
0709 12:20:30.803096 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:30.803372 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:30.803396 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:30.803433 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:30.803465 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:30.803514 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:30.803604 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:30.805696 24468 raft_consensus.cc:1240] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:20:30.772161 29626 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.807025 29626 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:30.809571 29709 log.cc:927] Time spent T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.672s	user 0.003s	sys 0.000s
I20260709 12:20:30.813736 29605 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:30.815364 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:30.816586 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:30.817481 24473 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 14.
W20260709 12:20:30.798666 24471 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33272 (request call id 2415) took 1455 ms (client timeout 1674 ms). Trace:
W20260709 12:20:30.821810 24471 rpcz_store.cc:269] 0709 12:20:29.342854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.355241 (+ 12387us) service_pool.cc:224] Handling call
0709 12:20:30.798463 (+1443222us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b54000fd2d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:30.798574 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2105048320}
I20260709 12:20:30.828357 24394 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 15.
W20260709 12:20:30.834383 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 63004.6us
I20260709 12:20:30.834679 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:30.835469 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:30.836190 25110 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 10.
W20260709 12:20:30.837019 29735 log.cc:927] Time spent T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:20:30.745483 29532 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:30.841289 24474 raft_consensus.cc:1240] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:30.845837 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:30.842068 24438 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:30.851430 29631 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:30.852243 29492 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:30.854813 29642 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:30.861810 25083 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:30.862920 25083 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:30.860116 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:30.868620 24474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 1119) took 1721 ms. Trace:
I20260709 12:20:30.863745 25083 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:30.869395 24474 rpcz_store.cc:276] 0709 12:20:29.128582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.773795 (+1645213us) service_pool.cc:224] Handling call
0709 12:20:30.841046 (+ 67251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:30.849907 (+  8861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:30.850136 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:30.872982 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 99209.5us
I20260709 12:20:30.871094 24289 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:30.874011 25083 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:30.765298 29462 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:30.881110 24289 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:30.832249 29626 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:30.885233 24469 raft_consensus.cc:1240] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:30.897604 25083 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:20:30.898254 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.903041 25083 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:30.903215 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:30.909175 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2409) took 1788 ms. Trace:
I20260709 12:20:30.909655 24469 rpcz_store.cc:276] 0709 12:20:29.130148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.771565 (+1641417us) service_pool.cc:224] Handling call
0709 12:20:30.847690 (+ 76125us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:30.908883 (+ 61193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:30.909104 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:30.902216 29625 raft_consensus.cc:2804] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:30.912443 25083 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:30.904134 25115 raft_consensus.cc:2376] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12. Re-sending same reply.
I20260709 12:20:30.874094 29642 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:30.919601 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:30.883368 29134 raft_consensus.cc:2804] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:30.897735 29605 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:30.897429 29457 raft_consensus.cc:2804] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:30.921756 25118 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:30.908048 29492 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:30.929006 29729 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:30.931869 29742 raft_consensus.cc:2804] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:30.936810 29742 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.937299 29742 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:30.938189 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.921346 29642 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.939232 29642 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:30.934454 24289 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:30.912618 29586 raft_consensus.cc:2804] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:30.912899 29629 raft_consensus.cc:2804] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:30.912328 29625 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.928443 24438 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:30.926888 29605 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.920269 29432 raft_consensus.cc:2804] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:30.932621 29492 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.950961 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:30.927263 29134 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.930480 29457 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.968168 24470 raft_consensus.cc:2468] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 14.
I20260709 12:20:30.952301 29586 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.972568 24470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33198 (request call id 1120) took 1046 ms. Trace:
I20260709 12:20:30.962248 29432 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:30.977149 29432 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:30.978185 29648 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:30.951742 29629 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:30.979166 29629 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:30.962515 29605 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:30.959595 29625 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:30.973127 24470 rpcz_store.cc:276] 0709 12:20:29.926049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.695181 (+769132us) service_pool.cc:224] Handling call
0709 12:20:30.972484 (+277303us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:30.966560 29356 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:30.966090 29492 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:30.971061 29134 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:30.989248 29457 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:30.985198 29586 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:31.034730 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 270530us
I20260709 12:20:31.041813 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:31.033850 29496 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:31.053002 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 139669us
I20260709 12:20:31.057229 29356 raft_consensus.cc:697] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 17 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:31.058696 29356 consensus_queue.cc:237] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:31.065608 25113 raft_consensus.cc:1240] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:20:31.067212 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:31.027554 29532 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:31.073747 25083 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:31.102355 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:31.103829 25110 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:31.131871 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:31.134565 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:20:31.155589 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.162981 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:31.165505 24392 raft_consensus.cc:1240] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:31.166911 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:31.167771 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:31.168957 25111 raft_consensus.cc:2410] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:20:31.169318 24394 raft_consensus.cc:1240] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:31.169957 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:31.170652 29464 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.170922 29472 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:31.171370 29464 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:31.174551 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:31.175737 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:31.167886 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:31.176723 29714 log.cc:927] Time spent T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 1.034s	user 0.004s	sys 0.005s
I20260709 12:20:31.178215 24466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2402) took 2160 ms. Trace:
I20260709 12:20:31.178567 24466 rpcz_store.cc:276] 0709 12:20:29.017855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.020978 (+  3123us) service_pool.cc:224] Handling call
0709 12:20:29.021703 (+   725us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:29.022441 (+   738us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:29.022497 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:29.023183 (+   686us) log.cc:844] Serialized 26 byte log entry
0709 12:20:29.935683 (+912500us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:29.935746 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:29.935829 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:31.138385 (+1202556us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:20:31.177912 (+ 39527us) raft_consensus.cc:1685] finished
0709 12:20:31.177933 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:31.178152 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115734,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":193,"spinlock_wait_cycles":37054848,"thread_start_us":898241,"threads_started":1,"wal-append.queue_time_us":1097827}
I20260709 12:20:31.181234 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:31.181712 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:20:31.181948 29748 log.cc:927] Time spent T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:20:31.182319 24392 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:31.184187 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:31.185042 24399 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 11: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:31.185976 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:31.189028 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:31.190793 29733 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:31.123106 29229 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:31.193013 29229 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:31.195070 24472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2413) took 1853 ms. Trace:
I20260709 12:20:31.195729 29229 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:31.130579 29532 raft_consensus.cc:2804] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:31.197360 29734 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:31.199035 24391 raft_consensus.cc:2410] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:20:31.176363 24465 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:31.200675 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:31.126693 29462 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:31.201550 24465 raft_consensus.cc:2393] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 13: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:31.163990 29496 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:31.202404 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:31.202353 29496 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:31.202994 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:31.200943 29612 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:31.203645 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:31.203874 29612 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:31.195523 24472 rpcz_store.cc:276] 0709 12:20:29.342158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.778434 (+1436276us) service_pool.cc:224] Handling call
0709 12:20:30.778796 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:30.779237 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:30.779271 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:30.779768 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 12:20:30.959743 (+179975us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:30.960999 (+  1256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:30.961446 (+   447us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:31.194818 (+233372us) raft_consensus.cc:1685] finished
0709 12:20:31.194850 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:31.194989 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5948,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":107,"thread_start_us":177378,"threads_started":1,"wal-append.queue_time_us":413105}
I20260709 12:20:31.205813 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:31.180472 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:31.206467 24465 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
I20260709 12:20:31.181986 25114 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:20:31.224865 25111 raft_consensus.cc:2393] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 15: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
W20260709 12:20:31.225531 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 60741.4us
I20260709 12:20:31.226200 25083 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:31.230254 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:31.231180 24396 raft_consensus.cc:2393] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 15: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:31.232365 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:31.226244 24392 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:31.236003 24395 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 15.
I20260709 12:20:31.237977 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:31.238129 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:31.239128 24470 raft_consensus.cc:2376] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 17. Re-sending same reply.
I20260709 12:20:31.239039 24472 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 10.
I20260709 12:20:31.243875 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:31.246219 24395 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:31.246965 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:31.248183 24470 raft_consensus.cc:2393] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 11: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:31.249264 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:31.250003 24470 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:31.262476 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:31.268718 25083 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:31.232682 29464 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:31.268900 25082 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:31.233038 29532 raft_consensus.cc:697] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:31.285595 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:31.288499 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:31.291917 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:31.264099 29734 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:31.305933 29734 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:31.306388 29734 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:31.308130 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:31.309152 24392 raft_consensus.cc:2393] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 15: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:31.297216 24466 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 11: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:31.303020 25111 raft_consensus.cc:1240] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:31.304755 29432 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:31.316546 25112 raft_consensus.cc:1240] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:31.285472 29648 raft_consensus.cc:2804] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:31.286743 29229 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:20:31.363266 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 52769.2us
I20260709 12:20:31.367457 24470 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 15.
W20260709 12:20:31.369959 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 101154us
W20260709 12:20:31.373195 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 48365.5us
I20260709 12:20:31.371692 25082 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:31.325750 29648 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.382026 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:31.325671 29753 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:31.307235 29742 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:31.379015 29464 raft_consensus.cc:2804] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:31.406092 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:31.408138 24395 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:31.387763 29648 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:31.390287 29229 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:31.415880 29754 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:31.416461 29754 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:31.417017 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:31.417668 29229 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:31.418434 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:31.418603 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:31.419126 24394 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:31.419821 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:31.420854 25110 raft_consensus.cc:2368] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 14. Current term is 15.
I20260709 12:20:31.426120 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:31.427644 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:31.428459 24396 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
I20260709 12:20:31.420051 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:31.405819 29733 raft_consensus.cc:2804] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:31.436964 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:31.437868 24400 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:31.439967 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:31.441767 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:31.426970 24393 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
I20260709 12:20:31.407655 29464 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.402982 29753 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:31.499853 24391 raft_consensus.cc:2393] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 12: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:31.447856 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:31.450770 29432 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:31.451541 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:31.452457 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:31.500619 24400 raft_consensus.cc:2376] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11. Re-sending same reply.
I20260709 12:20:31.418618 29754 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:31.455397 29756 log.cc:927] Time spent T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:20:31.402227 29532 consensus_queue.cc:237] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:31.477968 29496 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:31.487699 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:31.444092 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:31.498400 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:31.393005 29457 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:31.505388 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:31.453320 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:31.537444 24397 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:31.541868 24394 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 11: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:31.508420 24392 raft_consensus.cc:2410] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:20:31.403560 29586 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
W20260709 12:20:31.511013 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 139403us
I20260709 12:20:31.507351 24393 raft_consensus.cc:2376] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 15. Re-sending same reply.
I20260709 12:20:31.519069 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:31.525653 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:31.513797 29625 consensus_meta.cc:287] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.001s
I20260709 12:20:31.501436 29464 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:31.444796 29733 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:31.537298 24399 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:31.545403 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:31.445238 29134 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:31.550344 29639 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.020s	sys 0.036s
W20260709 12:20:31.573848 29639 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.020s	sys 0.036s
I20260709 12:20:31.575150 24473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2494) took 1149 ms. Trace:
I20260709 12:20:31.575675 24473 rpcz_store.cc:276] 0709 12:20:30.425357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.818369 (+393012us) service_pool.cc:224] Handling call
0709 12:20:30.818817 (+   448us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:30.843313 (+ 24496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:30.843363 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:30.882154 (+ 38791us) log.cc:844] Serialized 52 byte log entry
0709 12:20:31.274041 (+391887us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:31.302322 (+ 28281us) log.cc:844] Serialized 14 byte log entry
0709 12:20:31.302984 (+   662us) log.cc:844] Serialized 14 byte log entry
0709 12:20:31.303392 (+   408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:31.303468 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:31.574854 (+271386us) raft_consensus.cc:1685] finished
0709 12:20:31.574877 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:31.575069 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15043,"prepare.queue_time_us":268555,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":95,"raft.queue_time_us":30508,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":275,"thread_start_us":350785,"threads_started":1,"wal-append.queue_time_us":663073}
I20260709 12:20:31.578711 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:31.580024 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:31.552193 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:31.582443 24396 raft_consensus.cc:2393] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 15: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:31.555028 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:31.584034 24397 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:31.562783 24400 raft_consensus.cc:2410] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 12:20:31.568974 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.572350 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2490) took 1239 ms. Trace:
I20260709 12:20:31.580895 24473 raft_consensus.cc:2393] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 14: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:31.557703 24472 raft_consensus.cc:2393] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 15: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:20:31.546005 24289 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.015s	sys 0.017s
W20260709 12:20:31.592792 24289 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.016s	sys 0.018s
I20260709 12:20:31.561041 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:31.593685 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 566942us
I20260709 12:20:31.594147 24470 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
I20260709 12:20:31.547073 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:31.580915 24469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.030s	sys 0.045s
W20260709 12:20:31.595268 24469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.030s	sys 0.045s
I20260709 12:20:31.492312 29642 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:31.594571 24289 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:20:31.598711 24291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.024s	sys 0.014s
W20260709 12:20:31.606074 24291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.024s	sys 0.015s
I20260709 12:20:31.588524 24468 rpcz_store.cc:276] 0709 12:20:30.332787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.806646 (+473859us) service_pool.cc:224] Handling call
0709 12:20:30.807003 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:30.823879 (+ 16876us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:30.823974 (+    95us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:30.851090 (+ 27116us) log.cc:844] Serialized 26 byte log entry
0709 12:20:31.305472 (+454382us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:31.305818 (+   346us) log.cc:844] Serialized 14 byte log entry
0709 12:20:31.306310 (+   492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:31.306383 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:31.572143 (+265760us) raft_consensus.cc:1685] finished
0709 12:20:31.572165 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:31.572292 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10113,"prepare.queue_time_us":105007,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":7943,"raft.queue_time_us":22336,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":6180,"thread_start_us":396048,"threads_started":1,"wal-append.queue_time_us":688109}
W20260709 12:20:31.608839 24474 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.013s	sys 0.024s
W20260709 12:20:31.615244 24474 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.013s	sys 0.024s
I20260709 12:20:31.615465 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:31.591791 29733 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:31.621346 25110 raft_consensus.cc:2368] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 14. Current term is 15.
I20260709 12:20:31.580871 29612 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:31.552451 29496 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.573256 29134 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:31.571211 29753 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:31.612784 29639 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:31.655251 29639 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.655887 29639 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:31.657306 25111 raft_consensus.cc:1240] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:31.657163 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:31.658599 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:31.659363 25111 raft_consensus.cc:2393] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 15: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:31.660100 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:31.660476 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:31.661280 25110 raft_consensus.cc:2393] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 13: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:31.662045 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:31.664832 29496 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:31.667296 29496 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:31.668021 29496 consensus_queue.cc:1059] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:31.647994 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:31.670404 24473 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:31.671034 25118 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.000s	sys 0.030s
W20260709 12:20:31.671581 25118 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.000s	sys 0.031s
I20260709 12:20:31.558391 29571 consensus_queue.cc:1059] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.076s
W20260709 12:20:31.625633 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 469765us
I20260709 12:20:31.663163 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:31.648407 24289 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:31.582206 29625 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:31.627817 24290 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.020s	sys 0.014s
I20260709 12:20:31.675765 24289 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:20:31.678067 24290 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.020s	sys 0.014s
W20260709 12:20:31.678442 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 718159us
W20260709 12:20:31.672369 25115 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.007s	sys 0.018s
W20260709 12:20:31.682765 25115 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.007s	sys 0.018s
I20260709 12:20:31.646160 29742 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:31.670477 29605 consensus_meta.cc:287] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.690s	user 0.010s	sys 0.002s
I20260709 12:20:31.705310 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:31.705892 24366 consensus_peers.cc:597] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:31.708330 24289 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:20:31.712698 24366 consensus_peers.cc:597] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:31.714923 25116 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.010s	sys 0.029s
I20260709 12:20:31.688977 29571 consensus_queue.cc:1243] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer c855242ec9d34a5397741ef20db9de8a log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:20:31.718145 25116 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.011s	sys 0.029s
I20260709 12:20:31.676478 29631 raft_consensus.cc:2804] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:31.718619 25111 raft_consensus.cc:2368] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 15. Current term is 16.
W20260709 12:20:31.719383 24366 consensus_peers.cc:597] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:31.709345 29492 consensus_meta.cc:287] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.656s	user 0.007s	sys 0.007s
I20260709 12:20:31.721935 29631 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.725710 29646 raft_consensus.cc:2804] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:31.727104 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:31.715202 29605 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:31.734143 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:31.738356 29631 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:31.746832 25116 raft_consensus.cc:2368] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 14. Current term is 15.
I20260709 12:20:31.747320 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:31.748088 24468 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:31.767899 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:31.768597 25116 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:31.768882 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 43957.6us
W20260709 12:20:31.774646 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:31.777032 24366 consensus_peers.cc:597] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:31.777654 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 57352.4us
I20260709 12:20:31.779493 24397 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 15.
I20260709 12:20:31.738863 29646 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:31.790158 25119 raft_consensus.cc:2393] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 17: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
W20260709 12:20:31.792004 24366 consensus_peers.cc:597] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:31.800658 24366 leader_election.cc:336] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:31.801546 24366 leader_election.cc:336] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:31.767690 29571 raft_consensus.cc:3055] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:31.809861 25112 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:31.813268 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:31.745605 29492 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:31.818012 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:31.798761 29646 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:31.820729 24366 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:31.818543 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:31.828151 24472 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
I20260709 12:20:31.845574 24365 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:31.808598 29571 raft_consensus.cc:740] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:31.885993 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:31.821751 29457 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:31.858589 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 304022us
I20260709 12:20:31.833930 29588 raft_consensus.cc:2804] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:31.860092 29229 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.897969 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:31.861392 29586 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:31.897002 24469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 1132) took 1196 ms. Trace:
I20260709 12:20:31.912873 24469 rpcz_store.cc:276] 0709 12:20:30.700809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.964553 (+263744us) service_pool.cc:224] Handling call
0709 12:20:31.023873 (+ 59320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:31.024146 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:20:31.035252 (+ 11106us) log.cc:844] Serialized 14 byte log entry
0709 12:20:31.896355 (+861103us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:31.896479 (+   124us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:31.896549 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:31.896689 (+   140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:31.896911 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14734,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":27898,"raft.queue_time_us":137369,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":20512,"thread_start_us":844379,"threads_started":2,"wal-append.queue_time_us":838974}
I20260709 12:20:31.876216 29642 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:31.923377 24465 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.028s	sys 0.040s
W20260709 12:20:31.923774 24465 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.028s	sys 0.040s
I20260709 12:20:31.923426 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:31.876518 29612 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.924806 25112 raft_consensus.cc:2393] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 12: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:31.928170 24474 raft_consensus.cc:1240] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:31.896862 29588 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.934716 24440 leader_election.cc:400] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 14. Current term is 15.
I20260709 12:20:31.935230 24440 leader_election.cc:403] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:20:31.911656 29764 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:31.945637 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:31.930750 29753 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:31.931767 29588 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:31.906909 24438 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:31.952899 29625 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:31.954101 29771 log.cc:927] Time spent T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 12:20:31.959342 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:31.960053 24474 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Advancing to term 16
W20260709 12:20:31.965269 29770 log.cc:927] Time spent T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:20:31.965574 29496 raft_consensus.cc:3055] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:31.966281 29496 raft_consensus.cc:740] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:31.967013 25118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 1445) took 1014 ms. Trace:
I20260709 12:20:31.923100 29229 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
W20260709 12:20:31.973227 29767 log.cc:927] Time spent T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:20:31.973555 29229 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:20:31.974166 29229 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:31.974514 29229 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.974856 29229 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:31.978206 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:31.980940 29763 log.cc:927] Time spent T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.159s	user 0.000s	sys 0.002s
I20260709 12:20:31.966313 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:31.982492 24469 raft_consensus.cc:3060] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 15
W20260709 12:20:31.983067 29757 log.cc:927] Time spent T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.277s	user 0.005s	sys 0.000s
I20260709 12:20:31.930750 29612 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:31.986747 29755 log.cc:927] Time spent T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.270s	user 0.000s	sys 0.002s
W20260709 12:20:31.986891 29761 log.cc:927] Time spent T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 12:20:31.989050 29605 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 17 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:31.991267 29629 consensus_meta.cc:287] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 1.011s	user 0.011s	sys 0.003s
I20260709 12:20:31.967423 25118 rpcz_store.cc:276] 0709 12:20:30.955075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.962936 (+  7861us) service_pool.cc:224] Handling call
0709 12:20:30.983354 (+ 20418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:30.983842 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:30.983884 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:30.996256 (+ 12372us) log.cc:844] Serialized 26 byte log entry
0709 12:20:31.672120 (+675864us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:31.711398 (+ 39278us) log.cc:844] Serialized 14 byte log entry
0709 12:20:31.720577 (+  9179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:31.720705 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:31.966788 (+246083us) raft_consensus.cc:1685] finished
0709 12:20:31.966810 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:31.966933 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39810,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":58490,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":6832,"thread_start_us":599485,"threads_started":1,"wal-append.queue_time_us":772539}
I20260709 12:20:31.993809 29571 consensus_queue.cc:260] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:32.049407 25115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 1446) took 1063 ms. Trace:
I20260709 12:20:32.002532 29229 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:32.008103 29492 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:32.036964 29734 consensus_meta.cc:287] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.665s	user 0.011s	sys 0.001s
I20260709 12:20:31.972967 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:32.019294 24474 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 16.
I20260709 12:20:32.023034 24468 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 15.
I20260709 12:20:32.073498 24473 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 12.
I20260709 12:20:32.035744 25116 raft_consensus.cc:2468] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
W20260709 12:20:32.033397 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 73356.1us
I20260709 12:20:32.048007 24291 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:31.967618 29496 consensus_queue.cc:260] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:31.998771 29639 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:32.123977 25083 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:32.009361 29764 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:32.085394 29765 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:20:32.052659 29777 log.cc:927] Time spent T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.060s	user 0.001s	sys 0.001s
I20260709 12:20:32.086760 24291 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:32.090416 29612 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:32.092743 29646 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:32.152746 29646 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:32.053622 29629 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:32.046327 29648 consensus_meta.cc:287] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.546s	user 0.003s	sys 0.007s
I20260709 12:20:32.154207 25117 raft_consensus.cc:1240] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:32.154106 29648 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:32.155225 29629 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:32.156214 29571 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:32.094295 24467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2420) took 2383 ms. Trace:
I20260709 12:20:32.157698 25117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 1452) took 1094 ms. Trace:
I20260709 12:20:32.158048 25110 raft_consensus.cc:2368] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12.
I20260709 12:20:32.158123 25117 rpcz_store.cc:276] 0709 12:20:31.063576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.070485 (+  6909us) service_pool.cc:224] Handling call
0709 12:20:31.070877 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:32.154925 (+1084048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:32.157434 (+  2509us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400709ed4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:32.157630 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2490614528}
I20260709 12:20:32.095611 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2495) took 1659 ms. Trace:
I20260709 12:20:32.160995 29781 raft_consensus.cc:2749] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 14. Current term is 15.
I20260709 12:20:32.159804 24471 rpcz_store.cc:276] 0709 12:20:30.436518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.823209 (+386691us) service_pool.cc:224] Handling call
0709 12:20:30.837136 (+ 13927us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:30.867637 (+ 30501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:30.867680 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:30.909201 (+ 41521us) log.cc:844] Serialized 26 byte log entry
0709 12:20:31.374101 (+464900us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:31.374139 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:31.374204 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:32.095350 (+721146us) raft_consensus.cc:1685] finished
0709 12:20:32.095384 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:32.095546 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7400,"raft.queue_time_us":12046,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":172,"thread_start_us":424555,"threads_started":1,"wal-append.queue_time_us":732834}
I20260709 12:20:32.106631 29229 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:32.162060 29781 raft_consensus.cc:2804] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:32.162611 29781 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:32.163121 29781 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:32.045948 29766 log.cc:927] Time spent T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
W20260709 12:20:32.117393 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 395703us
I20260709 12:20:32.129088 25083 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:20:32.167951 29733 consensus_meta.cc:287] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.519s	user 0.007s	sys 0.003s
I20260709 12:20:32.168315 24289 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:32.168459 29733 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:32.168851 25083 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:32.170836 29733 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:32.171485 29733 raft_consensus.cc:2804] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:20:32.133682 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 47096.2us
I20260709 12:20:32.134526 29642 raft_consensus.cc:2804] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:20:32.117059 29757 log.cc:927] Time spent T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:20:32.112524 29464 consensus_meta.cc:287] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.000s
I20260709 12:20:32.137698 29780 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.140854 29586 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:32.142720 29639 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:32.130551 29765 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.172482 24291 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:32.176255 25083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.156925 24467 rpcz_store.cc:276] 0709 12:20:29.710836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.795790 (+1084954us) service_pool.cc:224] Handling call
0709 12:20:30.796111 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:30.797258 (+  1147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:30.797374 (+   116us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:30.799405 (+  2031us) log.cc:844] Serialized 26 byte log entry
0709 12:20:31.285960 (+486555us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:31.769520 (+483560us) log.cc:844] Serialized 14 byte log entry
0709 12:20:31.769767 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:31.769845 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:31.985984 (+216139us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:20:32.093928 (+107944us) raft_consensus.cc:1685] finished
0709 12:20:32.094061 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:32.094219 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21968,"prepare.queue_time_us":192499,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":348292,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":17223,"spinlock_wait_cycles":46486272,"thread_start_us":892255,"threads_started":2,"wal-append.queue_time_us":825814}
I20260709 12:20:32.185002 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:32.185361 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:32.081645 25115 rpcz_store.cc:276] 0709 12:20:30.985727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.027129 (+ 41402us) service_pool.cc:224] Handling call
0709 12:20:31.039870 (+ 12741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:31.071136 (+ 31266us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:20:31.071528 (+   392us) log.cc:844] Serialized 14 byte log entry
0709 12:20:31.941102 (+869574us) log.cc:844] Serialized 14 byte log entry
0709 12:20:31.970364 (+ 29262us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b18003f8f20. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9425f522 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd 0000000000388634 0000000000388479 00007f4a9424283a
0709 12:20:31.985047 (+ 14683us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b18003f8f20. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9425f3f3 00007f4a942617c1 00007f4a94261779 00007f4a94261709 00007f4a942616d1 00007f4a942609cd 0000000000388634 0000000000388479 00007f4a9424283a
0709 12:20:32.031489 (+ 46442us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:32.031567 (+    78us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:32.031642 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:32.049136 (+ 17494us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:32.049322 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109111,"prepare.queue_time_us":42218,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":86,"raft.queue_time_us":95449,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":9447,"spinlock_wait_cycles":22366336,"thread_start_us":840455,"threads_started":2,"wal-append.queue_time_us":639483}
I20260709 12:20:32.202553 24471 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:32.197928 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:32.147918 29631 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:32.202613 24468 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:32.203982 24474 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:20:32.172837 29297 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:32.163134 29648 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:32.186201 29605 raft_consensus.cc:2804] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:32.125174 29734 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:32.221586 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 49227.6us
I20260709 12:20:32.243027 24291 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:32.229784 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.186486 29642 raft_consensus.cc:697] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 16 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:32.245293 24291 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:32.186302 29733 raft_consensus.cc:697] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 15 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:32.253408 24290 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:32.206898 29765 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:32.251681 29356 consensus_queue.cc:1048] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:20:32.258869 25114 raft_consensus.cc:1240] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:32.192011 29464 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:32.223146 29586 raft_consensus.cc:2749] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:32.249295 29646 raft_consensus.cc:2804] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:32.223359 29297 raft_consensus.cc:697] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 15 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:32.223188 29784 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.200832 29780 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:20:32.258412 29496 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:32.267590 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 422124us
I20260709 12:20:32.254953 29605 raft_consensus.cc:697] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:32.275427 24365 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:32.253783 29457 raft_consensus.cc:2749] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:32.267411 29646 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:32.286554 24474 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 12.
I20260709 12:20:32.294730 25114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35194 (request call id 801) took 1127 ms. Trace:
W20260709 12:20:32.293298 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 45871.6us
I20260709 12:20:32.295152 25114 rpcz_store.cc:276] 0709 12:20:31.167111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.326111 (+159000us) service_pool.cc:224] Handling call
0709 12:20:31.379390 (+ 53279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:32.262592 (+883202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:32.294530 (+ 31938us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b54005ff354. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:32.294681 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2022116608}
W20260709 12:20:32.299371 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 497790us
W20260709 12:20:32.300830 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.298174 24365 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:20:32.301395 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:32.379284 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 472449us
I20260709 12:20:32.375135 24290 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:32.336153 29733 consensus_queue.cc:237] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:32.375667 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 71707.8us
I20260709 12:20:32.297785 29646 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:32.274358 29784 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:32.387562 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2430) took 1283 ms. Trace:
W20260709 12:20:32.375738 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 65874.2us
I20260709 12:20:32.297232 29612 raft_consensus.cc:2804] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:32.389912 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:32.294029 29229 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:32.378379 24469 raft_consensus.cc:2468] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 15.
I20260709 12:20:32.390755 25083 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:20:32.336931 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 433486us
W20260709 12:20:32.380364 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 82273.1us
I20260709 12:20:32.381911 24468 raft_consensus.cc:2468] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 15.
I20260709 12:20:32.383597 24438 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:32.301011 29786 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:32.382666 24471 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 17.
I20260709 12:20:32.383559 29753 raft_consensus.cc:2804] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:32.386528 29492 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.403647 25083 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:32.330063 29642 consensus_queue.cc:237] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:32.399974 24365 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:32.400759 24438 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:32.406016 29492 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:32.386649 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:32.406867 29796 raft_consensus.cc:2804] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:32.407015 29753 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.407380 29457 consensus_queue.cc:1059] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:32.365051 29605 consensus_queue.cc:237] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:32.408392 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:32.450588 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:32.410547 24400 raft_consensus.cc:1240] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:32.411489 29631 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:32.390516 29612 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.410826 29734 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:32.415901 29784 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:32.416783 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 142103us
I20260709 12:20:32.435289 29646 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:32.436681 24366 connection.cc:256] RPC call timeout handler was delayed by -1.0126741060000768s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1746s for a response
W20260709 12:20:32.437774 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.441206 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:32.404937 24291 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:32.445055 24399 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 16.
I20260709 12:20:32.468503 24392 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 13.
I20260709 12:20:32.355430 29297 consensus_queue.cc:237] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:32.444725 29796 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.447178 29764 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:32.452212 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 52939.8us
W20260709 12:20:32.452294 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 51680.9us
W20260709 12:20:32.453390 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 49818.6us
I20260709 12:20:32.481741 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:32.455034 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 185544us
I20260709 12:20:32.457814 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:32.482939 24393 raft_consensus.cc:3060] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:32.388020 24465 rpcz_store.cc:276] 0709 12:20:31.103767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.307596 (+203829us) service_pool.cc:224] Handling call
0709 12:20:31.325516 (+ 17920us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:31.375788 (+ 50272us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:31.924194 (+548406us) log.cc:844] Serialized 14 byte log entry
0709 12:20:32.387227 (+463033us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:32.387286 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:32.387332 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:32.387390 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:32.387509 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3040,"prepare.queue_time_us":102950,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":3262,"thread_start_us":975937,"threads_started":2}
I20260709 12:20:32.462536 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:32.455811 29787 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:32.488868 29796 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:32.448050 29753 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:32.464447 29782 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:32.493129 29782 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.493564 29782 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:32.474673 29646 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:32.475446 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:32.497713 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:32.498389 29492 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:32.498884 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:32.447794 29532 raft_consensus.cc:2804] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:32.499714 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:20:32.484620 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 79823.8us
W20260709 12:20:32.485630 25084 leader_election.cc:336] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:32.499879 29532 raft_consensus.cc:697] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:32.486836 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:32.502218 25083 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:32.533851 24396 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:32.501220 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:32.505329 25082 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:32.465173 29134 raft_consensus.cc:2804] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:32.464895 29612 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:32.556864 24440 leader_election.cc:400] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 15. Current term is 16.
I20260709 12:20:32.577275 24290 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:32.579725 24440 leader_election.cc:403] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:32.443634 29229 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:32.557749 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 56640.4us
I20260709 12:20:32.581202 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:32.582080 24399 raft_consensus.cc:3060] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:32.584210 29789 raft_consensus.cc:2804] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:32.584838 29789 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.585240 29789 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:32.576532 29634 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:32.557236 29734 raft_consensus.cc:2804] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:32.590317 29734 raft_consensus.cc:697] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 15 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:32.592923 29790 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:32.593515 29790 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:32.501140 29780 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:20:32.595894 29790 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:32.596518 29790 consensus_queue.cc:1059] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:32.597349 29639 raft_consensus.cc:2804] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:20:32.576503 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 94104.4us
I20260709 12:20:32.542055 25083 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:32.597622 29788 raft_consensus.cc:3055] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:20:32.581403 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 181492us
W20260709 12:20:32.600775 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 66149us
I20260709 12:20:32.576766 24438 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:20:32.616479 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 76725.3us
I20260709 12:20:32.619216 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:32.619930 24400 raft_consensus.cc:3060] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:32.620930 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:32.624409 24440 leader_election.cc:400] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 14. Current term is 15.
I20260709 12:20:32.624812 24440 leader_election.cc:403] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:32.617416 24438 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:32.611800 29788 raft_consensus.cc:740] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:32.629801 24438 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:32.534807 29784 raft_consensus.cc:2749] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:32.638744 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:32.591722 29734 consensus_queue.cc:237] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:32.657208 24210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 180111us
I20260709 12:20:32.468940 29786 raft_consensus.cc:3055] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:32.541018 29787 raft_consensus.cc:697] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 14 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:32.612079 29629 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:32.476253 29795 consensus_queue.cc:1059] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.175s
I20260709 12:20:32.501946 29631 consensus_queue.cc:1059] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 14.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.131s
I20260709 12:20:32.597995 29639 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:32.618470 29634 raft_consensus.cc:2804] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:32.627451 29492 raft_consensus.cc:2764] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:20:32.618451 29780 raft_consensus.cc:2749] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 15. Current term is 16.
I20260709 12:20:32.614243 29646 consensus_queue.cc:1059] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:20:32.679001 24440 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:32.683317 24396 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
I20260709 12:20:32.631219 29496 raft_consensus.cc:2749] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:20:32.663381 29571 consensus_meta.cc:287] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.500s	user 0.008s	sys 0.004s
I20260709 12:20:32.660514 29464 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:32.702831 29629 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:32.708170 29457 consensus_queue.cc:1059] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:20:32.664561 29786 raft_consensus.cc:740] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:32.738700 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:32.743846 24396 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:32.746644 29646 raft_consensus.cc:3055] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:32.747287 29646 raft_consensus.cc:740] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:32.748570 29629 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:32.740926 29571 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:32.708036 29532 consensus_queue.cc:237] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:32.752926 29571 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:32.754045 29571 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:32.758348 29791 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 14. Current term is 15.
I20260709 12:20:32.723650 29639 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:32.761746 24210 catalog_manager.cc:4755] TS c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): ChangeConfig:REMOVE_PEER RPC failed for tablet 97dd30b21cc14958a91b2da522e4bbe9: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:32.762831 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.763193 29457 raft_consensus.cc:3055] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:32.763711 29457 raft_consensus.cc:740] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:32.774201 29457 consensus_queue.cc:260] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:32.785113 29787 consensus_queue.cc:237] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:32.788681 29788 consensus_queue.cc:260] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:32.792469 29786 consensus_queue.cc:260] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:32.794209 29786 raft_consensus.cc:3060] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:32.749022 29496 raft_consensus.cc:2749] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:32.815567 24396 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 15.
I20260709 12:20:32.817915 24399 raft_consensus.cc:2468] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 12.
W20260709 12:20:32.821424 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 244243us
I20260709 12:20:32.837677 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:32.537370 29588 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:32.838786 24396 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:32.839736 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.839422 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:20:32.853816 25084 leader_election.cc:336] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:32.854513 25084 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:20:32.859040 25084 leader_election.cc:336] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:32.860296 25084 leader_election.cc:336] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:32.861393 25084 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:32.864755 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:32.865499 24399 raft_consensus.cc:3060] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 15
W20260709 12:20:32.866791 25084 leader_election.cc:336] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:32.873234 24289 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:20:32.876984 25084 leader_election.cc:336] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:32.861020 29457 raft_consensus.cc:3060] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:32.877620 25084 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:20:32.878459 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 248740us
W20260709 12:20:32.883574 25084 leader_election.cc:336] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:32.865777 29432 raft_consensus.cc:2749] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:32.926986 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:32.933033 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 48459.4us
W20260709 12:20:32.934418 25084 leader_election.cc:336] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:32.748473 29646 consensus_queue.cc:260] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:32.941170 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 346100us
W20260709 12:20:32.962532 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 104702us
W20260709 12:20:32.963927 25084 leader_election.cc:336] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:32.951108 29229 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:32.950102 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.874744 29809 raft_consensus.cc:2749] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:32.952117 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 332920us
W20260709 12:20:32.975454 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 296534us
I20260709 12:20:32.976843 24440 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:32.970814 24396 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 13.
I20260709 12:20:32.902216 29733 raft_consensus.cc:2749] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:32.977273 24399 raft_consensus.cc:2468] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 15.
I20260709 12:20:32.982160 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:32.983505 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:32.984402 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 368710us
I20260709 12:20:32.961095 29134 raft_consensus.cc:697] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
W20260709 12:20:32.986778 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 346805us
I20260709 12:20:32.985641 24396 raft_consensus.cc:2393] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 14: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:32.990581 24365 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:20:33.018414 24393 consensus_meta.cc:287] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.003s
I20260709 12:20:33.019268 24393 raft_consensus.cc:2468] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 17.
I20260709 12:20:33.021608 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:33.022401 24399 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:32.982993 29229 consensus_queue.cc:1059] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
W20260709 12:20:33.025072 29796 consensus_meta.cc:287] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.535s	user 0.013s	sys 0.000s
I20260709 12:20:33.024950 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:33.025828 24471 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 15.
I20260709 12:20:33.025619 29796 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:33.028276 29796 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:33.029769 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 52978.3us
I20260709 12:20:33.034289 24400 raft_consensus.cc:2468] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 16.
W20260709 12:20:33.040756 29765 consensus_meta.cc:287] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.771s	user 0.010s	sys 0.005s
I20260709 12:20:33.041292 29795 raft_consensus.cc:2804] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:33.041998 29795 raft_consensus.cc:697] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:32.987707 29634 raft_consensus.cc:697] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 17 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:33.043468 29788 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:33.043241 29634 consensus_queue.cc:237] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:33.041311 29765 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:33.043051 29795 consensus_queue.cc:237] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:33.046648 29765 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:33.051389 24468 raft_consensus.cc:1275] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:20:33.051630 24440 leader_election.cc:400] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12.
I20260709 12:20:33.052302 24440 leader_election.cc:403] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:33.054728 24399 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
W20260709 12:20:33.048385 29802 log.cc:927] Time spent T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.307s	user 0.004s	sys 0.000s
I20260709 12:20:33.059917 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:33.060801 24393 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 14.
I20260709 12:20:33.057780 24398 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:33.011725 29297 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:20:33.051182 29781 consensus_meta.cc:287] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.887s	user 0.011s	sys 0.004s
W20260709 12:20:33.049925 29782 consensus_meta.cc:287] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.542s	user 0.013s	sys 0.000s
I20260709 12:20:33.078920 29764 raft_consensus.cc:3055] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:33.079490 29808 consensus_queue.cc:1048] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:33.081220 29765 consensus_queue.cc:1059] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:33.082832 24398 raft_consensus.cc:1240] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:33.083284 29612 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:33.085638 29815 raft_consensus.cc:2749] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 11. Current term is 12.
W20260709 12:20:33.092774 24440 connection.cc:256] RPC call timeout handler was delayed by -1.1305658699998276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
W20260709 12:20:33.178136 24440 connection.cc:256] RPC call timeout handler was delayed by -1.079265869999972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
I20260709 12:20:33.124202 29134 consensus_queue.cc:237] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:33.125123 29588 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:33.201077 25115 raft_consensus.cc:1275] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:20:33.129266 29790 consensus_queue.cc:1059] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:20:33.131244 29803 log.cc:927] Time spent T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.337s	user 0.000s	sys 0.002s
W20260709 12:20:33.132233 29805 log.cc:927] Time spent T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.340s	user 0.001s	sys 0.002s
W20260709 12:20:33.134760 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 261596us
I20260709 12:20:33.136130 24393 raft_consensus.cc:1240] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 10. Current term is 11. Ops: []
W20260709 12:20:33.192565 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.206459 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:33.149271 29297 raft_consensus.cc:697] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 15 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:33.207916 24394 raft_consensus.cc:2393] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 13: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:33.198851 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:33.206736 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:33.153035 29764 raft_consensus.cc:740] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:20:33.195936 29753 consensus_meta.cc:287] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.685s	user 0.010s	sys 0.002s
I20260709 12:20:33.215052 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:33.215624 25111 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:33.210094 25116 raft_consensus.cc:1240] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:33.208714 24289 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:33.212963 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:33.213253 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:33.232877 25118 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:33.148701 29781 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:33.249989 29612 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:33.250743 29781 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:33.205699 24440 consensus_peers.cc:597] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:33.253201 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 47864.5us
W20260709 12:20:33.255995 24440 leader_election.cc:336] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:33.256579 24440 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:33.257278 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 294903us
I20260709 12:20:33.260501 24366 leader_election.cc:400] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 14. Current term is 15.
I20260709 12:20:33.260926 24366 leader_election.cc:403] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:20:33.257614 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 267097us
I20260709 12:20:33.262667 24365 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:33.220680 25110 raft_consensus.cc:2393] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 12: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:33.149025 29782 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:33.196792 29796 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:33.221071 25114 raft_consensus.cc:1240] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:33.239301 29784 raft_consensus.cc:2804] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:33.291343 24365 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:33.293599 24289 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:33.293673 24366 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:33.275660 25118 raft_consensus.cc:2410] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
W20260709 12:20:33.294153 29605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.014s	sys 0.039s
I20260709 12:20:33.291632 25111 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
W20260709 12:20:33.293800 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 329347us
I20260709 12:20:33.298190 24289 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:20:33.299371 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 45385.4us
W20260709 12:20:33.313035 24440 leader_election.cc:336] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:33.220278 29753 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:33.310868 24290 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:33.313566 24440 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:33.311666 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2572) took 1011 ms. Trace:
I20260709 12:20:33.229063 29571 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:33.303136 29639 consensus_meta.cc:287] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.542s	user 0.012s	sys 0.000s
I20260709 12:20:33.309149 29808 raft_consensus.cc:2804] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:33.252174 29297 consensus_queue.cc:237] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:33.324653 25084 leader_election.cc:336] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:33.307065 29784 raft_consensus.cc:697] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:33.327646 24397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2570) took 1034 ms. Trace:
W20260709 12:20:33.306947 29786 consensus_meta.cc:287] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.001s
I20260709 12:20:33.330657 24392 raft_consensus.cc:2393] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 12: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
W20260709 12:20:33.305680 29814 log.cc:927] Time spent T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:20:33.304932 29781 raft_consensus.cc:2749] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:33.335456 25084 leader_election.cc:336] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:33.313493 29789 consensus_meta.cc:287] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.728s	user 0.010s	sys 0.003s
W20260709 12:20:33.336740 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:33.397935 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 84935.5us
I20260709 12:20:33.400452 24397 rpcz_store.cc:276] 0709 12:20:32.293708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.296224 (+  2516us) service_pool.cc:224] Handling call
0709 12:20:32.296726 (+   502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:32.302709 (+  5983us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:20:32.302761 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:32.314515 (+ 11754us) log.cc:844] Serialized 26 byte log entry
0709 12:20:32.628496 (+313981us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:32.628679 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:32.629022 (+   343us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:33.130538 (+501516us) spinlock_profiling.cc:243] Waited 43.5 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:20:33.322681 (+192143us) raft_consensus.cc:1685] finished
0709 12:20:33.322714 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:33.327542 (+  4828us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2698,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":7946,"spinlock_wait_cycles":100126592,"thread_start_us":180545,"threads_started":1,"wal-append.queue_time_us":399655}
I20260709 12:20:33.332001 29824 raft_consensus.cc:2749] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:33.320130 29807 raft_consensus.cc:2804] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:33.297442 29796 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:33.328668 24391 rpcz_store.cc:276] 0709 12:20:32.300707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.309867 (+  9160us) service_pool.cc:224] Handling call
0709 12:20:32.382040 (+ 72173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:32.382291 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:32.649659 (+267368us) log.cc:844] Serialized 14 byte log entry
0709 12:20:32.983016 (+333357us) log.cc:844] Serialized 14 byte log entry
0709 12:20:33.311272 (+328256us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:33.311330 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:33.311379 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.311468 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:33.311597 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":412429,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":93,"raft.queue_time_us":453256,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":14053,"spinlock_wait_cycles":4894080,"thread_start_us":908937,"threads_started":3,"wal-append.queue_time_us":557062}
I20260709 12:20:33.331499 29815 raft_consensus.cc:2749] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:33.299242 29605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.015s	sys 0.039s
W20260709 12:20:33.427543 24440 leader_election.cc:336] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:33.423599 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 88182.3us
W20260709 12:20:33.443017 25084 leader_election.cc:336] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:33.405608 25083 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:20:33.457357 24438 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.023s	sys 0.055s
W20260709 12:20:33.457932 24438 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.023s	sys 0.055s
W20260709 12:20:33.458312 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 520148us
W20260709 12:20:33.460053 24437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:33.460769 24438 leader_election.cc:336] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.539s (SENT)
I20260709 12:20:33.461347 24438 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:33.429975 29806 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:33.467854 24395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 823) took 1089 ms. Trace:
I20260709 12:20:33.428071 29808 raft_consensus.cc:697] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:20:33.466048 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 60538.8us
W20260709 12:20:33.463551 24440 leader_election.cc:336] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:33.476513 24440 leader_election.cc:336] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:33.479643 24440 leader_election.cc:336] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:33.480448 24440 leader_election.cc:336] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:33.468254 24395 rpcz_store.cc:276] 0709 12:20:32.378586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.378758 (+   172us) service_pool.cc:224] Handling call
0709 12:20:32.387239 (+  8481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:32.387492 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:20:32.680518 (+293026us) log.cc:844] Serialized 14 byte log entry
0709 12:20:33.467438 (+786920us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:33.467499 (+    61us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:33.467556 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.467630 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:33.467787 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11201,"prepare.queue_time_us":405269,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":30,"raft.queue_time_us":207178,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":22884,"thread_start_us":1028191,"threads_started":3,"wal-append.queue_time_us":514503}
I20260709 12:20:33.324745 29764 consensus_queue.cc:260] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.5, Last appended by leader: 5, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:33.405112 29639 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:33.465193 29642 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.014s	sys 0.035s
I20260709 12:20:33.457571 29807 raft_consensus.cc:697] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:20:33.485085 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 191269us
I20260709 12:20:33.461273 29733 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:33.488361 24440 leader_election.cc:336] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:33.492841 29642 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.015s	sys 0.035s
I20260709 12:20:33.492141 29787 consensus_queue.cc:1059] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 14.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:20:33.494138 29808 consensus_queue.cc:237] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:33.495395 29811 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:33.496004 29832 raft_consensus.cc:3055] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:33.496675 29823 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.498939 29229 raft_consensus.cc:2749] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511) with higher term. Message: Invalid argument: T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 14. Current term is 15.
I20260709 12:20:33.439460 29786 consensus_queue.cc:1059] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:20:33.435971 29789 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:33.540277 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:33.603008 24474 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:20:33.467702 29806 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:33.549961 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:33.489085 29781 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:33.586544 29819 log.cc:927] Time spent T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.331s	user 0.000s	sys 0.001s
I20260709 12:20:33.561285 29784 consensus_queue.cc:237] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:20:33.583997 29780 raft_consensus.cc:3055] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:33.615738 29780 raft_consensus.cc:740] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:33.470809 29432 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:33.619951 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:33.565372 24440 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:33.564028 29835 raft_consensus.cc:2804] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:33.579614 29827 raft_consensus.cc:2749] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:33.584722 24469 raft_consensus.cc:1275] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:20:33.590443 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:33.624140 24471 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:20:33.599258 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:33.626250 24470 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
I20260709 12:20:33.604729 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:33.627548 24473 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 17.
I20260709 12:20:33.607601 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:33.628746 24467 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:33.538004 29634 consensus_queue.cc:1048] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:20:33.607117 29806 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:33.611613 29836 raft_consensus.cc:2749] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:33.611682 24465 raft_consensus.cc:2393] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 12: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:33.613416 29840 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.562682 24468 raft_consensus.cc:1275] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:20:33.617093 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 323451us
I20260709 12:20:33.630070 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:33.705456 24466 raft_consensus.cc:3060] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:20:33.616652 29780 consensus_queue.cc:260] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:33.632172 24472 raft_consensus.cc:1275] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:20:33.624402 29835 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:33.557631 29733 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:33.585706 29832 raft_consensus.cc:740] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:20:33.694352 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:33.692015 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 203754us
W20260709 12:20:33.710080 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:33.710511 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:33.710642 24440 leader_election.cc:336] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:33.623585 29432 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:33.690704 24396 raft_consensus.cc:2393] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 12: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:33.606108 29782 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:33.701687 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 346346us
W20260709 12:20:33.712574 24440 leader_election.cc:336] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:33.721443 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.696385 29795 raft_consensus.cc:2749] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:33.603377 29823 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:33.733067 24440 leader_election.cc:336] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:33.733160 24290 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:33.734086 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 273351us
I20260709 12:20:33.695164 29753 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:33.738616 24438 leader_election.cc:336] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.713s (SENT)
I20260709 12:20:33.739132 24438 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:33.736896 24440 leader_election.cc:336] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:33.601857 29811 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:33.702185 29571 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:33.740214 24440 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:33.744231 25084 consensus_peers.cc:597] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:33.708251 29835 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:33.724007 29432 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:33.756219 25084 leader_election.cc:336] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:33.765623 29841 log.cc:927] Time spent T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
W20260709 12:20:33.773639 29838 log.cc:927] Time spent T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:20:33.698482 29807 consensus_queue.cc:237] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:33.720938 29840 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:33.751238 29780 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:33.777087 29846 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:33.778649 29733 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:33.779986 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:33.781666 29753 consensus_queue.cc:1059] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:20:33.784220 29788 consensus_meta.cc:287] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.740s	user 0.011s	sys 0.000s
I20260709 12:20:33.742117 29796 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:33.795850 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 58974.6us
I20260709 12:20:33.881958 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:33.882359 24440 leader_election.cc:336] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:33.883051 24440 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:33.796799 25084 leader_election.cc:336] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:33.885095 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:33.885896 24471 raft_consensus.cc:2393] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 12: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:33.799642 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:33.801326 25082 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:33.803993 25118 raft_consensus.cc:1240] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:33.804845 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:33.805605 29849 raft_consensus.cc:2749] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:33.807598 29823 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:33.808845 29457 consensus_meta.cc:287] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.924s	user 0.009s	sys 0.004s
W20260709 12:20:33.893333 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 92153.5us
I20260709 12:20:33.893633 29822 raft_consensus.cc:2804] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:33.894148 25082 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:33.894556 29822 raft_consensus.cc:697] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:33.813287 29612 raft_consensus.cc:3055] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:33.775141 29832 consensus_queue.cc:260] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:33.896024 25082 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:33.863775 24365 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:20:33.858651 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 120090us
I20260709 12:20:33.864032 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:33.864007 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 18 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:33.898406 24397 raft_consensus.cc:2393] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 13: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
W20260709 12:20:33.898614 24438 leader_election.cc:336] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.806s (SENT)
I20260709 12:20:33.898905 24395 raft_consensus.cc:2410] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:20:33.871774 24467 raft_consensus.cc:2468] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 16.
I20260709 12:20:33.899067 24438 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:33.876793 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:33.881424 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:33.900203 24391 raft_consensus.cc:2393] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 15: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:33.881052 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:20:33.849426 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 125342us
I20260709 12:20:33.897749 24399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 838) took 1475 ms. Trace:
I20260709 12:20:33.900214 24393 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:33.901631 24290 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:33.873171 24472 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
W20260709 12:20:33.885219 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 88475.3us
I20260709 12:20:33.900933 24398 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:33.880970 29629 consensus_queue.cc:1048] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:20:33.901412 24399 rpcz_store.cc:276] 0709 12:20:32.421900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.074249 (+652349us) service_pool.cc:224] Handling call
0709 12:20:33.151814 (+ 77565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.152029 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:20:33.195476 (+ 43447us) log.cc:844] Serialized 14 byte log entry
0709 12:20:33.756479 (+561003us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b180049de60. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a94241e07 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425ec02 00007f4a96ee620b 00007f4a96eebd23 00007f4a96eec23a 00007f4a97356a2a
0709 12:20:33.897371 (+140892us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:33.897430 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:33.897477 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.897546 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:33.897679 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20663,"prepare.queue_time_us":43259,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":3498,"raft.queue_time_us":21475,"spinlock_wait_cycles":10858240,"thread_start_us":119936,"threads_started":1}
I20260709 12:20:33.872779 29571 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:33.910833 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 47157.9us
I20260709 12:20:33.919576 24365 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:33.880179 29733 consensus_queue.cc:1048] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:33.920765 24365 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:33.923422 25110 raft_consensus.cc:1240] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 12:20:33.926230 24438 leader_election.cc:336] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.815s (SENT)
I20260709 12:20:33.926786 24438 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:33.881289 29781 raft_consensus.cc:2749] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:33.899271 29782 raft_consensus.cc:2749] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:33.896855 29612 raft_consensus.cc:740] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:33.926892 29789 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:33.904750 29642 raft_consensus.cc:2749] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:33.938228 24365 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:33.944940 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:33.944939 24438 leader_election.cc:336] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.870s (SENT)
I20260709 12:20:33.903280 29830 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:33.953301 25116 raft_consensus.cc:2393] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 14: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:33.971841 24393 raft_consensus.cc:2468] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
W20260709 12:20:33.972496 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 62548.4us
I20260709 12:20:33.979384 24438 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:33.929327 29823 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:33.929805 29827 raft_consensus.cc:2764] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:20:33.938171 29796 raft_consensus.cc:2749] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:33.944351 29832 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:33.989789 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:33.996114 24472 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:33.928750 29788 consensus_queue.cc:1048] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:20:33.895985 29822 consensus_queue.cc:237] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:33.931097 29571 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:33.981521 29753 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:34.011286 29846 raft_consensus.cc:697] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 17 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:34.012883 29846 consensus_queue.cc:237] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:33.992269 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 90710.7us
I20260709 12:20:33.978981 29790 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:34.015924 24398 raft_consensus.cc:2468] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
I20260709 12:20:33.993040 29588 consensus_queue.cc:1059] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:20:33.991377 29781 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:20:34.022958 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 78066.4us
W20260709 12:20:34.027467 24438 leader_election.cc:336] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.974s (SENT)
I20260709 12:20:34.027848 24438 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:34.022028 24290 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:34.042521 29823 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:34.040516 24438 leader_election.cc:336] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.770s (SENT)
I20260709 12:20:34.046329 29823 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:34.047588 24438 leader_election.cc:336] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.774s (SENT)
I20260709 12:20:34.048736 24438 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:34.049675 29823 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:34.049914 29432 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:34.050650 29823 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:34.051206 25114 raft_consensus.cc:1240] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:34.043457 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:34.052317 24400 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 17.
I20260709 12:20:34.035019 29790 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:34.053361 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:34.043793 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:34.044129 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:34.044443 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:34.034124 29806 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:34.026119 29612 consensus_queue.cc:260] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:34.042035 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:34.058351 24393 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14.
I20260709 12:20:34.058630 29612 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:34.059257 29806 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:34.050848 24438 leader_election.cc:336] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.804s (SENT)
I20260709 12:20:34.060283 29816 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:34.060688 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:34.026371 29786 consensus_queue.cc:1059] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:20:33.986388 29830 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:34.061241 29816 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:34.043241 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 66060.1us
I20260709 12:20:34.061807 29816 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:34.044834 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:34.061628 24471 raft_consensus.cc:2393] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 14: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:34.060716 29850 raft_consensus.cc:2804] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:34.063272 29830 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:34.063616 29850 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:34.064282 29850 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:34.072700 24291 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:34.018414 29753 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:34.078945 24289 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.908s (SENT) [suppressed 136 similar messages]
I20260709 12:20:34.079723 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:34.080432 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 58570.6us
I20260709 12:20:34.080554 24471 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
W20260709 12:20:34.095257 24394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2577) took 1714 ms (client timeout 1908 ms). Trace:
W20260709 12:20:34.096971 24392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 827) took 1678 ms (client timeout 1918 ms). Trace:
W20260709 12:20:34.097386 24392 rpcz_store.cc:269] 0709 12:20:32.418854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.498633 (+ 79779us) service_pool.cc:224] Handling call
0709 12:20:34.096778 (+1598145us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b54001b9c54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:34.096914 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1910898432}
I20260709 12:20:34.021718 29860 raft_consensus.cc:2749] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:34.099330 24473 raft_consensus.cc:1275] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 12:20:34.095753 24394 rpcz_store.cc:269] 0709 12:20:32.381222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.401453 (+ 20231us) service_pool.cc:224] Handling call
0709 12:20:34.094990 (+1693537us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b54003246d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:34.095142 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1739856640}
I20260709 12:20:34.063849 29843 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:20:34.104962 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 54220.5us
W20260709 12:20:34.108055 24438 leader_election.cc:336] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.988s (SENT)
I20260709 12:20:34.108783 24438 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:34.112893 29843 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:34.113392 29843 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:34.081470 29753 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:34.120325 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:34.120433 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 57337.1us
I20260709 12:20:34.121767 24291 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:34.095412 29356 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:34.129092 24472 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
W20260709 12:20:34.135839 24438 leader_election.cc:336] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.092s (SENT)
I20260709 12:20:34.136556 24438 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:34.140683 24438 leader_election.cc:336] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 2.213s (SENT)
I20260709 12:20:34.141124 24438 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:34.107451 29432 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:34.060768 29847 consensus_queue.cc:1048] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.238s
W20260709 12:20:34.162664 24440 leader_election.cc:336] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:34.163424 24440 leader_election.cc:336] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:34.165782 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 71975.3us
I20260709 12:20:34.143626 29840 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:34.142680 29823 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:34.114495 29810 consensus_queue.cc:1059] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
W20260709 12:20:34.169142 24440 leader_election.cc:336] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:34.178664 24440 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:34.169948 24466 raft_consensus.cc:2468] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
I20260709 12:20:34.150869 29782 raft_consensus.cc:2749] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:34.185671 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.188098 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:34.164510 29866 raft_consensus.cc:2749] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:20:34.197175 29851 log.cc:927] Time spent T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 12:20:34.198242 29866 raft_consensus.cc:2749] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:34.198352 29571 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:34.196290 29861 raft_consensus.cc:2804] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:34.207293 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:34.208150 29432 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.208833 29432 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:34.211437 29432 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:34.203670 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:34.212407 24466 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:34.212757 29857 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:34.169160 29790 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:34.177613 29639 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:34.184656 29795 raft_consensus.cc:2749] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:34.176479 29816 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:34.272400 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 131770us
I20260709 12:20:34.256317 29588 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.278614 24438 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:34.279980 24438 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:34.281181 24438 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:34.264439 29861 raft_consensus.cc:697] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:34.302449 24438 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:34.304014 24466 raft_consensus.cc:2468] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 16.
I20260709 12:20:34.266773 29787 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:34.313627 24438 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:20:34.314059 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 144965us
W20260709 12:20:34.314914 24440 leader_election.cc:336] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:34.315789 24440 leader_election.cc:336] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:34.316706 24440 leader_election.cc:336] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:34.317102 24440 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:34.300813 29571 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:34.301998 29823 raft_consensus.cc:2804] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:34.302058 29782 raft_consensus.cc:2804] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:20:34.323858 29867 log.cc:927] Time spent T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:20:34.297580 29588 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:34.330541 29872 raft_consensus.cc:2749] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:34.330834 29859 log.cc:927] Time spent T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:20:34.331700 29646 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:34.346463 24396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2588) took 1140 ms. Trace:
I20260709 12:20:34.346994 24393 raft_consensus.cc:1240] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:34.348306 24466 raft_consensus.cc:1275] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:20:34.348489 24398 raft_consensus.cc:1240] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:34.350279 24392 raft_consensus.cc:1275] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:20:34.351562 29229 raft_consensus.cc:3055] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:34.352072 29229 raft_consensus.cc:740] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:34.318774 29866 raft_consensus.cc:2749] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:34.315126 29784 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.327105 29780 raft_consensus.cc:2804] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:34.346966 24396 rpcz_store.cc:276] 0709 12:20:33.205569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.206791 (+  1222us) service_pool.cc:224] Handling call
0709 12:20:34.346247 (+1139456us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b54000e38d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:34.346395 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":952735104}
I20260709 12:20:34.322574 29571 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:34.319396 29787 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:34.329787 29823 raft_consensus.cc:697] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:34.368276 29816 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:34.373893 25116 raft_consensus.cc:1240] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:20:34.358184 29586 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.383648 29764 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:34.386185 29835 consensus_meta.cc:287] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.621s	user 0.006s	sys 0.007s
I20260709 12:20:34.386754 29835 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:34.361959 29850 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:34.373358 29861 consensus_queue.cc:237] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:34.395220 29646 consensus_queue.cc:1059] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:34.395565 29850 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:34.396692 29823 consensus_queue.cc:237] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:34.397243 29588 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:34.364390 29780 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:34.404165 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:34.388401 29356 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:34.372984 29571 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:34.394315 29787 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:34.429368 25116 raft_consensus.cc:2393] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 16: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:34.430438 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:34.414016 29780 raft_consensus.cc:3060] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:34.406112 29782 raft_consensus.cc:697] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:34.366470 29784 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:34.403975 29586 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:34.470873 29586 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:34.406343 29229 consensus_queue.cc:260] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:34.472002 29229 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:34.475481 29782 consensus_queue.cc:237] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:34.454239 29356 consensus_queue.cc:1059] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:20:34.485674 29784 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:34.449462 29787 consensus_queue.cc:1059] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:20:34.505417 29787 raft_consensus.cc:3055] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:34.454624 29857 consensus_queue.cc:1048] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:20:34.495235 29807 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.510109 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:34.515969 24392 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:34.510805 24396 raft_consensus.cc:1275] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:20:34.511677 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:34.518250 24398 raft_consensus.cc:2393] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 13: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:34.505941 29787 raft_consensus.cc:740] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:34.519326 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:34.519979 24399 raft_consensus.cc:1275] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:20:34.523553 24394 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 14.
I20260709 12:20:34.533659 24395 raft_consensus.cc:1240] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:34.532111 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:34.536142 24393 raft_consensus.cc:2410] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:20:34.503405 29835 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:34.541002 29782 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:34.546329 29782 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:34.541260 29831 consensus_queue.cc:1048] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:20:34.552651 29825 raft_consensus.cc:3055] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:34.553190 29825 raft_consensus.cc:740] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:34.554072 29825 consensus_queue.cc:260] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:34.553212 24391 raft_consensus.cc:1240] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:34.555682 29825 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:34.556941 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.560035 29806 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.560808 25083 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:34.561429 29812 consensus_queue.cc:1048] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:34.560616 29806 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:34.565062 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.558723 24396 raft_consensus.cc:1275] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 12:20:34.565685 24396 pending_rounds.cc:85] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a: Aborting all ops after (but not including) 6
W20260709 12:20:34.565733 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.566169 24396 pending_rounds.cc:107] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:20:34.566483 24396 raft_consensus.cc:2889] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:34.565372 24365 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:34.570319 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:34.571197 24470 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:34.578049 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:34.578706 24466 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:34.581454 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:34.582062 24469 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:20:34.575399 24365 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:34.585712 24392 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:34.567904 29642 raft_consensus.cc:2804] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:34.590006 24365 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:34.565398 29782 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:34.529681 29807 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:34.573257 29832 raft_consensus.cc:2804] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:34.657321 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:34.570386 29857 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:20:34.663638 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 73747.4us
W20260709 12:20:34.675427 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 358705us
I20260709 12:20:34.676012 24365 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:20:34.676344 24440 leader_election.cc:336] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:34.676883 24440 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:34.679220 24466 raft_consensus.cc:2468] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 14.
I20260709 12:20:34.564317 29753 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:34.682801 24470 raft_consensus.cc:2468] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
W20260709 12:20:34.682984 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.683555 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:34.573659 29817 consensus_queue.cc:1048] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.092s
I20260709 12:20:34.570209 29571 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:34.647868 29835 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:20:34.720104 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 43788.8us
W20260709 12:20:34.721448 24440 leader_election.cc:336] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:34.722426 24440 leader_election.cc:336] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:34.690579 29790 raft_consensus.cc:2804] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:34.723549 29790 raft_consensus.cc:697] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:34.724613 29790 consensus_queue.cc:237] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:34.728763 29823 raft_consensus.cc:2749] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:34.729636 29806 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:34.731596 29753 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:34.733319 29571 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:34.693599 29832 raft_consensus.cc:697] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 16 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:34.734761 29832 consensus_queue.cc:237] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:34.738078 29880 log.cc:927] Time spent T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.235s	user 0.001s	sys 0.001s
I20260709 12:20:34.741881 24399 raft_consensus.cc:1240] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:34.743646 24399 raft_consensus.cc:1275] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:20:34.681996 29836 raft_consensus.cc:2804] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:34.744506 29836 raft_consensus.cc:697] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:34.745501 29836 consensus_queue.cc:237] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:34.722860 24440 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:34.760571 24440 leader_election.cc:336] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:34.761528 24440 leader_election.cc:336] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:34.762701 24440 leader_election.cc:336] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:34.763074 24440 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:34.764508 29781 raft_consensus.cc:2749] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:34.757592 29571 raft_consensus.cc:2749] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:34.582631 29787 consensus_queue.cc:260] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:34.692723 29642 raft_consensus.cc:697] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 16 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
W20260709 12:20:34.758848 29843 consensus_meta.cc:287] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a: Time spent flushing consensus metadata: real 0.645s	user 0.000s	sys 0.014s
I20260709 12:20:34.779744 24396 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
W20260709 12:20:34.781510 24440 leader_election.cc:336] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:34.782270 24440 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:34.689224 29857 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:34.718688 29835 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:34.774741 29796 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:34.783406 29781 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:20:34.810319 24440 leader_election.cc:336] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:34.811090 24440 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:34.798290 29835 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:34.794281 29843 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:34.830209 29571 raft_consensus.cc:2749] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:34.880386 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:34.887400 24474 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:34.905977 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:34.881803 29872 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.884583 29781 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:34.914352 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:34.922960 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:34.878244 29642 consensus_queue.cc:237] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:34.941759 29571 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.942595 29571 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:34.945598 29888 log.cc:927] Time spent T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:20:34.914198 29807 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:34.914098 29781 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:34.962553 29781 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:34.908406 29872 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:34.984000 24474 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 13.
I20260709 12:20:34.975636 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:34.985886 24471 raft_consensus.cc:2393] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 13: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:34.986675 29857 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:34.986918 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:34.991052 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:34.991865 24474 raft_consensus.cc:2393] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 13: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:34.992623 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:34.994750 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:34.995399 24474 raft_consensus.cc:2393] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 15: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:34.997691 24471 raft_consensus.cc:2368] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 17. Current term is 18.
I20260709 12:20:35.002096 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:35.003574 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:35.004819 24474 raft_consensus.cc:2410] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:20:35.006491 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:35.008874 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:35.011546 29855 log.cc:927] Time spent T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.957s	user 0.002s	sys 0.000s
I20260709 12:20:35.002674 29872 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:35.019116 29811 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:35.019949 29790 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:35.022671 24471 raft_consensus.cc:2393] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 16: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
W20260709 12:20:35.025061 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:35.025851 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.031392 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:35.033246 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:35.034209 24391 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14.
I20260709 12:20:35.040645 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:35.041517 24471 raft_consensus.cc:2393] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 12: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:35.041198 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:35.042308 24394 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
I20260709 12:20:35.043972 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:35.048844 25110 raft_consensus.cc:1275] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:20:35.049131 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:35.051023 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:35.027696 29586 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.020594 29790 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:35.063772 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.064973 24438 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:35.029958 29832 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.068796 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:35.070051 24438 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:35.062040 29586 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:35.091984 25118 raft_consensus.cc:1240] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:20:35.079310 24400 raft_consensus.cc:1275] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:20:35.086275 29843 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:35.073733 29832 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:35.068305 29885 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:20:35.091152 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.064558 29846 consensus_queue.cc:1048] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:20:35.074177 29811 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:35.098896 29811 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:35.099416 29811 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:35.101042 29229 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.101642 29229 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:35.104156 29229 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:35.104615 29846 consensus_queue.cc:1059] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:35.106104 29790 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:35.106927 29881 consensus_queue.cc:1048] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:35.108711 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:35.109294 24472 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:35.093182 29796 raft_consensus.cc:2749] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:35.096194 29885 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.127914 29885 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:35.130049 29832 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:35.127489 29780 consensus_meta.cc:287] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.669s	user 0.008s	sys 0.004s
I20260709 12:20:35.135031 29780 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:35.138142 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:35.139727 24472 raft_consensus.cc:2468] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 18.
I20260709 12:20:35.141746 29586 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:35.146111 24392 raft_consensus.cc:2468] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14.
I20260709 12:20:35.147504 24438 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:35.148118 25115 raft_consensus.cc:1275] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:20:35.153115 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:35.149322 29634 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.159955 29634 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:35.163642 29634 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:35.164114 29864 raft_consensus.cc:3055] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:35.164383 29795 raft_consensus.cc:2804] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:35.166536 24290 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:35.167902 24290 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:35.170262 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:35.176249 29795 raft_consensus.cc:697] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:35.177500 29795 consensus_queue.cc:237] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:35.181169 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:35.182027 25111 raft_consensus.cc:2393] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 12: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:35.164767 29864 raft_consensus.cc:740] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:20:35.183138 24440 leader_election.cc:336] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:35.192487 24440 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:35.192543 24290 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:35.188772 29356 consensus_queue.cc:1048] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:20:35.185230 29815 consensus_queue.cc:1048] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:20:35.196344 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:35.196758 29849 raft_consensus.cc:2749] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:35.197124 29780 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:35.189005 29808 consensus_queue.cc:1059] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:20:35.180202 29846 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:35.198948 29864 consensus_queue.cc:260] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:35.200436 29864 raft_consensus.cc:3060] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:35.197070 24473 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 15.
I20260709 12:20:35.204556 24289 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:35.208021 25114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35188 (request call id 1462) took 1302 ms. Trace:
I20260709 12:20:35.209781 25114 rpcz_store.cc:276] 0709 12:20:33.905875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.905986 (+   111us) service_pool.cc:224] Handling call
0709 12:20:33.928575 (+ 22589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:34.051761 (+123186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:35.202642 (+1150881us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b540075e754. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:35.207909 (+  5267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281558272}
W20260709 12:20:35.210475 24440 leader_election.cc:336] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:35.211041 24440 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:35.207054 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:35.213469 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:20:35.213819 24440 leader_election.cc:336] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:35.214674 24290 leader_election.cc:400] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 election: Vote denied by peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453) with higher term. Message: Invalid argument: T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for earlier term 17. Current term is 18.
I20260709 12:20:35.215221 24440 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:35.198998 29868 log.cc:927] Time spent T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.943s	user 0.000s	sys 0.017s
I20260709 12:20:35.218729 24290 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:35.222620 24440 leader_election.cc:336] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:35.223625 24440 leader_election.cc:336] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:35.224998 24440 leader_election.cc:336] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:35.226621 24440 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:35.226840 24289 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:35.227864 24440 leader_election.cc:336] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:35.224890 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:35.205802 29815 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.230141 24473 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:35.206096 29861 raft_consensus.cc:2749] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:35.231655 24440 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:35.208222 29356 raft_consensus.cc:2749] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:35.219931 29780 raft_consensus.cc:2749] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:35.225773 29826 raft_consensus.cc:2749] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:35.233911 29848 consensus_queue.cc:1059] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:20:35.225929 29849 raft_consensus.cc:2749] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:35.229174 29881 raft_consensus.cc:2749] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:35.239051 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:35.246254 29646 consensus_queue.cc:1048] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:20:35.246831 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:35.223574 29835 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:35.250007 29835 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:35.252727 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.252542 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:35.253939 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:35.254540 24473 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:35.243618 24290 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:35.257823 29861 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:35.264873 29825 raft_consensus.cc:2749] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:35.269599 24290 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:35.271045 24290 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:35.271907 29826 raft_consensus.cc:2749] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:35.272746 29826 raft_consensus.cc:3060] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:35.279736 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:35.283172 29586 consensus_queue.cc:1059] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:20:35.285508 24440 leader_election.cc:336] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:35.287135 24440 leader_election.cc:336] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:35.239498 29639 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:35.287621 24440 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:35.295997 24467 raft_consensus.cc:1275] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:20:35.296600 24467 pending_rounds.cc:85] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 10
I20260709 12:20:35.296950 24467 pending_rounds.cc:107] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:20:35.297278 24467 raft_consensus.cc:2889] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:35.298655 25082 leader_election.cc:336] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.583s (SENT)
I20260709 12:20:35.299098 24467 raft_consensus.cc:1240] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:35.299257 25082 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:35.302260 24467 raft_consensus.cc:1240] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:35.303962 24467 raft_consensus.cc:1240] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:20:35.309470 24290 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:35.313453 24440 leader_election.cc:336] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:35.314200 24440 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:35.244052 29872 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:20:35.316416 24440 consensus_peers.cc:597] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:35.316915 29823 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:35.252308 29811 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:35.326107 25082 leader_election.cc:336] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.858s (SENT)
W20260709 12:20:35.331439 25082 leader_election.cc:336] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.560s (SENT)
I20260709 12:20:35.332022 25082 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:35.294550 29639 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.329645 24290 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:35.323854 24473 raft_consensus.cc:2468] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 14.
I20260709 12:20:35.338090 24473 raft_consensus.cc:1275] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:20:35.337406 24290 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:35.347229 24397 raft_consensus.cc:1240] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 11. Current term is 12. Ops: []
W20260709 12:20:35.349990 25082 leader_election.cc:336] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.710s (SENT)
I20260709 12:20:35.353596 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:35.354575 24392 raft_consensus.cc:2376] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 17. Re-sending same reply.
I20260709 12:20:35.356361 24391 raft_consensus.cc:1275] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:20:35.284387 29786 consensus_queue.cc:1048] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:20:35.314517 29781 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:35.359658 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:35.360508 25114 raft_consensus.cc:2393] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 14: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:35.352874 24290 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:35.361884 24391 raft_consensus.cc:1275] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:20:35.363317 24290 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:35.331256 29848 raft_consensus.cc:2749] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:35.330543 29464 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:35.372623 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:35.374193 24393 raft_consensus.cc:1275] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:20:35.377543 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:35.331770 29586 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:35.378093 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:35.385111 24398 raft_consensus.cc:2393] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 12: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:35.386721 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:35.381083 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:35.388258 24392 raft_consensus.cc:2410] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 12:20:35.380998 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 139168us
I20260709 12:20:35.337224 29639 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:35.336395 29634 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:35.317670 29826 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:35.336609 29780 raft_consensus.cc:2749] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:35.337033 29872 raft_consensus.cc:2749] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:35.361685 29825 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:35.393587 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:35.352723 29843 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.358906 29861 raft_consensus.cc:2749] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:20:35.402657 25082 leader_election.cc:336] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.784s (SENT)
I20260709 12:20:35.412868 25082 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:35.405470 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:35.412390 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:35.352975 29832 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:35.414475 24394 raft_consensus.cc:2393] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 12: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:35.410347 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:35.417140 24399 raft_consensus.cc:2393] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 14: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:35.417974 24400 raft_consensus.cc:1275] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:20:35.410660 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:35.411706 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:35.423633 24397 raft_consensus.cc:2376] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 15. Re-sending same reply.
I20260709 12:20:35.413384 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:35.425312 24391 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:20:35.332907 29823 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:35.418723 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:35.430608 24473 raft_consensus.cc:1240] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:35.438917 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:35.444026 24392 raft_consensus.cc:2376] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 17. Re-sending same reply.
I20260709 12:20:35.412608 29825 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.379462 29781 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:35.450379 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:35.431319 29848 raft_consensus.cc:2749] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:35.432654 29464 raft_consensus.cc:2749] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:20:35.453227 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 89998.2us
I20260709 12:20:35.457916 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:35.462297 24290 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:35.460866 24470 raft_consensus.cc:1275] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:20:35.402868 29586 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:35.462539 24398 raft_consensus.cc:2376] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 16. Re-sending same reply.
I20260709 12:20:35.441068 29826 raft_consensus.cc:2804] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:35.466639 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:35.445943 29861 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:20:35.471722 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:35.471871 25082 leader_election.cc:336] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.853s (SENT)
I20260709 12:20:35.448832 29825 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:35.433282 29832 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:35.427901 29843 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:35.470753 29853 log.cc:927] Time spent T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 1.363s	user 0.005s	sys 0.000s
I20260709 12:20:35.469857 29835 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.471997 29826 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.504412 24395 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
I20260709 12:20:35.247937 29885 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:35.516489 24472 raft_consensus.cc:1275] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:20:35.515904 24471 raft_consensus.cc:1240] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:35.234889 29815 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:35.504352 29826 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:35.539983 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:35.540484 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:35.545658 25082 leader_election.cc:336] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.918s (SENT)
I20260709 12:20:35.549518 24465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 1176) took 1778 ms. Trace:
I20260709 12:20:35.549836 24474 raft_consensus.cc:1240] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:20:35.521961 29848 consensus_queue.cc:1048] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:20:35.516237 29919 raft_consensus.cc:2749] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:35.499306 29835 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:35.550118 24465 rpcz_store.cc:276] 0709 12:20:33.771581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.772060 (+   479us) service_pool.cc:224] Handling call
0709 12:20:33.772475 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:33.806368 (+ 33893us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:20:33.806404 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:33.807431 (+  1027us) log.cc:844] Serialized 26 byte log entry
0709 12:20:33.937678 (+130247us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:33.938504 (+   826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:34.840332 (+901828us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b54001432d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:34.840396 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:35.333408 (+493012us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:20:35.549188 (+215780us) raft_consensus.cc:1685] finished
0709 12:20:35.549220 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:35.549433 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11115,"raft.queue_time_us":12062,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"spinlock_wait_cycles":57663616,"thread_start_us":129781,"threads_started":1,"wal-append.queue_time_us":219533}
I20260709 12:20:35.567188 24465 raft_consensus.cc:1240] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:35.568665 24465 raft_consensus.cc:1240] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 12. Current term is 13. Ops: []
W20260709 12:20:35.570261 29914 log.cc:927] Time spent T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 12:20:35.571301 29913 log.cc:927] Time spent T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:20:35.581903 29846 raft_consensus.cc:3055] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:35.582479 29846 raft_consensus.cc:740] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:35.584615 29835 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:35.586212 29832 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:35.587641 24470 raft_consensus.cc:1240] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:20:35.594107 24472 raft_consensus.cc:1275] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:20:35.595770 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.605959 24392 raft_consensus.cc:1240] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:35.607039 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:35.607880 24473 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
I20260709 12:20:35.614820 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:35.615382 24399 raft_consensus.cc:1240] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:35.616210 24398 raft_consensus.cc:1240] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 18 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:35.613400 24469 raft_consensus.cc:1240] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:35.605274 24391 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 16.
W20260709 12:20:35.610153 25084 consensus_peers.cc:597] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:35.562456 29908 log.cc:927] Time spent T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.192s	user 0.002s	sys 0.000s
I20260709 12:20:35.615267 24365 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:35.606099 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:35.639354 24395 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 15.
I20260709 12:20:35.641392 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:35.637755 24365 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:35.630918 24469 raft_consensus.cc:1240] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:35.631386 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:35.647872 24365 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:20:35.635509 25084 leader_election.cc:336] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:35.654174 25084 leader_election.cc:336] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:35.655592 25084 consensus_peers.cc:597] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:35.643476 29586 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:35.606086 29786 consensus_queue.cc:1059] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:20:35.597952 29911 consensus_queue.cc:1048] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:20:35.567667 29828 consensus_queue.cc:1048] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
W20260709 12:20:35.753496 29921 log.cc:927] Time spent T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:20:35.760074 29811 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:35.756875 29909 log.cc:927] Time spent T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 12:20:35.773850 29796 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:35.773965 29782 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:35.656402 29781 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:35.770434 29864 consensus_meta.cc:287] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.565s	user 0.013s	sys 0.002s
I20260709 12:20:35.650161 29229 raft_consensus.cc:2804] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:35.644261 29790 raft_consensus.cc:2804] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:35.768786 29586 consensus_queue.cc:1059] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:35.775542 29639 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:35.776764 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.772068 29815 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:35.769934 29885 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:35.658030 24365 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:20:35.827973 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 170059us
I20260709 12:20:35.780525 24289 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:35.766923 25084 leader_election.cc:336] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:35.829797 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 167449us
W20260709 12:20:35.765213 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 313972us
I20260709 12:20:35.782021 29825 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:35.728053 29917 log.cc:927] Time spent T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:20:35.661126 29832 raft_consensus.cc:2804] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:35.604820 29922 consensus_queue.cc:1059] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.093s
W20260709 12:20:35.685407 29912 log.cc:927] Time spent T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 12:20:35.789412 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:35.803167 29796 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:35.783528 24438 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:35.822914 29790 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.826745 29864 raft_consensus.cc:3055] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:35.857156 29885 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:35.857391 29864 raft_consensus.cc:740] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:35.857779 29885 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:35.858268 29885 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:35.858404 29920 consensus_queue.cc:1059] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:20:35.859795 29911 raft_consensus.cc:3055] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:35.859949 29924 raft_consensus.cc:2804] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:35.860262 29911 raft_consensus.cc:740] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:20:35.861511 29915 log.cc:927] Time spent T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.246s	user 0.000s	sys 0.004s
I20260709 12:20:35.861284 29911 consensus_queue.cc:260] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:35.863080 29911 raft_consensus.cc:3060] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:35.825358 29229 raft_consensus.cc:697] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:35.867667 29229 consensus_queue.cc:237] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:35.831180 24365 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:20:35.839262 24366 leader_election.cc:336] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:35.887866 24366 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:35.821705 29811 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:35.832804 25084 leader_election.cc:336] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:35.888937 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 58278.8us
W20260709 12:20:35.842587 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 62147.9us
I20260709 12:20:35.820984 29782 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:35.851207 24364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:35.854616 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 71198.9us
I20260709 12:20:35.847026 29639 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:35.853495 29786 raft_consensus.cc:2749] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:35.870493 29885 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:35.872711 29790 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:35.777681 29849 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:35.852932 29861 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:35.865895 29810 raft_consensus.cc:3055] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:35.879546 29826 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:35.883208 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:35.884868 24469 raft_consensus.cc:1240] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:35.897086 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:35.782938 29846 consensus_queue.cc:260] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:35.907434 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:35.887472 29832 raft_consensus.cc:697] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:20:35.933744 25084 consensus_peers.cc:597] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:35.931818 25118 raft_consensus.cc:2393] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 16: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:35.912756 29810 raft_consensus.cc:740] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:35.900453 29811 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:35.916409 29786 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.919759 29808 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.903065 29922 consensus_queue.cc:1059] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:20:35.943104 24291 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:35.950407 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 111183us
W20260709 12:20:35.957895 24366 leader_election.cc:336] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:35.958927 24366 leader_election.cc:336] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:35.940047 29612 raft_consensus.cc:2749] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:35.936062 29920 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.959363 24366 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:35.966097 24366 leader_election.cc:336] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:35.967026 24366 leader_election.cc:336] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:35.967401 24366 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:35.917578 29861 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:35.942834 29843 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:35.949709 29846 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:35.970912 29612 raft_consensus.cc:2804] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:20:35.974474 24366 consensus_peers.cc:597] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:35.914527 29849 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:35.971786 29922 raft_consensus.cc:3055] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:20:35.976545 24366 leader_election.cc:336] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:35.977033 24366 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:36.005249 29612 raft_consensus.cc:697] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:20:36.011897 29930 log.cc:927] Time spent T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.114s	user 0.002s	sys 0.000s
I20260709 12:20:36.012569 29796 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:35.956761 29808 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:36.015955 24366 leader_election.cc:336] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:36.019515 24366 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:36.014184 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:36.021130 24391 raft_consensus.cc:2393] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 16: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
W20260709 12:20:36.023438 24366 leader_election.cc:336] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:36.024048 24366 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:35.977952 29911 raft_consensus.cc:2749] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:35.958487 29786 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:35.978078 29922 raft_consensus.cc:740] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:36.030520 24289 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:36.032495 29863 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:36.040956 29863 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:36.043951 29863 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:36.034657 29786 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:36.037331 29935 log.cc:927] Time spent T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:20:36.046005 29861 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:36.046269 29782 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:36.039194 29808 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:35.974226 29920 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:36.039651 29825 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:36.050783 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:20:36.056093 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.062327 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:36.063217 24393 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:36.065073 24391 raft_consensus.cc:1275] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:20:36.074333 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:36.013607 29910 consensus_queue.cc:1059] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.159s
W20260709 12:20:36.080152 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 249039us
I20260709 12:20:36.029004 29885 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:36.084218 24365 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:36.069109 29786 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:36.022504 29832 consensus_queue.cc:237] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:36.005657 29810 consensus_queue.cc:260] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:36.106096 29810 raft_consensus.cc:3060] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:36.076918 29612 consensus_queue.cc:237] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:36.089200 29826 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:36.070032 29911 consensus_queue.cc:1048] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 12:20:36.129161 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.124715 24393 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 16.
I20260709 12:20:36.111572 29808 raft_consensus.cc:3055] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:36.130748 29356 raft_consensus.cc:3055] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:36.142262 29356 raft_consensus.cc:740] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:36.158259 29356 consensus_queue.cc:260] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:36.170599 29920 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:36.179834 29849 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:36.138935 29808 raft_consensus.cc:740] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:36.181493 29808 consensus_queue.cc:260] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:36.182857 29808 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:36.184785 29931 log.cc:927] Time spent T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:20:36.108429 29922 consensus_queue.cc:260] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:36.186508 29790 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:36.187553 29922 raft_consensus.cc:3060] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:36.187820 24394 raft_consensus.cc:2393] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 12: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:36.188709 24400 raft_consensus.cc:1240] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:20:36.189535 29790 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:36.199270 29811 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:36.209659 25082 leader_election.cc:336] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.935s (SENT)
I20260709 12:20:36.210161 25082 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:36.213282 29629 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:20:36.247153 24440 leader_election.cc:336] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:36.237571 29881 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.249717 29910 consensus_queue.cc:1048] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:20:36.244097 29826 consensus_queue.cc:1059] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:20:36.245469 29924 raft_consensus.cc:697] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 18 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:36.242439 29862 consensus_queue.cc:1059] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:20:36.258253 29924 consensus_queue.cc:237] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:36.232800 29828 consensus_queue.cc:1048] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:20:36.265558 24474 raft_consensus.cc:1275] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:20:36.273206 24440 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:36.272771 24393 raft_consensus.cc:1240] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:36.232462 29642 consensus_queue.cc:1059] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:20:36.241442 29920 consensus_queue.cc:1059] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
W20260709 12:20:36.289654 24440 leader_election.cc:336] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:36.291347 24440 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:36.258352 29862 raft_consensus.cc:3055] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:36.286260 29811 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:36.309650 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:36.314821 24393 raft_consensus.cc:2468] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:36.287698 29925 consensus_queue.cc:1048] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:20:36.353394 29938 raft_consensus.cc:2749] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:36.355333 29938 raft_consensus.cc:2749] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:36.356281 29836 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:36.357218 29836 raft_consensus.cc:2804] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:36.357676 29836 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:36.358073 29836 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:36.295466 29862 raft_consensus.cc:740] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:36.361406 29945 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.361567 29862 consensus_queue.cc:260] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:36.362053 29945 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:36.362689 29862 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:36.364188 29945 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:36.297997 29849 raft_consensus.cc:2749] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:36.286933 29881 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:36.390056 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 100442us
W20260709 12:20:36.402731 24440 consensus_peers.cc:597] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:36.403914 24440 leader_election.cc:336] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:36.418502 24393 raft_consensus.cc:3055] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:36.419121 24393 raft_consensus.cc:740] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:20:36.435221 24440 leader_election.cc:336] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:36.436830 24440 consensus_peers.cc:597] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:36.448024 29810 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.453791 29810 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:36.470101 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.456425 29810 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:36.472548 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 449093us
W20260709 12:20:36.483636 24366 leader_election.cc:336] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:36.478237 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 268586us
W20260709 12:20:36.487964 24366 leader_election.cc:336] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:36.486058 25082 leader_election.cc:336] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Timed out: RequestConsensusVote RPC to 127.22.155.194:35893 timed out after 1.983s (SENT)
I20260709 12:20:36.420065 24393 consensus_queue.cc:260] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:36.491206 25082 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:36.494251 24393 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:36.490788 24366 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:36.486056 29946 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.497826 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:36.497432 25111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:36.496840 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:20:36.516206 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 432182us
I20260709 12:20:36.519250 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:36.524900 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:36.522841 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.523779 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:36.553483 25117 raft_consensus.cc:1275] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:20:36.554653 25118 raft_consensus.cc:1240] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:36.554353 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:36.555862 25113 raft_consensus.cc:2393] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 12: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:36.556120 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:36.553674 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:36.559142 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:36.495134 29642 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:36.561386 25117 raft_consensus.cc:1240] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:36.521010 25111 raft_consensus.cc:1240] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:36.569679 24399 raft_consensus.cc:1240] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:36.495126 29938 raft_consensus.cc:2749] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:36.583530 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:36.583748 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:36.589839 24393 raft_consensus.cc:3060] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:36.599213 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:36.600335 25112 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
I20260709 12:20:36.605989 24393 raft_consensus.cc:2468] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 15.
I20260709 12:20:36.512706 29849 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.585556 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:36.571467 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 62473.8us
I20260709 12:20:36.607106 25110 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 15.
W20260709 12:20:36.611388 24366 connection.cc:256] RPC call timeout handler was delayed by -1.1968381049998698s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
I20260709 12:20:36.612387 24366 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:36.615629 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:36.559128 29843 raft_consensus.cc:2749] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:36.519531 29944 raft_consensus.cc:2749] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:36.588483 29885 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:36.628957 24366 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:36.596961 29790 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.630275 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:36.629978 29612 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.641616 29812 raft_consensus.cc:3055] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:36.520097 29946 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:36.624826 29945 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:36.677050 24397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2623) took 1016 ms. Trace:
I20260709 12:20:36.681303 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:36.679726 25119 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
W20260709 12:20:36.677124 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 48269.1us
W20260709 12:20:36.683633 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 156863us
I20260709 12:20:36.674575 29784 raft_consensus.cc:3055] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:36.687577 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:36.681743 24397 rpcz_store.cc:276] 0709 12:20:35.661200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:35.869456 (+208256us) service_pool.cc:224] Handling call
0709 12:20:35.869853 (+   397us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:36.242399 (+372546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:36.242430 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:36.252914 (+ 10484us) log.cc:844] Serialized 52 byte log entry
0709 12:20:36.557778 (+304864us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:36.557837 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.557928 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:36.661126 (+103198us) raft_consensus.cc:1685] finished
0709 12:20:36.661163 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:36.676975 (+ 15812us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41133,"raft.queue_time_us":105352,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":27838,"thread_start_us":601050,"threads_started":2,"wal-append.queue_time_us":356126}
I20260709 12:20:36.694181 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:36.616612 29849 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:36.697325 24366 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:36.699327 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:36.678921 29812 raft_consensus.cc:740] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:36.713059 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:36.692287 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 83725.7us
I20260709 12:20:36.740522 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:36.741746 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 44538.2us
I20260709 12:20:36.691371 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:36.681192 29944 raft_consensus.cc:2749] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:36.743096 24397 raft_consensus.cc:2393] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 12: Already voted for candidate c711faa13ead43ebbea0192cb74a4756 in this term.
I20260709 12:20:36.693192 29784 raft_consensus.cc:740] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:36.679757 29960 raft_consensus.cc:2749] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:36.675803 29885 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:36.588073 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:36.747565 24470 raft_consensus.cc:1275] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:20:36.679356 29790 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:36.749984 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:36.740532 29922 consensus_meta.cc:287] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.002s
I20260709 12:20:36.682471 29612 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:36.693527 29945 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:36.767656 24440 leader_election.cc:336] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:36.752169 29944 raft_consensus.cc:2749] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:36.780838 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:36.780601 29864 consensus_queue.cc:260] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:36.781612 24397 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
I20260709 12:20:36.782045 29864 raft_consensus.cc:3060] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:36.782298 29945 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:36.783051 24397 raft_consensus.cc:1275] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:20:36.783511 29955 log.cc:927] Time spent T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:20:36.750937 29959 consensus_queue.cc:1059] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 12:20:36.785462 29959 raft_consensus.cc:3055] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:36.785848 29959 raft_consensus.cc:740] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:20:36.786405 29953 log.cc:927] Time spent T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:20:36.786051 29790 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:36.786821 29959 consensus_queue.cc:260] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:36.750725 29947 consensus_queue.cc:1059] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:20:36.771874 29964 consensus_queue.cc:1059] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:20:36.772218 29881 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:36.776305 29812 consensus_queue.cc:260] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:36.788306 29959 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:36.791039 29885 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:36.802278 29885 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.802736 29885 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:36.794042 29612 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:36.805485 29885 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:36.796147 29836 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:36.792104 29946 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:36.794149 29784 consensus_queue.cc:260] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:36.792115 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:36.807582 29432 consensus_queue.cc:1048] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:20:36.810523 29784 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:36.808758 29885 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.812350 29885 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:36.813611 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:36.814400 24474 raft_consensus.cc:3060] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:36.814456 29849 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:36.759002 29919 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:36.815239 29919 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:36.813757 29836 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:36.818621 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 58112.6us
I20260709 12:20:36.784449 24397 raft_consensus.cc:1275] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:20:36.819515 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:36.775161 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:36.820777 24440 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:36.826877 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 63991.7us
I20260709 12:20:36.831676 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:36.831996 24474 raft_consensus.cc:2468] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:20:36.824110 24393 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 15.
I20260709 12:20:36.820766 29919 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:36.855020 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 136711us
I20260709 12:20:36.830336 29849 raft_consensus.cc:2749] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:36.862501 24365 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:36.868198 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:36.871394 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 128089us
I20260709 12:20:36.872432 24366 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:36.870913 29965 raft_consensus.cc:2804] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:20:36.874413 23151 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 24350)
I20260709 12:20:36.882084 24399 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
I20260709 12:20:36.837985 29952 consensus_queue.cc:1048] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:20:36.885767 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:36.890918 24393 raft_consensus.cc:1275] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:36.862864 29642 consensus_queue.cc:1048] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:20:36.888556 29836 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:36.904028 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.892721 29965 raft_consensus.cc:697] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:36.906021 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:36.907639 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:36.908278 24472 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:36.905248 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:36.918954 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:36.919644 24465 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:20:36.922640 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:36.923496 24465 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:36.936497 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:36.922109 24365 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:36.937486 24471 raft_consensus.cc:2393] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 12: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:36.939023 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:36.939682 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:36.943012 29919 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.943583 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:36.943692 29919 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:36.947487 29919 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:36.940084 29836 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:36.948804 29836 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:36.949193 29836 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:36.950022 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:36.951493 24392 raft_consensus.cc:1240] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:36.953701 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:36.955536 29940 log.cc:927] Time spent T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.923s	user 0.003s	sys 0.001s
I20260709 12:20:36.957530 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:36.958843 29787 raft_consensus.cc:3060] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:36.961122 29965 consensus_queue.cc:237] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:36.961990 29919 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.962491 29919 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:36.965544 29571 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:36.971364 24472 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 16.
I20260709 12:20:36.981051 29356 raft_consensus.cc:3060] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:36.981791 29919 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:36.939767 24471 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:20:36.985371 24394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51478 (request call id 2615) took 1382 ms. Trace:
I20260709 12:20:36.985807 24394 rpcz_store.cc:276] 0709 12:20:35.602512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:35.603869 (+  1357us) service_pool.cc:224] Handling call
0709 12:20:36.985145 (+1381276us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b54002a5154. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:20:36.985286 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1236779264}
I20260709 12:20:36.990636 24468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 1199) took 1115 ms. Trace:
I20260709 12:20:36.991086 24468 rpcz_store.cc:276] 0709 12:20:35.875132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:35.883773 (+  8641us) service_pool.cc:224] Handling call
0709 12:20:35.884131 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:35.888852 (+  4721us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:35.888891 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:35.888935 (+    44us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:35.888974 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.990424 (+1101450us) spinlock_profiling.cc:243] Waited 4.53 ms on lock 0x7b54000339d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:36.990472 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:36.990581 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10408832}
W20260709 12:20:36.991722 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.993834 24470 raft_consensus.cc:1240] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:36.994716 29464 raft_consensus.cc:3055] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:36.994969 24470 raft_consensus.cc:1240] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:36.995180 29464 raft_consensus.cc:740] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:36.997727 29823 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:37.005030 24472 raft_consensus.cc:1240] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 14. Current term is 15. Ops: []
W20260709 12:20:37.006065 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 140992us
W20260709 12:20:37.011564 24366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.012816 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.008391 24438 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:37.020557 24438 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:37.023819 24438 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:37.025970 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 160389us
W20260709 12:20:37.031203 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.033098 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.034160 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.008431 24465 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 14.
I20260709 12:20:37.043292 24469 raft_consensus.cc:1275] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:20:37.048192 24468 raft_consensus.cc:1240] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:37.050982 25082 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:37.058163 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.060058 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:37.060853 24395 raft_consensus.cc:2393] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 14: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:37.039927 29823 raft_consensus.cc:2804] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:20:37.062512 24366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.060597 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:37.041275 29919 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.996254 29464 consensus_queue.cc:260] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:37.042614 29811 raft_consensus.cc:2749] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:37.074486 29881 consensus_queue.cc:1048] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:37.067308 29946 raft_consensus.cc:3055] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:37.076884 29823 raft_consensus.cc:697] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:37.070374 29975 raft_consensus.cc:2804] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:37.080718 29812 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:37.081400 29571 consensus_queue.cc:1048] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:37.076956 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:37.085171 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:37.056869 29822 consensus_queue.cc:1048] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:20:37.056676 29922 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:37.075526 24438 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:20:37.121932 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 46501.4us
I20260709 12:20:37.123008 24438 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:37.099303 24468 raft_consensus.cc:1275] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:20:37.101632 24465 raft_consensus.cc:1240] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:37.104169 24398 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
W20260709 12:20:37.089705 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.105777 24366 leader_election.cc:336] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:37.128259 24366 leader_election.cc:336] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:37.129617 24366 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:20:37.131137 24366 leader_election.cc:336] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:37.133108 24366 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:20:37.137279 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.141183 24366 leader_election.cc:336] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:37.142392 24366 leader_election.cc:336] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:37.097002 29817 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:37.146332 24400 raft_consensus.cc:1240] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 13. Current term is 14. Ops: []
W20260709 12:20:37.146826 24366 leader_election.cc:336] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:37.148327 24366 leader_election.cc:336] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:37.096769 29946 raft_consensus.cc:740] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:37.101161 29975 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:37.090579 29944 consensus_queue.cc:1048] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:20:37.140511 29974 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.142751 29835 raft_consensus.cc:2749] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:37.142303 29811 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:37.140317 29970 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:37.091969 29919 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:37.162981 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 112131us
I20260709 12:20:37.119881 29959 consensus_queue.cc:1059] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 12:20:37.164469 24473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33198 (request call id 1204) took 1243 ms. Trace:
I20260709 12:20:37.167438 24473 rpcz_store.cc:276] 0709 12:20:35.921384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:35.921590 (+   206us) service_pool.cc:224] Handling call
0709 12:20:35.921981 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:36.019454 (+ 97473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:36.019485 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:36.019532 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:36.019577 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:37.164147 (+1144570us) spinlock_profiling.cc:243] Waited 97.3 ms on lock 0x7b54000343d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:37.164203 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:37.164393 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":223677312}
I20260709 12:20:37.169607 25082 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:37.143435 29790 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:37.154424 29969 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:37.172825 25082 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:37.177495 29983 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:37.178117 29983 raft_consensus.cc:697] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 16 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:37.178310 29885 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:37.179162 29983 consensus_queue.cc:237] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:37.171936 29823 consensus_queue.cc:237] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:37.155975 29975 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:37.182518 25082 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:37.144557 29922 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:37.177384 29982 raft_consensus.cc:2749] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:37.191385 29984 raft_consensus.cc:2749] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:37.162320 29811 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:37.192888 29811 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:37.197065 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:37.201421 29978 log.cc:927] Time spent T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.122s	user 0.000s	sys 0.002s
I20260709 12:20:37.166939 29464 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:37.186580 29969 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:37.158413 24366 leader_election.cc:336] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:37.212322 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 53940us
W20260709 12:20:37.213081 24366 leader_election.cc:336] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:37.208562 24440 leader_election.cc:336] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:37.192910 29982 consensus_queue.cc:1048] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:20:37.163159 29974 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:37.219192 29974 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:37.221433 29922 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:37.223747 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.226040 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:37.226094 24366 leader_election.cc:336] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:37.226423 24440 leader_election.cc:336] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:37.230170 24440 leader_election.cc:336] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:37.230710 24440 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:37.228534 24365 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:37.225235 29926 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:37.231794 24440 leader_election.cc:336] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:37.243495 24440 leader_election.cc:336] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:37.252868 24290 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:37.214285 29639 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.257843 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:37.249863 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:37.263988 25114 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:37.233265 29944 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:37.265561 29944 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:37.261039 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 206109us
I20260709 12:20:37.238943 29974 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:37.276598 24290 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:37.256441 29790 consensus_queue.cc:1048] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:20:37.269227 29787 raft_consensus.cc:2749] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:37.236537 29836 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:37.285988 29836 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:37.286762 29836 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:37.287379 29836 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:20:37.297919 29969 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:37.299249 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:37.304991 29836 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:20:37.247226 29959 raft_consensus.cc:2804] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:37.323635 24290 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:37.328135 24290 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:37.336490 24290 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:37.339262 24290 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:37.321616 29922 raft_consensus.cc:2749] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:37.325278 29787 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.326895 29857 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.332782 29864 raft_consensus.cc:2749] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:37.312341 29965 consensus_queue.cc:1048] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:20:37.365005 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:37.252156 29926 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:37.333259 29959 raft_consensus.cc:697] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
W20260709 12:20:37.413684 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 66035.6us
I20260709 12:20:37.340515 29862 raft_consensus.cc:2749] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:37.424569 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:37.430114 25114 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:37.340757 29810 raft_consensus.cc:2749] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:37.339977 29944 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:37.424459 29229 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:37.457162 29229 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:37.461105 29959 consensus_queue.cc:237] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:37.427707 29970 raft_consensus.cc:697] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:37.468720 29970 consensus_queue.cc:237] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:37.424924 29796 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.473017 29796 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:37.475272 29796 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:37.413452 29787 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:37.478480 29787 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:37.349287 29919 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:37.275231 29639 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:37.433156 24440 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:37.437659 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.497244 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.440691 29881 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.443236 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:37.445361 29810 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.417325 29969 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.524204 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:37.429054 29922 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:37.523020 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.421468 29836 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:20:37.498507 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 65429.9us
W20260709 12:20:37.525795 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 88338.6us
W20260709 12:20:37.532804 24366 leader_election.cc:336] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:37.533344 24366 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:20:37.534802 24366 leader_election.cc:336] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:37.535923 24366 leader_election.cc:336] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:37.522186 24391 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 11.
I20260709 12:20:37.525074 24396 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
W20260709 12:20:37.488520 29990 log.cc:927] Time spent T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:20:37.538463 24366 leader_election.cc:336] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:37.540728 24366 leader_election.cc:336] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:37.542199 24366 leader_election.cc:336] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:37.543450 24366 leader_election.cc:336] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:37.421705 29857 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:37.545593 24440 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:37.472200 29811 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:37.544085 24366 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:37.554617 24440 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:37.554723 24366 leader_election.cc:336] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:37.556254 24440 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:37.559557 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:37.556506 24366 leader_election.cc:336] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:37.525076 29864 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.560993 24366 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:37.520277 29796 raft_consensus.cc:2749] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:37.561081 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:37.564786 29965 raft_consensus.cc:2749] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:37.569545 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:37.570358 24473 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:37.571730 29965 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:20:37.573627 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.575538 24366 leader_election.cc:336] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:37.576107 24366 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:37.584292 24472 raft_consensus.cc:1240] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:37.587705 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:37.553499 29976 raft_consensus.cc:2749] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:37.562461 29849 raft_consensus.cc:2749] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:37.590997 25115 raft_consensus.cc:2410] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:20:37.526631 29810 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:37.561501 29571 raft_consensus.cc:2749] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:37.565418 29782 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:20:37.590479 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 251268us
I20260709 12:20:37.589923 29787 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.527977 29881 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:37.528475 29969 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:37.620170 24290 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
W20260709 12:20:37.595351 24366 leader_election.cc:336] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:37.621414 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:37.543840 29836 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:37.625473 24289 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:37.636086 24366 consensus_peers.cc:597] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:37.568233 29864 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:37.636823 24366 leader_election.cc:336] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:37.603410 29945 raft_consensus.cc:2749] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:37.639074 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:37.639707 24366 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:37.643146 24396 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 11.
I20260709 12:20:37.644367 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:37.572995 29998 consensus_queue.cc:1048] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 12:20:37.603495 29919 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.619485 29782 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.655709 24470 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
W20260709 12:20:37.656764 24366 consensus_peers.cc:597] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:37.656952 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:37.657567 24366 consensus_peers.cc:597] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:37.658345 24366 leader_election.cc:336] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:37.658782 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.659198 24366 leader_election.cc:336] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:37.661319 30005 raft_consensus.cc:2749] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:37.667058 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:37.668051 24396 raft_consensus.cc:2410] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:20:37.641227 30003 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.686048 29969 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:37.667658 29782 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:37.635668 29787 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:37.671933 29922 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:37.708452 24366 leader_election.cc:336] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:37.720335 24366 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:37.682086 30001 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:37.734704 29965 raft_consensus.cc:2749] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:37.738165 29927 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:37.738770 29927 raft_consensus.cc:697] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 16 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:20:37.741153 29996 log.cc:927] Time spent T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:20:37.744230 30013 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:37.747624 29974 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:37.747934 29864 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:37.749356 29810 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:37.755375 25082 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:37.757000 29982 raft_consensus.cc:2804] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:20:37.757266 29995 log.cc:927] Time spent T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:20:37.757457 29982 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.757853 29982 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:37.758980 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:37.759691 24394 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:37.768577 29926 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:37.772867 30000 log.cc:927] Time spent T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:20:37.777716 24394 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 16.
I20260709 12:20:37.778808 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:37.779995 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 159943us
I20260709 12:20:37.672608 29919 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:37.790699 24472 raft_consensus.cc:1275] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:20:37.782917 24438 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:37.785215 24474 raft_consensus.cc:1275] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:20:37.800001 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:37.804082 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2624) took 2125 ms. Trace:
I20260709 12:20:37.804543 24392 rpcz_store.cc:276] 0709 12:20:35.678849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:35.885675 (+206826us) service_pool.cc:224] Handling call
0709 12:20:35.886108 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:36.951964 (+1065856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:37.779798 (+827834us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001112d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:37.804010 (+ 24212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2449654144}
I20260709 12:20:37.770859 29946 consensus_queue.cc:260] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:37.800760 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:37.810233 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:37.801578 24469 raft_consensus.cc:1275] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:20:37.800508 24438 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:37.814118 24472 raft_consensus.cc:1275] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:20:37.820866 29790 consensus_queue.cc:1048] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.012s
W20260709 12:20:37.830457 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.831607 29975 consensus_meta.cc:287] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.641s	user 0.011s	sys 0.001s
W20260709 12:20:37.832990 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.806778 29857 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:37.731051 29922 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:37.836236 29919 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:37.836506 29922 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:37.837181 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.807493 29946 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:37.808882 29969 raft_consensus.cc:2804] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:37.813359 24438 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:37.770488 29982 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:37.821692 29571 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:20:37.852839 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.808126 29926 consensus_queue.cc:1059] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:20:37.698660 30003 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:37.824493 29612 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:37.832204 29975 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:37.855670 29571 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.816691 29944 consensus_queue.cc:1048] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:20:37.739719 29927 consensus_queue.cc:237] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.5, Last appended by leader: 5, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:37.847051 29922 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:37.861176 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 47913.3us
I20260709 12:20:37.780118 30001 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:37.857470 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 166202us
W20260709 12:20:37.872015 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.874938 23151 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 24350)
I20260709 12:20:37.854260 29926 raft_consensus.cc:3055] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:37.876857 29926 raft_consensus.cc:740] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:37.878080 29926 consensus_queue.cc:260] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:37.879776 29926 raft_consensus.cc:3060] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:37.881752 29965 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:37.882511 29965 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:37.851866 29969 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.865541 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:37.848531 29811 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:37.890838 29969 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:37.892441 24469 raft_consensus.cc:2393] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 14: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:37.847697 29790 consensus_queue.cc:1048] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.020s
W20260709 12:20:37.893874 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.894656 24471 raft_consensus.cc:1275] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:20:37.896086 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:37.864274 29571 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:37.864424 29885 raft_consensus.cc:2804] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:37.896981 25115 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:37.856594 30004 consensus_queue.cc:1048] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:20:37.862884 29612 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:37.906209 29836 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:37.899117 29639 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:37.904172 29919 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.933197 29857 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.890017 29922 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:37.901738 29835 consensus_queue.cc:1048] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:20:37.947486 29881 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:37.944788 29885 raft_consensus.cc:697] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
W20260709 12:20:37.975098 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 349690us
I20260709 12:20:37.981564 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:37.987586 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:37.991629 24289 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:37.997223 24472 raft_consensus.cc:1275] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:20:37.971032 29823 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:37.965991 29919 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:37.981510 29787 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:38.037194 29975 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:38.041265 29922 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:37.968532 29857 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:38.020081 30018 raft_consensus.cc:2804] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:38.026757 29944 consensus_queue.cc:1048] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:20:38.053426 29922 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.031658 29782 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:38.032203 29823 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:38.063998 30018 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:38.083803 30014 log.cc:927] Time spent T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:20:38.084069 29782 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:38.081434 30003 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:38.106146 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:38.123242 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:38.091451 30018 raft_consensus.cc:3060] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:38.082094 29922 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:38.146729 29822 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.147503 29822 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:38.158851 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.104393 30001 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:38.139422 29924 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:38.161718 29924 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:38.164006 29924 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:38.142509 29612 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:38.166620 29922 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:38.167546 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:38.072335 29885 consensus_queue.cc:237] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:38.171350 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:38.172349 24395 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:38.174002 24399 raft_consensus.cc:1275] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:20:38.175309 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:38.178681 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:38.142110 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 128157us
I20260709 12:20:38.164340 29571 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:38.171767 29982 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:38.208292 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:38.208141 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:38.209115 25110 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:20:38.211896 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:38.212484 25110 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:38.174842 29924 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:38.176898 29881 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:38.213999 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:38.202437 29938 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.217991 25115 raft_consensus.cc:1240] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:38.220491 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:38.210353 29964 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:38.235294 24395 raft_consensus.cc:2468] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
I20260709 12:20:38.235622 29964 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:38.236472 29571 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:38.237310 24438 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:38.238154 29964 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:38.219816 29924 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:38.238911 29970 raft_consensus.cc:2804] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:38.239675 29970 raft_consensus.cc:697] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:38.240934 29924 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:38.241411 29970 consensus_queue.cc:237] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:38.228338 29938 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:38.245668 29938 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:38.248898 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.249217 29823 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:38.253252 30026 log.cc:927] Time spent T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:20:38.218341 29881 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:38.254573 30028 log.cc:927] Time spent T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:20:38.254133 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:38.256711 29881 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:38.184043 29975 consensus_queue.cc:1048] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 12:20:38.234658 29981 log.cc:927] Time spent T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 1.156s	user 0.026s	sys 0.015s
I20260709 12:20:38.257570 29975 consensus_queue.cc:1243] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer c855242ec9d34a5397741ef20db9de8a log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:20:38.258878 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:38.259317 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:38.259688 24396 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:38.260026 24393 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 15.
I20260709 12:20:38.260542 24392 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:38.261062 24467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33272 (request call id 2474) took 1792 ms. Trace:
I20260709 12:20:38.261461 24467 rpcz_store.cc:276] 0709 12:20:36.468315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:36.489571 (+ 21256us) service_pool.cc:224] Handling call
0709 12:20:36.489958 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:36.491936 (+  1978us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:36.824447 (+332511us) log.cc:844] Serialized 14 byte log entry
0709 12:20:37.042184 (+217737us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:37.043394 (+  1210us) log.cc:844] Serialized 26 byte log entry
0709 12:20:37.043543 (+   149us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:37.043581 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:37.043655 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:38.176572 (+1132917us) spinlock_profiling.cc:243] Waited 4.34 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a96ee786e 00007f4a96ee6bb6 00007f4a96ee67d8 00007f4a96ef0221 00007f4a96ef01d9 00007f4a96ef0169
0709 12:20:38.260737 (+ 84165us) raft_consensus.cc:1685] finished
0709 12:20:38.260850 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:38.260999 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38765,"prepare.queue_time_us":131994,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":6900,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":8327,"spinlock_wait_cycles":9982848,"thread_start_us":483622,"threads_started":2,"wal-append.queue_time_us":220535}
W20260709 12:20:38.234781 30024 log.cc:927] Time spent T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 12:20:38.227977 29919 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:38.265769 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:38.266840 24467 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 15.
I20260709 12:20:38.270021 24365 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:38.276507 29857 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:38.277469 24392 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 16.
I20260709 12:20:38.279327 24438 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:38.280620 24396 raft_consensus.cc:1217] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Deduplicated request from leader. Original: 10.7->[11.8-15.10]   Dedup: 11.8->[13.9-15.10]
I20260709 12:20:38.280942 29924 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:38.281219 24396 pending_rounds.cc:85] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a: Aborting all ops after (but not including) 8
I20260709 12:20:38.281376 29924 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:38.281827 29924 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:38.283634 24438 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:38.281534 24396 pending_rounds.cc:107] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:20:38.287868 24396 raft_consensus.cc:2889] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:38.300889 24365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.301731 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:38.302682 24465 raft_consensus.cc:2393] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 18: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
W20260709 12:20:38.302778 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.283274 29975 raft_consensus.cc:2804] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:38.283463 29229 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:38.305868 24291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.308149 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:38.308806 25118 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:38.298770 29881 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:20:38.306598 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 88768us
I20260709 12:20:38.319379 29881 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:38.324699 29881 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:38.327638 25118 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
I20260709 12:20:38.307520 29975 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:38.340169 24289 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:38.338693 25110 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 14.
I20260709 12:20:38.343369 30039 raft_consensus.cc:2804] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:38.343828 30039 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.343729 30030 consensus_queue.cc:1059] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:38.344241 30039 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:38.344882 30030 raft_consensus.cc:3055] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:38.345242 30030 raft_consensus.cc:740] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:38.346073 30030 consensus_queue.cc:260] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:38.347293 30030 raft_consensus.cc:3060] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:38.297787 29969 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:38.342658 24289 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:38.303818 30018 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:38.356246 24289 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:38.361194 30006 log.cc:927] Time spent T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.712s	user 0.003s	sys 0.000s
W20260709 12:20:38.362833 30031 log.cc:927] Time spent T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.146s	user 0.002s	sys 0.000s
I20260709 12:20:38.365437 29946 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:38.342131 29975 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:38.366103 29946 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:38.362846 29965 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:38.355888 29927 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:38.372195 29969 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:38.368402 29946 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:38.379894 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:38.380515 24393 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:38.383714 24399 raft_consensus.cc:1240] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:38.385152 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:38.385746 24399 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 13.
I20260709 12:20:38.400096 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:38.402741 25110 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 14.
I20260709 12:20:38.407191 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:38.407294 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:38.413501 25118 raft_consensus.cc:1275] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:20:38.425105 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 69483us
I20260709 12:20:38.426028 24289 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:38.427435 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:38.430226 30042 log.cc:927] Time spent T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:20:38.431052 29975 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:38.434304 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:38.409363 29926 consensus_meta.cc:287] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756: Time spent flushing consensus metadata: real 0.529s	user 0.011s	sys 0.003s
I20260709 12:20:38.450572 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 877) took 1034 ms. Trace:
I20260709 12:20:38.440728 29922 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:38.408120 30044 log.cc:927] Time spent T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:20:38.452167 24400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51478 (request call id 2632) took 2545 ms. Trace:
I20260709 12:20:38.452366 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:38.461434 24400 rpcz_store.cc:276] 0709 12:20:35.906795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:36.189608 (+282813us) service_pool.cc:224] Handling call
0709 12:20:36.189904 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:37.146841 (+956937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:38.451879 (+1305038us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b54003647d4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:38.452076 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2195825408}
W20260709 12:20:38.462901 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.422506 29642 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.452129 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:38.440148 29825 raft_consensus.cc:2749] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:38.455047 24391 rpcz_store.cc:276] 0709 12:20:37.415849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:37.537376 (+121527us) service_pool.cc:224] Handling call
0709 12:20:37.562011 (+ 24635us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:37.575143 (+ 13132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:37.575191 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:37.585084 (+  9893us) log.cc:844] Serialized 26 byte log entry
0709 12:20:37.640776 (+ 55692us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:37.640831 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:38.436789 (+795958us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b540027e554. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:20:38.436835 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:38.436879 (+    44us) raft_consensus.cc:1685] finished
0709 12:20:38.436892 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:38.450471 (+ 13579us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":516,"raft.queue_time_us":2735,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":7969,"spinlock_wait_cycles":28864256,"thread_start_us":16687,"threads_started":1,"wal-append.queue_time_us":77881}
I20260709 12:20:38.464372 24290 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:38.378036 29924 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:38.464726 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
W20260709 12:20:38.453287 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 47540.7us
I20260709 12:20:38.469477 24398 raft_consensus.cc:1240] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:38.480516 24473 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 12: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:38.469642 24393 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
I20260709 12:20:38.481097 25082 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:38.483117 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:38.483868 24395 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:38.484320 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:38.461370 29810 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:38.470842 29969 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.487543 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:38.491106 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:38.472939 29927 raft_consensus.cc:2804] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:38.492262 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:38.470619 30009 raft_consensus.cc:493] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:38.494292 24474 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 13.
I20260709 12:20:38.502220 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:38.504469 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:38.507812 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:38.508549 24474 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:38.508374 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:38.484836 29998 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:38.452065 30039 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:38.515383 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:38.516100 24395 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 14.
I20260709 12:20:38.465034 29922 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:38.486965 30036 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:38.519505 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cf199780b748b28ae5a775abb95cbe" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:38.522135 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:38.522468 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:38.494571 29927 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.525848 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:38.533074 24289 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:38.534500 29926 raft_consensus.cc:2804] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:38.535058 29926 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.535503 29926 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:38.523353 24473 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 14.
I20260709 12:20:38.501799 29823 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:38.538823 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:38.502429 29969 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:38.474809 29642 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:38.547856 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:38.548782 25115 raft_consensus.cc:1240] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Rejecting Update request from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:38.521672 30036 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.551270 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:38.549863 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:38.550228 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:38.501063 29782 consensus_queue.cc:1059] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:20:38.524494 29975 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:38.537055 29927 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:38.557896 24473 raft_consensus.cc:2393] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 14: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:38.562938 24474 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 14.
I20260709 12:20:38.563966 29782 raft_consensus.cc:3055] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:38.564424 29782 raft_consensus.cc:740] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:38.556349 30036 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:38.565353 29782 consensus_queue.cc:260] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:38.566679 29782 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:38.568811 29946 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.569322 29946 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:38.571378 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:38.550139 29823 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:20:38.572804 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:38.573902 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:38.574630 29946 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:38.574923 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:38.575649 24399 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 14.
I20260709 12:20:38.575939 29823 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:20:38.576522 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:38.558486 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:38.504559 30009 raft_consensus.cc:515] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:38.559320 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:38.581019 25115 raft_consensus.cc:3060] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:38.585652 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:20:38.594862 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 61922.9us
I20260709 12:20:38.596985 25117 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 12: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:38.598197 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:38.599115 24399 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
I20260709 12:20:38.549644 30018 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:38.524689 29998 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:38.607013 24210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 75294.9us
I20260709 12:20:38.600503 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:38.610940 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:38.611797 24399 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:38.613848 24467 raft_consensus.cc:1240] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:38.606803 29946 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.640060 24472 raft_consensus.cc:1240] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:38.629731 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:38.656235 24439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:38.669198 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 156792us
I20260709 12:20:38.671011 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:38.675958 24399 raft_consensus.cc:2468] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
I20260709 12:20:38.679226 29922 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:38.649127 29946 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:38.688349 29946 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:38.694098 30018 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:38.694797 30018 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:38.695884 30045 log.cc:927] Time spent T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 12:20:38.697190 30018 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:38.698734 30018 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.699199 30018 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:38.701673 30009 leader_election.cc:290] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:38.704013 29998 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:38.705824 29822 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:38.701915 30018 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:38.705466 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:38.712651 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:38.713474 24399 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 17.
I20260709 12:20:38.674719 29924 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:38.719980 25110 raft_consensus.cc:2468] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 16.
W20260709 12:20:38.717301 24440 leader_election.cc:336] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:38.721167 24440 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:38.710353 30009 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:38.740046 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 67927.8us
W20260709 12:20:38.720121 30038 log.cc:927] Time spent T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.266s	user 0.002s	sys 0.001s
W20260709 12:20:38.744031 25084 leader_election.cc:336] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:38.744673 25084 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:38.741346 29796 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:38.751062 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:38.751963 24392 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 16.
I20260709 12:20:38.754678 24394 raft_consensus.cc:1240] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 12:20:38.740754 24440 leader_election.cc:336] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:38.757417 25084 consensus_peers.cc:597] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.756364 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:38.757266 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:38.756397 24440 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:38.758946 24394 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 12: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:38.742272 29924 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:38.755836 30029 raft_consensus.cc:2749] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:20:38.774905 24440 leader_election.cc:336] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:38.776312 24440 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:38.779765 24210 catalog_manager.cc:4755] TS c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): ChangeConfig:REMOVE_PEER RPC failed for tablet 97dd30b21cc14958a91b2da522e4bbe9: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:38.754753 30009 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:38.776836 29642 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:38.776865 29823 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:38.774906 29969 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:38.772378 29924 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:38.818921 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.819569 29924 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:38.837507 29823 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:38.840032 29823 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:38.841435 30039 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:38.846406 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 77242us
W20260709 12:20:38.847285 24440 leader_election.cc:336] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:38.847752 24440 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:38.853909 25115 raft_consensus.cc:2468] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 16.
I20260709 12:20:38.862514 29969 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:38.875456 23151 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 24350)
I20260709 12:20:38.889578 24290 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:38.890709 24290 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:38.893302 24290 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:38.881362 29864 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.885349 30036 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:38.895313 29864 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:38.895975 29356 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:38.896492 29356 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.896927 29356 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:38.897567 29864 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:38.892940 29969 raft_consensus.cc:2749] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:38.898244 29862 raft_consensus.cc:2749] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:38.895613 29881 consensus_meta.cc:287] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Time spent flushing consensus metadata: real 0.570s	user 0.006s	sys 0.007s
I20260709 12:20:38.900110 29881 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:38.901567 30025 log.cc:927] Time spent T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.759s	user 0.000s	sys 0.007s
I20260709 12:20:38.904358 29881 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:38.907967 24290 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:38.865669 30009 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:38.909147 29810 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:38.927507 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:38.912019 29864 raft_consensus.cc:2749] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:38.927610 24366 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:38.927712 24394 raft_consensus.cc:1275] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 14 index: 5. Preceding OpId from leader: term: 16 index: 6. (index mismatch)
I20260709 12:20:38.933139 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:38.935132 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:38.935446 24366 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:38.936538 25117 raft_consensus.cc:3055] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:38.938047 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:38.938756 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:38.939766 25114 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 12: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:38.942121 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:38.937033 25117 raft_consensus.cc:740] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:38.946188 24440 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:38.947218 24400 raft_consensus.cc:1240] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:38.952543 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:38.953428 24465 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 18.
I20260709 12:20:38.945824 25117 consensus_queue.cc:260] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:38.954792 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:38.954967 25117 raft_consensus.cc:3060] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:38.958860 24469 raft_consensus.cc:1240] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:38.960443 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:38.962935 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fa7cd50b4c4a12af95a9accb7dd947" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:38.930011 30004 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:38.936601 29998 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:38.938287 29843 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:38.979079 29843 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:38.981220 29843 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:38.939244 29959 raft_consensus.cc:2764] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:20:38.914162 29926 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:38.977941 30036 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:38.915259 29927 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:38.939597 29922 consensus_queue.cc:1059] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:20:38.983083 24465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:38.970587 29969 raft_consensus.cc:2804] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:38.949047 29881 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:38.993491 24471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 2562) took 1008 ms. Trace:
I20260709 12:20:38.954169 29924 raft_consensus.cc:2749] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:38.958781 29356 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:39.001753 29969 raft_consensus.cc:697] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:39.002871 29969 consensus_queue.cc:237] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:39.004930 24465 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 12: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:38.999184 24471 rpcz_store.cc:276] 0709 12:20:37.984984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:37.985973 (+   989us) service_pool.cc:224] Handling call
0709 12:20:37.986449 (+   476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:37.987014 (+   565us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:38.155802 (+168788us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b48001a01d8. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9c275aa1 00007f4a9c26cb37 00007f4a9c26c9ca 00007f4a9c36426f 00007f4a9c363f37 00007f4a9c37855c 00007f4a9c378508 00007f4a9c378488 00007f4a9c378443 00007f4a9c3776ec 00007f4a9b2a1a96
0709 12:20:38.436254 (+280452us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b18004905a0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a941d9c0a 00007f4a9d919219 00007f4a94261a40 00007f4a9425c4e4 00007f4a9425c455 00007f4a9ad443c7 00007f4a973569a7 00007f4a973660bf 00007f4a97366038
0709 12:20:38.722018 (+285764us) spinlock_profiling.cc:243] Waited 6.3 ms on lock 0x7b18004905a0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a96ef44bc 00007f4a9424248b 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425c455 00007f4a9ad443c7 00007f4a973569a7 00007f4a973660bf
0709 12:20:38.722197 (+   179us) log.cc:844] Serialized 14 byte log entry
0709 12:20:38.769995 (+ 47798us) log.cc:844] Serialized 14 byte log entry
0709 12:20:38.931801 (+161806us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:38.932314 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 12:20:38.932486 (+   172us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:38.932520 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:38.932587 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:38.984195 (+ 51608us) raft_consensus.cc:1685] finished
0709 12:20:38.984225 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:38.993415 (+  9190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10463,"prepare.queue_time_us":520760,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":2983,"raft.queue_time_us":9119,"raft.run_cpu_time_us":2395,"raft.run_wall_time_us":168554,"spinlock_wait_cycles":59826688,"thread_start_us":281136,"threads_started":3,"wal-append.queue_time_us":138864}
I20260709 12:20:39.013712 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:39.015007 24400 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:39.016296 30018 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.012689 29881 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:39.017773 30018 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:39.025669 29938 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.019s	sys 0.019s
I20260709 12:20:38.984941 30004 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:39.030797 29938 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.019s	sys 0.019s
I20260709 12:20:39.080938 29946 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:39.081669 29946 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:39.086131 24438 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:39.090787 29849 raft_consensus.cc:2804] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:39.091424 29849 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:39.092048 29849 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:39.093746 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.098176 29862 raft_consensus.cc:3055] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:39.098670 29862 raft_consensus.cc:740] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:39.094786 24438 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:39.101660 29885 raft_consensus.cc:2804] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:39.101747 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:39.101403 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:39.102358 29885 raft_consensus.cc:697] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:39.099860 29862 consensus_queue.cc:260] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:39.105334 24398 raft_consensus.cc:1240] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:39.105026 29885 consensus_queue.cc:237] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:39.106958 29862 raft_consensus.cc:3060] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:39.110446 24466 raft_consensus.cc:1275] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 14 index: 5. Preceding OpId from leader: term: 16 index: 6. (index mismatch)
I20260709 12:20:39.110564 29926 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:39.112200 30004 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:39.115892 24289 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:39.104450 25084 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 103 similar messages]
I20260709 12:20:39.117480 24290 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
W20260709 12:20:39.118266 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 182893us
I20260709 12:20:39.119457 24289 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:39.120376 24366 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:39.124243 24366 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:39.125732 24397 raft_consensus.cc:1275] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:20:39.126674 24290 leader_election.cc:304] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:39.130904 25117 raft_consensus.cc:1275] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:20:39.131662 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:39.132354 24397 raft_consensus.cc:1275] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:20:39.132810 24470 raft_consensus.cc:2393] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 16: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:39.101576 29946 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:39.133993 29881 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:39.118112 29927 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:39.134234 29796 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:39.134757 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:39.135713 24398 raft_consensus.cc:2410] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:20:39.136227 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:39.137179 24391 raft_consensus.cc:2393] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in current term 16: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:39.137584 30018 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:39.137848 25084 leader_election.cc:336] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:39.138393 25084 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:39.138718 29356 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:39.135149 24440 leader_election.cc:336] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:39.139240 29642 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:39.140012 24440 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:39.140931 29970 raft_consensus.cc:2749] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:20:39.141146 25084 leader_election.cc:336] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:39.141420 24440 leader_election.cc:336] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:39.130312 30027 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:20:39.141940 25084 consensus_peers.cc:597] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:39.142165 30027 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.141963 24440 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:39.142750 30027 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:39.130707 29926 raft_consensus.cc:2749] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:39.148792 29926 raft_consensus.cc:2749] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:39.149230 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:39.145162 24290 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:39.150913 24290 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:39.151865 24290 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:39.145496 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:39.145752 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:39.153326 24470 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 16.
W20260709 12:20:39.154882 24440 leader_election.cc:336] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:39.156324 24440 leader_election.cc:336] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:39.156852 24440 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:39.157881 24400 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 13.
W20260709 12:20:39.158463 24288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.159312 29947 raft_consensus.cc:2749] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:20:39.176126 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 51989.7us
I20260709 12:20:39.139515 30003 consensus_queue.cc:1059] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:20:39.178701 29784 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:39.178752 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:39.180678 24440 leader_election.cc:336] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:39.189775 24440 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:39.181329 30033 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:39.186932 29975 consensus_queue.cc:1048] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:39.187897 29998 consensus_queue.cc:1048] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:20:39.188390 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 69006.3us
I20260709 12:20:39.207945 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:39.193068 24366 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
W20260709 12:20:39.197896 24440 leader_election.cc:336] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:39.127794 30004 raft_consensus.cc:2749] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:39.208673 24289 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:39.210363 24440 leader_election.cc:336] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:39.212679 24289 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:39.208767 25117 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:39.213253 24440 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:39.188578 30018 raft_consensus.cc:2749] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:39.217023 24366 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:39.219000 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:39.221312 24468 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:39.217777 24440 leader_election.cc:336] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:39.223616 24440 leader_election.cc:336] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:39.210042 29881 raft_consensus.cc:2749] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:39.228816 29926 raft_consensus.cc:2749] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:39.231177 24289 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:39.273432 24289 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:39.233073 29959 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:39.217101 29927 raft_consensus.cc:3055] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:39.278035 29927 raft_consensus.cc:740] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:39.279057 29927 consensus_queue.cc:260] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:39.262737 30027 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:39.220280 29969 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:39.280685 29586 raft_consensus.cc:2749] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:39.281843 30018 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:39.188947 29970 raft_consensus.cc:2749] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:39.181648 29823 raft_consensus.cc:2749] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:39.280398 29927 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:39.192303 30033 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.207723 30039 raft_consensus.cc:2749] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:39.249024 24217 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54254 (request call id 265) took 37876 ms (client timeout 15000 ms). Trace:
I20260709 12:20:39.217600 30003 raft_consensus.cc:2749] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:39.258087 29946 consensus_queue.cc:1048] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:20:39.255663 24366 consensus_peers.cc:597] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:39.291163 25117 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 13.
I20260709 12:20:39.291275 24289 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:39.292693 24289 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:39.261246 24365 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:39.267218 24440 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:39.293887 24289 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:39.294013 30004 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:39.294693 30004 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.277535 29959 raft_consensus.cc:697] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:39.260187 30005 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:39.295135 30004 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:39.297417 24289 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:39.306248 24468 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 15.
I20260709 12:20:39.281643 30027 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 19 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:39.288457 30033 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:39.310431 24289 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:39.313910 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 90360.6us
W20260709 12:20:39.314528 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 67140.9us
I20260709 12:20:39.319751 24289 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:39.301155 29926 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:39.304230 29784 raft_consensus.cc:2749] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:39.300904 30005 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:39.304446 29586 raft_consensus.cc:2749] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:39.314009 30039 raft_consensus.cc:2749] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:39.317821 30003 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:39.350211 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:39.345948 25117 raft_consensus.cc:1275] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:20:39.347951 24289 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
W20260709 12:20:39.287379 24217 rpcz_store.cc:269] 0709 12:20:01.373042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.378365 (+1005323us) service_pool.cc:224] Handling call
0709 12:20:39.248915 (+36870550us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:31.910879 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:31.955153 (+ 44274us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:31.955211 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:20:31.955242 (+    31us) tablet.cc:662] Decoding operations
0709 12:20:31.956543 (+  1301us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:31.956667 (+   124us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:31.956698 (+    31us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:20:31.957895 (+  1197us) tablet.cc:701] Row locks acquired
0709 12:20:31.957951 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:20:31.958189 (+   238us) write_op.cc:270] Start()
0709 12:20:31.958365 (+   176us) write_op.cc:276] Timestamp: P: 1783599631958061 usec, L: 0
0709 12:20:31.958406 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 12:20:31.981245 (+ 22839us) log.cc:844] Serialized 4420 byte log entry
0709 12:20:32.963012 (+981767us) op_driver.cc:464] REPLICATION: finished
0709 12:20:33.595210 (+632198us) write_op.cc:301] APPLY: starting
0709 12:20:33.595344 (+   134us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:33.788180 (+192836us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:33.788299 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:34.217832 (+429533us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:34.218273 (+   441us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=0
0709 12:20:34.218347 (+    74us) write_op.cc:312] APPLY: finished
0709 12:20:34.218807 (+   460us) log.cc:844] Serialized 105 byte log entry
0709 12:20:34.321906 (+103099us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:34.328023 (+  6117us) write_op.cc:454] Released schema lock
0709 12:20:34.334415 (+  6392us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:34.400885 (+ 66470us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:34.405335 (+  4450us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":368139,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":615125,"apply.run_cpu_time_us":34333,"apply.run_wall_time_us":771334,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50151,"num_ops":11,"prepare.queue_time_us":713650,"prepare.run_cpu_time_us":24314,"prepare.run_wall_time_us":478389,"raft.queue_time_us":515668,"raft.run_cpu_time_us":26061,"raft.run_wall_time_us":382201,"replication_time_us":995530,"thread_start_us":1598227,"threads_started":5,"wal-append.queue_time_us":571279,"wal-append.run_cpu_time_us":26680,"wal-append.run_wall_time_us":2450339}]]}
I20260709 12:20:39.374042 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:39.327812 29881 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:39.374472 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:39.378454 24471 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:39.379760 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:39.319617 29849 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:20:39.389011 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:39.398432 24469 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:39.400805 24290 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:39.401486 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:39.402992 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:39.404018 24468 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:39.405725 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:39.406653 24391 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:39.327978 29810 raft_consensus.cc:2749] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:39.349902 30003 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.327071 30027 consensus_queue.cc:1048] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:20:39.342953 30005 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:39.416726 24440 leader_election.cc:336] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:39.419256 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:39.420691 24398 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:20:39.392400 29787 raft_consensus.cc:2804] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:20:39.423277 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 133022us
W20260709 12:20:39.421355 24440 consensus_peers.cc:597] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:39.427155 24366 consensus_peers.cc:597] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:39.429602 24366 leader_election.cc:336] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:39.430017 24366 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:39.428237 24440 leader_election.cc:336] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:39.417940 30003 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:39.438185 24471 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 13.
I20260709 12:20:39.418104 29926 raft_consensus.cc:2749] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:39.426592 24222 catalog_manager.cc:5697] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 10 to 11, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 11 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:39.363713 29796 consensus_queue.cc:1048] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 12:20:39.375733 29959 consensus_queue.cc:237] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:39.417447 29881 consensus_queue.cc:1048] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 12:20:39.431113 29924 raft_consensus.cc:2749] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:39.449054 24366 leader_election.cc:336] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:39.450249 24468 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 19.
I20260709 12:20:39.520267 29787 raft_consensus.cc:697] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:20:39.449082 24440 leader_election.cc:336] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:39.521353 24440 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:39.519652 24469 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 15.
W20260709 12:20:39.472429 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 92244.2us
I20260709 12:20:39.464622 30001 raft_consensus.cc:493] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:20:39.523937 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 74910.8us
W20260709 12:20:39.524801 24440 leader_election.cc:336] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:39.525291 24440 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:39.527539 24440 leader_election.cc:336] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:39.528228 24440 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:39.528075 30084 raft_consensus.cc:2749] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:39.531661 30004 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:39.531931 29787 consensus_queue.cc:237] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:39.473276 29356 consensus_queue.cc:1048] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:20:39.532987 30061 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.533604 30061 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:39.526259 30001 raft_consensus.cc:515] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:39.536972 30001 leader_election.cc:290] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:39.540388 30004 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:39.526173 29881 raft_consensus.cc:2749] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:39.542064 29849 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:20:39.543987 30005 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:39.546694 30005 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:39.542482 30061 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:39.550187 30018 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:39.531662 30003 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:39.547880 30033 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:39.557700 30003 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:39.567589 30033 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:39.608448 24222 catalog_manager.cc:5697] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 9 to 10, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 10 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:39.612787 24222 catalog_manager.cc:5697] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:39.617650 24222 catalog_manager.cc:5697] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 9 to 13, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 13 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:39.620456 24222 catalog_manager.cc:5697] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:39.622951 24222 catalog_manager.cc:5697] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 9 to 12, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 12 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:39.625468 24222 catalog_manager.cc:5697] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 7 to 14, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 14 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:39.628074 24222 catalog_manager.cc:5697] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 6 to 13, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 13 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:39.631019 24222 catalog_manager.cc:5697] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 6 to 14. New cstate: current_term: 14 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:39.633462 24222 catalog_manager.cc:5697] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 9 to 13, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 13 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:39.635807 24222 catalog_manager.cc:5697] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:39.638038 24222 catalog_manager.cc:5697] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:39.640331 24222 catalog_manager.cc:5697] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 8 to 11, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 11 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:39.519500 24366 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:20:39.646737 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 119059us
I20260709 12:20:39.440547 24391 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 15.
I20260709 12:20:39.526432 24398 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 19.
W20260709 12:20:39.648517 24440 leader_election.cc:336] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:39.649768 24440 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:39.651157 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:39.652595 24399 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:39.653515 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:39.657091 24400 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:39.660459 24290 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:39.654891 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:39.663910 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:39.665108 24468 raft_consensus.cc:2368] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 14. Current term is 15.
I20260709 12:20:39.666672 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:39.667691 24469 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:39.647994 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 198821us
W20260709 12:20:39.669397 24366 leader_election.cc:336] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:39.668948 24222 catalog_manager.cc:5697] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 7 to 13, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 13 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:39.670075 24366 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:20:39.677258 25082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.688807 24290 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:39.690809 24289 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:39.691568 30004 raft_consensus.cc:2749] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:39.709497 30033 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:39.711365 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:39.713147 29922 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.678871 29849 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:39.713085 30033 raft_consensus.cc:697] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 19 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:39.715729 29998 raft_consensus.cc:2749] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:39.714166 29922 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:39.676993 24222 catalog_manager.cc:5697] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 8 to 14, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 14 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:39.717181 30086 raft_consensus.cc:493] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.722579 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:39.722895 30086 raft_consensus.cc:515] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:39.721733 24469 raft_consensus.cc:2468] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 17.
I20260709 12:20:39.728276 24222 catalog_manager.cc:5697] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 9 to 10, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 10 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:39.730585 29612 raft_consensus.cc:2749] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:39.731812 29922 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:39.735754 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 49518.2us
I20260709 12:20:39.736497 29927 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:39.737295 29927 raft_consensus.cc:697] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 15 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
W20260709 12:20:39.739178 30072 log.cc:927] Time spent T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.385s	user 0.003s	sys 0.000s
I20260709 12:20:39.740056 29356 raft_consensus.cc:2749] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:20:39.740620 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 50245us
I20260709 12:20:39.742921 30086 leader_election.cc:290] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:39.725771 30033 consensus_queue.cc:237] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:39.749121 25083 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:39.751428 29964 raft_consensus.cc:2804] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:39.752174 29964 raft_consensus.cc:697] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:39.753636 29964 consensus_queue.cc:237] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:39.755451 24222 catalog_manager.cc:5697] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:39.775708 24400 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 17.
W20260709 12:20:39.791682 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 122408us
I20260709 12:20:39.793524 24222 catalog_manager.cc:5697] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:39.796912 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:39.799597 24394 raft_consensus.cc:1240] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 16. Current term is 17. Ops: [16.6-16.6]
I20260709 12:20:39.781313 30086 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.801398 30086 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:39.806211 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 63841.4us
I20260709 12:20:39.795986 24222 catalog_manager.cc:5697] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 7 to 13, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 13 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:39.739192 29927 consensus_queue.cc:237] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:39.807252 29885 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.842355 24289 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:39.848531 29586 consensus_queue.cc:1059] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: INVALID_TERM, Last received: 14.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:39.849078 29926 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:39.852069 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:39.855227 29885 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:39.858321 24365 leader_election.cc:400] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Vote denied by peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453) with higher term. Message: Invalid argument: T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 14. Current term is 15.
I20260709 12:20:39.858778 24365 leader_election.cc:403] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:20:39.859519 30004 raft_consensus.cc:3060] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:39.860713 24365 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:39.861886 29946 raft_consensus.cc:2804] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:39.862524 29946 raft_consensus.cc:697] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 17 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:39.863724 29946 consensus_queue.cc:237] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.5, Last appended by leader: 5, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:39.815076 30086 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:39.875115 24399 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 15.
W20260709 12:20:39.876473 23151 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 24350)
I20260709 12:20:39.877079 25082 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:39.879899 29982 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:39.849116 24400 raft_consensus.cc:1275] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:20:39.859220 24222 catalog_manager.cc:5697] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:39.883749 24222 catalog_manager.cc:5697] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 10 to 14, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 14 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:39.888674 29924 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:39.897164 29586 raft_consensus.cc:3055] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:39.919143 29586 raft_consensus.cc:740] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:39.919250 29924 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:39.920810 29586 consensus_queue.cc:260] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 16.6, Last appended by leader: 6, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:39.921943 29924 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:39.922248 29586 raft_consensus.cc:3060] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:39.923331 24222 catalog_manager.cc:5697] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 10 to 13, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 13 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:39.901057 24289 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:39.925164 24222 catalog_manager.cc:5697] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 10 to 11, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 11 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:39.905982 29926 raft_consensus.cc:697] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 17 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:39.906049 29862 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:39.907469 29881 consensus_queue.cc:1048] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:39.908183 29885 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:39.910682 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:39.913563 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bd4c6351f24e35abba86aef1ce23be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:39.914803 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:39.916517 24474 raft_consensus.cc:1240] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 16. Current term is 17. Ops: [16.6-16.6]
I20260709 12:20:39.940692 24470 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:39.926677 29862 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:39.943137 29926 consensus_queue.cc:237] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:39.958024 30004 raft_consensus.cc:2749] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453) with higher term. Message: Invalid argument: T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 14. Current term is 15.
I20260709 12:20:39.962109 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34412a32b83e40b7918bf8492b7af28f" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:39.964239 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:39.966391 29862 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:39.968602 24399 raft_consensus.cc:1275] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:20:39.940330 30033 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:39.977064 24468 raft_consensus.cc:1240] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:39.984740 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:39.985793 30061 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.986564 30061 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:39.985463 24470 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 15.
I20260709 12:20:39.947371 24222 catalog_manager.cc:5697] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 10 to 11, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 11 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:39.993100 29881 consensus_queue.cc:1048] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:39.998392 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:40.004261 24440 leader_election.cc:336] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:40.005125 24440 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:40.008399 30061 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:40.013399 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:39.996809 30033 raft_consensus.cc:697] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 15 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:40.012246 29881 raft_consensus.cc:2749] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:40.026636 29927 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.027590 29927 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:40.033707 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:40.035143 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:40.036170 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:40.037724 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:40.038957 24474 raft_consensus.cc:1275] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 12:20:40.039391 24474 pending_rounds.cc:85] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting all ops after (but not including) 11
I20260709 12:20:40.039212 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:40.043661 24474 pending_rounds.cc:107] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 12:20:40.048863 24474 raft_consensus.cc:2889] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:40.053380 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:40.054352 25110 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 16.
I20260709 12:20:40.057595 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c31a779e7949a590cf168eef01e405" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:40.043395 24222 catalog_manager.cc:5697] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 6 to 8, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 8 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:20:40.064239 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 57611.1us
I20260709 12:20:40.043942 29927 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:40.040438 30033 consensus_queue.cc:237] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:40.083138 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:40.081903 29612 consensus_queue.cc:1048] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:20:40.115751 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:40.108850 24222 catalog_manager.cc:5697] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:40.119051 24290 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:40.125705 25112 raft_consensus.cc:1275] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:20:40.129980 24290 leader_election.cc:304] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:40.140858 29975 consensus_queue.cc:1048] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 12:20:40.143659 24291 leader_election.cc:304] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:40.145514 25114 raft_consensus.cc:1275] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:20:40.129092 29926 raft_consensus.cc:2749] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:40.135705 24222 catalog_manager.cc:5697] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:40.166853 29862 raft_consensus.cc:2749] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:40.170226 29586 raft_consensus.cc:2749] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:40.170984 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:40.171746 25117 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
I20260709 12:20:40.172948 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:40.182180 29927 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:40.183018 29927 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:40.198099 29927 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:40.199087 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 69172.6us
I20260709 12:20:40.201536 29586 consensus_queue.cc:1059] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:40.203637 30086 raft_consensus.cc:3055] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:40.204097 30086 raft_consensus.cc:740] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:40.205329 30086 consensus_queue.cc:260] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:20:40.206750 30086 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:40.217335 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:40.226322 24400 raft_consensus.cc:1240] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:40.227221 30061 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.227962 30061 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:40.231678 30061 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:40.233280 24290 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:40.235499 29927 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:40.245260 24440 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:40.246737 25084 leader_election.cc:336] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:40.253262 24290 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:40.254177 24291 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:40.307880 24440 leader_election.cc:336] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:40.311663 24440 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:40.313710 24440 consensus_peers.cc:597] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:40.314991 29881 raft_consensus.cc:2749] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:20:40.306519 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 54435.2us
I20260709 12:20:40.310351 29926 raft_consensus.cc:2749] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:40.322037 24469 raft_consensus.cc:1275] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 19 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:20:40.322283 30018 consensus_queue.cc:1048] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:20:40.362516 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:40.363788 24394 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 16.
I20260709 12:20:40.350950 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:40.316854 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:40.372388 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:40.365792 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:40.379602 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:40.379823 24473 raft_consensus.cc:1275] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:20:40.382295 24398 raft_consensus.cc:1275] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:20:40.306226 29862 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:40.380779 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:40.401857 30001 consensus_queue.cc:1048] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:20:40.393826 25084 consensus_peers.cc:597] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:40.434984 24398 raft_consensus.cc:1275] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 19 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:20:40.452996 29952 consensus_queue.cc:1048] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:20:40.455066 23151 tablet_replica.cc:333] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:40.458092 23151 raft_consensus.cc:2243] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:40.459120 23151 raft_consensus.cc:2272] T 9ae0187acc6343ef874010bc79580048 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:40.462073 24366 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:40.463956 24366 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:40.464732 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:40.466415 25082 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:40.470505 29982 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:40.471527 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:40.473495 25114 raft_consensus.cc:1275] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:20:40.475232 23151 tablet_replica.cc:333] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:40.478948 23151 raft_consensus.cc:2243] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:40.489523 23151 pending_rounds.cc:70] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756: Trying to abort 3 pending ops.
I20260709 12:20:40.503064 24222 catalog_manager.cc:5697] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 11 to 16, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 16 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
W20260709 12:20:40.513221 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 44571.5us
I20260709 12:20:40.493496 23151 pending_rounds.cc:77] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756: Aborting op as it isn't in flight: id { term: 17 index: 10 } timestamp: 7305624101958619136 op_type: NO_OP noop_request { }
I20260709 12:20:40.515262 23151 raft_consensus.cc:2889] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:40.515746 23151 pending_rounds.cc:77] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756: Aborting op as it isn't in flight: id { term: 16 index: 9 } timestamp: 7305624062943817728 op_type: NO_OP noop_request { }
I20260709 12:20:40.535841 23151 raft_consensus.cc:2889] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:40.536420 23151 pending_rounds.cc:77] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756: Aborting op as it isn't in flight: id { term: 14 index: 8 } timestamp: 7305624012268548096 op_type: NO_OP noop_request { }
I20260709 12:20:40.536880 23151 raft_consensus.cc:2889] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:40.540933 23151 raft_consensus.cc:2272] T 66cf199780b748b28ae5a775abb95cbe P c711faa13ead43ebbea0192cb74a4756 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:40.543211 24397 raft_consensus.cc:2468] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 15.
I20260709 12:20:40.508944 30004 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:40.551849 29959 raft_consensus.cc:2749] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:40.552994 30005 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:40.553432 30005 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:40.553849 30005 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:40.555395 23151 tablet_replica.cc:333] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:40.557693 23151 raft_consensus.cc:2243] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:40.559280 24222 catalog_manager.cc:5697] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 5 to 12, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 12 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:40.561094 24392 raft_consensus.cc:1275] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:20:40.565637 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 58240us
I20260709 12:20:40.583952 24474 raft_consensus.cc:1275] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 14 index: 5. Preceding OpId from leader: term: 17 index: 6. (index mismatch)
I20260709 12:20:40.538193 29586 consensus_queue.cc:1048] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:20:40.552374 30004 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:40.620913 23151 raft_consensus.cc:2272] T 34412a32b83e40b7918bf8492b7af28f P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:40.580175 29959 consensus_queue.cc:1048] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
W20260709 12:20:40.680027 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 140616us
W20260709 12:20:40.689555 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 121987us
W20260709 12:20:40.692567 24366 leader_election.cc:336] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:40.693025 24366 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:20:40.694324 24366 consensus_peers.cc:597] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:40.701102 24366 consensus_peers.cc:597] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:40.707746 30069 consensus_queue.cc:1048] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.085s
W20260709 12:20:40.709800 30110 log.cc:927] Time spent T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:20:40.713451 24397 raft_consensus.cc:1275] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 12:20:40.726586 24470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.022s	sys 0.027s
W20260709 12:20:40.727069 24470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.023s	sys 0.027s
W20260709 12:20:40.728749 25084 consensus_peers.cc:597] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:40.732286 24366 leader_election.cc:336] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:40.736083 25084 consensus_peers.cc:597] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:40.713438 30004 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:40.747648 30018 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:40.760784 30107 log.cc:927] Time spent T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 12:20:40.744743 25084 consensus_peers.cc:597] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:40.766275 29970 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:40.772102 24366 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:40.774776 23151 tablet_replica.cc:333] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:40.775913 23151 raft_consensus.cc:2243] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:40.776736 30118 raft_consensus.cc:2749] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:40.779013 24290 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:40.779956 29922 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.780825 30086 raft_consensus.cc:2749] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:40.780541 29922 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:40.780725 29926 consensus_queue.cc:1048] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:40.767326 30018 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:40.783231 29922 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:40.783692 30018 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:40.785816 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 53562.2us
W20260709 12:20:40.786924 24366 consensus_peers.cc:597] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:40.787760 24366 leader_election.cc:336] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:40.787981 30005 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:40.793571 30005 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:40.794471 30018 raft_consensus.cc:493] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.795262 30018 raft_consensus.cc:515] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:40.770970 25084 consensus_peers.cc:597] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:40.797827 30018 leader_election.cc:290] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:40.817914 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:40.819445 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:40.824853 25117 raft_consensus.cc:3055] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:40.829150 23151 raft_consensus.cc:2272] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:40.825325 25117 raft_consensus.cc:740] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:40.834806 24471 raft_consensus.cc:1275] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:20:40.788174 24366 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:40.859586 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400165817fe74ada9a4793982993a5e3" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:40.873257 24466 raft_consensus.cc:1275] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:20:40.875068 24465 raft_consensus.cc:1275] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:20:40.876488 25117 consensus_queue.cc:260] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:40.877727 30111 log.cc:927] Time spent T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.211s	user 0.000s	sys 0.007s
I20260709 12:20:40.895007 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:40.896104 24472 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 16.
I20260709 12:20:40.897073 30018 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.897962 30018 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:40.903128 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 115380us
W20260709 12:20:40.904189 24366 leader_election.cc:336] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:40.904806 24366 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:40.906569 24366 leader_election.cc:336] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:40.908025 24366 leader_election.cc:336] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:40.874327 30005 raft_consensus.cc:2749] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:40.908541 24366 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:40.924263 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 100495us
W20260709 12:20:40.931116 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 229775us
I20260709 12:20:40.912588 30119 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:40.933846 30118 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:40.920017 30069 raft_consensus.cc:2749] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:40.926839 29922 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.927270 30033 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.978797 24393 raft_consensus.cc:1275] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:20:40.984758 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 76779.4us
I20260709 12:20:40.984877 30029 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.961127 30033 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:40.971906 30018 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:40.987592 24391 raft_consensus.cc:1275] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:20:40.990130 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:40.991278 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fce41b64ab4350b88ec02abbcd9c82" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:40.994360 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:40.999805 29922 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:41.003206 23151 tablet_replica.cc:333] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:41.007553 24290 leader_election.cc:304] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:40.998260 24366 leader_election.cc:336] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:41.014828 24399 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 16.
I20260709 12:20:41.014605 30029 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:41.019711 30033 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:41.029314 24366 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:41.038097 29612 raft_consensus.cc:2749] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:41.038542 29969 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:41.038947 30129 log.cc:927] Time spent T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:20:41.039372 29969 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:41.044461 29975 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.046160 29975 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:41.046787 29922 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:41.048337 30135 consensus_queue.cc:1048] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:20:41.049373 29926 consensus_queue.cc:1048] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:20:41.050794 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 52558.5us
I20260709 12:20:41.044679 30033 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.053807 30033 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:41.054260 25082 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:41.057008 29970 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:41.091461 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:41.048784 29975 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:41.040621 23151 raft_consensus.cc:2243] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:20:41.068003 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:41.069954 30029 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:41.068050 25117 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:41.095700 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:41.045183 24290 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:41.053215 29969 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:41.057713 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:41.109728 23151 raft_consensus.cc:2272] T 1246d2a6c02a457f97a768233aa6cf6d P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:41.094754 29970 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:41.096609 24391 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 15.
I20260709 12:20:41.101135 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:41.102458 24471 raft_consensus.cc:2368] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 13. Current term is 14.
I20260709 12:20:41.103338 30132 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:20:41.103467 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 49360.8us
W20260709 12:20:41.113288 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 68228.6us
I20260709 12:20:41.107903 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:41.126531 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:41.119210 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:41.127525 30132 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:41.132230 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c8932a13b744d7a945b0a7655f5a47" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:41.133814 30132 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:41.129691 25110 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
I20260709 12:20:41.137238 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:41.128783 25082 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:41.132718 24392 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
I20260709 12:20:41.143690 25082 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:41.090610 30136 raft_consensus.cc:2749] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:41.146420 24366 leader_election.cc:336] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:41.147037 29952 raft_consensus.cc:2749] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:41.127646 30114 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:41.148579 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:41.176681 24366 leader_election.cc:336] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:41.177291 24366 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:41.178164 30118 raft_consensus.cc:2749] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:20:41.179987 24366 leader_election.cc:336] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:41.181493 24366 leader_election.cc:336] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:41.181917 24366 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:41.183835 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:41.184746 24474 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 12.
I20260709 12:20:41.184885 30132 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:41.186422 25119 raft_consensus.cc:2393] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 17: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:41.187546 30132 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 17 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:41.175742 23151 tablet_replica.cc:333] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:41.190052 23151 raft_consensus.cc:2243] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:20:41.196756 29922 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.153662 30114 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:41.197383 23151 raft_consensus.cc:2272] T 8616bc73679e486399b789377c5cd1ba P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:41.197512 29922 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:41.200897 30005 raft_consensus.cc:2749] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:41.201288 29586 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.201978 29586 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:41.202493 24366 leader_election.cc:336] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:41.203032 24366 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:41.204427 24366 leader_election.cc:336] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:41.132113 29862 consensus_queue.cc:1048] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:20:41.204927 24366 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:41.205616 24290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:41.206558 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 49597us
I20260709 12:20:41.200377 29922 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:41.219607 30018 consensus_queue.cc:1048] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:20:41.215543 29959 raft_consensus.cc:2749] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:41.228808 24438 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:20:41.229681 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 113229us
I20260709 12:20:41.228984 30033 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:41.214468 30114 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:41.242760 25117 raft_consensus.cc:1275] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 12:20:41.243301 25117 pending_rounds.cc:85] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281: Aborting all ops after (but not including) 13
I20260709 12:20:41.243566 25117 pending_rounds.cc:107] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 12:20:41.243826 25117 raft_consensus.cc:2889] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:41.245744 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:41.246448 24469 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
W20260709 12:20:41.249907 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 45504.9us
W20260709 12:20:41.251264 24366 leader_election.cc:336] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:41.252221 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 99656.7us
W20260709 12:20:41.241593 24440 leader_election.cc:336] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:41.253152 24366 leader_election.cc:336] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:41.253970 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 18 candidate_status { last_received { term: 16 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:41.254611 24440 leader_election.cc:336] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:41.254748 24365 leader_election.cc:400] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Vote denied by peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453) with higher term. Message: Invalid argument: T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 13. Current term is 14.
I20260709 12:20:41.255470 24365 leader_election.cc:403] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:41.253706 24366 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:41.257123 24440 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:41.249902 30005 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:41.258102 24366 consensus_peers.cc:597] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:41.242815 29885 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:41.267124 24289 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:41.248221 29964 raft_consensus.cc:2749] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:41.258670 30134 raft_consensus.cc:2804] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:41.265487 29959 raft_consensus.cc:2749] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:41.294406 29885 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:41.318373 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:41.321367 25117 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 12.
I20260709 12:20:41.298125 29586 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:41.275898 29952 consensus_queue.cc:1048] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:20:41.312486 23151 tablet_replica.cc:333] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:41.335001 23151 raft_consensus.cc:2243] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:41.335901 23151 raft_consensus.cc:2272] T d9034e708c454259aebd10b80eeab667 P c711faa13ead43ebbea0192cb74a4756 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:41.270046 30018 consensus_queue.cc:1048] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:20:41.309535 30134 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:41.344120 30134 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:41.319015 29926 raft_consensus.cc:493] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.345876 29926 raft_consensus.cc:515] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:41.347137 30126 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:20:41.357853 30001 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:41.327069 29885 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:41.361704 23151 tablet_replica.cc:333] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:41.290499 30135 consensus_queue.cc:1048] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
W20260709 12:20:41.364938 30144 log.cc:927] Time spent T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.125s	user 0.002s	sys 0.000s
I20260709 12:20:41.394752 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:41.429010 29926 leader_election.cc:290] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:41.391943 29970 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:41.511235 30135 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.511597 24472 raft_consensus.cc:1240] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Rejecting Update request from peer c855242ec9d34a5397741ef20db9de8a for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:41.512063 30135 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:41.516386 30135 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:41.500732 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 100403us
W20260709 12:20:41.501822 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 106573us
I20260709 12:20:41.398746 23151 raft_consensus.cc:2243] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:41.522359 23151 raft_consensus.cc:2272] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:41.488530 30134 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:41.509091 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 115379us
I20260709 12:20:41.517961 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:41.518940 29970 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:41.556964 30146 consensus_queue.cc:1059] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:20:41.495187 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 228199us
I20260709 12:20:41.559217 24289 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:41.498142 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:41.496657 24398 raft_consensus.cc:2393] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 17: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:41.554529 30134 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:41.496771 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 197011us
W20260709 12:20:41.508049 24440 consensus_peers.cc:597] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:41.491149 30114 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:41.562189 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 54202.2us
I20260709 12:20:41.578724 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:41.578874 24289 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:41.579478 24400 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:41.579743 24289 raft_consensus.cc:2686] T 46c46f855639421fb6d7eab9b01f55a0 P c711faa13ead43ebbea0192cb74a4756: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:20:41.580845 29922 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:41.583431 24289 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:41.584945 30114 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:41.488535 30126 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453) with higher term. Message: Invalid argument: T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a for earlier term 13. Current term is 14.
I20260709 12:20:41.584945 30147 raft_consensus.cc:2749] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:41.588240 24366 leader_election.cc:336] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:41.589051 24290 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:41.591212 29922 raft_consensus.cc:2804] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:41.591655 29922 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:41.592008 29922 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:41.592897 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de6cc497bc845dda523b96c519faf83" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 18 candidate_status { last_received { term: 16 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:41.594369 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:41.595523 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:41.596730 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:41.598435 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:41.594924 24399 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:41.589182 24366 leader_election.cc:336] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:41.600709 24366 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:41.600937 24400 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
I20260709 12:20:41.602829 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:41.604691 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:41.605249 25110 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:41.607990 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:41.622771 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:41.624905 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218e3bf7807b42d09ac3db0dad69fcf9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:41.628665 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:41.629400 24466 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:41.632220 24440 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:41.495299 29885 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:41.572310 29926 consensus_queue.cc:1048] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 12:20:41.643435 30118 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:41.644326 23151 tablet_replica.cc:333] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:41.635066 29975 raft_consensus.cc:2749] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:41.630468 30147 raft_consensus.cc:493] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.679319 24472 raft_consensus.cc:1240] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Rejecting Update request from peer c711faa13ead43ebbea0192cb74a4756 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:20:41.697304 23151 raft_consensus.cc:2243] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:41.710261 25110 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
W20260709 12:20:41.711186 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 63397.2us
I20260709 12:20:41.689011 29862 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.722851 29862 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:20:41.725054 29862 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:41.727864 24399 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 17.
I20260709 12:20:41.691064 30147 raft_consensus.cc:515] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:41.731110 30147 leader_election.cc:290] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:41.732540 30001 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.733124 30001 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:41.735312 30001 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:41.687394 30135 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.745564 30069 raft_consensus.cc:3055] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:41.745421 30135 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:41.745992 30069 raft_consensus.cc:740] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:41.746968 30069 consensus_queue.cc:260] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:41.747836 30135 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:41.750787 23151 raft_consensus.cc:2272] T 400165817fe74ada9a4793982993a5e3 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:41.753854 23151 tablet_replica.cc:333] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:41.754534 24440 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:41.754899 23151 raft_consensus.cc:2243] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:41.756886 30065 raft_consensus.cc:2804] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:41.741822 29885 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:41.760968 30065 raft_consensus.cc:697] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:41.768895 29922 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:41.771353 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 125699us
I20260709 12:20:41.785599 24289 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:41.791967 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 115781us
I20260709 12:20:41.793805 24289 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:41.795228 24289 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:41.796281 24466 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 17.
W20260709 12:20:41.802845 25083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 185207us
I20260709 12:20:41.810316 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:41.811117 24398 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 14.
I20260709 12:20:41.813649 23151 raft_consensus.cc:2272] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:41.815830 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:41.818552 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:41.822064 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 64031.9us
I20260709 12:20:41.822881 24289 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:41.819219 24395 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 13.
I20260709 12:20:41.826120 24289 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:41.793922 30069 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:41.791967 30136 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:41.795866 29862 raft_consensus.cc:2749] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:41.841266 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 237454us
I20260709 12:20:41.823669 30135 raft_consensus.cc:2749] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:41.851526 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:20:41.856680 25084 consensus_peers.cc:597] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:41.838035 29926 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:41.837844 30018 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:41.825475 29959 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:20:41.864838 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 214721us
I20260709 12:20:41.863274 30136 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:41.887018 30136 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:41.888888 30148 raft_consensus.cc:2749] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:41.863313 29926 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:41.773978 30065 consensus_queue.cc:237] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:41.872308 25084 consensus_peers.cc:597] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:41.870410 29862 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.872673 30018 raft_consensus.cc:697] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 17 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:41.945952 24290 leader_election.cc:304] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:41.897310 29926 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:41.906860 30135 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.872761 29959 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:20:41.953938 30086 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.958352 30001 raft_consensus.cc:2749] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:41.994345 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 170163us
I20260709 12:20:41.995806 29862 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:42.006300 29922 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:42.013963 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 68772.9us
W20260709 12:20:42.016491 24440 leader_election.cc:336] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:42.019726 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 62048us
I20260709 12:20:42.026119 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:42.027056 24466 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 14.
I20260709 12:20:42.029002 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:42.031119 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:42.035297 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f1d05390b4454b317c19d513384be" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:42.044328 24472 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 14.
I20260709 12:20:41.958946 30165 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.081171 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:42.086520 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:42.065240 23151 tablet_replica.cc:333] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
W20260709 12:20:42.065378 30169 log.cc:927] Time spent T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:20:42.094331 24393 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 13: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:42.098071 23151 raft_consensus.cc:2243] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:20:42.066256 29862 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:42.111495 30129 log.cc:927] Time spent T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.270s	user 0.002s	sys 0.000s
W20260709 12:20:42.121537 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 276016us
I20260709 12:20:42.094034 30136 consensus_queue.cc:1059] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:20:42.081528 29922 raft_consensus.cc:493] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:20:42.131841 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 72485.3us
I20260709 12:20:42.063997 30086 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:42.142266 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d97e40dd274a2ea3734c2982741e3c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:42.145314 24290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 124143us
W20260709 12:20:42.141597 24440 consensus_peers.cc:597] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:42.061502 30135 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:42.149305 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:42.159083 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:42.170814 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:42.091449 30165 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:42.177024 30180 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.189579 30180 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:42.191752 30180 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:42.193068 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c2470f38204e5ba4ee545bb2de933c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:42.153177 30018 consensus_queue.cc:237] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:42.185920 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:42.197417 25119 raft_consensus.cc:2393] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 13: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
W20260709 12:20:42.205076 25084 consensus_peers.cc:597] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:42.206343 25084 leader_election.cc:336] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:42.206780 25084 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:42.206765 29926 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:42.210788 24290 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:42.210259 30061 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:42.214660 30135 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:42.210178 30113 raft_consensus.cc:3055] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:42.187403 30086 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:42.220490 30113 raft_consensus.cc:740] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:42.222463 24290 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:42.223011 30147 raft_consensus.cc:2804] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:42.223600 30147 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:42.223997 30147 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:42.224512 30180 raft_consensus.cc:2749] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:42.223095 30113 consensus_queue.cc:260] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:42.226339 30113 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:42.147567 29922 raft_consensus.cc:515] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:42.242636 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:42.245932 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:42.230079 29926 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:42.252315 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:42.259330 24474 raft_consensus.cc:2393] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 14: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:42.255741 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:42.260512 24466 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:42.265455 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:42.277055 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:42.270671 29922 leader_election.cc:290] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:42.282513 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 218472us
I20260709 12:20:42.287213 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:42.283528 29959 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:20:42.315871 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63debf83121c430e9dffcd1c5035cf3a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:42.316529 24440 leader_election.cc:336] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:42.283725 30165 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:42.319288 24440 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:42.330250 24289 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:42.337741 30135 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:42.343132 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:42.344475 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48340fd716644ed18711f9addc546f4b" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:42.345665 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a61f2b7e79419c82712f4b54b899ed" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:42.328905 24291 leader_election.cc:304] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:42.351322 29885 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:42.347064 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:42.354029 24396 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:42.356954 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:42.366559 30165 raft_consensus.cc:2749] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:42.370725 24291 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:42.377254 24366 leader_election.cc:336] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:42.378784 23151 raft_consensus.cc:2272] T dfa0a0cd756141c094288d3c05139379 P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.379793 24291 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:42.380851 30177 raft_consensus.cc:2749] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:42.381978 23151 tablet_replica.cc:333] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:42.382186 30177 raft_consensus.cc:2749] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:42.383495 23151 raft_consensus.cc:2243] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:20:42.390455 30114 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.391070 30114 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:42.395534 25084 leader_election.cc:336] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:42.396051 25084 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:42.398147 24396 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 15.
I20260709 12:20:42.399379 24466 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 15.
I20260709 12:20:42.387341 23151 raft_consensus.cc:2272] T 18eaf20aac4141229219a10fc4ed0a23 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.401783 24289 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:42.408442 24289 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:42.409849 24289 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:42.405261 24290 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:42.415144 24365 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:42.416766 24289 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:42.428762 29612 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:42.397745 29964 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:42.444931 30114 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:42.447429 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:42.419643 30181 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.449448 30181 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:42.418797 30136 raft_consensus.cc:2749] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:42.418327 30086 raft_consensus.cc:2749] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:20:42.466245 24291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 66108us
I20260709 12:20:42.467082 24291 leader_election.cc:304] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:42.474610 24440 consensus_peers.cc:597] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:42.484840 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:42.485762 25119 raft_consensus.cc:2393] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 17: Already voted for candidate d99d5d772cfe4a96afcab3d3b009a281 in this term.
I20260709 12:20:42.488237 29862 raft_consensus.cc:2749] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:42.490955 30170 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:42.491533 30170 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:42.463936 30177 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:42.500306 30170 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:42.503906 30147 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:20:42.452457 30181 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:42.514715 30177 raft_consensus.cc:697] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 15 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:42.552589 24400 raft_consensus.cc:1275] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:20:42.556212 29862 raft_consensus.cc:2749] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:42.580178 23151 tablet_replica.cc:333] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:42.581961 23151 raft_consensus.cc:2243] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 12:20:42.563455 24289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 146794us
I20260709 12:20:42.573776 30177 consensus_queue.cc:237] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:42.576036 30150 consensus_queue.cc:1048] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:42.591209 30147 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:42.608771 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:42.562704 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:42.609474 24466 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:42.600243 24366 consensus_peers.cc:597] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:42.593852 29612 raft_consensus.cc:2749] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:42.553840 30018 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:42.611207 24366 leader_election.cc:336] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:42.616017 25110 raft_consensus.cc:1275] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:20:42.627075 24365 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:42.630448 29969 consensus_queue.cc:1048] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:42.640115 29612 raft_consensus.cc:2749] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:42.644301 23151 pending_rounds.cc:70] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756: Trying to abort 1 pending ops.
I20260709 12:20:42.644745 23151 pending_rounds.cc:77] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756: Aborting op as it isn't in flight: id { term: 11 index: 7 } timestamp: 7305624101493899264 op_type: NO_OP noop_request { }
I20260709 12:20:42.645085 23151 raft_consensus.cc:2889] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:42.645401 23151 raft_consensus.cc:2272] T c06ca9ec70d4444d88577d9e07b62edc P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.648842 30132 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:42.649569 30132 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:42.655645 30132 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:42.660986 23151 tablet_replica.cc:333] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:42.663887 23151 raft_consensus.cc:2243] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:20:42.666275 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:42.672093 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a60f1722e64f329fe72226d0dbb7c4" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:42.672737 24466 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 15.
I20260709 12:20:42.677807 24397 raft_consensus.cc:2393] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c711faa13ead43ebbea0192cb74a4756 in current term 17: Already voted for candidate c855242ec9d34a5397741ef20db9de8a in this term.
I20260709 12:20:42.678061 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:42.678766 24395 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:42.679442 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:42.681785 29862 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:42.682397 29862 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:42.694526 24290 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756; no voters: 
I20260709 12:20:42.695207 30150 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:42.696599 24289 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:42.697856 23151 raft_consensus.cc:2272] T 7910ea4d480e41fda4aa4fd10f0fef8f P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:42.695926 24440 consensus_peers.cc:597] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:42.699573 24289 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:42.699221 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:42.702188 24366 consensus_peers.cc:597] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:42.687714 29862 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:42.702013 30177 raft_consensus.cc:2804] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:42.704161 30033 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:42.722646 25084 leader_election.cc:336] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:42.708914 30178 raft_consensus.cc:2749] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:42.733256 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:42.724980 25084 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:42.700057 30150 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:42.736404 30177 raft_consensus.cc:697] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 15 LEADER]: Becoming Leader. State: Replica: c711faa13ead43ebbea0192cb74a4756, State: Running, Role: LEADER
I20260709 12:20:42.744227 24291 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:42.751004 25084 consensus_peers.cc:597] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:42.747253 30135 raft_consensus.cc:2749] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:42.757587 24440 consensus_peers.cc:597] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:42.748236 30121 raft_consensus.cc:2749] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:42.748791 30065 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:42.741189 30177 consensus_queue.cc:237] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:20:42.767501 24395 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c711faa13ead43ebbea0192cb74a4756 in term 15.
I20260709 12:20:42.768934 30065 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:42.775250 30065 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:42.780320 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:42.794031 24440 leader_election.cc:336] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:42.794755 25117 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14.
I20260709 12:20:42.795935 24440 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:42.797734 30134 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:42.803026 30134 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:42.803411 30134 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:42.803666 23151 tablet_replica.cc:333] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:42.805574 30150 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:42.812155 23151 raft_consensus.cc:2243] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:20:42.813375 23151 raft_consensus.cc:2272] T c7855d741eff4cb394101baa2af0f082 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.817309 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:42.818536 24395 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14.
I20260709 12:20:42.819746 24438 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:42.851775 23151 tablet_replica.cc:333] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:42.829663 29885 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:42.854315 29885 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:42.855036 29885 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:42.859282 24392 raft_consensus.cc:1275] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:20:42.861799 30033 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:42.861979 30177 consensus_queue.cc:1048] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:42.879354 23151 raft_consensus.cc:2243] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:42.880095 23151 raft_consensus.cc:2272] T 626f1d05390b4454b317c19d513384be P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:42.919332 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 99653.3us
W20260709 12:20:42.912352 24366 consensus_peers.cc:597] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:42.931545 24440 leader_election.cc:336] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:42.950724 29885 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:42.959851 24218 catalog_manager.cc:5697] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:42.961133 23151 tablet_replica.cc:333] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:42.976154 24222 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54252 (request call id 257) took 11055 ms. Trace:
I20260709 12:20:43.003018 24469 raft_consensus.cc:1275] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:20:43.008030 23151 raft_consensus.cc:2243] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:43.015669 23151 pending_rounds.cc:70] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756: Trying to abort 1 pending ops.
I20260709 12:20:43.016131 23151 pending_rounds.cc:77] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756: Aborting op as it isn't in flight: id { term: 16 index: 6 } timestamp: 7305624117675053056 op_type: NO_OP noop_request { }
I20260709 12:20:43.016535 23151 raft_consensus.cc:2889] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:43.018010 23151 raft_consensus.cc:2272] T 5de6cc497bc845dda523b96c519faf83 P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.968365 30134 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:43.028858 30181 consensus_queue.cc:1048] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:20:43.054982 30176 raft_consensus.cc:493] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:20:43.089187 30176 raft_consensus.cc:515] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:43.096253 24440 consensus_peers.cc:597] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:43.096288 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:42.994122 24222 rpcz_store.cc:276] 0709 12:20:31.941797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.942184 (+   387us) service_pool.cc:224] Handling call
0709 12:20:32.412122 (+469938us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b540008ff54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b6090 00007f4a97354f3a 00007f4a9d10ae9c 00007f4a9d20904e 00007f4a9b6ca2a4 00007f4a9b6ca232 00007f4a9b6ca161 00007f4a9b6ca0dc 00007f4a9b6c9392 00007f4a9568748c 00007f4a956868c6
0709 12:20:42.976062 (+10563940us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:40.957058 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:40.957918 (+   860us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:40.957973 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:20:40.958016 (+    43us) tablet.cc:662] Decoding operations
0709 12:20:40.960605 (+  2589us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:40.960745 (+   140us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:40.960778 (+    33us) tablet.cc:685] Acquiring locks for 29 operations
0709 12:20:40.994576 (+ 33798us) tablet.cc:701] Row locks acquired
0709 12:20:40.994629 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:20:40.994810 (+   181us) write_op.cc:270] Start()
0709 12:20:40.994986 (+   176us) write_op.cc:276] Timestamp: P: 1783599640994735 usec, L: 0
0709 12:20:40.995029 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 12:20:40.995903 (+   874us) log.cc:844] Serialized 11473 byte log entry
0709 12:20:41.241000 (+245097us) op_driver.cc:464] REPLICATION: finished
0709 12:20:41.496027 (+255027us) spinlock_profiling.cc:243] Waited 8.8 ms on lock 0x7b4400022b4c. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94185c85 00007f4a941866a2 00007f4a96ef81db 00007f4a96ef3aaf 00007f4a942420ac 00007f4a9d09c9a9 00007f4a9425e69b 00007f4a9425c93f 00007f4a9425ec02 00007f4a9ad82ef0
0709 12:20:41.503482 (+  7455us) write_op.cc:301] APPLY: starting
0709 12:20:41.503598 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:41.878584 (+374986us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:41.878648 (+    64us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:42.631102 (+752454us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:42.631619 (+   517us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=58,key_file_lookups=58,delta_file_lookups=0,mrs_lookups=0
0709 12:20:42.631673 (+    54us) write_op.cc:312] APPLY: finished
0709 12:20:42.632324 (+   651us) log.cc:844] Serialized 252 byte log entry
0709 12:20:42.708271 (+ 75947us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:42.721414 (+ 13143us) write_op.cc:454] Released schema lock
0709 12:20:42.740093 (+ 18679us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:42.740623 (+   530us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:42.740684 (+    61us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":60159,"reported_tablets":46,"spinlock_wait_cycles":385701760,"child_traces":[["op",{"apply.queue_time_us":262119,"apply.run_cpu_time_us":52618,"apply.run_wall_time_us":1237115,"cfile_cache_hit":118,"cfile_cache_hit_bytes":125463,"num_ops":29,"prepare.queue_time_us":212343,"prepare.run_cpu_time_us":34947,"prepare.run_wall_time_us":80874,"raft.queue_time_us":60183,"raft.run_cpu_time_us":11558,"raft.run_wall_time_us":283683,"replication_time_us":245739,"spinlock_wait_cycles":20249984,"thread_start_us":575152,"threads_started":5,"wal-append.queue_time_us":207107,"wal-append.run_cpu_time_us":9749,"wal-append.run_wall_time_us":1113920}]]}
I20260709 12:20:43.106463 24393 raft_consensus.cc:1275] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:20:43.136508 29952 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:43.137231 29952 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:43.139410 29952 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:43.142452 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:43.144336 24469 raft_consensus.cc:2393] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 14: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:43.123983 30018 consensus_queue.cc:1048] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:20:43.172842 30176 leader_election.cc:290] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:43.149299 29885 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:43.180246 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:20:43.151661 25084 consensus_peers.cc:597] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:43.228545 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 76939.9us
I20260709 12:20:43.243263 24399 raft_consensus.cc:3060] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:43.245770 30134 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:43.254966 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:43.255761 24393 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 14.
I20260709 12:20:43.254954 24469 raft_consensus.cc:1275] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:20:43.257853 25082 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:43.259817 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36992a1e3818480c9a2705bd569f099a" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:43.262171 25084 consensus_peers.cc:597] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:43.250932 30118 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:20:43.271838 24366 consensus_peers.cc:597] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:43.278326 30069 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:43.286638 30127 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:43.292327 24291 leader_election.cc:304] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:43.259270 23151 tablet_replica.cc:333] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
W20260709 12:20:43.297462 24366 consensus_peers.cc:597] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:43.297868 30118 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:43.300261 24466 raft_consensus.cc:1275] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:20:43.297601 30127 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:20:43.300207 30177 raft_consensus.cc:2749] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:43.301548 30127 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:43.303005 23151 raft_consensus.cc:2243] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:43.303833 23151 raft_consensus.cc:2272] T 74a60f1722e64f329fe72226d0dbb7c4 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:43.307971 23151 tablet_replica.cc:333] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:43.313704 30177 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.314050 30118 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:43.314436 30177 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:43.315320 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:43.317378 30177 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:43.300952 30069 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:43.322130 30069 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:43.324350 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:43.325358 24466 raft_consensus.cc:2393] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c855242ec9d34a5397741ef20db9de8a in current term 16: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:43.331943 23151 raft_consensus.cc:2243] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 12:20:43.334040 24366 leader_election.cc:336] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:43.334548 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246d2a6c02a457f97a768233aa6cf6d" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:20:43.334761 25084 consensus_peers.cc:597] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:43.335331 25117 raft_consensus.cc:3060] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:43.337000 23151 pending_rounds.cc:70] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756: Trying to abort 1 pending ops.
I20260709 12:20:43.337260 23151 pending_rounds.cc:77] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756: Aborting op as it isn't in flight: id { term: 12 index: 10 } timestamp: 7305624079652265984 op_type: NO_OP noop_request { }
I20260709 12:20:43.337538 23151 raft_consensus.cc:2889] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:43.337774 23151 raft_consensus.cc:2272] T 95c2470f38204e5ba4ee545bb2de933c P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:43.334618 24366 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:43.356956 30118 raft_consensus.cc:2749] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:43.362109 23151 tablet_replica.cc:333] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:43.365681 23151 raft_consensus.cc:2243] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 12:20:43.362838 24366 leader_election.cc:336] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:43.368371 24366 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:43.369544 30118 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:43.367266 25117 raft_consensus.cc:2468] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 15.
I20260709 12:20:43.373612 30176 consensus_queue.cc:1048] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:43.375721 30176 consensus_queue.cc:1048] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:43.377092 24440 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:43.378014 29885 raft_consensus.cc:2804] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:43.379065 29885 raft_consensus.cc:697] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:43.380080 29885 consensus_queue.cc:237] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:43.378000 30127 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:43.383030 30127 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:43.384038 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:43.384939 24470 raft_consensus.cc:2393] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d99d5d772cfe4a96afcab3d3b009a281 in current term 14: Already voted for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in this term.
I20260709 12:20:43.387837 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
W20260709 12:20:43.390017 24440 leader_election.cc:336] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:43.392158 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:43.392081 30118 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:43.397004 24399 raft_consensus.cc:2468] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 15.
I20260709 12:20:43.398932 24438 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:43.401813 23151 raft_consensus.cc:2272] T cabffff9a20f4f0091c52fc21d5abcde P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:43.403792 24393 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 14.
I20260709 12:20:43.406589 24395 raft_consensus.cc:1275] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Refusing update from remote peer c711faa13ead43ebbea0192cb74a4756: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:20:43.409854 25082 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3
I20260709 12:20:43.411700 30150 raft_consensus.cc:2804] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:43.430967 30150 raft_consensus.cc:697] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
W20260709 12:20:43.420003 24366 consensus_peers.cc:597] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:43.429987 29964 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:43.433153 29964 raft_consensus.cc:697] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:43.434201 29964 consensus_queue.cc:237] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:43.435492 24440 leader_election.cc:336] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:43.442195 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edb2262948747f3b2674ddb57a2da5c" candidate_uuid: "c711faa13ead43ebbea0192cb74a4756" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:43.441726 24366 consensus_peers.cc:597] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:43.432165 30150 consensus_queue.cc:237] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:43.491616 30018 consensus_queue.cc:1048] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:43.508967 24289 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711faa13ead43ebbea0192cb74a4756; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:43.513778 30147 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:43.520105 23151 tablet_replica.cc:333] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:43.521027 23151 raft_consensus.cc:2243] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:20:43.524802 23151 raft_consensus.cc:2272] T 9f31ae8f765347f0b4ac12809516729c P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:43.552249 23151 tablet_replica.cc:333] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:43.599692 23151 raft_consensus.cc:2243] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:43.621359 23151 raft_consensus.cc:2272] T 22a61f2b7e79419c82712f4b54b899ed P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:43.626858 23151 tablet_replica.cc:333] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:43.627804 23151 raft_consensus.cc:2243] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:43.628396 23151 pending_rounds.cc:70] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756: Trying to abort 1 pending ops.
I20260709 12:20:43.628664 23151 pending_rounds.cc:77] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756: Aborting op as it isn't in flight: id { term: 15 index: 8 } timestamp: 7305624124741881856 op_type: NO_OP noop_request { }
I20260709 12:20:43.629985 23151 raft_consensus.cc:2889] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:43.630323 23151 raft_consensus.cc:2272] T 9950f2ff950845e1837dbf993fb23cb0 P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:43.622640 29969 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.634222 29969 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:43.633224 23151 tablet_replica.cc:333] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:43.638603 29969 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:43.638790 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:43.641006 23151 raft_consensus.cc:2243] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:43.641717 23151 raft_consensus.cc:2272] T 48340fd716644ed18711f9addc546f4b P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:43.642635 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:43.643842 24400 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14.
I20260709 12:20:43.644968 23151 tablet_replica.cc:333] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:43.645885 23151 raft_consensus.cc:2243] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:43.646380 23151 raft_consensus.cc:2272] T 67fce41b64ab4350b88ec02abbcd9c82 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:43.656162 23151 tablet_replica.cc:333] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:43.657292 23151 raft_consensus.cc:2243] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:43.658062 23151 raft_consensus.cc:2272] T 48b5441f03704ebb94ffdbb55b9f33c6 P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:43.659327 24438 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:43.661509 30161 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:43.662145 30161 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.662626 30161 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:43.669324 23151 tablet_replica.cc:333] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:43.681324 23151 raft_consensus.cc:2243] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:20:43.682587 23151 raft_consensus.cc:2272] T 8fcc66a9731446a989f79106ac6fa5ea P c711faa13ead43ebbea0192cb74a4756 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:43.685355 23151 tablet_replica.cc:333] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
W20260709 12:20:43.686066 24366 consensus_peers.cc:597] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:43.688066 24366 consensus_peers.cc:597] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:43.686215 23151 raft_consensus.cc:2243] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:43.704761 30118 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.705538 30118 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:43.723176 23151 raft_consensus.cc:2272] T 40ccde13a66c45c8bd6d8780ee632ea8 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:43.713610 30205 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:43.732388 23151 tablet_replica.cc:333] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:43.731987 30205 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:43.734889 23151 raft_consensus.cc:2243] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:20:43.736066 23151 raft_consensus.cc:2272] T 4fb70b6bc9ed40a793fb93839c889578 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:43.737946 30207 log.cc:927] Time spent T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:20:43.738732 30205 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:43.741508 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:43.742301 24400 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 15.
I20260709 12:20:43.743673 24438 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:20:43.744550 24440 leader_election.cc:336] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:43.749388 25084 consensus_peers.cc:597] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:43.753364 30118 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:43.760845 30205 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:43.761487 30205 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:43.762188 30205 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:43.766582 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:43.767354 25117 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 17.
I20260709 12:20:43.768939 24366 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:43.738901 23151 tablet_replica.cc:333] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:43.772318 30069 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:43.778033 30069 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.778476 30069 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:43.785748 24366 leader_election.cc:336] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:43.787708 23151 raft_consensus.cc:2243] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:43.793742 29964 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:43.798919 30127 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:43.794440 29964 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:43.799580 30127 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:43.801206 29964 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:43.805917 30127 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:43.804209 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:43.810434 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:43.814994 24219 catalog_manager.cc:5697] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 6 to 8, leader changed from d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 8 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:43.817093 24219 catalog_manager.cc:5697] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 5 to 8, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 8 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:43.835999 23151 raft_consensus.cc:2272] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:43.839776 25084 leader_election.cc:336] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:43.840442 25084 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:43.844659 29964 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:43.844908 30069 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:43.846022 25084 leader_election.cc:336] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:43.846745 25084 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:43.847085 30161 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:43.848228 29964 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:43.854964 23151 tablet_replica.cc:333] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:43.855985 23151 raft_consensus.cc:2243] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:43.856518 23151 raft_consensus.cc:2272] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:43.858757 30161 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:43.859174 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:43.859794 23151 tablet_replica.cc:333] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:43.860793 23151 raft_consensus.cc:2243] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:20:43.861991 23151 raft_consensus.cc:2272] T 36cbfd088b3e4737a74b878b802210f1 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:43.865429 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:43.866344 24399 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:43.888986 25117 raft_consensus.cc:1275] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:20:43.890025 30005 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:43.891772 30005 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:43.892920 30205 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:43.899531 24440 leader_election.cc:336] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:43.902926 30069 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:43.904500 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b5441f03704ebb94ffdbb55b9f33c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:43.905274 25117 raft_consensus.cc:3060] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:43.905370 23151 tablet_replica.cc:333] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:43.906584 23151 raft_consensus.cc:2243] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:43.907172 23151 raft_consensus.cc:2272] T 27d97e40dd274a2ea3734c2982741e3c P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:43.909163 24218 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54254 (request call id 264) took 65840 ms (client timeout 15000 ms). Trace:
I20260709 12:20:43.890163 30200 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:43.910585 23151 tablet_replica.cc:333] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:43.894104 29969 consensus_queue.cc:1048] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:20:43.909624 24218 rpcz_store.cc:269] 0709 12:19:38.068671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.083800 (+ 15129us) service_pool.cc:224] Handling call
0709 12:20:43.909048 (+65825248us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:43.312678 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:43.320248 (+  7570us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:43.320288 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:20:43.320309 (+    21us) tablet.cc:662] Decoding operations
0709 12:20:43.320729 (+   420us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:43.320785 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:43.320819 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:20:43.321013 (+   194us) tablet.cc:701] Row locks acquired
0709 12:20:43.321043 (+    30us) write_op.cc:260] PREPARE: finished
0709 12:20:43.321196 (+   153us) write_op.cc:270] Start()
0709 12:20:43.321343 (+   147us) write_op.cc:276] Timestamp: P: 1783599643321143 usec, L: 0
0709 12:20:43.321368 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:20:43.322094 (+   726us) log.cc:844] Serialized 544 byte log entry
0709 12:20:43.367282 (+ 45188us) op_driver.cc:464] REPLICATION: finished
0709 12:20:43.500585 (+133303us) write_op.cc:301] APPLY: starting
0709 12:20:43.522086 (+ 21501us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:43.523177 (+  1091us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:43.523275 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:43.524001 (+   726us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:43.524176 (+   175us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:20:43.524219 (+    43us) write_op.cc:312] APPLY: finished
0709 12:20:43.524404 (+   185us) log.cc:844] Serialized 25 byte log entry
0709 12:20:43.527742 (+  3338us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:43.540378 (+ 12636us) write_op.cc:454] Released schema lock
0709 12:20:43.541958 (+  1580us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:43.589484 (+ 47526us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:43.589516 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12928,"reported_tablets":47,"spinlock_wait_cycles":17792,"child_traces":[["op",{"apply.queue_time_us":132956,"apply.run_cpu_time_us":3703,"apply.run_wall_time_us":75349,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8311,"num_ops":1,"prepare.queue_time_us":70199,"prepare.run_cpu_time_us":2953,"prepare.run_wall_time_us":16267,"replication_time_us":45738,"spinlock_wait_cycles":7936,"thread_start_us":128219,"threads_started":2}]]}
I20260709 12:20:43.894309 30005 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:43.911592 23151 raft_consensus.cc:2243] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:20:43.922993 25117 raft_consensus.cc:2468] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 18.
I20260709 12:20:43.924513 24366 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:43.925585 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:43.926185 24393 raft_consensus.cc:1275] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:20:43.926136 23151 raft_consensus.cc:2272] T 111838cb1ad347d59c8b479393f9d486 P c711faa13ead43ebbea0192cb74a4756 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:43.931169 25084 consensus_peers.cc:597] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:43.936782 30069 raft_consensus.cc:2804] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:43.937943 30069 raft_consensus.cc:697] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 18 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:43.939010 30069 consensus_queue.cc:237] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:43.940980 30205 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:43.940999 30065 consensus_queue.cc:1048] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:20:43.924547 30200 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:43.951659 24219 catalog_manager.cc:5697] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:43.953619 30200 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:43.954352 24469 raft_consensus.cc:1240] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Rejecting Update request from peer d99d5d772cfe4a96afcab3d3b009a281 for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:43.954984 24219 catalog_manager.cc:5697] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 7 to 9, leader changed from d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 9 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:43.956148 23151 tablet_replica.cc:333] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:43.956038 29952 consensus_queue.cc:1059] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:43.956962 29952 raft_consensus.cc:3055] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:43.957363 29952 raft_consensus.cc:740] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:43.958259 29952 consensus_queue.cc:260] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:43.960253 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:43.965253 24393 raft_consensus.cc:3060] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:43.957181 23151 raft_consensus.cc:2243] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:43.973148 29952 raft_consensus.cc:3060] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:43.973546 30200 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:43.974069 30200 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:43.976119 30200 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:43.985152 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:43.982067 24366 leader_election.cc:336] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:43.986186 25117 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 17.
I20260709 12:20:43.986738 24366 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:43.986120 24399 raft_consensus.cc:2468] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 15.
I20260709 12:20:43.991477 24438 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:43.990803 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:43.989475 30005 raft_consensus.cc:2749] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:43.993834 25112 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 11.
I20260709 12:20:44.002943 24366 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:43.989523 29969 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.007293 23151 raft_consensus.cc:2272] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:44.005496 29969 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:44.000995 30134 raft_consensus.cc:2804] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:20:44.083628 24291 raft_consensus.cc:687] T 03c8932a13b744d7a945b0a7655f5a47 P c711faa13ead43ebbea0192cb74a4756: failed to submit failure detected task: Service unavailable: Thread pool token was shut down
I20260709 12:20:44.085575 30134 raft_consensus.cc:697] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:44.093784 30134 consensus_queue.cc:237] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:44.100549 29969 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:44.105297 25084 consensus_peers.cc:597] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:44.107671 24393 raft_consensus.cc:2468] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 16.
W20260709 12:20:44.109382 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 108144us
W20260709 12:20:44.109465 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 106595us
I20260709 12:20:44.110898 24438 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:44.112783 30200 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:20:44.113817 24440 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 232 similar messages]
I20260709 12:20:44.113269 30200 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:44.114637 30200 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:44.131150 24366 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:44.133512 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:44.135882 24440 consensus_peers.cc:597] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:44.142577 30194 raft_consensus.cc:2804] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:44.143447 30194 raft_consensus.cc:697] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
W20260709 12:20:44.145709 24366 leader_election.cc:336] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:44.146464 24393 raft_consensus.cc:2410] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
W20260709 12:20:44.147398 24366 consensus_peers.cc:597] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:44.164796 24366 leader_election.cc:336] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:44.165975 24366 leader_election.cc:336] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:44.149982 23151 tablet_replica.cc:333] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
W20260709 12:20:44.178869 24440 leader_election.cc:336] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:44.179409 24440 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:44.152726 30214 raft_consensus.cc:2804] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:44.202109 23151 raft_consensus.cc:2243] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:44.144569 30194 consensus_queue.cc:237] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:44.172190 30205 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:44.221133 30205 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:44.223676 30205 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:44.195130 29969 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:44.230818 30200 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:44.233795 23151 raft_consensus.cc:2272] T 97dd30b21cc14958a91b2da522e4bbe9 P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:44.237008 24399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:44.237823 24399 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 15.
I20260709 12:20:44.239113 24438 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:44.201649 30214 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:44.243287 30214 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:44.242241 24366 consensus_peers.cc:597] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:44.249866 25084 consensus_peers.cc:597] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:44.262275 24440 consensus_peers.cc:597] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:44.262970 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 46457.7us
W20260709 12:20:44.266867 24440 consensus_peers.cc:597] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:44.246765 29885 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:44.288990 29885 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:44.289446 29885 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:44.290727 23151 tablet_replica.cc:333] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:44.291702 23151 raft_consensus.cc:2243] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 15 LEADER]: Raft consensus shutting down.
W20260709 12:20:44.298915 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 130250us
W20260709 12:20:44.303561 24366 leader_election.cc:336] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:44.307644 25084 consensus_peers.cc:597] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:44.337298 24440 leader_election.cc:336] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:44.341346 30200 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:44.342330 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910ea4d480e41fda4aa4fd10f0fef8f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:44.343070 25110 raft_consensus.cc:3060] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:44.353775 23151 raft_consensus.cc:2272] T 419283bfbe814a8dbebaa6962ce15ee0 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:44.368338 25110 raft_consensus.cc:2468] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 18.
I20260709 12:20:44.382812 24366 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:44.388083 30069 raft_consensus.cc:2804] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:44.389499 30069 raft_consensus.cc:697] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 18 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:44.390409 30069 consensus_queue.cc:237] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:44.393260 23151 tablet_replica.cc:333] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:44.396447 23151 raft_consensus.cc:2243] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:44.398185 23151 raft_consensus.cc:2272] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:44.414544 29885 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:44.429078 24366 consensus_peers.cc:597] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:44.433964 30214 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:44.459712 24440 leader_election.cc:336] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:44.460322 24366 leader_election.cc:336] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:44.462682 29885 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:44.463284 23151 tablet_replica.cc:333] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:44.464793 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0a0cd756141c094288d3c05139379" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:44.466786 25110 raft_consensus.cc:3060] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:44.467197 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:44.467844 24392 raft_consensus.cc:3060] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:44.463130 30214 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:44.472105 24440 consensus_peers.cc:597] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:44.482863 24392 raft_consensus.cc:2468] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 16.
I20260709 12:20:44.484334 24438 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:44.485317 23151 raft_consensus.cc:2243] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:44.485940 29885 raft_consensus.cc:2804] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:44.486163 23151 raft_consensus.cc:2272] T 9edb2262948747f3b2674ddb57a2da5c P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:44.486776 29885 raft_consensus.cc:697] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:44.487756 29885 consensus_queue.cc:237] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:44.491959 25112 raft_consensus.cc:1275] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:20:44.497632 23151 tablet_replica.cc:333] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:44.498692 23151 raft_consensus.cc:2243] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:44.499788 23151 raft_consensus.cc:2272] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:44.475167 25110 raft_consensus.cc:2468] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:20:44.503108 24366 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:44.503479 30214 consensus_queue.cc:1048] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:44.508085 30069 raft_consensus.cc:2804] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:44.510470 30069 raft_consensus.cc:697] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:44.511399 30069 consensus_queue.cc:237] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:44.539110 23151 tablet_replica.cc:333] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:44.549194 23151 raft_consensus.cc:2243] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 12 LEADER]: Raft consensus shutting down.
W20260709 12:20:44.561559 25084 consensus_peers.cc:597] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:44.568347 24366 consensus_peers.cc:597] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:44.577134 24222 catalog_manager.cc:5697] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.579406 23151 raft_consensus.cc:2272] T 9e8cc498654c4fde9917eeb605fdc906 P c711faa13ead43ebbea0192cb74a4756 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:44.579066 24222 catalog_manager.cc:5697] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 8 to 16. New cstate: current_term: 16 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.586546 25112 raft_consensus.cc:1275] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 12:20:44.587038 25112 pending_rounds.cc:85] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281: Aborting all ops after (but not including) 12
I20260709 12:20:44.587284 25112 pending_rounds.cc:107] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 12:20:44.587509 25112 raft_consensus.cc:2889] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:44.591275 29885 consensus_queue.cc:1048] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:44.582356 24222 catalog_manager.cc:5697] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 13 to 14, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 14 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:44.603649 24222 catalog_manager.cc:5697] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 15 to 16, leader changed from d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 16 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:44.606168 24222 catalog_manager.cc:5697] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.609212 24222 catalog_manager.cc:5697] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 10 to 19, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 19 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:44.602494 23151 tablet_replica.cc:333] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:44.611294 23151 raft_consensus.cc:2243] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:20:44.612502 23151 raft_consensus.cc:2272] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c711faa13ead43ebbea0192cb74a4756 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:44.614379 25084 consensus_peers.cc:597] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:44.604856 24219 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35986 (request call id 184) took 34155 ms (client timeout 15000 ms). Trace:
I20260709 12:20:44.620151 24393 raft_consensus.cc:1275] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:20:44.622013 29885 consensus_queue.cc:1048] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:44.636492 24392 raft_consensus.cc:1275] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:20:44.615368 24219 rpcz_store.cc:269] 0709 12:20:10.449226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.454364 (+  5138us) service_pool.cc:224] Handling call
0709 12:20:44.604779 (+34150415us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:44.201033 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:44.224832 (+ 23799us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:44.224875 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:20:44.224895 (+    20us) tablet.cc:662] Decoding operations
0709 12:20:44.225561 (+   666us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:44.225647 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:44.225680 (+    33us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:20:44.226104 (+   424us) tablet.cc:701] Row locks acquired
0709 12:20:44.226127 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:20:44.226300 (+   173us) write_op.cc:270] Start()
0709 12:20:44.226429 (+   129us) write_op.cc:276] Timestamp: P: 1783599644226245 usec, L: 0
0709 12:20:44.226455 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:20:44.248227 (+ 21772us) log.cc:844] Serialized 1698 byte log entry
0709 12:20:44.274265 (+ 26038us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b540008ff54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a97347e28 00007f4a9ad82581 00007f4a9ad81d58 00007f4a9ad869f1 00007f4a9ad869a9 00007f4a9ad86939 00007f4a9ad86901 00007f4a9ad85b2d 0000000000388634 0000000000388479
0709 12:20:44.425585 (+151320us) op_driver.cc:464] REPLICATION: finished
0709 12:20:44.493209 (+ 67624us) write_op.cc:301] APPLY: starting
0709 12:20:44.493323 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:44.503381 (+ 10058us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:44.503410 (+    29us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:44.507096 (+  3686us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:44.509987 (+  2891us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 12:20:44.510037 (+    50us) write_op.cc:312] APPLY: finished
0709 12:20:44.510307 (+   270us) log.cc:844] Serialized 49 byte log entry
0709 12:20:44.515287 (+  4980us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:44.515401 (+   114us) write_op.cc:454] Released schema lock
0709 12:20:44.515452 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:44.536728 (+ 21276us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:44.536767 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2090149,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":67289,"apply.run_cpu_time_us":7370,"apply.run_wall_time_us":38330,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20863,"num_ops":4,"prepare.queue_time_us":206540,"prepare.run_cpu_time_us":7062,"prepare.run_wall_time_us":96946,"replication_time_us":180216,"spinlock_wait_cycles":23696128,"thread_start_us":187036,"threads_started":2}]]}
I20260709 12:20:44.638494 29885 consensus_queue.cc:1048] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:44.647991 23151 tablet_replica.cc:333] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:44.649158 23151 raft_consensus.cc:2243] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:44.654139 24222 catalog_manager.cc:5697] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 14 to 16, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 16 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:44.649788 23151 pending_rounds.cc:70] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756: Trying to abort 1 pending ops.
I20260709 12:20:44.659638 23151 pending_rounds.cc:77] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756: Aborting op as it isn't in flight: id { term: 11 index: 10 } timestamp: 7305624065871138816 op_type: NO_OP noop_request { }
I20260709 12:20:44.660110 23151 raft_consensus.cc:2889] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:44.660509 23151 raft_consensus.cc:2272] T 36992a1e3818480c9a2705bd569f099a P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:44.672339 24440 consensus_peers.cc:597] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:44.674386 23151 tablet_replica.cc:333] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:44.675388 23151 raft_consensus.cc:2243] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:44.676035 23151 raft_consensus.cc:2272] T 3f669315af0d426da28d57b462979ebd P c711faa13ead43ebbea0192cb74a4756 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:44.657837 24222 catalog_manager.cc:5697] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 12 to 13, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 13 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.683087 24222 catalog_manager.cc:5697] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 12 to 17, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 17 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:44.685457 24222 catalog_manager.cc:5697] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 11 to 12, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 12 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:44.689368 24222 catalog_manager.cc:5697] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:44.690649 24222 catalog_manager.cc:5697] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 10 to 15, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 15 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:44.692409 24222 catalog_manager.cc:5697] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:44.693691 24222 catalog_manager.cc:5697] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 9 to 15, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 15 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:44.695130 24222 catalog_manager.cc:5697] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 10 to 11, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 11 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:44.696744 24222 catalog_manager.cc:5697] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 7 to 15, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 15 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:44.698287 24222 catalog_manager.cc:5697] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 9 to 15, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 15 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } }
I20260709 12:20:44.699653 24222 catalog_manager.cc:5697] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 7 to 13, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 13 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:44.701345 24222 catalog_manager.cc:5697] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:44.707587 24222 catalog_manager.cc:5697] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 14 to 17, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 17 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.709161 24222 catalog_manager.cc:5697] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 13 to 14, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 14 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.710889 24222 catalog_manager.cc:5697] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.712451 24222 catalog_manager.cc:5697] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 11 to 17, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 17 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:44.713884 24222 catalog_manager.cc:5697] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 13 to 14, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 14 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.715441 24222 catalog_manager.cc:5697] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.720934 24222 catalog_manager.cc:5697] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 6 to 16. New cstate: current_term: 16 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:44.722250 24222 catalog_manager.cc:5697] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 2 to 12, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 12 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:44.723583 24222 catalog_manager.cc:5697] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 10 to 13, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 13 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:44.725345 24222 catalog_manager.cc:5697] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:44.726724 24222 catalog_manager.cc:5697] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 8 to 12, leader changed from d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 12 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:44.728183 24222 catalog_manager.cc:5697] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.729664 23151 tablet_replica.cc:333] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:44.729811 24222 catalog_manager.cc:5697] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 11 to 13, leader changed from d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 13 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:44.732758 23151 raft_consensus.cc:2243] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:44.732437 24222 catalog_manager.cc:5697] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 10 to 11, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 11 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:44.733553 23151 raft_consensus.cc:2272] T f3d18ca89df84c1ba95edb6284f7a8fb P c711faa13ead43ebbea0192cb74a4756 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:44.734768 24222 catalog_manager.cc:5697] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 11 to 12, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 12 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:44.736402 24222 catalog_manager.cc:5697] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
W20260709 12:20:44.750038 25084 consensus_peers.cc:597] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:44.791471 23151 tablet_replica.cc:333] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:44.794667 23151 raft_consensus.cc:2243] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:44.802290 23151 pending_rounds.cc:70] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756: Trying to abort 1 pending ops.
I20260709 12:20:44.802654 23151 pending_rounds.cc:77] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756: Aborting op as it isn't in flight: id { term: 13 index: 12 } timestamp: 7305624068635897856 op_type: NO_OP noop_request { }
I20260709 12:20:44.803081 23151 raft_consensus.cc:2889] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:44.803493 23151 raft_consensus.cc:2272] T 218e3bf7807b42d09ac3db0dad69fcf9 P c711faa13ead43ebbea0192cb74a4756 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:44.806679 23151 tablet_replica.cc:333] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:44.807464 23151 raft_consensus.cc:2243] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:20:44.808525 23151 raft_consensus.cc:2272] T 1ba811822a8a4266a950b36a73a9fce7 P c711faa13ead43ebbea0192cb74a4756 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:44.811460 23151 tablet_replica.cc:333] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756: stopping tablet replica
I20260709 12:20:44.812297 23151 raft_consensus.cc:2243] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:20:44.813616 23151 raft_consensus.cc:2272] T 125e800842274e17a2c01df7bb749005 P c711faa13ead43ebbea0192cb74a4756 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:44.833308 30194 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:44.834002 30194 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:44.839864 30194 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:44.844849 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:44.858214 24440 leader_election.cc:336] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:44.858888 24440 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:44.864723 30194 raft_consensus.cc:2749] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:44.890893 29964 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:44.891615 29964 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:44.895211 29964 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:44.897511 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:44.901297 24366 consensus_peers.cc:597] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:44.905417 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:44.910392 25084 leader_election.cc:336] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:44.910569 30069 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:44.910954 25084 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:44.911147 30069 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:44.912093 30173 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:44.920320 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:20:44.924125 24366 leader_election.cc:336] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:44.924602 24366 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:44.926123 24393 raft_consensus.cc:1275] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:20:44.927384 30214 raft_consensus.cc:2749] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:44.928267 24366 consensus_peers.cc:597] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:44.919286 30069 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:45.063853 30239 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:45.064981 30214 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:45.070369 30200 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:45.070539 30214 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:45.071085 30200 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:45.073104 30200 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:45.073407 30214 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:45.075119 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 138543us
I20260709 12:20:45.074043 30239 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:45.080843 30239 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:45.082340 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:45.082584 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:45.086660 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 156159us
I20260709 12:20:45.088900 30161 consensus_queue.cc:1048] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:45.091753 30161 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:45.092334 30161 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:45.094357 30161 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:45.120263 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:45.120698 25112 raft_consensus.cc:1275] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:20:45.121007 25117 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
I20260709 12:20:45.124969 25117 raft_consensus.cc:1275] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:20:45.125263 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:45.127792 30118 consensus_queue.cc:1048] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:45.128379 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:45.129171 24393 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 12.
I20260709 12:20:45.129604 30118 consensus_queue.cc:1048] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:20:45.145154 24366 leader_election.cc:336] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:45.146025 24366 leader_election.cc:336] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:45.162672 25084 leader_election.cc:336] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:45.178923 24365 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:45.180503 24365 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:45.181989 30242 raft_consensus.cc:2749] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:45.182616 30069 raft_consensus.cc:2749] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:45.185855 25082 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:45.188052 30240 raft_consensus.cc:2804] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:20:45.188370 25084 consensus_peers.cc:597] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:45.188616 30240 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:45.189216 30240 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:45.194518 30242 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:45.195250 30242 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:45.200148 24440 consensus_peers.cc:597] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:45.236847 30194 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:45.249684 30194 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:45.254760 30200 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:45.255497 30200 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:45.264199 30069 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:45.265866 30069 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:45.269356 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 69254.3us
W20260709 12:20:45.276809 24366 consensus_peers.cc:597] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:45.281040 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 95296.1us
I20260709 12:20:45.292572 30242 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:45.297832 30194 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:45.299870 24366 leader_election.cc:336] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:45.284179 30245 log.cc:927] Time spent T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:20:45.319828 30240 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:45.326418 25084 leader_election.cc:336] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:45.331840 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 46114.4us
I20260709 12:20:45.341111 30240 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:45.345224 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:45.346422 24392 raft_consensus.cc:3060] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:45.346858 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:45.347535 24393 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
I20260709 12:20:45.349928 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:45.350638 30069 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:45.351830 30200 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:45.359218 24366 leader_election.cc:336] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:45.360031 24366 leader_election.cc:336] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:45.350662 24470 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 16.
I20260709 12:20:45.363721 24392 raft_consensus.cc:2468] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 13.
I20260709 12:20:45.364992 25082 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:45.367026 29964 raft_consensus.cc:2804] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:45.367625 29964 raft_consensus.cc:697] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 13 LEADER]: Becoming Leader. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Running, Role: LEADER
I20260709 12:20:45.368610 29964 consensus_queue.cc:237] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:45.372399 24365 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:45.374310 30242 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:45.374758 30242 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:45.375141 30242 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:45.375779 30161 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:45.376528 30161 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:45.380213 30161 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:45.388404 25110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:45.392438 25110 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
I20260709 12:20:45.394204 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:45.394927 24393 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 19.
I20260709 12:20:45.384318 30242 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:45.403096 24438 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:45.404923 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:45.406427 24470 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
I20260709 12:20:45.408707 24365 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:45.416273 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:45.412210 30200 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:45.417902 30200 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:45.418361 30200 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:45.423101 30242 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:45.411115 30065 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:45.424127 30065 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:45.424540 30065 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:45.427215 30200 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:45.434072 24366 leader_election.cc:336] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:45.438295 24366 leader_election.cc:336] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:45.440799 24222 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54252 (request call id 258) took 1544 ms. Trace:
I20260709 12:20:45.441359 24222 rpcz_store.cc:276] 0709 12:20:43.896211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:43.896409 (+   198us) service_pool.cc:224] Handling call
0709 12:20:45.440689 (+1544280us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:44.751158 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:44.751737 (+   579us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:44.751773 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:20:44.751791 (+    18us) tablet.cc:662] Decoding operations
0709 12:20:44.756359 (+  4568us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:44.756420 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:44.756449 (+    29us) tablet.cc:685] Acquiring locks for 35 operations
0709 12:20:44.759020 (+  2571us) tablet.cc:701] Row locks acquired
0709 12:20:44.759035 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:20:44.759201 (+   166us) write_op.cc:270] Start()
0709 12:20:44.759330 (+   129us) write_op.cc:276] Timestamp: P: 1783599644759148 usec, L: 0
0709 12:20:44.759348 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:20:44.760126 (+   778us) log.cc:844] Serialized 13883 byte log entry
0709 12:20:44.768606 (+  8480us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b5400110ba0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b6090 00007f4a972c36b8 00007f4a972c32fa 00007f4a97347965 00007f4a97347e09 00007f4a9ad82581 00007f4a9ad81d58 00007f4a9ad869f1 00007f4a9ad869a9 00007f4a9ad86939 00007f4a9ad86901
0709 12:20:44.769207 (+   601us) op_driver.cc:464] REPLICATION: finished
0709 12:20:44.770531 (+  1324us) write_op.cc:301] APPLY: starting
0709 12:20:44.770634 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:44.875540 (+104906us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:44.875569 (+    29us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:45.374534 (+498965us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:45.374995 (+   461us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=70,key_file_lookups=70,delta_file_lookups=0,mrs_lookups=0
0709 12:20:45.375047 (+    52us) write_op.cc:312] APPLY: finished
0709 12:20:45.376328 (+  1281us) log.cc:844] Serialized 300 byte log entry
0709 12:20:45.377258 (+   930us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:45.377632 (+   374us) write_op.cc:454] Released schema lock
0709 12:20:45.377712 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:45.420729 (+ 43017us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:45.420765 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2567,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":1024,"apply.run_cpu_time_us":47766,"apply.run_wall_time_us":639632,"cfile_cache_hit":140,"cfile_cache_hit_bytes":146440,"num_ops":35,"prepare.queue_time_us":139,"prepare.run_cpu_time_us":8949,"prepare.run_wall_time_us":17681,"replication_time_us":9706,"spinlock_wait_cycles":5423744}]]}
I20260709 12:20:45.459159 30065 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:45.438989 30200 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:45.468384 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 83569.8us
I20260709 12:20:45.476399 24440 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:45.479251 24220 catalog_manager.cc:5697] T 63debf83121c430e9dffcd1c5035cf3a P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:45.484715 24220 catalog_manager.cc:5697] T 72fa7cd50b4c4a12af95a9accb7dd947 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:45.484771 30252 raft_consensus.cc:2804] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:45.489604 30252 raft_consensus.cc:493] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:45.490031 30252 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:45.488785 24220 catalog_manager.cc:5697] T 01bd4c6351f24e35abba86aef1ce23be P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:45.495118 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:45.495785 24393 raft_consensus.cc:3060] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:45.493760 30065 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 20 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:45.504531 24393 raft_consensus.cc:2468] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 20.
I20260709 12:20:45.506829 24438 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
I20260709 12:20:45.508085 30065 raft_consensus.cc:2804] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:45.508898 30065 raft_consensus.cc:697] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 20 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
W20260709 12:20:45.514433 24440 leader_election.cc:336] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:45.515235 24440 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:45.516656 30065 consensus_queue.cc:237] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:45.524806 25084 consensus_peers.cc:597] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:45.514537 24220 catalog_manager.cc:5697] T 82c31a779e7949a590cf168eef01e405 P c711faa13ead43ebbea0192cb74a4756 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:45.537185 30255 raft_consensus.cc:2749] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:45.537386 24365 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:45.541723 30200 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:45.557036 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcc66a9731446a989f79106ac6fa5ea" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:45.557772 24466 raft_consensus.cc:3060] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:45.560479 30200 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.561214 30200 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:45.571271 24466 raft_consensus.cc:2468] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 17.
I20260709 12:20:45.575963 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbfd088b3e4737a74b878b802210f1" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:45.576730 24469 raft_consensus.cc:3060] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:45.553017 30252 raft_consensus.cc:515] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:45.580825 24440 consensus_peers.cc:597] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:45.592563 30252 leader_election.cc:290] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:45.572542 30200 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:45.593624 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:45.594488 24392 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:45.597585 24366 leader_election.cc:336] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:45.598259 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:45.599170 24470 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 16.
W20260709 12:20:45.601893 24440 consensus_peers.cc:597] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:45.602077 24365 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
W20260709 12:20:45.602527 24440 leader_election.cc:336] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:45.604990 24440 leader_election.cc:336] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:45.605859 24440 consensus_peers.cc:597] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:45.609820 24440 leader_election.cc:336] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:45.610661 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb70b6bc9ed40a793fb93839c889578" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:45.611517 24469 raft_consensus.cc:2468] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 14.
I20260709 12:20:45.611707 25112 raft_consensus.cc:3060] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:45.611217 30118 raft_consensus.cc:2804] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:45.625069 30118 raft_consensus.cc:697] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 17 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:45.626219 30118 consensus_queue.cc:237] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:45.627029 24366 consensus_peers.cc:597] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:45.630268 24365 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:45.630813 24392 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14.
W20260709 12:20:45.633970 24440 leader_election.cc:336] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:45.634811 30242 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:45.635967 30242 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.636401 30242 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:45.639321 24365 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
W20260709 12:20:45.640179 24366 consensus_peers.cc:597] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:45.641708 30260 raft_consensus.cc:2804] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:45.642401 30260 raft_consensus.cc:697] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:45.661407 25112 raft_consensus.cc:2468] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14.
I20260709 12:20:45.664866 30252 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:45.665616 30252 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:45.671759 30252 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:45.707083 24440 consensus_peers.cc:597] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:45.707975 24440 leader_election.cc:336] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:45.722738 30242 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:45.732602 30242 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:45.736254 24366 leader_election.cc:336] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:45.735466 24471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40588
I20260709 12:20:45.747314 24471 raft_consensus.cc:606] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Received request to transfer leadership
I20260709 12:20:45.753468 24471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40588
I20260709 12:20:45.754163 24471 raft_consensus.cc:606] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Received request to transfer leadership
I20260709 12:20:45.768803 24222 catalog_manager.cc:5697] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 17 to 18, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 18 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:45.770660 24222 catalog_manager.cc:5697] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 15 to 16, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 16 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:45.643478 30260 consensus_queue.cc:237] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:45.775274 24222 catalog_manager.cc:5697] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 11 to 12, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 12 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:45.778350 24222 catalog_manager.cc:5697] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 13 to 15, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 15 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:45.780012 24222 catalog_manager.cc:5697] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:45.781642 24222 catalog_manager.cc:5697] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 11 to 15, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 15 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:45.783135 24222 catalog_manager.cc:5697] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 15 to 16, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 16 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:45.784854 30241 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:45.785533 30241 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:45.807549 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:45.807296 30241 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:45.808827 25084 connection.cc:573] client connection to 127.22.155.193:36951 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 12:20:45.819825 29964 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:45.821203 29964 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:45.848096 24470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9"
dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40588
I20260709 12:20:45.848908 24470 raft_consensus.cc:606] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Received request to transfer leadership
W20260709 12:20:45.849926 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 210705us
I20260709 12:20:45.853736 24438 leader_election.cc:304] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:45.856200 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:45.858381 24466 raft_consensus.cc:3060] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:45.860483 24392 raft_consensus.cc:1275] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Refusing update from remote peer d99d5d772cfe4a96afcab3d3b009a281: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:20:45.860859 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:45.861603 24400 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 15.
W20260709 12:20:45.868978 24220 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54244 (request call id 273) took 20843 ms (client timeout 15000 ms). Trace:
I20260709 12:20:45.881297 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:20:45.869637 24220 rpcz_store.cc:269] 0709 12:20:25.037728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.040837 (+  3109us) service_pool.cc:224] Handling call
0709 12:20:45.867521 (+20826684us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:45.559700 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:45.560393 (+   693us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:45.560433 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:20:45.560454 (+    21us) tablet.cc:662] Decoding operations
0709 12:20:45.561196 (+   742us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:45.561287 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:45.561323 (+    36us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:20:45.561738 (+   415us) tablet.cc:701] Row locks acquired
0709 12:20:45.561756 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:20:45.561909 (+   153us) write_op.cc:270] Start()
0709 12:20:45.562024 (+   115us) write_op.cc:276] Timestamp: P: 1783599645561860 usec, L: 0
0709 12:20:45.562046 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:20:45.562790 (+   744us) log.cc:844] Serialized 1698 byte log entry
0709 12:20:45.664835 (+102045us) op_driver.cc:464] REPLICATION: finished
0709 12:20:45.665282 (+   447us) write_op.cc:301] APPLY: starting
0709 12:20:45.665383 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:45.667919 (+  2536us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:45.668029 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:45.670888 (+  2859us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:45.671113 (+   225us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 12:20:45.671167 (+    54us) write_op.cc:312] APPLY: finished
0709 12:20:45.671434 (+   267us) log.cc:844] Serialized 49 byte log entry
0709 12:20:45.671650 (+   216us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:45.671773 (+   123us) write_op.cc:454] Released schema lock
0709 12:20:45.671826 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:45.672306 (+   480us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:45.672340 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1793656,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":156,"apply.run_cpu_time_us":6696,"apply.run_wall_time_us":6944,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16736,"num_ops":4,"prepare.queue_time_us":24673,"prepare.run_cpu_time_us":3587,"prepare.run_wall_time_us":20540,"replication_time_us":96155,"thread_start_us":21862,"threads_started":1}]]}
I20260709 12:20:45.884269 30249 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:45.889176 30239 consensus_queue.cc:1048] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:45.889981 30249 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:45.892241 30249 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:45.874711 30065 raft_consensus.cc:2804] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:45.902498 24438 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
W20260709 12:20:45.900586 24210 catalog_manager.cc:4755] TS c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): ChangeConfig:REMOVE_PEER RPC failed for tablet 4fb70b6bc9ed40a793fb93839c889578: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:20:45.883942 24223 catalog_manager.cc:5697] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:45.881671 29964 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:45.906586 30065 raft_consensus.cc:697] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:45.913297 30065 consensus_queue.cc:237] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:45.916114 30161 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:20:45.909610 24208 connection.cc:466] server connection from 127.0.0.1:54244 torn down before Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54244 (request call id 273) could send its response
I20260709 12:20:45.910573 30255 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:20:45.916587 24366 consensus_peers.cc:597] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:45.922847 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:45.930720 25112 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 12.
I20260709 12:20:45.922806 24466 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 17.
I20260709 12:20:45.919342 30255 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:20:45.930688 24366 leader_election.cc:336] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:20:45.935941 24365 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:45.938836 24366 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:45.917052 30161 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:45.949892 24223 catalog_manager.cc:5697] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:45.948022 30255 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:45.958523 24223 catalog_manager.cc:5697] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:45.950387 30118 raft_consensus.cc:2804] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:45.963303 30118 raft_consensus.cc:697] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 17 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:45.964422 30118 consensus_queue.cc:237] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:45.967330 24223 catalog_manager.cc:5697] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 11 to 15, leader changed from d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 15 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:45.952260 30249 raft_consensus.cc:2804] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:45.952847 30253 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:45.972187 30249 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:45.971964 24223 catalog_manager.cc:5697] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 9 to 11, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 11 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:45.988222 29969 raft_consensus.cc:993] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: : Instructing follower c855242ec9d34a5397741ef20db9de8a to start an election
I20260709 12:20:45.988899 30161 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:45.986588 30253 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
W20260709 12:20:45.994474 25084 leader_election.cc:336] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:20:45.995064 25084 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:20:45.995682 30253 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:20:45.997859 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
I20260709 12:20:45.997973 29964 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:45.983973 30249 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:46.001770 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a" is_pre_election: true
W20260709 12:20:46.007285 25084 consensus_peers.cc:597] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:46.012801 30260 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:46.028121 30260 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:46.030618 30260 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:46.031435 25084 leader_election.cc:336] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:20:46.031972 25084 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:46.032847 30173 raft_consensus.cc:2749] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:46.024030 29969 raft_consensus.cc:1081] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Signalling peer c855242ec9d34a5397741ef20db9de8a to start an election
I20260709 12:20:46.127445 30194 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:46.128198 30194 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:46.130618 30194 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:46.131619 30249 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:46.133869 30249 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:46.112308 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 77626.7us
W20260709 12:20:46.111514 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 80107.4us
I20260709 12:20:46.113363 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:46.143605 24466 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 17.
I20260709 12:20:46.117643 30200 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:20:46.145049 25084 consensus_peers.cc:597] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:46.147333 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:20:46.148049 25112 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 10.
I20260709 12:20:46.149228 30255 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:46.150746 24466 raft_consensus.cc:1275] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:20:46.151427 30255 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:46.156383 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cc498654c4fde9917eeb605fdc906" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:46.157060 25112 raft_consensus.cc:3060] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:46.162909 30200 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:20:46.177153 24392 raft_consensus.cc:1275] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 20 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:20:46.177371 30200 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:20:46.178412 24400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9"
dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
 from {username='slave'} at 127.0.0.1:51474
I20260709 12:20:46.179176 24400 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:46.179566 24400 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:46.187728 25112 raft_consensus.cc:2468] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 13.
W20260709 12:20:46.182291 25084 consensus_peers.cc:597] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:46.190074 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:20:46.204531 24469 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 15.
W20260709 12:20:46.191519 24271 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
I20260709 12:20:46.180233 24365 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: 
W20260709 12:20:46.198243 24440 leader_election.cc:336] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:20:46.208154 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 63361.2us
W20260709 12:20:46.208837 24271 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 97dd30b21cc14958a91b2da522e4bbe9 already in progress
I20260709 12:20:46.208997 24440 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:46.212163 24366 consensus_peers.cc:597] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:46.213076 24366 leader_election.cc:336] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:20:46.213608 24366 consensus_peers.cc:597] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:46.214078 24366 leader_election.cc:336] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:20:46.215066 24366 consensus_peers.cc:597] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:46.222517 24440 leader_election.cc:336] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:20:46.223073 24440 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:20:46.210369 24271 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 97dd30b21cc14958a91b2da522e4bbe9 already in progress
I20260709 12:20:46.228590 30194 raft_consensus.cc:2749] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:46.229930 24366 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
W20260709 12:20:46.229910 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 49806us
I20260709 12:20:46.231685 30069 raft_consensus.cc:2804] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:46.236516 29969 raft_consensus.cc:2749] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:20:46.241700 25084 consensus_peers.cc:597] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:46.241123 24440 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:46.229830 30200 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:46.245265 24400 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:46.236815 30242 consensus_queue.cc:1048] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:20:46.246729 30065 consensus_queue.cc:1048] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:20:46.251495 30270 raft_consensus.cc:2804] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:20:46.256336 24440 leader_election.cc:336] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:20:46.266149 24366 leader_election.cc:336] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:20:46.265794 24400 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:20:46.274667 24440 consensus_peers.cc:597] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:46.275400 24440 leader_election.cc:336] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:20:46.278996 24366 consensus_peers.cc:597] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:46.286000 24366 leader_election.cc:336] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:20:46.262353 30200 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:46.270299 30270 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
W20260709 12:20:46.311583 30273 log.cc:927] Time spent T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:20:46.323472 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:20:46.324236 25117 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:46.327068 24366 consensus_peers.cc:597] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:46.327622 24366 consensus_peers.cc:597] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:46.309623 30270 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:46.298197 30200 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:46.337507 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 105203us
I20260709 12:20:46.338505 24365 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:46.342536 25117 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 14.
I20260709 12:20:46.287164 30069 raft_consensus.cc:697] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:46.352305 24470 raft_consensus.cc:1275] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:20:46.349598 30278 raft_consensus.cc:2804] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:46.353758 30278 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting leader election (detected failure of leader c711faa13ead43ebbea0192cb74a4756)
I20260709 12:20:46.354192 30278 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:46.368204 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dd30b21cc14958a91b2da522e4bbe9" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:46.369113 24470 raft_consensus.cc:3055] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:46.369532 24470 raft_consensus.cc:740] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:46.370396 24470 consensus_queue.cc:260] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:46.372746 24470 raft_consensus.cc:3060] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:46.380702 24222 catalog_manager.cc:5697] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 13 to 14, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 14 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:46.382632 24222 catalog_manager.cc:5697] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 12 to 13, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 13 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:46.384078 24222 catalog_manager.cc:5697] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 16 to 17, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 17 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:46.385620 24222 catalog_manager.cc:5697] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 13 to 17, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 17 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:46.380012 30278 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:20:46.395125 24400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c855242ec9d34a5397741ef20db9de8a"
I20260709 12:20:46.396411 24400 raft_consensus.cc:3060] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:46.397776 25117 raft_consensus.cc:1275] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:20:46.401477 24393 raft_consensus.cc:1275] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:20:46.417521 24470 raft_consensus.cc:2468] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 14.
I20260709 12:20:46.443185 24400 raft_consensus.cc:2468] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 16.
I20260709 12:20:46.429291 30242 consensus_queue.cc:1048] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:20:46.432610 30270 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:46.470846 30270 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:20:46.472615 30278 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 election: Requested vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:20:46.429005 30194 consensus_queue.cc:1048] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:20:46.478175 30069 consensus_queue.cc:237] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:46.478492 30255 consensus_queue.cc:1048] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:46.482565 30200 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:20:46.483495 24223 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35986 (request call id 185) took 11341 ms (client timeout 15000 ms). Trace:
W20260709 12:20:46.483989 24223 rpcz_store.cc:269] 0709 12:20:35.142605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:35.143241 (+   636us) service_pool.cc:224] Handling call
0709 12:20:46.483408 (+11340167us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:46.020682 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:46.021445 (+   763us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:46.021496 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:20:46.021515 (+    19us) tablet.cc:662] Decoding operations
0709 12:20:46.022424 (+   909us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:46.022502 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:46.022551 (+    49us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:20:46.023284 (+   733us) tablet.cc:701] Row locks acquired
0709 12:20:46.023306 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:20:46.023513 (+   207us) write_op.cc:270] Start()
0709 12:20:46.023663 (+   150us) write_op.cc:276] Timestamp: P: 1783599646023449 usec, L: 0
0709 12:20:46.023697 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:20:46.024617 (+   920us) log.cc:844] Serialized 2084 byte log entry
0709 12:20:46.027726 (+  3109us) op_driver.cc:464] REPLICATION: finished
0709 12:20:46.028264 (+   538us) write_op.cc:301] APPLY: starting
0709 12:20:46.028366 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:46.031301 (+  2935us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:46.031399 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:46.058119 (+ 26720us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:46.232767 (+174648us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 12:20:46.237303 (+  4536us) write_op.cc:312] APPLY: finished
0709 12:20:46.271421 (+ 34118us) log.cc:844] Serialized 57 byte log entry
0709 12:20:46.289209 (+ 17788us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:46.305425 (+ 16216us) write_op.cc:454] Released schema lock
0709 12:20:46.306774 (+  1349us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:46.321654 (+ 14880us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:46.321688 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":709846,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":275,"apply.run_cpu_time_us":11924,"apply.run_wall_time_us":293310,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20920,"num_ops":5,"prepare.queue_time_us":161,"prepare.run_cpu_time_us":4287,"prepare.run_wall_time_us":4332,"replication_time_us":3716}]]}
I20260709 12:20:46.490437 30200 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 election: Requested vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:20:46.512576 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 57600.5us
W20260709 12:20:46.541193 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 95732.4us
I20260709 12:20:46.545173 24365 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:46.550483 30284 raft_consensus.cc:2804] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:46.551391 30284 raft_consensus.cc:697] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:46.552553 30284 consensus_queue.cc:237] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:46.556571 24438 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:46.557842 30255 raft_consensus.cc:2804] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:46.558390 30255 raft_consensus.cc:697] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:46.559437 30255 consensus_queue.cc:237] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:46.565613 24221 catalog_manager.cc:5697] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 8 to 11, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 11 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:46.567356 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a802b4f6ba54f358ebd8a2a74f2a9c6" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:46.568058 24466 raft_consensus.cc:3060] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:46.570626 24366 leader_election.cc:336] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:20:46.571121 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125e800842274e17a2c01df7bb749005" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
W20260709 12:20:46.571390 24366 consensus_peers.cc:597] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:46.571770 25112 raft_consensus.cc:3060] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:46.571964 24366 consensus_peers.cc:597] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:46.583227 25112 raft_consensus.cc:2468] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 11.
I20260709 12:20:46.589354 24440 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:20:46.590026 24466 raft_consensus.cc:2468] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 16.
I20260709 12:20:46.604210 30289 raft_consensus.cc:2804] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:20:46.604892 25084 consensus_peers.cc:597] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:46.604892 30289 raft_consensus.cc:697] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:20:46.606104 30289 consensus_queue.cc:237] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:46.609948 24366 leader_election.cc:336] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:20:46.611465 24440 leader_election.cc:336] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:20:46.617383 24440 consensus_peers.cc:597] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:46.617913 24440 consensus_peers.cc:597] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:46.619302 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba811822a8a4266a950b36a73a9fce7" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3"
I20260709 12:20:46.619969 24474 raft_consensus.cc:1275] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:20:46.620151 24467 raft_consensus.cc:3060] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:46.634124 24223 catalog_manager.cc:5697] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 12 to 13, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 13 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:46.636268 24223 catalog_manager.cc:5697] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 19 to 20, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 20 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
W20260709 12:20:46.675382 25084 consensus_peers.cc:597] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:46.678875 24467 raft_consensus.cc:2468] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c855242ec9d34a5397741ef20db9de8a in term 18.
I20260709 12:20:46.709743 24365 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:46.724838 24365 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756
I20260709 12:20:46.735807 30242 raft_consensus.cc:2804] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:46.744110 30242 raft_consensus.cc:697] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 18 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:46.745285 30242 consensus_queue.cc:237] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:20:46.717787 30200 raft_consensus.cc:2804] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:46.725384 30118 consensus_queue.cc:1048] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
W20260709 12:20:46.795871 24221 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54254 (request call id 266) took 21595 ms (client timeout 15000 ms). Trace:
W20260709 12:20:46.796406 24221 rpcz_store.cc:269] 0709 12:20:25.219533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.267878 (+ 48345us) service_pool.cc:224] Handling call
0709 12:20:46.795761 (+21527883us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:46.578307 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:46.578933 (+   626us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:46.578975 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:20:46.578994 (+    19us) tablet.cc:662] Decoding operations
0709 12:20:46.579424 (+   430us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:46.579492 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:46.579529 (+    37us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:20:46.579749 (+   220us) tablet.cc:701] Row locks acquired
0709 12:20:46.579770 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:20:46.579933 (+   163us) write_op.cc:270] Start()
0709 12:20:46.580065 (+   132us) write_op.cc:276] Timestamp: P: 1783599646579882 usec, L: 0
0709 12:20:46.580090 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:20:46.580849 (+   759us) log.cc:844] Serialized 539 byte log entry
0709 12:20:46.583375 (+  2526us) op_driver.cc:464] REPLICATION: finished
0709 12:20:46.583969 (+   594us) write_op.cc:301] APPLY: starting
0709 12:20:46.584060 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:46.606723 (+ 22663us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:46.606822 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:46.607568 (+   746us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:46.607725 (+   157us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:20:46.607773 (+    48us) write_op.cc:312] APPLY: finished
0709 12:20:46.607966 (+   193us) log.cc:844] Serialized 25 byte log entry
0709 12:20:46.608147 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:46.608245 (+    98us) write_op.cc:454] Released schema lock
0709 12:20:46.608288 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:46.611003 (+  2715us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:46.612450 (+  1447us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1541112,"reported_tablets":49,"spinlock_wait_cycles":14080,"child_traces":[["op",{"apply.queue_time_us":377,"apply.run_cpu_time_us":3057,"apply.run_wall_time_us":24638,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4184,"num_ops":1,"prepare.queue_time_us":122,"prepare.run_cpu_time_us":2858,"prepare.run_wall_time_us":2858,"replication_time_us":3159}]]}
W20260709 12:20:46.800843 24366 consensus_peers.cc:597] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:46.801364 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 56839.5us
I20260709 12:20:46.808538 30200 raft_consensus.cc:697] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 16 LEADER]: Becoming Leader. State: Replica: c855242ec9d34a5397741ef20db9de8a, State: Running, Role: LEADER
I20260709 12:20:46.809870 30200 consensus_queue.cc:237] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
W20260709 12:20:46.817052 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 74661.5us
W20260709 12:20:46.816182 30290 log.cc:927] Time spent T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
W20260709 12:20:46.827402 25084 consensus_peers.cc:597] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:46.830574 24440 consensus_peers.cc:597] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:46.831970 24440 consensus_peers.cc:597] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:46.901424 30295 log.cc:927] Time spent T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 12:20:46.908290 30300 log.cc:927] Time spent T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 12:20:46.924644 23151 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 24346)
W20260709 12:20:46.956859 30293 log.cc:927] Time spent T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a: Append to log took a long time: real 0.144s	user 0.002s	sys 0.002s
W20260709 12:20:46.957134 24440 consensus_peers.cc:597] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:46.983741 24209 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 97dd30b21cc14958a91b2da522e4bbe9 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 99b8650fa8324ac2ac5f75eee9b1a1e3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:20:47.012709 24440 consensus_peers.cc:597] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:47.030428 25117 raft_consensus.cc:1275] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:20:47.032447 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 180812us
I20260709 12:20:47.058830 24217 catalog_manager.cc:5697] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 11 to 13, leader changed from d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 13 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:47.064312 25084 consensus_peers.cc:597] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:47.066840 24217 catalog_manager.cc:5697] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 11 to 15, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 15 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:47.072150 24217 catalog_manager.cc:5697] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 12 to 14, leader changed from d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) to c711faa13ead43ebbea0192cb74a4756 (127.22.155.193). New cstate: current_term: 14 leader_uuid: "c711faa13ead43ebbea0192cb74a4756" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:47.073791 24397 raft_consensus.cc:1275] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:20:47.093989 24217 catalog_manager.cc:5697] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 15 to 16, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196). New cstate: current_term: 16 leader_uuid: "d99d5d772cfe4a96afcab3d3b009a281" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:20:47.096933 24440 consensus_peers.cc:597] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:47.101616 25084 consensus_peers.cc:597] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:47.121870 30285 consensus_queue.cc:1048] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:47.135608 30242 consensus_queue.cc:1048] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:20:47.137434 25084 consensus_peers.cc:597] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:47.140606 24366 consensus_peers.cc:597] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:47.149938 25112 raft_consensus.cc:1275] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:20:47.156983 30305 consensus_queue.cc:1048] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:47.186473 24221 catalog_manager.cc:5697] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 15 to 16, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 16 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:47.188365 24221 catalog_manager.cc:5697] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 13 to 14, leader changed from 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 14 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:47.190524 24221 catalog_manager.cc:5697] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 13 to 14, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 14 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } attrs { replace: true } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:20:47.193564 24366 consensus_peers.cc:597] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:47.192380 24221 catalog_manager.cc:5697] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 17 to 18, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to c855242ec9d34a5397741ef20db9de8a (127.22.155.194). New cstate: current_term: 18 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:47.201525 24366 consensus_peers.cc:597] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:47.208153 25112 raft_consensus.cc:1275] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:20:47.226902 30255 consensus_queue.cc:1048] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:47.261384 24469 raft_consensus.cc:1275] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:20:47.293129 24474 raft_consensus.cc:1275] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 12:20:47.344358 24366 consensus_peers.cc:597] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:47.349771 24440 consensus_peers.cc:597] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:47.331359 30278 consensus_queue.cc:1048] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:20:47.324615 30277 consensus_queue.cc:1048] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
W20260709 12:20:47.361407 24366 consensus_peers.cc:597] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:47.362013 24366 consensus_peers.cc:597] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:47.386830 24217 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54254 (request call id 267) took 5437 ms. Trace:
I20260709 12:20:47.387369 24217 rpcz_store.cc:276] 0709 12:20:41.993682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.994005 (+   323us) service_pool.cc:224] Handling call
0709 12:20:47.386722 (+5392717us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:47.139049 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:47.152240 (+ 13191us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:47.152291 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:20:47.152314 (+    23us) tablet.cc:662] Decoding operations
0709 12:20:47.153081 (+   767us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:47.153149 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:47.153177 (+    28us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:20:47.153712 (+   535us) tablet.cc:701] Row locks acquired
0709 12:20:47.153732 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:20:47.153931 (+   199us) write_op.cc:270] Start()
0709 12:20:47.154075 (+   144us) write_op.cc:276] Timestamp: P: 1783599647153872 usec, L: 0
0709 12:20:47.154103 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:20:47.154797 (+   694us) log.cc:844] Serialized 1698 byte log entry
0709 12:20:47.159689 (+  4892us) op_driver.cc:464] REPLICATION: finished
0709 12:20:47.162355 (+  2666us) write_op.cc:301] APPLY: starting
0709 12:20:47.162484 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:47.167101 (+  4617us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:47.167208 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:47.170133 (+  2925us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:47.170338 (+   205us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 12:20:47.170386 (+    48us) write_op.cc:312] APPLY: finished
0709 12:20:47.170638 (+   252us) log.cc:844] Serialized 49 byte log entry
0709 12:20:47.173547 (+  2909us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:47.173675 (+   128us) write_op.cc:454] Released schema lock
0709 12:20:47.173730 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:47.174107 (+   377us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:47.174139 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9594,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":2445,"apply.run_cpu_time_us":7008,"apply.run_wall_time_us":11726,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16736,"num_ops":4,"prepare.queue_time_us":232,"prepare.run_cpu_time_us":4085,"prepare.run_wall_time_us":18050,"replication_time_us":5418}]]}
W20260709 12:20:47.425743 24366 consensus_peers.cc:597] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:47.426539 24366 consensus_peers.cc:597] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:47.445825 25084 consensus_peers.cc:597] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:47.465389 24210 catalog_manager.cc:4755] TS c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): ChangeConfig:REMOVE_PEER RPC failed for tablet 4fb70b6bc9ed40a793fb93839c889578: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:20:47.489326 24474 raft_consensus.cc:1275] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:20:47.502952 24366 consensus_peers.cc:597] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:47.524484 24440 consensus_peers.cc:597] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:47.538401 24223 catalog_manager.cc:5697] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 14 to 15, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 15 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:47.553095 30278 consensus_queue.cc:1048] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:47.566210 24217 catalog_manager.cc:5697] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a reported cstate change: term changed from 15 to 16, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 16 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } }
I20260709 12:20:47.640715 24223 catalog_manager.cc:5697] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: term changed from 10 to 11, leader changed from c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 11 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:20:47.646355 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 72318.1us
W20260709 12:20:47.753602 25084 consensus_peers.cc:597] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:47.826143 24440 consensus_peers.cc:597] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:47.899207 24440 consensus_peers.cc:597] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:47.925220 23151 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 24346)
W20260709 12:20:48.017828 24366 consensus_peers.cc:597] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:48.026782 24366 consensus_peers.cc:597] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:48.243927 25084 consensus_peers.cc:597] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:48.251912 24366 consensus_peers.cc:597] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:48.291348 24366 consensus_peers.cc:597] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:48.321964 24366 consensus_peers.cc:597] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:48.403386 24366 consensus_peers.cc:597] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:48.422032 24440 consensus_peers.cc:597] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:48.512236 24469 consensus_queue.cc:237] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:48.517899 25084 consensus_peers.cc:597] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:48.545641 25084 consensus_peers.cc:597] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:48.547993 25112 raft_consensus.cc:1275] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:20:48.555053 30285 consensus_queue.cc:1048] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:20:48.579383 24440 consensus_peers.cc:597] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:48.586089 30065 raft_consensus.cc:2955] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 6 to 12, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:20:48.653411 24366 consensus_peers.cc:597] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:48.676843 24440 consensus_peers.cc:597] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:48.680193 24209 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4fb70b6bc9ed40a793fb93839c889578 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 8)
I20260709 12:20:48.686553 25112 raft_consensus.cc:2955] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 6 to 12, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:48.703043 24221 catalog_manager.cc:5697] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: config changed from index 6 to 12, VOTER c855242ec9d34a5397741ef20db9de8a (127.22.155.194) evicted. New cstate: current_term: 14 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:20:48.748509 25084 consensus_peers.cc:597] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:48.783311 24366 consensus_peers.cc:597] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:48.784729 25084 consensus_peers.cc:597] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:48.809202 24366 consensus_peers.cc:597] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:48.901093 24383 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fb70b6bc9ed40a793fb93839c889578 with delete_type TABLET_DATA_TOMBSTONED (TS c855242ec9d34a5397741ef20db9de8a not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:36020
W20260709 12:20:48.925777 23151 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 24346)
W20260709 12:20:48.949059 25084 consensus_peers.cc:597] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:49.005105 30328 tablet_replica.cc:333] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:20:49.036584 30328 raft_consensus.cc:2243] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:49.042899 30328 raft_consensus.cc:2272] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:49.049790 24366 consensus_peers.cc:597] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:49.067039 25084 consensus_peers.cc:597] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:49.081948 30328 ts_tablet_manager.cc:1916] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:20:49.091190 24366 consensus_peers.cc:597] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:49.091938 24366 consensus_peers.cc:597] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:49.105443 30328 ts_tablet_manager.cc:1929] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 12:20:49.106216 30328 log.cc:1199] T 4fb70b6bc9ed40a793fb93839c889578 P c855242ec9d34a5397741ef20db9de8a: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-1-root/wals/4fb70b6bc9ed40a793fb93839c889578
I20260709 12:20:49.108235 24208 catalog_manager.cc:5028] TS c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): tablet 4fb70b6bc9ed40a793fb93839c889578 (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
W20260709 12:20:49.117724 25084 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111) [suppressed 460 similar messages]
W20260709 12:20:49.189257 24440 consensus_peers.cc:597] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:49.257560 24440 consensus_peers.cc:597] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:49.318465 25084 consensus_peers.cc:597] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:49.322948 24440 consensus_peers.cc:597] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:49.416333 25084 consensus_peers.cc:597] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:49.435513 24366 consensus_peers.cc:597] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:49.431175 24440 consensus_peers.cc:597] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:49.462862 24440 consensus_peers.cc:597] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:49.555581 25084 consensus_peers.cc:597] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:49.567037 25084 consensus_peers.cc:597] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:49.648311 24366 consensus_peers.cc:597] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:49.689540 24366 consensus_peers.cc:597] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:49.703203 24440 consensus_peers.cc:597] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:49.724318 24366 consensus_peers.cc:597] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:49.894500 24366 consensus_peers.cc:597] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:49.926541 23151 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 24346)
W20260709 12:20:49.929634 25084 consensus_peers.cc:597] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:49.998991 24440 consensus_peers.cc:597] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:50.012122 24366 consensus_peers.cc:597] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:50.017602 24366 consensus_peers.cc:597] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:50.018641 24366 consensus_peers.cc:597] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:50.033195 24366 consensus_peers.cc:597] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:50.056382 24366 consensus_peers.cc:597] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:50.250237 24440 consensus_peers.cc:597] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:50.256807 24440 consensus_peers.cc:597] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:50.295353 24392 consensus_queue.cc:237] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
W20260709 12:20:50.316406 25084 consensus_peers.cc:597] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:50.331369 24474 raft_consensus.cc:1275] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 12:20:50.331715 24366 consensus_peers.cc:597] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9950f2ff950845e1837dbf993fb23cb0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:50.334316 30280 consensus_queue.cc:1048] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:20:50.337250 24366 consensus_peers.cc:597] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:50.369284 30335 raft_consensus.cc:2955] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 17 LEADER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:20:50.373756 24470 raft_consensus.cc:2955] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:20:50.418107 24222 catalog_manager.cc:5697] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index -1 to 10, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 17 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:20:50.427435 24392 consensus_queue.cc:237] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
W20260709 12:20:50.451117 24366 consensus_peers.cc:597] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cabffff9a20f4f0091c52fc21d5abcde. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:50.454658 24469 raft_consensus.cc:1275] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:20:50.460762 24366 consensus_peers.cc:597] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:50.468483 24440 consensus_peers.cc:597] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:50.469578 30278 consensus_queue.cc:1048] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:50.522871 30278 raft_consensus.cc:2955] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:20:50.541395 24469 raft_consensus.cc:2955] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:20:50.669420 24470 consensus_queue.cc:237] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:20:50.664479 24222 catalog_manager.cc:5697] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index -1 to 11, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 14 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
W20260709 12:20:50.703353 24440 consensus_peers.cc:597] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fdc8b7c33c2b4e9da87a15ea80d2f342. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:50.707607 24392 raft_consensus.cc:1275] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:20:50.713555 30329 consensus_queue.cc:1048] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:20:50.721632 24440 consensus_peers.cc:597] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:50.754537 24366 consensus_peers.cc:597] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:50.787015 30065 raft_consensus.cc:2955] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:20:50.794102 24397 raft_consensus.cc:2955] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
W20260709 12:20:50.820078 24366 consensus_peers.cc:597] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:50.824103 25084 consensus_peers.cc:597] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:50.863188 24222 catalog_manager.cc:5697] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a reported cstate change: config changed from index -1 to 10, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 12 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:20:50.869360 24397 consensus_queue.cc:237] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
W20260709 12:20:50.921368 24366 consensus_peers.cc:597] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:50.927314 23151 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 24346)
I20260709 12:20:50.931082 30349 ts_tablet_manager.cc:933] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:50.970585 24469 raft_consensus.cc:1275] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:20:50.974088 30318 consensus_queue.cc:1048] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
W20260709 12:20:50.975904 24366 consensus_peers.cc:597] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:50.976917 24366 consensus_peers.cc:597] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a -> Peer d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511): Couldn't send request to peer d99d5d772cfe4a96afcab3d3b009a281. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3d18ca89df84c1ba95edb6284f7a8fb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:50.977643 30353 ts_tablet_manager.cc:933] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:20:50.978852 25084 consensus_peers.cc:597] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:50.994962 30349 tablet_copy_client.cc:323] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.194:35893
W20260709 12:20:50.996816 24366 consensus_peers.cc:597] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:51.010174 24440 consensus_peers.cc:597] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:51.013154 24410 tablet_copy_service.cc:140] P c855242ec9d34a5397741ef20db9de8a: Received BeginTabletCopySession request for tablet 9950f2ff950845e1837dbf993fb23cb0 from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:50950)
I20260709 12:20:51.013938 24410 tablet_copy_service.cc:161] P c855242ec9d34a5397741ef20db9de8a: Beginning new tablet copy session on tablet 9950f2ff950845e1837dbf993fb23cb0 from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:50950: session id = d99d5d772cfe4a96afcab3d3b009a281-9950f2ff950845e1837dbf993fb23cb0
W20260709 12:20:51.016033 24366 consensus_peers.cc:597] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:51.016732 30335 raft_consensus.cc:2955] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
W20260709 12:20:51.024048 24440 consensus_peers.cc:597] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:51.027163 24469 raft_consensus.cc:2955] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
W20260709 12:20:51.028401 25084 consensus_peers.cc:597] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:51.035619 24410 tablet_copy_source_session.cc:215] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:51.035835 30353 tablet_copy_client.cc:323] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.194:35893
I20260709 12:20:51.041500 30349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9950f2ff950845e1837dbf993fb23cb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.052722 24410 tablet_copy_service.cc:140] P c855242ec9d34a5397741ef20db9de8a: Received BeginTabletCopySession request for tablet cabffff9a20f4f0091c52fc21d5abcde from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:50950)
W20260709 12:20:51.059381 24366 consensus_peers.cc:597] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:51.061177 24410 tablet_copy_service.cc:161] P c855242ec9d34a5397741ef20db9de8a: Beginning new tablet copy session on tablet cabffff9a20f4f0091c52fc21d5abcde from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:50950: session id = d99d5d772cfe4a96afcab3d3b009a281-cabffff9a20f4f0091c52fc21d5abcde
I20260709 12:20:51.083921 24410 tablet_copy_source_session.cc:215] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:51.086225 24222 catalog_manager.cc:5697] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index -1 to 8, NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) added. New cstate: current_term: 12 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } } }
I20260709 12:20:51.089105 30353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cabffff9a20f4f0091c52fc21d5abcde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.104669 30349 tablet_copy_client.cc:806] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:51.105659 30349 tablet_copy_client.cc:670] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
W20260709 12:20:51.109035 25084 consensus_peers.cc:597] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:51.116852 30349 tablet_copy_client.cc:538] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:51.130740 30349 tablet_bootstrap.cc:492] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:20:51.135792 30353 tablet_copy_client.cc:806] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:51.142287 30353 tablet_copy_client.cc:670] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:51.149312 30353 tablet_copy_client.cc:538] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:20:51.179673 24440 consensus_peers.cc:597] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:51.200416 30353 tablet_bootstrap.cc:492] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
W20260709 12:20:51.203887 25084 consensus_peers.cc:597] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:51.218287 30359 ts_tablet_manager.cc:933] T fdc8b7c33c2b4e9da87a15ea80d2f342 P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:20:51.269800 30359 tablet_copy_client.cc:323] T fdc8b7c33c2b4e9da87a15ea80d2f342 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.195:44453
I20260709 12:20:51.274536 24484 tablet_copy_service.cc:140] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Received BeginTabletCopySession request for tablet fdc8b7c33c2b4e9da87a15ea80d2f342 from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:33198)
I20260709 12:20:51.275168 24484 tablet_copy_service.cc:161] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Beginning new tablet copy session on tablet fdc8b7c33c2b4e9da87a15ea80d2f342 from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:33198: session id = d99d5d772cfe4a96afcab3d3b009a281-fdc8b7c33c2b4e9da87a15ea80d2f342
I20260709 12:20:51.295956 24484 tablet_copy_source_session.cc:215] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:51.300001 30359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdc8b7c33c2b4e9da87a15ea80d2f342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.313354 30349 tablet_bootstrap.cc:492] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:51.333663 30349 tablet_bootstrap.cc:492] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:20:51.334681 30349 ts_tablet_manager.cc:1403] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.204s	user 0.030s	sys 0.024s
I20260709 12:20:51.347851 30349 raft_consensus.cc:359] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:20:51.355710 30349 raft_consensus.cc:740] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:20:51.356562 30349 consensus_queue.cc:260] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:20:51.369256 30359 tablet_copy_client.cc:806] T fdc8b7c33c2b4e9da87a15ea80d2f342 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:51.370962 30359 tablet_copy_client.cc:670] T fdc8b7c33c2b4e9da87a15ea80d2f342 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:51.371362 30349 ts_tablet_manager.cc:1434] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 12:20:51.389138 30359 tablet_copy_client.cc:538] T fdc8b7c33c2b4e9da87a15ea80d2f342 P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:51.406795 30353 tablet_bootstrap.cc:492] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:51.415686 30353 tablet_bootstrap.cc:492] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:20:51.416689 30353 ts_tablet_manager.cc:1403] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.252s	user 0.027s	sys 0.026s
I20260709 12:20:51.427883 30353 raft_consensus.cc:359] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:20:51.428982 30353 raft_consensus.cc:740] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:20:51.429708 30353 consensus_queue.cc:260] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:20:51.436785 24410 tablet_copy_service.cc:342] P c855242ec9d34a5397741ef20db9de8a: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-9950f2ff950845e1837dbf993fb23cb0 received from {username='slave'} at 127.0.0.1:50950
I20260709 12:20:51.437786 24410 tablet_copy_service.cc:434] P c855242ec9d34a5397741ef20db9de8a: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-9950f2ff950845e1837dbf993fb23cb0 on tablet 9950f2ff950845e1837dbf993fb23cb0 with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:51.439488 30359 tablet_bootstrap.cc:492] T fdc8b7c33c2b4e9da87a15ea80d2f342 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
W20260709 12:20:51.446790 24366 consensus_peers.cc:597] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:51.456096 30353 ts_tablet_manager.cc:1434] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.001s
W20260709 12:20:51.456542 24366 consensus_peers.cc:597] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:51.468469 25084 consensus_peers.cc:597] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:51.494228 24410 tablet_copy_service.cc:342] P c855242ec9d34a5397741ef20db9de8a: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-cabffff9a20f4f0091c52fc21d5abcde received from {username='slave'} at 127.0.0.1:50950
I20260709 12:20:51.494868 24410 tablet_copy_service.cc:434] P c855242ec9d34a5397741ef20db9de8a: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-cabffff9a20f4f0091c52fc21d5abcde on tablet cabffff9a20f4f0091c52fc21d5abcde with peer d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:20:51.547185 30353 ts_tablet_manager.cc:933] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281: Initiating tablet copy from peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:20:51.567835 30353 tablet_copy_client.cc:323] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Beginning tablet copy session from remote peer at address 127.22.155.194:35893
I20260709 12:20:51.582728 24410 tablet_copy_service.cc:140] P c855242ec9d34a5397741ef20db9de8a: Received BeginTabletCopySession request for tablet f3d18ca89df84c1ba95edb6284f7a8fb from peer d99d5d772cfe4a96afcab3d3b009a281 ({username='slave'} at 127.0.0.1:50950)
I20260709 12:20:51.583424 24410 tablet_copy_service.cc:161] P c855242ec9d34a5397741ef20db9de8a: Beginning new tablet copy session on tablet f3d18ca89df84c1ba95edb6284f7a8fb from peer d99d5d772cfe4a96afcab3d3b009a281 at {username='slave'} at 127.0.0.1:50950: session id = d99d5d772cfe4a96afcab3d3b009a281-f3d18ca89df84c1ba95edb6284f7a8fb
I20260709 12:20:51.593497 24410 tablet_copy_source_session.cc:215] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:20:51.595010 24366 consensus_peers.cc:597] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:51.606927 30353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d18ca89df84c1ba95edb6284f7a8fb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:20:51.609141 24366 consensus_peers.cc:597] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:51.631587 30353 tablet_copy_client.cc:806] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:51.632372 30353 tablet_copy_client.cc:670] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Starting download of 1 WAL segments...
W20260709 12:20:51.637995 24366 consensus_peers.cc:597] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:51.642237 30353 tablet_copy_client.cc:538] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:51.649686 25112 raft_consensus.cc:1217] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.9->[17.10-17.10]   Dedup: 17.10->[]
W20260709 12:20:51.683748 25084 consensus_peers.cc:597] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:51.697359 30359 tablet_bootstrap.cc:492] T fdc8b7c33c2b4e9da87a15ea80d2f342 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:51.698448 30359 tablet_bootstrap.cc:492] T fdc8b7c33c2b4e9da87a15ea80d2f342 P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:20:51.699196 30359 ts_tablet_manager.cc:1403] T fdc8b7c33c2b4e9da87a15ea80d2f342 P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.260s	user 0.039s	sys 0.009s
I20260709 12:20:51.719539 30353 tablet_bootstrap.cc:492] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap starting.
I20260709 12:20:51.745530 30359 raft_consensus.cc:359] T fdc8b7c33c2b4e9da87a15ea80d2f342 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:20:51.748245 30359 raft_consensus.cc:740] T fdc8b7c33c2b4e9da87a15ea80d2f342 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:20:51.749248 30359 consensus_queue.cc:260] T fdc8b7c33c2b4e9da87a15ea80d2f342 P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:20:51.754760 30359 ts_tablet_manager.cc:1434] T fdc8b7c33c2b4e9da87a15ea80d2f342 P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.004s
I20260709 12:20:51.764418 24484 tablet_copy_service.cc:342] P 99b8650fa8324ac2ac5f75eee9b1a1e3: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-fdc8b7c33c2b4e9da87a15ea80d2f342 received from {username='slave'} at 127.0.0.1:33198
I20260709 12:20:51.764992 24484 tablet_copy_service.cc:434] P 99b8650fa8324ac2ac5f75eee9b1a1e3: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-fdc8b7c33c2b4e9da87a15ea80d2f342 on tablet fdc8b7c33c2b4e9da87a15ea80d2f342 with peer d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:51.812572 25084 consensus_peers.cc:597] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:51.861816 25084 consensus_peers.cc:597] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:51.888165 30353 tablet_bootstrap.cc:492] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:51.901855 30353 tablet_bootstrap.cc:492] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281: Bootstrap complete.
I20260709 12:20:51.903007 30353 ts_tablet_manager.cc:1403] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281: Time spent bootstrapping tablet: real 0.184s	user 0.041s	sys 0.003s
I20260709 12:20:51.906716 30353 raft_consensus.cc:359] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:20:51.907789 30353 raft_consensus.cc:740] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: d99d5d772cfe4a96afcab3d3b009a281, State: Initialized, Role: LEARNER
I20260709 12:20:51.908615 30353 consensus_queue.cc:260] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: NON_VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: true } }
I20260709 12:20:51.911525 30353 ts_tablet_manager.cc:1434] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:20:51.920970 24410 tablet_copy_service.cc:342] P c855242ec9d34a5397741ef20db9de8a: Request end of tablet copy session d99d5d772cfe4a96afcab3d3b009a281-f3d18ca89df84c1ba95edb6284f7a8fb received from {username='slave'} at 127.0.0.1:50950
I20260709 12:20:51.921511 24410 tablet_copy_service.cc:434] P c855242ec9d34a5397741ef20db9de8a: ending tablet copy session d99d5d772cfe4a96afcab3d3b009a281-f3d18ca89df84c1ba95edb6284f7a8fb on tablet f3d18ca89df84c1ba95edb6284f7a8fb with peer d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:20:51.927891 23151 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 24346)
W20260709 12:20:51.933543 24440 consensus_peers.cc:597] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:51.993430 25112 raft_consensus.cc:1217] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.10->[14.11-14.11]   Dedup: 14.11->[]
W20260709 12:20:52.003614 25084 consensus_peers.cc:597] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:52.012826 24440 consensus_peers.cc:597] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:52.013636 24440 consensus_peers.cc:597] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:52.022190 24440 consensus_peers.cc:597] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:52.039680 24440 consensus_peers.cc:597] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:52.062288 25112 raft_consensus.cc:1217] T fdc8b7c33c2b4e9da87a15ea80d2f342 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.9->[12.10-12.10]   Dedup: 12.10->[]
I20260709 12:20:52.065007 30278 raft_consensus.cc:1064] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:20:52.067807 30278 consensus_queue.cc:237] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 8, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:52.071687 24440 consensus_peers.cc:597] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:52.120285 24469 raft_consensus.cc:1275] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:20:52.122478 25112 raft_consensus.cc:1275] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [term 17 LEARNER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:20:52.124877 30335 consensus_queue.cc:1048] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:52.126768 30335 consensus_queue.cc:1048] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:20:52.133661 24366 consensus_peers.cc:597] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:52.177455 25117 raft_consensus.cc:1217] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.7->[12.8-12.8]   Dedup: 12.8->[]
W20260709 12:20:52.198287 25084 consensus_peers.cc:597] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:52.221290 30278 raft_consensus.cc:2955] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index 10 to 11, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:20:52.227157 24366 consensus_peers.cc:597] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:52.227540 25117 raft_consensus.cc:2955] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:52.233922 24470 raft_consensus.cc:2955] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:52.259771 24221 catalog_manager.cc:5697] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: config changed from index 10 to 11, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:20:52.270413 24366 consensus_peers.cc:597] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:52.299942 24366 consensus_peers.cc:597] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:52.303524 24366 consensus_peers.cc:597] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:52.324411 24366 consensus_peers.cc:597] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:52.486522 25084 consensus_peers.cc:597] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:52.595942 30065 raft_consensus.cc:1064] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:20:52.598410 30065 consensus_queue.cc:237] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:52.609306 24366 consensus_peers.cc:597] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:52.610584 30278 raft_consensus.cc:1064] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:20:52.613806 30278 consensus_queue.cc:237] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:52.641571 24400 raft_consensus.cc:1275] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:20:52.641721 24469 raft_consensus.cc:1275] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:20:52.642620 25117 raft_consensus.cc:1275] T fdc8b7c33c2b4e9da87a15ea80d2f342 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 LEARNER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:20:52.647759 25117 raft_consensus.cc:1275] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281 [term 14 LEARNER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:20:52.649238 30065 consensus_queue.cc:1048] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:52.650266 30329 consensus_queue.cc:1048] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:52.650665 30280 consensus_queue.cc:1048] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:20:52.663501 24440 consensus_peers.cc:597] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:52.703934 24366 consensus_peers.cc:597] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:52.731402 30350 raft_consensus.cc:2955] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:20:52.766299 25084 consensus_peers.cc:597] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:52.770747 24392 raft_consensus.cc:2955] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:52.789472 30369 consensus_queue.cc:1048] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:20:52.805264 24440 consensus_peers.cc:597] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:52.819568 24366 consensus_peers.cc:597] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:52.823169 25114 raft_consensus.cc:2955] T fdc8b7c33c2b4e9da87a15ea80d2f342 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:20:52.836038 24440 consensus_peers.cc:597] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:52.848364 24366 consensus_peers.cc:597] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:52.849300 24366 consensus_peers.cc:597] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:52.856405 24222 catalog_manager.cc:5697] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a reported cstate change: config changed from index 10 to 11, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:52.862697 30369 raft_consensus.cc:1064] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a: attempting to promote NON_VOTER d99d5d772cfe4a96afcab3d3b009a281 to VOTER
I20260709 12:20:52.866904 30369 consensus_queue.cc:237] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 6, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:20:52.913020 24440 consensus_peers.cc:597] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:52.928494 23151 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 24346)
I20260709 12:20:52.937192 30335 raft_consensus.cc:2955] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:52.994181 25117 raft_consensus.cc:2955] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:20:53.085134 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 79823.4us
W20260709 12:20:53.105521 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 109209us
W20260709 12:20:53.141840 24366 consensus_peers.cc:597] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:53.129770 24474 raft_consensus.cc:2955] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:53.214452 24467 raft_consensus.cc:1275] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:20:53.222432 24474 consensus_queue.cc:237] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:53.255685 30278 consensus_queue.cc:1048] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:53.265507 24221 catalog_manager.cc:5697] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: config changed from index 11 to 12, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:20:53.295141 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 137045us
I20260709 12:20:53.307687 25117 raft_consensus.cc:1275] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281 [term 12 LEARNER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:20:53.324045 30335 consensus_queue.cc:1048] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:20:53.351128 24366 consensus_peers.cc:597] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:53.351926 25112 raft_consensus.cc:1275] T fdc8b7c33c2b4e9da87a15ea80d2f342 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:20:53.353739 30329 consensus_queue.cc:1048] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:20:53.369081 25084 consensus_peers.cc:597] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:53.368407 30379 raft_consensus.cc:2955] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Committing config change with OpId 12.12: config changed from index 11 to 12, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:53.395222 25112 raft_consensus.cc:2955] T fdc8b7c33c2b4e9da87a15ea80d2f342 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 11 to 12, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:20:53.432868 25084 consensus_peers.cc:597] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:53.436848 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 54200.4us
W20260709 12:20:53.444832 24366 consensus_peers.cc:597] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:53.447575 24392 raft_consensus.cc:1275] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:20:53.465682 30401 consensus_queue.cc:1048] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:53.470783 24209 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fdc8b7c33c2b4e9da87a15ea80d2f342 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:53.470037 30395 raft_consensus.cc:2955] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 8 to 9, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:53.481596 24393 raft_consensus.cc:2955] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 11 to 12, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:20:53.499187 24366 consensus_peers.cc:597] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:53.505074 25117 raft_consensus.cc:2955] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:53.507174 24221 catalog_manager.cc:5697] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a reported cstate change: config changed from index 11 to 12, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New cstate: current_term: 12 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:53.513026 24474 raft_consensus.cc:2955] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:53.537873 24222 catalog_manager.cc:5697] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281 reported cstate change: config changed from index 8 to 9, d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } attrs { replace: true } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:20:53.580915 24366 consensus_peers.cc:597] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:53.592978 24366 consensus_peers.cc:597] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:53.600096 24397 consensus_queue.cc:237] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:20:53.609935 25112 raft_consensus.cc:1275] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:20:53.612399 30280 consensus_queue.cc:1048] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:20:53.613377 24210 catalog_manager.cc:4755] TS c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet fdc8b7c33c2b4e9da87a15ea80d2f342: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:20:53.616647 24466 raft_consensus.cc:1275] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:20:53.621264 30280 consensus_queue.cc:1048] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:53.634276 30369 raft_consensus.cc:2955] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:20:53.639078 24440 consensus_peers.cc:597] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:53.651607 24466 raft_consensus.cc:2955] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:53.664674 25112 raft_consensus.cc:2955] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
W20260709 12:20:53.678264 24440 consensus_peers.cc:597] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:53.695434 24222 catalog_manager.cc:5697] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: config changed from index 9 to 10, VOTER c711faa13ead43ebbea0192cb74a4756 (127.22.155.193) evicted. New cstate: current_term: 12 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:20:53.707437 24208 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f3d18ca89df84c1ba95edb6284f7a8fb with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:20:53.739503 25084 consensus_peers.cc:597] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:53.751547 24366 consensus_peers.cc:597] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:53.755712 25084 consensus_peers.cc:597] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:53.882583 24440 consensus_peers.cc:597] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:53.883001 25084 consensus_peers.cc:597] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:53.930020 23151 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 24346)
W20260709 12:20:53.959920 25084 consensus_peers.cc:597] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:54.035494 24366 consensus_peers.cc:597] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:54.059386 24366 consensus_peers.cc:597] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:54.131943 25084 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111) [suppressed 476 similar messages]
W20260709 12:20:54.168504 24366 consensus_peers.cc:597] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:54.201690 24440 consensus_peers.cc:597] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:54.266896 25084 consensus_peers.cc:597] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:54.308920 25084 consensus_peers.cc:597] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:54.329123 25084 consensus_peers.cc:597] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:54.505091 24366 consensus_peers.cc:597] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:54.543036 25084 consensus_peers.cc:597] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:54.679850 24440 consensus_peers.cc:597] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:54.684620 24440 consensus_peers.cc:597] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:54.691497 25084 consensus_peers.cc:597] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:54.750509 24440 consensus_peers.cc:597] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:54.751204 24440 consensus_peers.cc:597] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:54.761224 24440 consensus_peers.cc:597] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:54.753419 24366 consensus_peers.cc:597] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:54.762418 24366 consensus_peers.cc:597] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:54.872514 24210 catalog_manager.cc:4755] TS c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet fdc8b7c33c2b4e9da87a15ea80d2f342: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:20:54.903120 24366 consensus_peers.cc:597] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:54.918469 25084 consensus_peers.cc:597] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:54.930491 23151 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 24346)
W20260709 12:20:54.943552 24366 consensus_peers.cc:597] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:54.987478 24366 consensus_peers.cc:597] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:55.082084 24366 consensus_peers.cc:597] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:55.108810 24366 consensus_peers.cc:597] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:55.184543 25084 consensus_peers.cc:597] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:55.220877 24366 consensus_peers.cc:597] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:55.250665 24366 consensus_peers.cc:597] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:55.291889 24366 consensus_peers.cc:597] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:55.316875 24440 consensus_peers.cc:597] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:55.343830 24366 consensus_peers.cc:597] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:55.444924 24366 consensus_peers.cc:597] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:55.550350 24440 consensus_peers.cc:597] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:55.626544 24440 consensus_peers.cc:597] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:55.745438 25084 consensus_peers.cc:597] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:55.774546 24366 consensus_peers.cc:597] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:55.895943 24366 consensus_peers.cc:597] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:55.931038 23151 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 24346)
W20260709 12:20:55.931581 24210 catalog_manager.cc:4755] TS c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet fdc8b7c33c2b4e9da87a15ea80d2f342: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:20:55.977602 24440 consensus_peers.cc:597] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:56.167636 24366 consensus_peers.cc:597] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:56.211805 24366 consensus_peers.cc:597] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:56.378237 25084 consensus_peers.cc:597] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:56.380493 25084 consensus_peers.cc:597] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:56.397774 24366 consensus_peers.cc:597] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:56.415035 24440 consensus_peers.cc:597] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:56.424265 24366 consensus_peers.cc:597] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:56.429250 24440 consensus_peers.cc:597] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:56.448397 25084 consensus_peers.cc:597] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:56.520980 25084 consensus_peers.cc:597] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:56.569640 24366 consensus_peers.cc:597] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:56.648345 24366 consensus_peers.cc:597] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:56.655457 25084 consensus_peers.cc:597] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:56.728304 24440 consensus_peers.cc:597] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:56.771775 25084 consensus_peers.cc:597] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:56.874946 24440 consensus_peers.cc:597] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:56.931563 23151 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 24346)
W20260709 12:20:56.938387 24366 consensus_peers.cc:597] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:56.960218 25084 consensus_peers.cc:597] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:56.966914 24440 consensus_peers.cc:597] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:57.011953 25084 consensus_peers.cc:597] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:57.044528 24366 consensus_peers.cc:597] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:57.045189 24366 consensus_peers.cc:597] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:57.084177 25084 consensus_peers.cc:597] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:57.130203 24440 consensus_peers.cc:597] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:57.171612 25084 consensus_peers.cc:597] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:57.239286 24440 consensus_peers.cc:597] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:57.295464 25084 consensus_peers.cc:597] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:57.318576 24440 consensus_peers.cc:597] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:57.503368 24366 consensus_peers.cc:597] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:57.503968 24366 consensus_peers.cc:597] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:57.571019 24366 consensus_peers.cc:597] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:57.576857 24366 consensus_peers.cc:597] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:57.639899 24366 consensus_peers.cc:597] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:57.671787 24366 consensus_peers.cc:597] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:57.723294 24366 consensus_peers.cc:597] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:57.790812 24440 consensus_peers.cc:597] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:57.839468 24366 consensus_peers.cc:597] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:57.914026 25084 consensus_peers.cc:597] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:57.932180 23151 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 24346)
W20260709 12:20:57.978935 24366 consensus_peers.cc:597] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:58.043502 24210 catalog_manager.cc:4755] TS c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet fdc8b7c33c2b4e9da87a15ea80d2f342: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:20:58.064726 24366 consensus_peers.cc:597] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:58.139438 25084 consensus_peers.cc:597] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:58.318918 24440 consensus_peers.cc:597] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:58.326489 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 66727.4us
W20260709 12:20:58.332268 24440 consensus_peers.cc:597] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:58.365425 24366 consensus_peers.cc:597] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:58.419387 24366 consensus_peers.cc:597] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:58.565457 25084 consensus_peers.cc:597] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:58.594179 24440 consensus_peers.cc:597] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:58.749645 24366 consensus_peers.cc:597] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:58.774888 25084 consensus_peers.cc:597] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:20:58.821702 24440 consensus_peers.cc:597] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:58.822566 24366 consensus_peers.cc:597] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:58.872438 25084 consensus_peers.cc:597] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:20:58.881026 24366 consensus_peers.cc:597] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:58.884614 24440 consensus_peers.cc:597] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:58.933547 23151 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 24346)
W20260709 12:20:58.957306 24366 consensus_peers.cc:597] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:59.127358 24366 consensus_peers.cc:597] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:59.128880 24440 consensus_peers.cc:597] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:20:59.153256 24366 consensus_peers.cc:597] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:59.172267 24440 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111) [suppressed 464 similar messages]
W20260709 12:20:59.207909 24366 consensus_peers.cc:597] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:59.273129 25084 consensus_peers.cc:597] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:59.277297 25084 consensus_peers.cc:597] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:59.413919 24440 consensus_peers.cc:597] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:59.418572 25084 consensus_peers.cc:597] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:20:59.495463 25084 consensus_peers.cc:597] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:20:59.560145 25084 consensus_peers.cc:597] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:20:59.572435 24440 consensus_peers.cc:597] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:59.588161 25084 consensus_peers.cc:597] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:20:59.596863 24366 consensus_peers.cc:597] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:59.702077 25084 consensus_peers.cc:597] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:20:59.765049 24366 consensus_peers.cc:597] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:59.785195 24440 consensus_peers.cc:597] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:20:59.808457 25084 consensus_peers.cc:597] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:20:59.863152 24440 consensus_peers.cc:597] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:59.876955 24366 consensus_peers.cc:597] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:59.998914 23151 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 24346)
W20260709 12:21:00.133263 24440 consensus_peers.cc:597] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:00.156589 24366 consensus_peers.cc:597] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:00.160492 24366 consensus_peers.cc:597] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:00.249199 24440 consensus_peers.cc:597] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:00.274178 25084 consensus_peers.cc:597] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:00.382151 24366 consensus_peers.cc:597] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:00.424386 24366 consensus_peers.cc:597] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:00.431476 24366 consensus_peers.cc:597] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:00.435554 24366 consensus_peers.cc:597] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:00.518374 24366 consensus_peers.cc:597] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:00.528898 24366 consensus_peers.cc:597] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:00.678543 25084 consensus_peers.cc:597] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:00.742820 24440 consensus_peers.cc:597] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:00.755457 24440 consensus_peers.cc:597] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:00.755591 24366 consensus_peers.cc:597] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:00.797570 24366 consensus_peers.cc:597] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:00.871565 24366 consensus_peers.cc:597] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:00.893796 24440 consensus_peers.cc:597] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:00.952696 24366 consensus_peers.cc:597] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:01.000288 23151 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 24346)
W20260709 12:21:01.070305 25084 consensus_peers.cc:597] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:01.133515 25084 consensus_peers.cc:597] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:01.190945 25084 consensus_peers.cc:597] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:01.350298 24440 consensus_peers.cc:597] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:01.368505 24366 consensus_peers.cc:597] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:01.421175 24440 consensus_peers.cc:597] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:01.439738 24440 consensus_peers.cc:597] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:01.595482 24366 consensus_peers.cc:597] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:01.608892 25084 consensus_peers.cc:597] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:01.726783 25084 consensus_peers.cc:597] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:01.796271 24366 consensus_peers.cc:597] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:01.808889 24366 consensus_peers.cc:597] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:01.811797 24366 consensus_peers.cc:597] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:01.865507 25084 consensus_peers.cc:597] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:01.941783 25084 consensus_peers.cc:597] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:02.022117 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 66802.9us
W20260709 12:21:02.046065 25084 consensus_peers.cc:597] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:02.049968 24366 consensus_peers.cc:597] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:02.059255 25084 consensus_peers.cc:597] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:02.060308 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 78267.3us
W20260709 12:21:02.091081 24440 consensus_peers.cc:597] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:02.114403 24440 consensus_peers.cc:597] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:02.141448 24366 consensus_peers.cc:597] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:02.152156 25084 consensus_peers.cc:597] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:02.279906 24210 catalog_manager.cc:4755] TS c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet f3d18ca89df84c1ba95edb6284f7a8fb: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:02.297245 24440 consensus_peers.cc:597] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:02.318383 25084 consensus_peers.cc:597] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:02.417644 24440 consensus_peers.cc:597] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:02.434841 24366 consensus_peers.cc:597] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:02.436758 24440 consensus_peers.cc:597] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:02.563100 24366 consensus_peers.cc:597] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:02.596254 24366 consensus_peers.cc:597] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:02.660341 24366 consensus_peers.cc:597] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:02.776069 24366 consensus_peers.cc:597] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:02.811551 24440 consensus_peers.cc:597] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:02.824668 25084 consensus_peers.cc:597] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:02.953886 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 43771.4us
W20260709 12:21:03.057027 24366 consensus_peers.cc:597] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:03.063105 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 56904.8us
W20260709 12:21:03.134208 24366 consensus_peers.cc:597] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:03.144949 24440 consensus_peers.cc:597] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:03.142427 25084 consensus_peers.cc:597] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:03.147207 24366 consensus_peers.cc:597] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:03.183790 24366 consensus_peers.cc:597] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:03.278510 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 65883.6us
I20260709 12:21:03.316218 23151 tablet_server.cc:196] TabletServer@127.22.155.193:0 shutdown complete.
W20260709 12:21:03.334112 25084 consensus_peers.cc:597] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:03.372669 24440 consensus_peers.cc:597] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:21:03.382546 24392 consensus_queue.cc:237] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:21:03.396607 25084 consensus_peers.cc:597] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:03.509766 24440 consensus_peers.cc:597] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:03.531710 25084 consensus_peers.cc:597] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:21:03.537940 25112 raft_consensus.cc:1275] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Refusing update from remote peer c855242ec9d34a5397741ef20db9de8a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:21:03.574314 24366 consensus_peers.cc:597] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:03.577085 24366 consensus_peers.cc:597] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:21:03.602870 30452 consensus_queue.cc:1048] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:21:03.604158 24366 consensus_peers.cc:597] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:03.614050 24366 consensus_peers.cc:597] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:03.666901 24366 consensus_peers.cc:597] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:21:03.679927 30452 raft_consensus.cc:2955] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 7 to 11, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:21:03.683411 25112 raft_consensus.cc:2955] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 7 to 11, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } } }
I20260709 12:21:03.692976 24208 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 97dd30b21cc14958a91b2da522e4bbe9 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
I20260709 12:21:03.734619 24222 catalog_manager.cc:5697] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a reported cstate change: config changed from index 7 to 11, VOTER 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195) evicted. New cstate: current_term: 14 leader_uuid: "c855242ec9d34a5397741ef20db9de8a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:21:03.746484 24440 consensus_peers.cc:597] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:03.855880 24440 consensus_peers.cc:597] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:03.882668 24366 consensus_peers.cc:597] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:21:03.932430 24461 tablet_service.cc:1558] Processing DeleteTablet for tablet 97dd30b21cc14958a91b2da522e4bbe9 with delete_type TABLET_DATA_TOMBSTONED (TS 99b8650fa8324ac2ac5f75eee9b1a1e3 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:40588
I20260709 12:21:03.970793 30462 tablet_replica.cc:333] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:03.978768 30462 raft_consensus.cc:2243] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:03.980413 30462 raft_consensus.cc:2272] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:03.985450 30462 ts_tablet_manager.cc:1916] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:21:03.997592 24440 consensus_peers.cc:597] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:04.014843 24366 consensus_peers.cc:597] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:21:04.043709 30462 ts_tablet_manager.cc:1929] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.10
I20260709 12:21:04.044456 30462 log.cc:1199] T 97dd30b21cc14958a91b2da522e4bbe9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: Deleting WAL directory at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0/minicluster-data/ts-2-root/wals/97dd30b21cc14958a91b2da522e4bbe9
I20260709 12:21:04.055579 24209 catalog_manager.cc:5028] TS 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): tablet 97dd30b21cc14958a91b2da522e4bbe9 (table test-workload [id=fe4f37adb33246d5aa3de73aa6df3667]) successfully deleted
W20260709 12:21:04.086279 25084 consensus_peers.cc:597] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:04.519079 24440 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111) [suppressed 456 similar messages]
W20260709 12:21:04.526120 24440 consensus_peers.cc:597] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:04.535622 24366 consensus_peers.cc:597] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:21:04.621078 23151 tablet_server.cc:179] TabletServer@127.22.155.194:0 shutting down...
W20260709 12:21:04.766791 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 63600.2us
W20260709 12:21:04.823901 25084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 86092.7us
W20260709 12:21:04.891041 24366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 162403us
W20260709 12:21:04.885897 25084 consensus_peers.cc:597] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:04.893472 25084 consensus_peers.cc:597] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:04.901598 25084 consensus_peers.cc:597] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:04.902341 25084 consensus_peers.cc:597] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:04.908317 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 134553us
W20260709 12:21:04.924539 25084 consensus_peers.cc:597] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:04.927989 24438 consensus_peers.cc:597] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:04.937691 24438 consensus_peers.cc:597] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:04.940752 24438 consensus_peers.cc:597] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:04.946079 24438 consensus_peers.cc:597] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:04.949731 24438 consensus_peers.cc:597] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:04.950222 24438 consensus_peers.cc:597] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:04.954608 24438 consensus_peers.cc:597] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:04.955994 24438 consensus_peers.cc:597] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:04.956954 24366 consensus_peers.cc:597] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:04.954510 24440 consensus_peers.cc:597] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:04.960873 24438 consensus_peers.cc:597] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:04.961596 24438 consensus_peers.cc:597] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:04.965404 24438 consensus_peers.cc:597] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:04.967061 24440 consensus_peers.cc:597] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:04.966046 24438 consensus_peers.cc:597] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:04.970425 25082 consensus_peers.cc:597] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:04.979521 25082 consensus_peers.cc:597] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:04.969473 24438 consensus_peers.cc:597] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:04.985224 25082 consensus_peers.cc:597] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:04.984750 24438 consensus_peers.cc:597] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:04.993244 24366 consensus_peers.cc:597] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:04.994449 24366 consensus_peers.cc:597] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:04.994874 24366 consensus_peers.cc:597] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:04.991961 25082 consensus_peers.cc:597] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:05.000967 25082 consensus_peers.cc:597] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:05.004298 25082 consensus_peers.cc:597] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:05.014109 25082 consensus_peers.cc:597] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:05.014781 25082 consensus_peers.cc:597] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:05.022993 24366 consensus_peers.cc:597] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:05.042429 24440 consensus_peers.cc:597] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:05.212703 30481 raft_consensus.cc:493] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:21:05.213465 30481 raft_consensus.cc:515] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:05.215703 30481 leader_election.cc:290] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:21:05.232420 25084 consensus_peers.cc:597] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:21:05.286648 30441 raft_consensus.cc:493] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:21:05.287544 30441 raft_consensus.cc:515] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:05.296279 30481 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:21:05.297099 30481 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:05.299842 30441 leader_election.cc:290] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:21:05.311503 30481 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:21:05.328486 30442 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:21:05.329308 30442 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:21:05.332489 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 66696.5us
I20260709 12:21:05.336066 30442 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:21:05.338861 30441 raft_consensus.cc:493] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:21:05.341918 30441 raft_consensus.cc:515] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:05.344117 30441 leader_election.cc:290] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:21:05.346634 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0187acc6343ef874010bc79580048" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:21:05.358825 30442 raft_consensus.cc:493] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:21:05.359457 30442 raft_consensus.cc:515] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:05.362195 30442 leader_election.cc:290] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:21:05.402006 25084 consensus_peers.cc:597] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:05.608747 25140 debug-util.cc:398] Leaking SignalData structure 0x7b0800317400 after lost signal to thread 23154
W20260709 12:21:05.610605 25140 debug-util.cc:398] Leaking SignalData structure 0x7b0800270ca0 after lost signal to thread 24257
W20260709 12:21:05.612502 25140 debug-util.cc:398] Leaking SignalData structure 0x7b080021ef80 after lost signal to thread 24424
W20260709 12:21:05.614172 25140 debug-util.cc:398] Leaking SignalData structure 0x7b0800271220 after lost signal to thread 24498
W20260709 12:21:05.615875 25140 debug-util.cc:398] Leaking SignalData structure 0x7b080025b220 after lost signal to thread 25143
W20260709 12:21:05.944608 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 589033us
I20260709 12:21:05.952513 30469 raft_consensus.cc:493] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:21:05.953308 30469 raft_consensus.cc:515] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:05.955518 30469 leader_election.cc:290] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:21:05.956110 30469 raft_consensus.cc:493] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:21:05.956650 30469 raft_consensus.cc:515] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:05.958743 30469 leader_election.cc:290] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:21:05.965750 30469 raft_consensus.cc:493] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:21:05.966408 30469 raft_consensus.cc:515] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:05.969875 30469 leader_election.cc:290] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:21:05.970767 30469 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:21:05.971455 30469 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:05.978175 30469 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:21:05.984817 30442 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:21:05.985347 30442 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:05.987248 30442 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:21:06.005924 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:21:06.008134 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae398278b05401c9dbc83b30a800655" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:21:06.009908 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:21:06.016263 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:21:06.019896 24366 leader_election.cc:336] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:06.023636 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:21:06.025581 25119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:21:06.026352 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:21:06.036031 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51965da6bcc444d5b20f7348cba2c649" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:21:06.043260 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:21:06.061961 24366 leader_election.cc:336] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:06.062855 24366 leader_election.cc:336] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:06.063647 24366 consensus_peers.cc:597] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:06.064265 24366 consensus_peers.cc:597] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:21:06.080899 30441 raft_consensus.cc:493] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:21:06.081637 30441 raft_consensus.cc:515] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:06.091421 30477 raft_consensus.cc:493] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:21:06.093487 30477 raft_consensus.cc:515] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:06.103729 30441 leader_election.cc:290] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:21:06.110991 30469 raft_consensus.cc:493] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:21:06.111819 30469 raft_consensus.cc:515] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:06.113133 30442 raft_consensus.cc:493] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
W20260709 12:21:06.122460 24366 leader_election.cc:336] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:06.124171 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ccde13a66c45c8bd6d8780ee632ea8" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:21:06.132863 30475 raft_consensus.cc:493] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:21:06.133774 30475 raft_consensus.cc:515] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:06.138165 30442 raft_consensus.cc:515] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:06.140573 30442 leader_election.cc:290] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:21:06.144796 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:21:06.153781 30477 leader_election.cc:290] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:21:06.162220 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:06.163597 23151 tablet_replica.cc:333] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.164805 23151 raft_consensus.cc:2243] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.165795 23151 raft_consensus.cc:2272] T 34412a32b83e40b7918bf8492b7af28f P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.169647 23151 tablet_replica.cc:333] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.169836 30496 raft_consensus.cc:493] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:21:06.172366 24365 leader_election.cc:304] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:21:06.172261 30496 raft_consensus.cc:515] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:06.173864 24365 leader_election.cc:304] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:21:06.171298 30442 raft_consensus.cc:493] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:21:06.176748 30441 raft_consensus.cc:493] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:21:06.176795 30442 raft_consensus.cc:515] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:06.177723 30441 raft_consensus.cc:515] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:06.179104 30442 leader_election.cc:290] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:21:06.179646 30442 raft_consensus.cc:2749] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:06.172693 23151 raft_consensus.cc:2243] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.181314 30442 raft_consensus.cc:2749] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:06.182196 23151 raft_consensus.cc:2272] T 66cf199780b748b28ae5a775abb95cbe P c855242ec9d34a5397741ef20db9de8a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.183676 24365 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:21:06.185833 23151 tablet_replica.cc:333] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.186872 23151 raft_consensus.cc:2243] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.187626 23151 raft_consensus.cc:2272] T 9ae0187acc6343ef874010bc79580048 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.189608 30441 leader_election.cc:290] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:21:06.190152 30441 raft_consensus.cc:2749] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:06.155623 30475 leader_election.cc:290] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:21:06.203421 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101287bb58d2418bad8554ed0a096407" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:21:06.204245 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541b2ab674f43ca8c6b46df9171c32d" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:21:06.206189 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7855d741eff4cb394101baa2af0f082" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:21:06.210250 30491 raft_consensus.cc:493] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:21:06.210875 30491 raft_consensus.cc:515] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:06.213125 30491 leader_election.cc:290] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:21:06.216853 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd3bd910f7f47f9acdd1792db910842" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:21:06.218075 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc8b7c33c2b4e9da87a15ea80d2f342" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:21:06.219355 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18eaf20aac4141229219a10fc4ed0a23" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:21:06.222216 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83efb40b1c6f4c9385b9e7c153e902bc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:21:06.224200 30469 leader_election.cc:290] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:21:06.225427 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a08303c706b4fcda5778a1f60dc1915" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:21:06.215037 30496 leader_election.cc:290] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:21:06.218180 23151 tablet_replica.cc:333] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.232957 23151 raft_consensus.cc:2243] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.233457 30492 raft_consensus.cc:493] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:21:06.233808 23151 raft_consensus.cc:2272] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.234105 30492 raft_consensus.cc:515] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:06.237398 30479 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:06.238018 30479 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:06.239483 23151 tablet_replica.cc:333] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.240598 23151 raft_consensus.cc:2243] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.241374 23151 raft_consensus.cc:2272] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.244496 23151 tablet_replica.cc:333] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.245960 23151 raft_consensus.cc:2243] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.246910 23151 raft_consensus.cc:2272] T 7910ea4d480e41fda4aa4fd10f0fef8f P c855242ec9d34a5397741ef20db9de8a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.254814 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9034e708c454259aebd10b80eeab667" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:21:06.256292 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f31ae8f765347f0b4ac12809516729c" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:21:06.236469 30492 leader_election.cc:290] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:21:06.240486 30479 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:21:06.258898 25084 consensus_peers.cc:597] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:06.259804 25084 consensus_peers.cc:597] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:21:06.264492 24366 leader_election.cc:304] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:21:06.265645 24365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:44453, user_credentials={real_user=slave}} blocked reactor thread for 67372.4us
W20260709 12:21:06.280830 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 49800.2us
I20260709 12:21:06.267653 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:21:06.268388 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:21:06.269521 30480 raft_consensus.cc:493] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:21:06.286303 30480 raft_consensus.cc:515] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:06.288744 30480 leader_election.cc:290] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:21:06.272981 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419283bfbe814a8dbebaa6962ce15ee0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:21:06.289776 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111838cb1ad347d59c8b479393f9d486" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:21:06.276096 23151 tablet_replica.cc:333] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.295128 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:21:06.296510 30480 raft_consensus.cc:2749] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:06.295385 23151 raft_consensus.cc:2243] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.297574 23151 raft_consensus.cc:2272] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.297417 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac37baecf20841f7b0a74e07f89c2a09" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:21:06.298317 24438 leader_election.cc:336] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:21:06.306027 23151 tablet_replica.cc:333] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.306973 23151 raft_consensus.cc:2243] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.307695 23151 raft_consensus.cc:2272] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:06.309557 24440 consensus_peers.cc:597] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:06.333498 25084 consensus_peers.cc:597] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:21:06.314564 24469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeed7cb347a434082488f5c5807424b" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:21:06.321231 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ca9ec70d4444d88577d9e07b62edc" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:21:06.333962 24440 consensus_peers.cc:597] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:06.323099 30499 raft_consensus.cc:493] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:21:06.323630 24468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:21:06.326603 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8616bc73679e486399b789377c5cd1ba" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:21:06.336128 30499 raft_consensus.cc:515] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:06.321605 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c46f855639421fb6d7eab9b01f55a0" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:21:06.335204 24365 leader_election.cc:304] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:21:06.333297 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0373496af48a585a7d6ceab63908f" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
W20260709 12:21:06.337731 24365 raft_consensus.cc:2686] T c7855d741eff4cb394101baa2af0f082 P c855242ec9d34a5397741ef20db9de8a: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:21:06.339440 24366 leader_election.cc:336] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:06.339980 30499 leader_election.cc:290] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:21:06.340047 24366 leader_election.cc:304] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:21:06.341017 24440 consensus_peers.cc:597] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:06.341431 24366 leader_election.cc:336] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:06.341960 24366 leader_election.cc:336] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:06.310608 23151 tablet_replica.cc:333] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.342180 24440 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c855242ec9d34a5397741ef20db9de8a, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:21:06.343258 30454 raft_consensus.cc:2749] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:06.343716 30499 raft_consensus.cc:2749] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:06.344429 23151 raft_consensus.cc:2243] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.345070 24365 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:21:06.345640 23151 raft_consensus.cc:2272] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.346320 30499 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:06.347563 24365 leader_election.cc:304] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:21:06.349205 23151 tablet_replica.cc:333] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.350235 23151 raft_consensus.cc:2243] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.351008 23151 raft_consensus.cc:2272] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.352730 24366 leader_election.cc:304] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:21:06.353420 24366 raft_consensus.cc:2686] T d9034e708c454259aebd10b80eeab667 P c855242ec9d34a5397741ef20db9de8a: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:21:06.353274 24365 leader_election.cc:304] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:21:06.354200 30480 raft_consensus.cc:2749] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:06.354885 30480 raft_consensus.cc:2749] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:06.355082 23151 tablet_replica.cc:333] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.356230 23151 raft_consensus.cc:2243] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.356197 24365 leader_election.cc:304] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:21:06.357553 24365 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:21:06.357718 23151 raft_consensus.cc:2272] T fdc8b7c33c2b4e9da87a15ea80d2f342 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:06.358174 24365 raft_consensus.cc:2686] T 83efb40b1c6f4c9385b9e7c153e902bc P c855242ec9d34a5397741ef20db9de8a: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:21:06.359133 30480 raft_consensus.cc:2749] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:06.360698 24365 leader_election.cc:304] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:21:06.360973 23151 tablet_replica.cc:333] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.362012 23151 raft_consensus.cc:2243] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 12:21:06.362533 24366 consensus_peers.cc:597] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:06.363075 24366 leader_election.cc:336] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:06.363579 30480 raft_consensus.cc:2749] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:06.364591 23151 raft_consensus.cc:2272] T 9f31ae8f765347f0b4ac12809516729c P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:06.365321 24366 leader_election.cc:336] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:06.365864 24366 consensus_peers.cc:597] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:21:06.363725 24365 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
W20260709 12:21:06.366758 24365 raft_consensus.cc:2686] T 5a08303c706b4fcda5778a1f60dc1915 P c855242ec9d34a5397741ef20db9de8a: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:21:06.366290 24366 leader_election.cc:336] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:06.368171 23151 tablet_replica.cc:333] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.369319 23151 raft_consensus.cc:2243] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.370008 23151 raft_consensus.cc:2272] T 3ae398278b05401c9dbc83b30a800655 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:06.368147 24366 leader_election.cc:336] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:06.372982 25082 consensus_peers.cc:597] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:06.373628 23151 tablet_replica.cc:333] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.374574 23151 raft_consensus.cc:2243] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.375358 23151 raft_consensus.cc:2272] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:06.376808 25082 consensus_peers.cc:597] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:06.387965 23151 tablet_replica.cc:333] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.388985 23151 raft_consensus.cc:2243] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.390239 23151 raft_consensus.cc:2272] T 74a60f1722e64f329fe72226d0dbb7c4 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.393656 23151 tablet_replica.cc:333] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.394502 23151 raft_consensus.cc:2243] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.397188 23151 raft_consensus.cc:2272] T cabffff9a20f4f0091c52fc21d5abcde P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.398850 24365 leader_election.cc:304] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:21:06.402211 25084 consensus_peers.cc:597] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:21:06.403841 30480 raft_consensus.cc:2749] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:06.404887 23151 tablet_replica.cc:333] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.405803 23151 raft_consensus.cc:2243] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.406370 24365 leader_election.cc:304] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:21:06.407639 23151 raft_consensus.cc:2272] T dfa0a0cd756141c094288d3c05139379 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.408113 30480 raft_consensus.cc:2749] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:06.410416 24365 leader_election.cc:304] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:21:06.410750 23151 tablet_replica.cc:333] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.411734 23151 raft_consensus.cc:2243] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.412258 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f669315af0d426da28d57b462979ebd" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:21:06.413759 30480 raft_consensus.cc:2749] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:06.415057 23151 raft_consensus.cc:2272] T 18eaf20aac4141229219a10fc4ed0a23 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.418771 30480 raft_consensus.cc:493] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d99d5d772cfe4a96afcab3d3b009a281)
I20260709 12:21:06.419296 30480 raft_consensus.cc:515] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:06.421330 30480 leader_election.cc:290] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:21:06.422109 23151 tablet_replica.cc:333] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.423596 23151 raft_consensus.cc:2243] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.425405 24365 leader_election.cc:304] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:21:06.426083 24365 raft_consensus.cc:2686] T c06ca9ec70d4444d88577d9e07b62edc P c855242ec9d34a5397741ef20db9de8a: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:21:06.426088 23151 raft_consensus.cc:2272] T 626f1d05390b4454b317c19d513384be P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.427039 24365 leader_election.cc:304] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:21:06.429425 23151 tablet_replica.cc:333] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.430333 23151 raft_consensus.cc:2243] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.432955 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01a911fd14f38a5e1ca5b30c7da18" candidate_uuid: "c855242ec9d34a5397741ef20db9de8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:21:06.434729 30497 raft_consensus.cc:2749] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:06.436127 24365 leader_election.cc:304] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:21:06.437294 24365 leader_election.cc:304] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:21:06.437898 24365 raft_consensus.cc:2686] T 46c46f855639421fb6d7eab9b01f55a0 P c855242ec9d34a5397741ef20db9de8a: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:21:06.438632 30497 raft_consensus.cc:2749] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:21:06.439635 24366 leader_election.cc:336] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:06.439713 23151 raft_consensus.cc:2272] T 5de6cc497bc845dda523b96c519faf83 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.440111 24366 leader_election.cc:304] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:21:06.440850 30480 raft_consensus.cc:2749] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:06.438657 24365 leader_election.cc:304] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:21:06.444765 23151 tablet_replica.cc:333] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
W20260709 12:21:06.445199 24365 raft_consensus.cc:2686] T daeed7cb347a434082488f5c5807424b P c855242ec9d34a5397741ef20db9de8a: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:21:06.445806 23151 raft_consensus.cc:2243] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.448200 23151 raft_consensus.cc:2272] T f8dc8357b0c947d9a0f16daa0f4210aa P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:06.448908 24366 leader_election.cc:336] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:06.449496 24366 leader_election.cc:304] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c855242ec9d34a5397741ef20db9de8a; no voters: c711faa13ead43ebbea0192cb74a4756, d99d5d772cfe4a96afcab3d3b009a281
I20260709 12:21:06.450199 30480 raft_consensus.cc:2749] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:06.451351 23151 tablet_replica.cc:333] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.452332 23151 raft_consensus.cc:2243] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.453651 23151 raft_consensus.cc:2272] T 22a61f2b7e79419c82712f4b54b899ed P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.457273 23151 tablet_replica.cc:333] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.458209 23151 raft_consensus.cc:2243] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.458940 23151 raft_consensus.cc:2272] T 101287bb58d2418bad8554ed0a096407 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.461735 23151 tablet_replica.cc:333] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.462565 23151 raft_consensus.cc:2243] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.465664 23151 raft_consensus.cc:2272] T 36cbfd088b3e4737a74b878b802210f1 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.470008 23151 tablet_replica.cc:333] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.471035 23151 raft_consensus.cc:2243] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.471925 23151 raft_consensus.cc:2272] T 111838cb1ad347d59c8b479393f9d486 P c855242ec9d34a5397741ef20db9de8a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.480533 23151 tablet_replica.cc:333] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.481498 23151 raft_consensus.cc:2243] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.482352 23151 raft_consensus.cc:2272] T 51965da6bcc444d5b20f7348cba2c649 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:06.491044 24366 consensus_peers.cc:597] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:21:06.500957 23151 tablet_replica.cc:333] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.502046 23151 raft_consensus.cc:2243] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.509284 23151 raft_consensus.cc:2272] T 419283bfbe814a8dbebaa6962ce15ee0 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.512564 23151 tablet_replica.cc:333] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.513629 23151 raft_consensus.cc:2243] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.516903 23151 raft_consensus.cc:2272] T 67fce41b64ab4350b88ec02abbcd9c82 P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.527763 23151 tablet_replica.cc:333] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.549432 23151 raft_consensus.cc:2243] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.550762 23151 raft_consensus.cc:2272] T 48340fd716644ed18711f9addc546f4b P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.568660 23151 tablet_replica.cc:333] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.571643 23151 raft_consensus.cc:2243] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.575023 23151 raft_consensus.cc:2272] T 03c8932a13b744d7a945b0a7655f5a47 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.579282 23151 tablet_replica.cc:333] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
W20260709 12:21:06.584010 24366 consensus_peers.cc:597] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:21:06.600458 23151 raft_consensus.cc:2243] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.602458 23151 raft_consensus.cc:2272] T 97dd30b21cc14958a91b2da522e4bbe9 P c855242ec9d34a5397741ef20db9de8a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.609314 23151 tablet_replica.cc:333] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.612574 23151 raft_consensus.cc:2243] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.613219 23151 raft_consensus.cc:2272] T 8616bc73679e486399b789377c5cd1ba P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.615985 23151 tablet_replica.cc:333] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.616736 23151 raft_consensus.cc:2243] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 18 LEADER]: Raft consensus shutting down.
W20260709 12:21:06.624655 25084 consensus_peers.cc:597] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:21:06.631801 23151 raft_consensus.cc:2272] T 48b5441f03704ebb94ffdbb55b9f33c6 P c855242ec9d34a5397741ef20db9de8a [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:06.642094 24440 consensus_peers.cc:597] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:06.646853 23151 tablet_replica.cc:333] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
W20260709 12:21:06.647665 24440 consensus_peers.cc:597] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:21:06.647785 23151 raft_consensus.cc:2243] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.657979 23151 raft_consensus.cc:2272] T 8fcc66a9731446a989f79106ac6fa5ea P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.661518 23151 tablet_replica.cc:333] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.662422 23151 raft_consensus.cc:2243] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.663864 23151 raft_consensus.cc:2272] T 9edb2262948747f3b2674ddb57a2da5c P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.689472 23151 tablet_replica.cc:333] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.690433 23151 raft_consensus.cc:2243] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.691195 23151 raft_consensus.cc:2272] T ac37baecf20841f7b0a74e07f89c2a09 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.694597 23151 tablet_replica.cc:333] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.695485 23151 raft_consensus.cc:2243] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.696220 23151 raft_consensus.cc:2272] T 3f669315af0d426da28d57b462979ebd P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.699869 23151 tablet_replica.cc:333] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.710431 23151 raft_consensus.cc:2243] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.711381 23151 raft_consensus.cc:2272] T 7cd3bd910f7f47f9acdd1792db910842 P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.719574 23151 tablet_replica.cc:333] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.720389 23151 raft_consensus.cc:2243] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.726362 23151 raft_consensus.cc:2272] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P c855242ec9d34a5397741ef20db9de8a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.730198 23151 tablet_replica.cc:333] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.731151 23151 raft_consensus.cc:2243] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.741950 23151 raft_consensus.cc:2272] T 9e8cc498654c4fde9917eeb605fdc906 P c855242ec9d34a5397741ef20db9de8a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.745034 23151 tablet_replica.cc:333] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.745995 23151 raft_consensus.cc:2243] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.747386 23151 raft_consensus.cc:2272] T 1ba811822a8a4266a950b36a73a9fce7 P c855242ec9d34a5397741ef20db9de8a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.750257 23151 tablet_replica.cc:333] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.751011 23151 raft_consensus.cc:2243] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.751722 23151 raft_consensus.cc:2272] T 40ccde13a66c45c8bd6d8780ee632ea8 P c855242ec9d34a5397741ef20db9de8a [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.754617 23151 tablet_replica.cc:333] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.755338 23151 raft_consensus.cc:2243] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.755927 23151 raft_consensus.cc:2272] T 7fd01a911fd14f38a5e1ca5b30c7da18 P c855242ec9d34a5397741ef20db9de8a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.758929 23151 tablet_replica.cc:333] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.759676 23151 raft_consensus.cc:2243] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.760511 23151 raft_consensus.cc:2272] T 0ff0373496af48a585a7d6ceab63908f P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.763418 23151 tablet_replica.cc:333] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.764052 23151 raft_consensus.cc:2243] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.765133 23151 raft_consensus.cc:2272] T f3d18ca89df84c1ba95edb6284f7a8fb P c855242ec9d34a5397741ef20db9de8a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.767828 23151 tablet_replica.cc:333] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.768482 23151 raft_consensus.cc:2243] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.770219 23151 raft_consensus.cc:2272] T 9950f2ff950845e1837dbf993fb23cb0 P c855242ec9d34a5397741ef20db9de8a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.774322 23151 tablet_replica.cc:333] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a: stopping tablet replica
I20260709 12:21:06.775055 23151 raft_consensus.cc:2243] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.776262 23151 raft_consensus.cc:2272] T 1541b2ab674f43ca8c6b46df9171c32d P c855242ec9d34a5397741ef20db9de8a [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:06.785104 24254 debug-util.cc:398] Leaking SignalData structure 0x7b08003845a0 after lost signal to thread 23154
W20260709 12:21:06.786574 24254 debug-util.cc:398] Leaking SignalData structure 0x7b0800338fa0 after lost signal to thread 24257
W20260709 12:21:06.787352 24254 debug-util.cc:398] Leaking SignalData structure 0x7b0800354620 after lost signal to thread 24424
W20260709 12:21:06.788808 24254 debug-util.cc:398] Leaking SignalData structure 0x7b080031aba0 after lost signal to thread 24498
W20260709 12:21:06.790308 24254 debug-util.cc:398] Leaking SignalData structure 0x7b0800381940 after lost signal to thread 25143
W20260709 12:21:06.874918 25084 consensus_peers.cc:597] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:07.075287 24440 consensus_peers.cc:597] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:07.102427 24440 consensus_peers.cc:597] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:07.167441 24440 consensus_peers.cc:597] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:07.491125 24438 consensus_peers.cc:597] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:07.502393 25084 consensus_peers.cc:597] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:07.521400 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 46318.3us
W20260709 12:21:07.530171 24438 consensus_peers.cc:597] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:07.537289 25084 consensus_peers.cc:597] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:21:07.539237 30479 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:07.539966 30479 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:07.543286 30479 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:07.551203 24438 leader_election.cc:336] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:07.552033 24440 leader_election.cc:336] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:07.552505 24440 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:07.553529 30479 raft_consensus.cc:2749] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:07.592602 30471 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:07.593312 30471 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:07.595817 30471 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:21:07.597563 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:21:07.599503 24438 consensus_peers.cc:597] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:07.604238 24438 consensus_peers.cc:597] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:07.610509 25082 leader_election.cc:336] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:07.612128 25082 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:07.614754 30471 raft_consensus.cc:2749] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:07.617283 30471 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:07.620110 30471 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:21:07.635098 25084 leader_election.cc:336] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:07.635877 25084 consensus_peers.cc:597] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:21:07.638649 30471 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:21:07.639132 30504 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:07.646871 30504 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:07.649746 30504 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:07.664726 25084 leader_election.cc:336] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:07.679555 25084 consensus_peers.cc:597] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:21:07.726195 30479 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:07.726902 30479 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:21:07.730008 25082 leader_election.cc:336] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:07.730602 25082 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:07.731417 30503 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:07.732586 24438 consensus_peers.cc:597] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:07.732605 25082 leader_election.cc:336] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:07.733495 25082 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:21:07.738349 24440 leader_election.cc:336] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:07.738977 30503 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:07.740422 30454 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:07.741110 30479 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:21:07.741070 30454 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:07.743531 30454 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:21:07.740453 30502 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:07.744794 30502 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:07.747411 30502 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:21:07.748209 30503 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:07.748802 30503 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:07.755335 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:21:07.756959 30503 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:21:07.759538 24440 leader_election.cc:336] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:07.762239 25084 leader_election.cc:336] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:07.762804 25084 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:21:07.764010 24438 leader_election.cc:336] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:07.764554 30465 raft_consensus.cc:2749] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:07.765144 24440 leader_election.cc:336] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:07.764519 24438 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:07.766661 30479 raft_consensus.cc:2749] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:07.767570 25084 consensus_peers.cc:597] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:21:07.771114 30502 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:07.771827 30502 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:07.774537 30502 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:21:07.783288 30454 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:07.783880 30454 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:07.786129 30454 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:07.793766 24438 leader_election.cc:336] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:07.794269 24438 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:21:07.795255 24438 leader_election.cc:336] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:07.795694 24438 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:21:07.796895 24440 leader_election.cc:336] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:07.796932 30454 raft_consensus.cc:2749] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:07.797078 30502 raft_consensus.cc:2749] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:07.800164 30465 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:07.800874 30465 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:07.803191 30465 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:07.804029 24440 leader_election.cc:336] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:07.806736 30454 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:07.807426 30454 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:07.808271 30479 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:07.810415 30479 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:21:07.811264 25084 leader_election.cc:336] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:07.812587 30479 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:21:07.813513 30479 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:07.813998 30479 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:07.805372 30502 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:07.816804 30479 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:21:07.812685 30454 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:21:07.824129 30479 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:07.829093 30479 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:07.831631 30479 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:21:07.832449 30465 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:07.833118 30465 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:07.835340 30465 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:21:07.835757 30454 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:07.836344 30454 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:07.838891 30454 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:07.841598 25084 leader_election.cc:336] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:07.816612 30502 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:21:07.848606 24438 consensus_peers.cc:597] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:07.852771 24438 leader_election.cc:336] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:07.853263 24438 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:07.854615 30479 raft_consensus.cc:2749] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:07.859396 30502 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:07.854084 25082 leader_election.cc:336] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:07.872023 24438 leader_election.cc:336] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:07.872573 24438 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:21:07.877130 24440 consensus_peers.cc:597] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:07.877717 24440 leader_election.cc:336] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:07.878295 24440 leader_election.cc:336] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:07.878810 24440 leader_election.cc:336] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:07.879283 24440 leader_election.cc:336] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:07.882285 30479 raft_consensus.cc:2749] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:21:07.884316 24438 leader_election.cc:336] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:07.884817 24438 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:07.885737 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:21:07.886497 25117 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14.
W20260709 12:21:07.887872 24440 leader_election.cc:336] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:07.888446 24440 leader_election.cc:336] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:07.887925 30505 raft_consensus.cc:2749] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:07.885753 24438 leader_election.cc:336] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:07.897769 24438 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:21:07.898887 24438 leader_election.cc:336] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:07.899360 24438 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:07.900928 30479 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:07.901679 30505 raft_consensus.cc:2749] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:07.907124 24438 leader_election.cc:336] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:07.907748 24438 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:21:07.908571 25084 consensus_peers.cc:597] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:07.908977 24438 leader_election.cc:336] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:07.909204 30505 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:21:07.909008 25082 leader_election.cc:336] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:07.914640 24438 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:07.915391 25082 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:21:07.916965 24438 leader_election.cc:336] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:07.917097 30465 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:07.917629 24438 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:07.918340 30505 raft_consensus.cc:2749] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:07.918438 30502 raft_consensus.cc:2749] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:07.932685 30465 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:07.933640 30465 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:07.936792 30465 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:07.944396 25084 leader_election.cc:336] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:07.961539 25082 leader_election.cc:336] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:07.977417 24440 consensus_peers.cc:597] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:21:07.998540 25082 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:21:08.018663 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 57158.2us
W20260709 12:21:08.001123 24440 consensus_peers.cc:597] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:08.019331 30465 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:21:08.031345 24440 consensus_peers.cc:597] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:08.047683 24438 consensus_peers.cc:597] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:08.062269 24438 consensus_peers.cc:597] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:08.069487 25082 consensus_peers.cc:597] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:08.077665 25082 leader_election.cc:336] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:08.086766 30479 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:08.088915 25082 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:08.089202 30479 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:08.091554 30479 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:21:08.092197 30503 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:08.102577 30503 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:08.103194 30503 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:08.105460 30503 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:08.110661 25082 consensus_peers.cc:597] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:08.114624 25084 consensus_peers.cc:597] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:08.120885 24438 leader_election.cc:336] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:08.128407 25084 leader_election.cc:336] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:08.132205 24438 consensus_peers.cc:597] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:08.132315 24440 leader_election.cc:336] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:08.132899 24440 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:08.134038 30479 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:21:08.134740 25082 consensus_peers.cc:597] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:08.140261 24438 consensus_peers.cc:597] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:08.145227 23151 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 24421)
W20260709 12:21:08.160341 25082 leader_election.cc:336] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:08.160925 25082 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:08.161788 30504 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:21:08.165268 24438 consensus_peers.cc:597] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:08.175684 24438 consensus_peers.cc:597] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:08.184705 30504 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:08.185374 30504 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:21:08.187295 25082 consensus_peers.cc:597] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:08.187585 30504 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:21:08.189395 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
W20260709 12:21:08.198534 25082 consensus_peers.cc:597] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:08.198460 30505 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:08.199236 30505 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:21:08.199630 30479 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:08.200322 30479 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:08.201581 30505 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
I20260709 12:21:08.203431 30505 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:08.204011 30505 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:08.206979 30505 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:21:08.213958 30479 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:21:08.214694 24440 leader_election.cc:336] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:08.223271 24440 leader_election.cc:336] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:08.224920 30505 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:08.225546 30505 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:21:08.228552 24438 leader_election.cc:336] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:08.207300 25082 leader_election.cc:336] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:08.230520 25082 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:08.231367 30504 raft_consensus.cc:2749] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:08.232138 30505 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:21:08.234169 30504 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:08.234825 30504 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:08.241020 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:21:08.241797 25118 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 17.
I20260709 12:21:08.243252 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:21:08.243840 25118 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 12.
I20260709 12:21:08.245174 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:21:08.245810 25118 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14.
W20260709 12:21:08.248131 25084 leader_election.cc:336] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:08.257732 24440 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:21:08.258704 24440 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:21:08.262918 30504 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:21:08.265976 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:21:08.266763 24467 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 17.
I20260709 12:21:08.268342 30502 raft_consensus.cc:2804] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:08.268824 30502 raft_consensus.cc:493] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:08.269246 30502 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:08.271318 30479 raft_consensus.cc:2804] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:08.271968 30479 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:08.272385 30479 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:08.233610 24438 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:08.275645 30454 raft_consensus.cc:2749] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:21:08.276458 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 53940.8us
I20260709 12:21:08.286281 30502 raft_consensus.cc:515] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:21:08.293257 25082 consensus_peers.cc:597] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:08.298905 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d18ca89df84c1ba95edb6284f7a8fb" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:21:08.299578 25118 raft_consensus.cc:3060] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:08.300385 24438 leader_election.cc:336] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:08.300911 24438 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:08.301779 30454 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:08.311067 30479 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:08.315608 25118 raft_consensus.cc:2468] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 13.
W20260709 12:21:08.319591 24438 leader_election.cc:336] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:08.329377 24438 leader_election.cc:336] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:08.333891 24438 leader_election.cc:336] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:08.325057 30479 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:21:08.326480 30502 leader_election.cc:290] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Requested vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:21:08.327394 25082 leader_election.cc:336] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:08.339871 25082 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:08.341450 30504 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:08.344189 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8dc8357b0c947d9a0f16daa0f4210aa" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281"
I20260709 12:21:08.344833 25117 raft_consensus.cc:3060] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:08.346947 24440 leader_election.cc:304] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c855242ec9d34a5397741ef20db9de8a
W20260709 12:21:08.350502 25082 consensus_peers.cc:597] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:08.353788 25117 raft_consensus.cc:2468] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 15.
I20260709 12:21:08.356208 24440 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: 
I20260709 12:21:08.357286 30505 raft_consensus.cc:2804] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:08.359957 30502 raft_consensus.cc:2804] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:08.360483 30502 raft_consensus.cc:697] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:21:08.361569 30502 consensus_queue.cc:237] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:08.368968 30505 raft_consensus.cc:697] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Becoming Leader. State: Replica: 99b8650fa8324ac2ac5f75eee9b1a1e3, State: Running, Role: LEADER
I20260709 12:21:08.370244 30505 consensus_queue.cc:237] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:21:08.389887 25082 consensus_peers.cc:597] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:08.334448 24438 consensus_peers.cc:597] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:08.400959 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 66553.2us
W20260709 12:21:08.417980 24438 leader_election.cc:336] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:08.439172 24438 consensus_peers.cc:597] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:08.468843 24440 consensus_peers.cc:597] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:08.468209 24222 catalog_manager.cc:5697] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 12 to 13, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 13 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:08.470422 24222 catalog_manager.cc:5697] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 reported cstate change: term changed from 14 to 15, leader changed from c855242ec9d34a5397741ef20db9de8a (127.22.155.194) to 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195). New cstate: current_term: 15 leader_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:08.482545 25082 consensus_peers.cc:597] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:08.591588 25082 consensus_peers.cc:597] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:08.623111 25084 consensus_peers.cc:597] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:08.650835 24440 consensus_peers.cc:597] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:08.679821 24440 consensus_peers.cc:597] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:21:08.757032 25117 raft_consensus.cc:1275] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:21:08.760576 30479 consensus_queue.cc:1048] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:21:08.795589 25084 consensus_peers.cc:597] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:21:08.788586 25118 raft_consensus.cc:1275] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Refusing update from remote peer 99b8650fa8324ac2ac5f75eee9b1a1e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:21:08.800817 30479 consensus_queue.cc:1048] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:21:08.824970 24438 consensus_peers.cc:597] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:08.875346 24438 consensus_peers.cc:597] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:08.963750 25084 consensus_peers.cc:597] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:09.018188 25084 consensus_peers.cc:597] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:09.145735 23151 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 24421)
W20260709 12:21:09.153050 24440 consensus_peers.cc:597] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:09.153757 25084 consensus_peers.cc:597] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:09.174790 25084 consensus_peers.cc:597] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:09.216244 24440 consensus_peers.cc:597] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:21:09.459951 30508 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:09.460539 30508 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:09.462827 30508 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:09.468954 24438 leader_election.cc:336] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:09.471247 24440 leader_election.cc:336] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:09.471741 24440 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:09.472604 30508 raft_consensus.cc:2749] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:09.510610 30508 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:09.511240 30508 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:21:09.518394 24440 leader_election.cc:336] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:09.520012 30508 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:09.522763 24438 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111) [suppressed 572 similar messages]
W20260709 12:21:09.525738 24438 leader_election.cc:336] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:09.526311 24438 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:09.527186 30508 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:09.566500 30508 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:09.567214 30508 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:09.570408 30508 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:21:09.573138 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:21:09.573966 25117 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14.
W20260709 12:21:09.588573 24438 leader_election.cc:336] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:09.591655 30502 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:09.592281 30502 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:09.594491 30502 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:09.595244 24440 leader_election.cc:336] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:09.601636 24440 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:09.603504 30508 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:09.604609 30508 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:09.607509 30508 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:21:09.608071 30502 raft_consensus.cc:2749] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:09.617450 30520 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:09.618322 30520 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:09.621037 30520 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:09.627027 25082 leader_election.cc:336] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:09.634816 30521 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:09.635509 30521 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:09.637791 30521 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:09.648773 25084 leader_election.cc:336] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:09.656304 25084 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:21:09.646396 24438 leader_election.cc:336] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:09.661675 30504 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:21:09.666869 24438 leader_election.cc:336] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:09.669157 24440 leader_election.cc:336] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:09.674490 24440 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:09.678844 30508 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:09.680203 24440 leader_election.cc:336] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:09.684768 24440 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:09.689674 30508 raft_consensus.cc:2749] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:21:09.684201 24438 leader_election.cc:336] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:09.715857 24440 leader_election.cc:336] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:09.722513 24440 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:09.723610 30508 raft_consensus.cc:2749] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:21:09.725368 24440 consensus_peers.cc:597] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:21:09.740962 30508 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:09.741506 30508 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:09.743646 30508 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:09.748101 24440 consensus_peers.cc:597] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:09.749262 30479 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:09.749440 30508 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:09.749735 30479 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:09.750181 30508 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:09.751878 30479 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:21:09.752485 30508 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:09.754027 24438 leader_election.cc:336] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:09.757838 24438 leader_election.cc:336] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:09.759459 24438 leader_election.cc:336] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:09.761247 24440 leader_election.cc:336] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:09.761795 24440 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:09.762595 30508 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:09.763091 30479 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:09.763770 30479 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:21:09.768831 24440 leader_election.cc:336] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:09.768929 30479 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:21:09.769434 24440 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:21:09.770514 24440 leader_election.cc:336] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:09.770913 24440 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:09.771441 30479 raft_consensus.cc:2749] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:09.771620 30508 raft_consensus.cc:2749] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:09.773643 30521 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:09.775763 30521 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:09.778335 30521 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:09.787914 24440 leader_election.cc:336] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:09.791064 24440 leader_election.cc:336] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:09.802237 25084 consensus_peers.cc:597] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:09.816500 24438 leader_election.cc:336] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:09.821933 24438 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:09.823101 30508 raft_consensus.cc:2749] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:21:09.834595 25084 consensus_peers.cc:597] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:21:09.835806 30508 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:09.836483 30508 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:09.839708 30508 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:21:09.841930 30504 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:09.844877 30504 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:21:09.854355 25082 leader_election.cc:336] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:09.860705 30504 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:09.864948 25084 leader_election.cc:336] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:09.821020 24440 consensus_peers.cc:597] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:09.866222 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 45281.2us
I20260709 12:21:09.865679 25084 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:09.869647 30504 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:21:09.870770 24438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:35893, user_credentials={real_user=slave}} blocked reactor thread for 54307.8us
I20260709 12:21:09.874126 25117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:21:09.876451 25117 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 17.
W20260709 12:21:09.878261 24438 leader_election.cc:336] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:09.881079 24438 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:09.883958 30479 raft_consensus.cc:2749] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:09.891347 30504 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:09.892143 30504 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:21:09.900141 25082 leader_election.cc:336] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:09.920758 30504 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:21:09.937436 30508 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:09.938283 30508 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:09.940665 30508 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:09.948196 24440 leader_election.cc:336] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:09.953739 25084 leader_election.cc:336] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:09.967432 25084 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:09.971508 30504 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:09.981426 24438 leader_election.cc:336] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:09.982391 24438 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:21:09.962965 24440 leader_election.cc:336] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:09.986584 30508 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:09.989610 30504 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:09.990237 30504 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:09.992868 30504 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:10.004177 25082 leader_election.cc:336] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:10.023835 25084 leader_election.cc:336] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:10.035422 25084 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:21:10.048240 25084 consensus_peers.cc:597] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:10.056763 24438 leader_election.cc:336] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:10.061659 24438 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:10.063534 30504 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:10.065073 30520 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:10.075572 30520 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:10.078588 30520 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:21:10.080466 30508 raft_consensus.cc:2749] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:21:10.083643 24438 consensus_peers.cc:597] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:10.085227 30508 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:10.086014 30508 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:10.088467 30508 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:10.108930 25084 leader_election.cc:336] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:10.110615 24440 leader_election.cc:336] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:10.112214 25082 leader_election.cc:336] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:10.115832 25082 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:21:10.113036 24438 consensus_peers.cc:597] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:10.116982 24438 leader_election.cc:336] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:10.117458 24438 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:10.118105 30504 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:10.124464 30479 raft_consensus.cc:2749] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:21:10.130332 25084 consensus_peers.cc:597] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:10.164072 23151 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 24421)
I20260709 12:21:10.176257 30520 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:10.178220 30520 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:21:10.183050 24438 consensus_peers.cc:597] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:10.198127 24438 consensus_peers.cc:597] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:10.236878 30520 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:10.237353 24438 consensus_peers.cc:597] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:10.239881 25084 leader_election.cc:336] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:10.244212 25082 leader_election.cc:336] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:10.244860 25082 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:10.251130 30520 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:21:10.363570 24438 consensus_peers.cc:597] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:10.368664 24440 consensus_peers.cc:597] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:10.383307 24438 consensus_peers.cc:597] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:10.383867 25084 consensus_peers.cc:597] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:10.439898 25084 consensus_peers.cc:597] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:21:10.441206 30521 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:10.443048 30521 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:21:10.447412 30521 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
W20260709 12:21:10.458729 24438 leader_election.cc:336] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:10.463356 25082 consensus_peers.cc:597] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:10.463907 24440 leader_election.cc:336] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:10.465523 24440 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:10.467428 30521 raft_consensus.cc:2749] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:21:10.473245 24440 consensus_peers.cc:597] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:10.473922 24440 consensus_peers.cc:597] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:10.474126 25082 consensus_peers.cc:597] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:10.475168 25084 consensus_peers.cc:597] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:10.536113 24438 consensus_peers.cc:597] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:10.536933 24210 catalog_manager.cc:4755] TS c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet fdc8b7c33c2b4e9da87a15ea80d2f342: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:10.536999 25082 consensus_peers.cc:597] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:10.597841 25082 consensus_peers.cc:597] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:10.623819 25082 consensus_peers.cc:597] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:10.663556 24438 consensus_peers.cc:597] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:10.736704 25082 consensus_peers.cc:597] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:10.745229 24438 consensus_peers.cc:597] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:10.771138 24438 consensus_peers.cc:597] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:10.781047 24438 consensus_peers.cc:597] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:10.827683 24440 consensus_peers.cc:597] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:10.919412 24438 consensus_peers.cc:597] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:10.926853 25082 consensus_peers.cc:597] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:10.940666 25082 consensus_peers.cc:597] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:11.018505 24440 consensus_peers.cc:597] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:11.091339 25082 consensus_peers.cc:597] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:11.125626 24438 consensus_peers.cc:597] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:11.156701 25084 consensus_peers.cc:597] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:11.165335 23151 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 24421)
W20260709 12:21:11.223814 24440 consensus_peers.cc:597] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:11.225697 24440 consensus_peers.cc:597] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:11.226951 25082 consensus_peers.cc:597] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:11.325803 24438 consensus_peers.cc:597] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:11.419314 25084 consensus_peers.cc:597] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:21:11.461944 30527 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:11.462921 30527 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:21:11.480134 24438 leader_election.cc:336] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:11.465626 30527 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:21:11.484483 30521 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:11.487207 30521 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:11.489876 30521 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:11.486178 24440 leader_election.cc:336] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:11.493045 24440 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:11.496212 30521 raft_consensus.cc:2749] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:21:11.500566 24438 leader_election.cc:336] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:11.519071 24440 leader_election.cc:336] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:11.519703 24440 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:11.521541 30521 raft_consensus.cc:2749] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:11.528100 30520 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:11.529011 30520 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:11.543984 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:21:11.545050 24467 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 17.
I20260709 12:21:11.547508 30520 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:21:11.551309 25084 leader_election.cc:336] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:11.554931 25082 leader_election.cc:336] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:11.555552 25082 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:11.557731 30504 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:21:11.573410 24438 consensus_peers.cc:597] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:11.606832 25084 consensus_peers.cc:597] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:11.633175 25084 consensus_peers.cc:597] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:21:11.701206 30523 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:11.702054 30523 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:11.704784 30523 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:11.718566 24440 leader_election.cc:336] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:11.739423 24440 consensus_peers.cc:597] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:11.737527 24438 leader_election.cc:336] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:11.747776 24438 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:11.748931 30521 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:21:11.784531 25084 consensus_peers.cc:597] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:21:11.799949 25084 consensus_peers.cc:597] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:21:11.807191 30521 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:11.808008 30521 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:11.810406 30521 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:11.851984 24438 leader_election.cc:336] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:11.855439 24440 leader_election.cc:336] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:11.857631 24440 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:11.860219 30521 raft_consensus.cc:2749] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:21:11.994884 24440 consensus_peers.cc:597] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:21:12.000993 30521 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:12.001808 30521 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:12.004387 30521 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:12.013132 24440 leader_election.cc:336] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:12.020107 24438 leader_election.cc:336] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:12.020725 24438 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:12.021591 30521 raft_consensus.cc:2749] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:21:12.028209 24440 consensus_peers.cc:597] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:21:12.067152 30504 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:12.068317 30504 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:12.070474 30504 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:12.079159 25084 leader_election.cc:336] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:12.085484 25082 leader_election.cc:336] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:12.086169 25082 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:12.089653 30504 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:12.112001 30523 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:12.113206 30523 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:21:12.125903 24440 leader_election.cc:336] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:12.142033 30523 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:21:12.145740 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:21:12.156140 25118 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14.
W20260709 12:21:12.160125 24440 consensus_peers.cc:597] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:12.165880 23151 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 24421)
W20260709 12:21:12.172113 24438 leader_election.cc:336] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:12.172775 24438 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:12.176107 30523 raft_consensus.cc:2749] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:12.205030 30504 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:12.205929 30504 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:12.208426 30504 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:12.214699 25084 leader_election.cc:336] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:12.215387 25082 leader_election.cc:336] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:12.215855 25082 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:12.216853 30504 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:12.264420 30530 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:12.265235 30530 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:12.267910 30530 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:12.274956 24438 leader_election.cc:336] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:12.277457 24440 leader_election.cc:336] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:12.280938 24440 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:12.293900 30523 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:21:12.316327 25084 consensus_peers.cc:597] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:21:12.319396 24440 consensus_peers.cc:597] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:21:12.338276 30504 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:12.339151 30504 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:21:12.353302 25082 leader_election.cc:336] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:12.354380 30504 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:12.361207 25084 leader_election.cc:336] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:12.361882 25084 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:12.364408 30504 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:12.369655 30530 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:12.370501 30530 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:12.376034 30530 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:12.377539 24440 leader_election.cc:336] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:12.379643 25084 consensus_peers.cc:597] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:12.379997 24438 leader_election.cc:336] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:12.380579 24438 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:12.381932 30530 raft_consensus.cc:2749] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:12.421556 30530 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:12.422379 30530 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:21:12.430625 24440 leader_election.cc:336] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:12.433496 25084 consensus_peers.cc:597] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:21:12.477142 30530 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:12.506027 24438 leader_election.cc:336] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:12.515254 24438 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:12.516381 30530 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:12.578711 24438 consensus_peers.cc:597] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:12.638736 24438 consensus_peers.cc:597] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:12.658821 30520 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:12.659669 30520 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:21:12.676595 25084 leader_election.cc:336] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:12.662159 30520 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:12.683735 24438 consensus_peers.cc:597] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:12.684723 25082 leader_election.cc:336] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:12.689440 25082 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:12.691778 30520 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:12.697511 30530 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:12.698413 30530 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:21:12.700534 24438 consensus_peers.cc:597] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:12.708323 24440 leader_election.cc:336] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:12.710219 30530 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:12.717402 24438 leader_election.cc:336] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:12.719753 24438 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:12.721413 30523 raft_consensus.cc:2749] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:21:12.726464 24438 consensus_peers.cc:597] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:12.800557 25082 consensus_peers.cc:597] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:12.830425 25084 consensus_peers.cc:597] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:21:12.841420 25084 consensus_peers.cc:597] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:21:12.843998 30530 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:12.844657 30530 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:21:12.852212 30530 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
W20260709 12:21:12.857173 24440 leader_election.cc:336] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:12.860374 24440 consensus_peers.cc:597] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:21:12.860810 24438 leader_election.cc:336] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:12.870038 24438 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:12.873243 30530 raft_consensus.cc:2749] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:12.891877 30530 raft_consensus.cc:493] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:12.892738 30530 raft_consensus.cc:515] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:12.895437 30530 leader_election.cc:290] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:12.913949 25082 consensus_peers.cc:597] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:12.939760 24438 leader_election.cc:336] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:12.953495 24440 leader_election.cc:336] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:12.954627 24440 leader_election.cc:304] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:12.958108 30530 raft_consensus.cc:2749] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:12.972349 30530 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:12.973173 30530 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:12.975708 30530 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:12.996268 25084 consensus_peers.cc:597] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:21:12.998169 30531 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:13.001518 30531 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:13.007059 30531 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:21:13.015321 30530 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:13.018518 30520 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:13.016418 30530 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:21:13.035697 24438 consensus_peers.cc:597] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:13.022548 30520 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:13.052731 30520 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:13.053864 25084 leader_election.cc:336] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:13.056150 24438 leader_election.cc:336] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:13.056862 24438 consensus_peers.cc:597] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:13.058575 30530 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:13.059470 25082 leader_election.cc:336] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:13.067131 25082 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:13.070160 30520 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:13.072211 24438 leader_election.cc:336] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:13.073000 25084 leader_election.cc:336] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:13.074657 25082 consensus_peers.cc:597] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:13.075201 25082 consensus_peers.cc:597] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:13.083736 25082 leader_election.cc:336] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:13.086503 25082 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:21:13.086050 25084 consensus_peers.cc:597] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:21:13.091004 30520 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:21:13.093163 24438 consensus_peers.cc:597] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:13.096951 24438 consensus_peers.cc:597] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:13.103447 25082 consensus_peers.cc:597] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:13.106673 24440 leader_election.cc:336] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:13.107844 24440 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:13.108868 30532 raft_consensus.cc:2749] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:21:13.110073 24440 consensus_peers.cc:597] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:13.110548 24440 leader_election.cc:336] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:13.112071 24440 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:13.112861 30532 raft_consensus.cc:2749] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:13.113945 24440 consensus_peers.cc:597] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:13.166455 23151 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 24421)
W20260709 12:21:13.183622 24438 consensus_peers.cc:597] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:13.206519 25082 consensus_peers.cc:597] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:13.213824 30520 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:13.214421 30520 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:13.221638 24467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:21:13.222311 24467 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 17.
W20260709 12:21:13.233075 25084 leader_election.cc:336] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:13.235762 30520 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:21:13.239301 25082 leader_election.cc:336] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:13.239889 25082 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:13.241597 30520 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:21:13.276232 24438 consensus_peers.cc:597] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:13.421308 24438 consensus_peers.cc:597] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:13.465092 24440 consensus_peers.cc:597] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:21:13.487528 30532 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:13.488216 30532 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:13.490934 30532 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:13.525691 24440 consensus_peers.cc:597] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:13.529562 24438 leader_election.cc:336] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:13.553155 24440 leader_election.cc:336] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:13.568648 24440 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:13.576131 30532 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:21:13.568104 25082 consensus_peers.cc:597] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:13.577316 25082 consensus_peers.cc:597] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:13.578416 24438 consensus_peers.cc:597] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:13.608613 24438 consensus_peers.cc:597] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:13.634564 25082 consensus_peers.cc:597] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:13.638278 25084 consensus_peers.cc:597] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:21:13.639580 24440 consensus_peers.cc:597] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:13.763391 25082 consensus_peers.cc:597] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:13.790254 30523 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:13.790846 30523 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:21:13.797196 24440 leader_election.cc:336] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:13.798478 30523 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:13.803651 24438 leader_election.cc:336] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:13.804236 24438 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:13.805413 30523 raft_consensus.cc:2749] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:21:13.842541 25084 consensus_peers.cc:597] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:21:13.964517 25084 consensus_peers.cc:597] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:21:13.975283 25084 consensus_peers.cc:597] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 12:21:13.991776 30531 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:13.992583 30531 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:14.008395 30531 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:21:14.008704 24466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "d99d5d772cfe4a96afcab3d3b009a281" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" is_pre_election: true
I20260709 12:21:14.010879 24466 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d99d5d772cfe4a96afcab3d3b009a281 in term 14.
W20260709 12:21:14.023851 25082 leader_election.cc:336] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:14.035154 25084 leader_election.cc:336] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:14.036151 25084 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:14.039382 30520 raft_consensus.cc:2749] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:14.063740 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:36951, user_credentials={real_user=slave}} blocked reactor thread for 44004us
W20260709 12:21:14.101806 24440 consensus_peers.cc:597] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:21:14.109048 24438 consensus_peers.cc:597] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:14.112509 30531 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:14.113293 30531 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
W20260709 12:21:14.124771 25084 leader_election.cc:336] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:14.118053 30531 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:14.125638 25082 leader_election.cc:336] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:14.126636 25082 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:14.127506 30531 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:21:14.135488 24438 consensus_peers.cc:597] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:14.167126 23151 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 24421)
W20260709 12:21:14.243142 25084 consensus_peers.cc:597] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:21:14.262879 24440 consensus_peers.cc:597] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:14.318696 25084 consensus_peers.cc:597] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:21:14.493279 24440 consensus_peers.cc:597] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:14.524811 25082 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111) [suppressed 600 similar messages]
W20260709 12:21:14.626600 24440 consensus_peers.cc:597] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:21:14.702399 24440 consensus_peers.cc:597] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 12:21:14.758560 30504 raft_consensus.cc:493] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:14.759207 30504 raft_consensus.cc:515] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:14.775547 30504 leader_election.cc:290] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:14.788597 25082 leader_election.cc:336] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:14.825245 30532 raft_consensus.cc:493] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:14.826182 30532 raft_consensus.cc:515] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
W20260709 12:21:14.830215 25084 leader_election.cc:336] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:14.836975 25084 leader_election.cc:304] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:14.843632 30531 raft_consensus.cc:2749] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:21:14.859253 24440 consensus_peers.cc:597] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:21:14.861838 30532 leader_election.cc:290] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:14.887619 24438 leader_election.cc:336] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:14.896458 25084 consensus_peers.cc:597] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:21:14.905397 24440 leader_election.cc:336] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:14.906345 24440 leader_election.cc:304] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:14.909860 30523 raft_consensus.cc:2749] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:15.035202 25084 consensus_peers.cc:597] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:15.049309 25084 consensus_peers.cc:597] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 12:21:15.062626 30504 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:15.063308 30504 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:15.066895 30504 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:21:15.126510 30532 raft_consensus.cc:493] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:15.127413 30532 raft_consensus.cc:515] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:15.130582 30532 leader_election.cc:290] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
I20260709 12:21:15.141853 30523 raft_consensus.cc:493] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:15.142571 30523 raft_consensus.cc:515] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:15.152823 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9950f2ff950845e1837dbf993fb23cb0" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:21:15.156672 25118 raft_consensus.cc:2468] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 17.
I20260709 12:21:15.145736 30523 leader_election.cc:290] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:15.167707 23151 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 24421)
W20260709 12:21:15.172292 25084 leader_election.cc:336] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:15.175386 25084 consensus_peers.cc:597] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:21:15.177103 25082 leader_election.cc:336] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:15.180724 25082 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:15.186010 30504 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:21:15.190307 24438 consensus_peers.cc:597] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:15.207239 24440 leader_election.cc:336] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:15.212215 24438 leader_election.cc:336] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:15.213584 24438 leader_election.cc:304] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:15.217170 30523 raft_consensus.cc:2749] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:21:15.220337 24438 leader_election.cc:336] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:15.222932 24438 consensus_peers.cc:597] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:15.223834 24438 consensus_peers.cc:597] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:15.227510 24440 leader_election.cc:336] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:15.228574 24440 leader_election.cc:304] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:15.244683 30534 raft_consensus.cc:2749] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:21:15.255298 24440 consensus_peers.cc:597] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:15.331797 25082 consensus_peers.cc:597] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:21:15.373145 30534 raft_consensus.cc:493] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:15.373745 30534 raft_consensus.cc:515] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } }
I20260709 12:21:15.377980 30534 leader_election.cc:290] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951)
W20260709 12:21:15.379479 25082 consensus_peers.cc:597] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:15.382402 25082 consensus_peers.cc:597] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:15.391835 24440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:35511, user_credentials={real_user=slave}} blocked reactor thread for 48922.3us
W20260709 12:21:15.395887 25082 consensus_peers.cc:597] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:15.404201 24438 consensus_peers.cc:597] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:15.426919 24438 leader_election.cc:336] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:15.472004 25084 consensus_peers.cc:597] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 12:21:15.476402 30531 raft_consensus.cc:493] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:15.478426 30532 raft_consensus.cc:493] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:15.479131 30532 raft_consensus.cc:515] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:15.481946 30532 leader_election.cc:290] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:21:15.477173 30531 raft_consensus.cc:515] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:15.487134 30531 leader_election.cc:290] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:15.488763 24438 consensus_peers.cc:597] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:21:15.494371 30532 raft_consensus.cc:493] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:15.499743 30532 raft_consensus.cc:515] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:15.512009 30532 leader_election.cc:290] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:15.489929 24440 leader_election.cc:336] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:15.512905 24440 leader_election.cc:304] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:15.514425 30523 raft_consensus.cc:2749] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:15.518894 30533 raft_consensus.cc:493] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:15.519456 30533 raft_consensus.cc:515] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:15.521642 30533 leader_election.cc:290] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:15.542630 25084 leader_election.cc:336] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:15.544963 24438 consensus_peers.cc:597] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:15.558264 25082 leader_election.cc:336] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:15.566116 25082 leader_election.cc:304] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:21:15.565346 25084 consensus_peers.cc:597] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:21:15.572136 24438 leader_election.cc:336] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:15.572835 30531 raft_consensus.cc:2749] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:15.580734 24438 leader_election.cc:336] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:15.586042 24438 leader_election.cc:336] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:15.579485 24440 leader_election.cc:336] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:15.598457 24440 leader_election.cc:304] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:15.605700 30534 raft_consensus.cc:2749] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:21:15.600910 25084 consensus_peers.cc:597] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:21:15.610476 24440 leader_election.cc:336] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:15.617009 24440 leader_election.cc:304] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:21:15.621920 24438 consensus_peers.cc:597] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:21:15.622499 30523 raft_consensus.cc:2749] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:21:15.635052 25082 consensus_peers.cc:597] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:15.652036 24438 consensus_peers.cc:597] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:15.685050 24440 leader_election.cc:336] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:15.686331 24440 leader_election.cc:304] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:15.690315 30523 raft_consensus.cc:2749] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:21:15.691515 24440 consensus_peers.cc:597] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:15.699288 24440 consensus_peers.cc:597] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:21:15.701656 24438 consensus_peers.cc:597] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:15.714567 24438 consensus_peers.cc:597] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:15.731405 24438 consensus_peers.cc:597] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:15.774567 24438 consensus_peers.cc:597] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:15.782822 25082 consensus_peers.cc:597] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:15.854439 25082 consensus_peers.cc:597] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:21:16.000463 30532 raft_consensus.cc:493] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:16.001230 30532 raft_consensus.cc:515] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:16.003782 30532 leader_election.cc:290] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:16.019610 24438 leader_election.cc:336] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:16.022078 24438 consensus_peers.cc:597] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:16.045611 24440 leader_election.cc:336] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:16.055439 24440 leader_election.cc:304] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:16.056738 30523 raft_consensus.cc:2749] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:21:16.087381 24440 consensus_peers.cc:597] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:21:16.147755 30532 raft_consensus.cc:493] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:16.148422 30532 raft_consensus.cc:515] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:16.151155 30532 leader_election.cc:290] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:16.161965 24440 leader_election.cc:336] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:16.167153 24438 leader_election.cc:336] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:16.178850 24438 leader_election.cc:304] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:16.181917 30532 raft_consensus.cc:493] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
W20260709 12:21:16.169710 23151 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 24421)
I20260709 12:21:16.184180 30532 raft_consensus.cc:515] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } attrs { replace: true } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:16.185196 30534 raft_consensus.cc:2749] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:16.190128 24440 consensus_peers.cc:597] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:21:16.211074 25118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabffff9a20f4f0091c52fc21d5abcde" candidate_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d99d5d772cfe4a96afcab3d3b009a281" is_pre_election: true
I20260709 12:21:16.211885 25118 raft_consensus.cc:2468] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b8650fa8324ac2ac5f75eee9b1a1e3 in term 14.
W20260709 12:21:16.213488 25084 consensus_peers.cc:597] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 12:21:16.196421 30532 leader_election.cc:290] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), d99d5d772cfe4a96afcab3d3b009a281 (127.22.155.196:35511)
W20260709 12:21:16.223716 24438 leader_election.cc:336] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:16.225384 24440 leader_election.cc:336] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:16.225909 24440 leader_election.cc:304] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:16.226734 30532 raft_consensus.cc:2749] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:16.233778 25084 consensus_peers.cc:597] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:21:16.259141 24438 consensus_peers.cc:597] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:21:16.261556 30523 raft_consensus.cc:493] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:16.263047 30523 raft_consensus.cc:515] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:16.265403 30523 leader_election.cc:290] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:16.292573 25084 consensus_peers.cc:597] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:21:16.297842 24438 leader_election.cc:336] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:16.304589 24440 leader_election.cc:336] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:16.306417 24440 leader_election.cc:304] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:16.307315 30534 raft_consensus.cc:2749] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:21:16.316803 24440 consensus_peers.cc:597] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:16.446923 24438 consensus_peers.cc:597] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:16.458086 30534 raft_consensus.cc:493] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:16.458789 30534 raft_consensus.cc:515] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:16.461273 30534 leader_election.cc:290] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:16.468060 24440 leader_election.cc:336] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:16.477974 24438 leader_election.cc:336] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:16.478569 24438 leader_election.cc:304] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:16.479395 30534 raft_consensus.cc:2749] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:16.519668 30534 raft_consensus.cc:493] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:16.520282 30534 raft_consensus.cc:515] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:16.522456 30534 leader_election.cc:290] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:16.534787 24440 leader_election.cc:336] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:16.545224 24440 consensus_peers.cc:597] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:21:16.554831 24438 leader_election.cc:336] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:16.555474 24438 leader_election.cc:304] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:16.556318 30534 raft_consensus.cc:2749] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:16.624168 24438 consensus_peers.cc:597] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:16.685389 25084 consensus_peers.cc:597] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 12:21:16.717222 25084 consensus_peers.cc:597] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:21:16.744668 24440 consensus_peers.cc:597] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:21:16.794122 30520 raft_consensus.cc:493] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:16.794731 30520 raft_consensus.cc:515] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:16.799018 30520 leader_election.cc:290] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:16.809149 25084 leader_election.cc:336] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:16.949451 23151 tablet_server.cc:196] TabletServer@127.22.155.194:0 shutdown complete.
W20260709 12:21:17.053983 25084 consensus_peers.cc:597] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 12:21:17.078684 25082 consensus_peers.cc:597] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:17.094758 25082 consensus_peers.cc:597] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:17.095912 25082 consensus_peers.cc:597] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:17.109331 25082 leader_election.cc:336] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:17.112978 25082 leader_election.cc:304] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:17.116400 30520 raft_consensus.cc:2749] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:17.149430 23151 tablet_server.cc:179] TabletServer@127.22.155.195:0 shutting down...
W20260709 12:21:17.161814 24440 consensus_peers.cc:597] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:17.169306 25083 consensus_peers.cc:597] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Couldn't send request to peer 99b8650fa8324ac2ac5f75eee9b1a1e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:17.201706 25083 consensus_peers.cc:597] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 -> Peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Couldn't send request to peer 99b8650fa8324ac2ac5f75eee9b1a1e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:17.204978 24440 consensus_peers.cc:597] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:21:17.250782 24440 consensus_peers.cc:597] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:21:17.263413 30523 raft_consensus.cc:493] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:17.264175 30523 raft_consensus.cc:515] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } }
I20260709 12:21:17.272611 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:21:17.274729 24438 leader_election.cc:336] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:17.274356 23151 tablet_replica.cc:333] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
W20260709 12:21:17.276805 24440 leader_election.cc:336] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:17.277129 30523 leader_election.cc:290] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
I20260709 12:21:17.277345 24440 leader_election.cc:304] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b8650fa8324ac2ac5f75eee9b1a1e3; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
W20260709 12:21:17.278816 25083 consensus_peers.cc:597] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Couldn't send request to peer 99b8650fa8324ac2ac5f75eee9b1a1e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:17.279994 30532 raft_consensus.cc:2749] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:17.281498 23151 raft_consensus.cc:2243] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 LEADER]: Raft consensus shutting down.
W20260709 12:21:17.282311 25083 consensus_peers.cc:597] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Couldn't send request to peer 99b8650fa8324ac2ac5f75eee9b1a1e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:17.282984 23151 raft_consensus.cc:2272] T 83efb40b1c6f4c9385b9e7c153e902bc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.290629 23151 tablet_replica.cc:333] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.291682 23151 raft_consensus.cc:2243] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.293299 23151 raft_consensus.cc:2272] T 9ae0187acc6343ef874010bc79580048 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.296980 23151 tablet_replica.cc:333] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.298146 23151 raft_consensus.cc:2243] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.299026 23151 raft_consensus.cc:2272] T 66cf199780b748b28ae5a775abb95cbe P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.302075 23151 tablet_replica.cc:333] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.303122 23151 raft_consensus.cc:2243] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.304517 23151 raft_consensus.cc:2272] T 5a08303c706b4fcda5778a1f60dc1915 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.307358 23151 tablet_replica.cc:333] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.308384 23151 raft_consensus.cc:2243] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.309438 23151 raft_consensus.cc:2272] T 72fa7cd50b4c4a12af95a9accb7dd947 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.312765 23151 tablet_replica.cc:333] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.313807 23151 raft_consensus.cc:2243] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.314683 23151 raft_consensus.cc:2272] T 34412a32b83e40b7918bf8492b7af28f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.318387 23151 tablet_replica.cc:333] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.320835 23151 raft_consensus.cc:2243] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.322345 23151 raft_consensus.cc:2272] T 1246d2a6c02a457f97a768233aa6cf6d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.325145 23151 tablet_replica.cc:333] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.325794 23151 raft_consensus.cc:2243] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.327065 23151 raft_consensus.cc:2272] T 8616bc73679e486399b789377c5cd1ba P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.330093 23151 tablet_replica.cc:333] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.331199 23151 raft_consensus.cc:2243] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.332368 23151 raft_consensus.cc:2272] T 400165817fe74ada9a4793982993a5e3 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.335834 23151 tablet_replica.cc:333] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.336789 23151 raft_consensus.cc:2243] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.338277 23151 raft_consensus.cc:2272] T 46c46f855639421fb6d7eab9b01f55a0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.340875 23151 tablet_replica.cc:333] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.341615 23151 raft_consensus.cc:2243] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.342864 23151 raft_consensus.cc:2272] T fdc8b7c33c2b4e9da87a15ea80d2f342 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.345695 23151 tablet_replica.cc:333] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.346400 23151 raft_consensus.cc:2243] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.348060 23151 raft_consensus.cc:2272] T c06ca9ec70d4444d88577d9e07b62edc P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.350852 23151 tablet_replica.cc:333] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.351508 23151 raft_consensus.cc:2243] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.353157 23151 raft_consensus.cc:2272] T c7855d741eff4cb394101baa2af0f082 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.355986 23151 tablet_replica.cc:333] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.356786 23151 raft_consensus.cc:2243] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.357750 23151 raft_consensus.cc:2272] T 3ae398278b05401c9dbc83b30a800655 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.360981 23151 tablet_replica.cc:333] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.361971 23151 raft_consensus.cc:2243] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.363862 23151 raft_consensus.cc:2272] T 18eaf20aac4141229219a10fc4ed0a23 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.366827 23151 tablet_replica.cc:333] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.367534 23151 raft_consensus.cc:2243] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.368337 23151 raft_consensus.cc:2272] T 74a60f1722e64f329fe72226d0dbb7c4 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.371506 23151 tablet_replica.cc:333] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.372416 23151 raft_consensus.cc:2243] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.373906 23151 raft_consensus.cc:2272] T 95c2470f38204e5ba4ee545bb2de933c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.376922 23151 tablet_replica.cc:333] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.377774 23151 raft_consensus.cc:2243] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.379390 23151 raft_consensus.cc:2272] T cabffff9a20f4f0091c52fc21d5abcde P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.382882 23151 tablet_replica.cc:333] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.383999 23151 raft_consensus.cc:2243] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.385066 23151 raft_consensus.cc:2272] T 626f1d05390b4454b317c19d513384be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.388729 23151 tablet_replica.cc:333] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.389835 23151 raft_consensus.cc:2243] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.390635 23151 raft_consensus.cc:2272] T 5de6cc497bc845dda523b96c519faf83 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.393777 23151 tablet_replica.cc:333] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.394754 23151 raft_consensus.cc:2243] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.395809 23151 raft_consensus.cc:2272] T daeed7cb347a434082488f5c5807424b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.398723 23151 tablet_replica.cc:333] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.399519 23151 raft_consensus.cc:2243] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.401084 23151 raft_consensus.cc:2272] T f8dc8357b0c947d9a0f16daa0f4210aa P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.404035 23151 tablet_replica.cc:333] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.404933 23151 raft_consensus.cc:2243] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.405712 23151 raft_consensus.cc:2272] T 22a61f2b7e79419c82712f4b54b899ed P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.408830 23151 tablet_replica.cc:333] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.409754 23151 raft_consensus.cc:2243] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 LEADER]: Raft consensus shutting down.
W20260709 12:21:17.409948 25083 consensus_peers.cc:597] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Couldn't send request to peer 99b8650fa8324ac2ac5f75eee9b1a1e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:17.411221 23151 raft_consensus.cc:2272] T 101287bb58d2418bad8554ed0a096407 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.414273 23151 tablet_replica.cc:333] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.415251 23151 raft_consensus.cc:2243] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.416676 23151 raft_consensus.cc:2272] T 51965da6bcc444d5b20f7348cba2c649 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.419718 23151 tablet_replica.cc:333] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.420596 23151 raft_consensus.cc:2243] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.422462 23151 raft_consensus.cc:2272] T 9950f2ff950845e1837dbf993fb23cb0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.425526 23151 tablet_replica.cc:333] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.426368 23151 raft_consensus.cc:2243] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.427235 23151 raft_consensus.cc:2272] T 48340fd716644ed18711f9addc546f4b P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.430397 23151 tablet_replica.cc:333] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.431270 23151 raft_consensus.cc:2243] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.432089 23151 raft_consensus.cc:2272] T 03c8932a13b744d7a945b0a7655f5a47 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.434707 23151 tablet_replica.cc:333] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.435653 23151 raft_consensus.cc:2243] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.436575 23151 raft_consensus.cc:2272] T 9edb2262948747f3b2674ddb57a2da5c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.439608 23151 tablet_replica.cc:333] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.440593 23151 raft_consensus.cc:2243] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.441296 23151 raft_consensus.cc:2272] T 36cbfd088b3e4737a74b878b802210f1 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.443902 23151 tablet_replica.cc:333] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.444855 23151 raft_consensus.cc:2243] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.446581 23151 raft_consensus.cc:2272] T 27d97e40dd274a2ea3734c2982741e3c P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.448958 23151 tablet_replica.cc:333] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.449721 23151 raft_consensus.cc:2243] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.451341 23151 raft_consensus.cc:2272] T 111838cb1ad347d59c8b479393f9d486 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.454311 23151 tablet_replica.cc:333] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.455258 23151 raft_consensus.cc:2243] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.456280 23151 raft_consensus.cc:2272] T 8fcc66a9731446a989f79106ac6fa5ea P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.459354 23151 tablet_replica.cc:333] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.460276 23151 raft_consensus.cc:2243] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.461894 23151 raft_consensus.cc:2272] T 419283bfbe814a8dbebaa6962ce15ee0 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.465211 23151 tablet_replica.cc:333] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
W20260709 12:21:17.465510 25083 consensus_peers.cc:597] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Couldn't send request to peer 99b8650fa8324ac2ac5f75eee9b1a1e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:17.466130 23151 raft_consensus.cc:2243] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.467192 23151 raft_consensus.cc:2272] T 82c31a779e7949a590cf168eef01e405 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.470541 23151 tablet_replica.cc:333] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.471591 23151 raft_consensus.cc:2243] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.473145 23151 raft_consensus.cc:2272] T ac37baecf20841f7b0a74e07f89c2a09 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.475432 23151 tablet_replica.cc:333] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.476171 23151 raft_consensus.cc:2243] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.476923 23151 raft_consensus.cc:2272] T 36992a1e3818480c9a2705bd569f099a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.479429 23151 tablet_replica.cc:333] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.480140 23151 raft_consensus.cc:2243] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.480928 23151 raft_consensus.cc:2272] T 0ff0373496af48a585a7d6ceab63908f P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.483292 23151 tablet_replica.cc:333] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.483958 23151 raft_consensus.cc:2243] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.486090 23151 raft_consensus.cc:2272] T f3d18ca89df84c1ba95edb6284f7a8fb P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.488344 23151 tablet_replica.cc:333] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.489010 23151 raft_consensus.cc:2243] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.489692 23151 raft_consensus.cc:2272] T 63debf83121c430e9dffcd1c5035cf3a P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.492417 23151 tablet_replica.cc:333] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.493255 23151 raft_consensus.cc:2243] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.494010 23151 raft_consensus.cc:2272] T 3a802b4f6ba54f358ebd8a2a74f2a9c6 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.497179 23151 tablet_replica.cc:333] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.498023 23151 raft_consensus.cc:2243] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.499006 23151 raft_consensus.cc:2272] T 01bd4c6351f24e35abba86aef1ce23be P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.502538 23151 tablet_replica.cc:333] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.503387 23151 raft_consensus.cc:2243] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.505467 23151 raft_consensus.cc:2272] T 4fb70b6bc9ed40a793fb93839c889578 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.508461 23151 tablet_replica.cc:333] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
W20260709 12:21:17.509034 25083 consensus_peers.cc:597] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Couldn't send request to peer 99b8650fa8324ac2ac5f75eee9b1a1e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:17.509333 23151 raft_consensus.cc:2243] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.512200 23151 raft_consensus.cc:2272] T 7cd3bd910f7f47f9acdd1792db910842 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:17.519320 25083 consensus_peers.cc:597] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Couldn't send request to peer 99b8650fa8324ac2ac5f75eee9b1a1e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:17.521107 23151 tablet_replica.cc:333] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.523841 23151 raft_consensus.cc:2243] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.524959 23151 raft_consensus.cc:2272] T 218e3bf7807b42d09ac3db0dad69fcf9 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:17.525113 25084 consensus_peers.cc:597] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 12:21:17.527104 25083 consensus_peers.cc:597] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 -> Peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Couldn't send request to peer 99b8650fa8324ac2ac5f75eee9b1a1e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:17.527848 23151 tablet_replica.cc:333] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.528589 23151 raft_consensus.cc:2243] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.529295 23151 raft_consensus.cc:2272] T 1ba811822a8a4266a950b36a73a9fce7 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.531708 23151 tablet_replica.cc:333] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.532253 23151 raft_consensus.cc:2243] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.533540 23151 raft_consensus.cc:2272] T 125e800842274e17a2c01df7bb749005 P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.535828 23151 tablet_replica.cc:333] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3: stopping tablet replica
I20260709 12:21:17.536513 23151 raft_consensus.cc:2243] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.537743 23151 raft_consensus.cc:2272] T 1541b2ab674f43ca8c6b46df9171c32d P 99b8650fa8324ac2ac5f75eee9b1a1e3 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:17.545948 25084 consensus_peers.cc:597] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:17.606488 25083 consensus_peers.cc:597] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 -> Peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Couldn't send request to peer 99b8650fa8324ac2ac5f75eee9b1a1e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:17.625494 25083 consensus_peers.cc:597] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 -> Peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Couldn't send request to peer 99b8650fa8324ac2ac5f75eee9b1a1e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:17.678812 30520 raft_consensus.cc:493] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:17.679338 30520 raft_consensus.cc:515] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:17.681069 30520 leader_election.cc:290] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:17.678354 25083 consensus_peers.cc:597] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Couldn't send request to peer 99b8650fa8324ac2ac5f75eee9b1a1e3. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.195:44453: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:17.691009 25082 leader_election.cc:336] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:17.693408 25084 leader_election.cc:336] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:17.693929 25084 leader_election.cc:304] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:17.694727 30520 raft_consensus.cc:2749] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:21:17.697587 25083 consensus_peers.cc:597] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Couldn't send request to peer 99b8650fa8324ac2ac5f75eee9b1a1e3. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.195:44453: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:17.719787 25084 consensus_peers.cc:597] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 12:21:17.778635 25084 consensus_peers.cc:597] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 12:21:17.976910 25084 consensus_peers.cc:597] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 12:21:18.011469 25084 consensus_peers.cc:597] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260709 12:21:18.114845 30537 raft_consensus.cc:493] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:18.115484 30537 raft_consensus.cc:515] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:18.120426 30537 leader_election.cc:290] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:18.122704 25082 leader_election.cc:336] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:18.123636 25084 leader_election.cc:336] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:18.124089 25084 leader_election.cc:304] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:18.125383 30537 raft_consensus.cc:2749] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:21:18.197022 25082 consensus_peers.cc:597] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:18.371614 25082 consensus_peers.cc:597] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:18.374540 25084 consensus_peers.cc:597] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Couldn't send request to peer c711faa13ead43ebbea0192cb74a4756. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260709 12:21:18.469606 23151 tablet_server.cc:196] TabletServer@127.22.155.195:0 shutdown complete.
I20260709 12:21:18.501371 30537 raft_consensus.cc:493] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:21:18.502140 30537 raft_consensus.cc:515] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:18.504621 30537 leader_election.cc:290] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:21:18.508675 25082 consensus_peers.cc:597] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:18.510488 25083 leader_election.cc:336] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Network error: Client connection negotiation failed: client connection to 127.22.155.195:44453: connect: Connection refused (error 111)
W20260709 12:21:18.512084 25084 leader_election.cc:336] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:18.512506 25084 leader_election.cc:304] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:21:18.513502 30538 raft_consensus.cc:2749] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:18.536674 30538 raft_consensus.cc:493] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:21:18.537515 30538 raft_consensus.cc:515] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:18.540344 30538 leader_election.cc:290] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:21:18.545886 25082 leader_election.cc:336] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:18.548244 25083 leader_election.cc:336] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Network error: Client connection negotiation failed: client connection to 127.22.155.195:44453: connect: Connection refused (error 111)
I20260709 12:21:18.548785 25083 leader_election.cc:304] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:18.550118 30538 raft_consensus.cc:2749] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:18.604127 23151 tablet_server.cc:179] TabletServer@127.22.155.196:0 shutting down...
I20260709 12:21:18.608126 30537 raft_consensus.cc:493] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c855242ec9d34a5397741ef20db9de8a)
I20260709 12:21:18.608783 30537 raft_consensus.cc:515] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:18.615275 30537 leader_election.cc:290] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893)
W20260709 12:21:18.618387 25082 leader_election.cc:336] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:18.619174 25084 leader_election.cc:336] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:18.619688 25084 leader_election.cc:304] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: c711faa13ead43ebbea0192cb74a4756, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:18.620580 30537 raft_consensus.cc:2749] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:18.640072 30538 raft_consensus.cc:493] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:21:18.640851 30538 raft_consensus.cc:515] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:18.645530 30538 leader_election.cc:290] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
W20260709 12:21:18.649930 25082 consensus_peers.cc:597] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:18.651718 25083 leader_election.cc:336] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Network error: Client connection negotiation failed: client connection to 127.22.155.195:44453: connect: Connection refused (error 111)
W20260709 12:21:18.657917 25082 leader_election.cc:336] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:18.658420 25082 leader_election.cc:304] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:18.659102 30504 raft_consensus.cc:2749] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:18.676317 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:18.677582 23151 tablet_replica.cc:333] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.677476 30504 raft_consensus.cc:493] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:21:18.678457 30504 raft_consensus.cc:515] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:18.679106 23151 raft_consensus.cc:2243] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:18.679919 23151 raft_consensus.cc:2272] T f3d18ca89df84c1ba95edb6284f7a8fb P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.681036 30504 leader_election.cc:290] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:21:18.683677 23151 tablet_replica.cc:333] T fdc8b7c33c2b4e9da87a15ea80d2f342 P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.684757 23151 raft_consensus.cc:2243] T fdc8b7c33c2b4e9da87a15ea80d2f342 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:18.685778 23151 raft_consensus.cc:2272] T fdc8b7c33c2b4e9da87a15ea80d2f342 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:18.686470 25083 leader_election.cc:336] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Network error: Client connection negotiation failed: client connection to 127.22.155.195:44453: connect: Connection refused (error 111)
W20260709 12:21:18.687063 25082 leader_election.cc:336] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
I20260709 12:21:18.687520 25082 leader_election.cc:304] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:18.689349 23151 tablet_replica.cc:333] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.689332 30538 raft_consensus.cc:2749] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:18.690742 23151 raft_consensus.cc:2243] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:18.691668 23151 raft_consensus.cc:2272] T cabffff9a20f4f0091c52fc21d5abcde P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.695427 23151 tablet_replica.cc:333] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.696347 23151 raft_consensus.cc:2243] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 15 LEADER]: Raft consensus shutting down.
W20260709 12:21:18.696391 25082 consensus_peers.cc:597] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 -> Peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Couldn't send request to peer c855242ec9d34a5397741ef20db9de8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:21:18.696712 30538 raft_consensus.cc:493] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:21:18.697322 30538 raft_consensus.cc:515] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:18.697777 23151 raft_consensus.cc:2272] T 1541b2ab674f43ca8c6b46df9171c32d P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.699308 30538 leader_election.cc:290] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:21:18.701180 23151 tablet_replica.cc:333] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.702175 23151 raft_consensus.cc:2243] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:21:18.703369 23151 raft_consensus.cc:2272] T 63debf83121c430e9dffcd1c5035cf3a P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:18.703583 25082 leader_election.cc:336] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:18.704810 25083 leader_election.cc:336] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Network error: Client connection negotiation failed: client connection to 127.22.155.195:44453: connect: Connection refused (error 111)
I20260709 12:21:18.705302 25083 leader_election.cc:304] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:18.706076 30538 raft_consensus.cc:2749] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:18.706681 23151 tablet_replica.cc:333] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.707638 23151 raft_consensus.cc:2243] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:18.708238 23151 raft_consensus.cc:2272] T 51965da6bcc444d5b20f7348cba2c649 P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.711210 23151 tablet_replica.cc:333] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.712019 23151 raft_consensus.cc:2243] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:18.712869 23151 raft_consensus.cc:2272] T 67fce41b64ab4350b88ec02abbcd9c82 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.715857 23151 tablet_replica.cc:333] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.716840 23151 raft_consensus.cc:2243] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:18.718271 23151 raft_consensus.cc:2272] T 7910ea4d480e41fda4aa4fd10f0fef8f P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.721581 23151 tablet_replica.cc:333] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.722473 23151 raft_consensus.cc:2243] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:18.723418 23151 raft_consensus.cc:2272] T dfa0a0cd756141c094288d3c05139379 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.726460 23151 tablet_replica.cc:333] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.727279 23151 raft_consensus.cc:2243] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:21:18.728425 23151 raft_consensus.cc:2272] T 27d97e40dd274a2ea3734c2982741e3c P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.731515 23151 tablet_replica.cc:333] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.732337 23151 raft_consensus.cc:2243] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:18.733136 23151 raft_consensus.cc:2272] T 83efb40b1c6f4c9385b9e7c153e902bc P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.736128 23151 tablet_replica.cc:333] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.736892 23151 raft_consensus.cc:2243] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:18.737644 23151 raft_consensus.cc:2272] T 4fb70b6bc9ed40a793fb93839c889578 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.740674 23151 tablet_replica.cc:333] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.741572 23151 raft_consensus.cc:2243] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:21:18.743021 23151 raft_consensus.cc:2272] T 7fd01a911fd14f38a5e1ca5b30c7da18 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.745998 30504 raft_consensus.cc:493] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:21:18.746274 23151 tablet_replica.cc:333] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.746675 30504 raft_consensus.cc:515] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:18.747370 23151 raft_consensus.cc:2243] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:21:18.748733 23151 raft_consensus.cc:2272] T 40ccde13a66c45c8bd6d8780ee632ea8 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.748936 30504 leader_election.cc:290] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:21:18.751847 23151 tablet_replica.cc:333] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.752823 23151 raft_consensus.cc:2243] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:21:18.754007 23151 raft_consensus.cc:2272] T 3ae398278b05401c9dbc83b30a800655 P d99d5d772cfe4a96afcab3d3b009a281 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:18.754313 25084 leader_election.cc:336] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
W20260709 12:21:18.756372 25083 leader_election.cc:336] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Network error: Client connection negotiation failed: client connection to 127.22.155.195:44453: connect: Connection refused (error 111)
I20260709 12:21:18.756907 25083 leader_election.cc:304] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
I20260709 12:21:18.757457 23151 tablet_replica.cc:333] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.757570 30504 raft_consensus.cc:2749] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:18.758543 23151 raft_consensus.cc:2243] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:18.759430 23151 raft_consensus.cc:2272] T 5a08303c706b4fcda5778a1f60dc1915 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.762507 23151 tablet_replica.cc:333] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.763352 23151 raft_consensus.cc:2243] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:18.764249 23151 raft_consensus.cc:2272] T 101287bb58d2418bad8554ed0a096407 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.767433 23151 tablet_replica.cc:333] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.768249 23151 raft_consensus.cc:2243] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:21:18.769374 23151 raft_consensus.cc:2272] T 7cd3bd910f7f47f9acdd1792db910842 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.772253 23151 tablet_replica.cc:333] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.773012 23151 raft_consensus.cc:2243] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:18.773638 23151 raft_consensus.cc:2272] T 125e800842274e17a2c01df7bb749005 P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.774603 30504 raft_consensus.cc:493] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:21:18.775084 30504 raft_consensus.cc:515] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c711faa13ead43ebbea0192cb74a4756" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 36951 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:18.776379 23151 tablet_replica.cc:333] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.777073 30504 leader_election.cc:290] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:21:18.777542 23151 raft_consensus.cc:2243] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:18.778601 23151 raft_consensus.cc:2272] T 97dd30b21cc14958a91b2da522e4bbe9 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.781566 23151 tablet_replica.cc:333] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.782373 23151 raft_consensus.cc:2243] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 12:21:18.782469 25083 leader_election.cc:336] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Network error: Client connection negotiation failed: client connection to 127.22.155.195:44453: connect: Connection refused (error 111)
I20260709 12:21:18.783119 23151 raft_consensus.cc:2272] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:18.783129 25084 leader_election.cc:336] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:18.783847 25084 leader_election.cc:304] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c711faa13ead43ebbea0192cb74a4756
W20260709 12:21:18.784399 25084 raft_consensus.cc:2686] T 1246d2a6c02a457f97a768233aa6cf6d P d99d5d772cfe4a96afcab3d3b009a281: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:21:18.786378 23151 tablet_replica.cc:333] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.787302 23151 raft_consensus.cc:2243] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:21:18.788023 30538 raft_consensus.cc:493] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 99b8650fa8324ac2ac5f75eee9b1a1e3)
I20260709 12:21:18.788666 23151 raft_consensus.cc:2272] T 9f31ae8f765347f0b4ac12809516729c P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.788736 30538 raft_consensus.cc:515] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c855242ec9d34a5397741ef20db9de8a" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35893 } } peers { permanent_uuid: "99b8650fa8324ac2ac5f75eee9b1a1e3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 44453 } } peers { permanent_uuid: "d99d5d772cfe4a96afcab3d3b009a281" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 35511 } attrs { promote: false } }
I20260709 12:21:18.791254 30538 leader_election.cc:290] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893), 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453)
I20260709 12:21:18.791803 23151 tablet_replica.cc:333] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.793895 23151 raft_consensus.cc:2243] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:18.794916 23151 raft_consensus.cc:2272] T ac37baecf20841f7b0a74e07f89c2a09 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:18.796794 25082 leader_election.cc:336] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c855242ec9d34a5397741ef20db9de8a (127.22.155.194:35893): Network error: Client connection negotiation failed: client connection to 127.22.155.194:35893: connect: Connection refused (error 111)
W20260709 12:21:18.797514 25083 leader_election.cc:336] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 99b8650fa8324ac2ac5f75eee9b1a1e3 (127.22.155.195:44453): Network error: Client connection negotiation failed: client connection to 127.22.155.195:44453: connect: Connection refused (error 111)
I20260709 12:21:18.798092 23151 tablet_replica.cc:333] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.798033 25083 leader_election.cc:304] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d99d5d772cfe4a96afcab3d3b009a281; no voters: 99b8650fa8324ac2ac5f75eee9b1a1e3, c855242ec9d34a5397741ef20db9de8a
I20260709 12:21:18.798897 23151 raft_consensus.cc:2243] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:21:18.799054 30538 raft_consensus.cc:2749] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:18.800103 23151 raft_consensus.cc:2272] T 3f669315af0d426da28d57b462979ebd P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.802619 23151 tablet_replica.cc:333] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.803251 23151 raft_consensus.cc:2243] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:21:18.804234 23151 raft_consensus.cc:2272] T d9034e708c454259aebd10b80eeab667 P d99d5d772cfe4a96afcab3d3b009a281 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.806734 23151 tablet_replica.cc:333] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.807358 23151 raft_consensus.cc:2243] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:18.807845 23151 raft_consensus.cc:2272] T 9e8cc498654c4fde9917eeb605fdc906 P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.810214 23151 tablet_replica.cc:333] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.810920 23151 raft_consensus.cc:2243] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:21:18.811890 23151 raft_consensus.cc:2272] T 218e3bf7807b42d09ac3db0dad69fcf9 P d99d5d772cfe4a96afcab3d3b009a281 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.814334 23151 tablet_replica.cc:333] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.814936 23151 raft_consensus.cc:2243] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:21:18.815848 23151 raft_consensus.cc:2272] T 01bd4c6351f24e35abba86aef1ce23be P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.818154 23151 tablet_replica.cc:333] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.818749 23151 raft_consensus.cc:2243] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:21:18.819629 23151 raft_consensus.cc:2272] T daeed7cb347a434082488f5c5807424b P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.821959 23151 tablet_replica.cc:333] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.822513 23151 raft_consensus.cc:2243] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:21:18.823463 23151 raft_consensus.cc:2272] T 0ff0373496af48a585a7d6ceab63908f P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.825713 23151 tablet_replica.cc:333] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.826480 23151 raft_consensus.cc:2243] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:18.827312 23151 raft_consensus.cc:2272] T 9950f2ff950845e1837dbf993fb23cb0 P d99d5d772cfe4a96afcab3d3b009a281 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.831024 23151 tablet_replica.cc:333] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.831851 23151 raft_consensus.cc:2243] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:21:18.832907 23151 raft_consensus.cc:2272] T 36992a1e3818480c9a2705bd569f099a P d99d5d772cfe4a96afcab3d3b009a281 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.835114 23151 tablet_replica.cc:333] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.835675 23151 raft_consensus.cc:2243] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:21:18.836587 23151 raft_consensus.cc:2272] T 400165817fe74ada9a4793982993a5e3 P d99d5d772cfe4a96afcab3d3b009a281 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.839107 23151 tablet_replica.cc:333] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.839701 23151 raft_consensus.cc:2243] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:18.840274 23151 raft_consensus.cc:2272] T 48b5441f03704ebb94ffdbb55b9f33c6 P d99d5d772cfe4a96afcab3d3b009a281 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.842566 23151 tablet_replica.cc:333] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.843130 23151 raft_consensus.cc:2243] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:21:18.844098 23151 raft_consensus.cc:2272] T 82c31a779e7949a590cf168eef01e405 P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.847508 23151 tablet_replica.cc:333] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.848254 23151 raft_consensus.cc:2243] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:18.848856 23151 raft_consensus.cc:2272] T 95c2470f38204e5ba4ee545bb2de933c P d99d5d772cfe4a96afcab3d3b009a281 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.851318 23151 tablet_replica.cc:333] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.851842 23151 raft_consensus.cc:2243] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:18.852341 23151 raft_consensus.cc:2272] T f8dc8357b0c947d9a0f16daa0f4210aa P d99d5d772cfe4a96afcab3d3b009a281 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.854737 23151 tablet_replica.cc:333] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281: stopping tablet replica
I20260709 12:21:18.855232 23151 raft_consensus.cc:2243] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:21:18.856127 23151 raft_consensus.cc:2272] T 72fa7cd50b4c4a12af95a9accb7dd947 P d99d5d772cfe4a96afcab3d3b009a281 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.175084 23151 tablet_server.cc:196] TabletServer@127.22.155.196:0 shutdown complete.
I20260709 12:21:19.265206 23151 master.cc:562] Master@127.22.155.254:34311 shutting down...
W20260709 12:21:19.312590 24271 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:21:19.312924 24271 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:21:19.313171 24271 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:21:26.943279 24210 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111) [suppressed 433 similar messages]
W20260709 12:21:26.947566 24210 catalog_manager.cc:4755] TS c711faa13ead43ebbea0192cb74a4756 (127.22.155.193:36951): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet fdc8b7c33c2b4e9da87a15ea80d2f342: Network error: Client connection negotiation failed: client connection to 127.22.155.193:36951: connect: Connection refused (error 111)
I20260709 12:21:28.044867 23151 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:28.046283 23151 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:28.046748 23151 tablet_replica.cc:333] T 00000000000000000000000000000000 P 68b836feee894afe8d95b23bdf764928: stopping tablet replica
I20260709 12:21:28.278486 23151 master.cc:584] Master@127.22.155.254:34311 shutdown complete.
I20260709 12:21:28.343454 23151 test_util.cc:182] -----------------------------------------------
I20260709 12:21:28.343726 23151 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599400258298-23151-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (227515 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:21:28.348177 23151 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.155.254:37753
I20260709 12:21:28.349560 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:28.356272 30544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:28.356716 30545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:28.357282 30547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:28.358302 23151 server_base.cc:1061] running on GCE node
I20260709 12:21:28.361815 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:28.362015 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:28.362215 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599688362198 us; error 0 us; skew 500 ppm
I20260709 12:21:28.362857 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:28.365799 23151 webserver.cc:533] Webserver started at http://127.22.155.254:34107/ using document root <none> and password file <none>
I20260709 12:21:28.366379 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:28.366603 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:28.366930 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:28.368402 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/master-0-root/instance:
uuid: "17a4fc443d4545efb5ffae32542ddab5"
format_stamp: "Formatted at 2026-07-09 12:21:28 on dist-test-slave-p7fg"
I20260709 12:21:28.373729 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:21:28.377727 30552 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:28.378715 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:21:28.379066 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/master-0-root
uuid: "17a4fc443d4545efb5ffae32542ddab5"
format_stamp: "Formatted at 2026-07-09 12:21:28 on dist-test-slave-p7fg"
I20260709 12:21:28.379436 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:28.410629 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:28.411929 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:28.455166 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.254:37753
I20260709 12:21:28.455330 30603 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.254:37753 every 8 connection(s)
I20260709 12:21:28.459935 30604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:28.473490 30604 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17a4fc443d4545efb5ffae32542ddab5: Bootstrap starting.
I20260709 12:21:28.479233 30604 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 17a4fc443d4545efb5ffae32542ddab5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:28.484611 30604 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17a4fc443d4545efb5ffae32542ddab5: No bootstrap required, opened a new log
I20260709 12:21:28.487301 30604 raft_consensus.cc:359] T 00000000000000000000000000000000 P 17a4fc443d4545efb5ffae32542ddab5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17a4fc443d4545efb5ffae32542ddab5" member_type: VOTER }
I20260709 12:21:28.487785 30604 raft_consensus.cc:385] T 00000000000000000000000000000000 P 17a4fc443d4545efb5ffae32542ddab5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:28.488082 30604 raft_consensus.cc:740] T 00000000000000000000000000000000 P 17a4fc443d4545efb5ffae32542ddab5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4fc443d4545efb5ffae32542ddab5, State: Initialized, Role: FOLLOWER
I20260709 12:21:28.488783 30604 consensus_queue.cc:260] T 00000000000000000000000000000000 P 17a4fc443d4545efb5ffae32542ddab5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17a4fc443d4545efb5ffae32542ddab5" member_type: VOTER }
I20260709 12:21:28.489310 30604 raft_consensus.cc:399] T 00000000000000000000000000000000 P 17a4fc443d4545efb5ffae32542ddab5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:21:28.489549 30604 raft_consensus.cc:493] T 00000000000000000000000000000000 P 17a4fc443d4545efb5ffae32542ddab5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:21:28.489818 30604 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 17a4fc443d4545efb5ffae32542ddab5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:28.495095 30604 raft_consensus.cc:515] T 00000000000000000000000000000000 P 17a4fc443d4545efb5ffae32542ddab5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17a4fc443d4545efb5ffae32542ddab5" member_type: VOTER }
I20260709 12:21:28.495682 30604 leader_election.cc:304] T 00000000000000000000000000000000 P 17a4fc443d4545efb5ffae32542ddab5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 17a4fc443d4545efb5ffae32542ddab5; no voters: 
I20260709 12:21:28.497085 30604 leader_election.cc:290] T 00000000000000000000000000000000 P 17a4fc443d4545efb5ffae32542ddab5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:21:28.497666 30607 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 17a4fc443d4545efb5ffae32542ddab5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:28.499241 30607 raft_consensus.cc:697] T 00000000000000000000000000000000 P 17a4fc443d4545efb5ffae32542ddab5 [term 1 LEADER]: Becoming Leader. State: Replica: 17a4fc443d4545efb5ffae32542ddab5, State: Running, Role: LEADER
I20260709 12:21:28.500020 30607 consensus_queue.cc:237] T 00000000000000000000000000000000 P 17a4fc443d4545efb5ffae32542ddab5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17a4fc443d4545efb5ffae32542ddab5" member_type: VOTER }
I20260709 12:21:28.500483 30604 sys_catalog.cc:565] T 00000000000000000000000000000000 P 17a4fc443d4545efb5ffae32542ddab5 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:21:28.507512 30608 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17a4fc443d4545efb5ffae32542ddab5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "17a4fc443d4545efb5ffae32542ddab5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17a4fc443d4545efb5ffae32542ddab5" member_type: VOTER } }
I20260709 12:21:28.507516 30609 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17a4fc443d4545efb5ffae32542ddab5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17a4fc443d4545efb5ffae32542ddab5. Latest consensus state: current_term: 1 leader_uuid: "17a4fc443d4545efb5ffae32542ddab5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17a4fc443d4545efb5ffae32542ddab5" member_type: VOTER } }
I20260709 12:21:28.508402 30609 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17a4fc443d4545efb5ffae32542ddab5 [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:28.508397 30608 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17a4fc443d4545efb5ffae32542ddab5 [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:28.510699 30614 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:21:28.515825 30614 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:21:28.520462 23151 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:21:28.526208 30614 catalog_manager.cc:1383] Generated new cluster ID: 757b4a5ce6a34de596f1178fc18df2a3
I20260709 12:21:28.526553 30614 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:21:28.543619 30614 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:21:28.545168 30614 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:21:28.557520 30614 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 17a4fc443d4545efb5ffae32542ddab5: Generated new TSK 0
I20260709 12:21:28.558250 30614 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:21:28.588446 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:28.596465 30625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:28.597612 30626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:28.602901 23151 server_base.cc:1061] running on GCE node
W20260709 12:21:28.602946 30628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:28.605732 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:28.605960 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:28.606195 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599688606178 us; error 0 us; skew 500 ppm
I20260709 12:21:28.606844 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:28.609524 23151 webserver.cc:533] Webserver started at http://127.22.155.193:33521/ using document root <none> and password file <none>
I20260709 12:21:28.610031 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:28.610196 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:28.610531 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:28.611788 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/ts-0-root/instance:
uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
format_stamp: "Formatted at 2026-07-09 12:21:28 on dist-test-slave-p7fg"
I20260709 12:21:28.616793 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:21:28.620357 30633 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:28.621289 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:21:28.621634 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/ts-0-root
uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
format_stamp: "Formatted at 2026-07-09 12:21:28 on dist-test-slave-p7fg"
I20260709 12:21:28.621940 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:28.664204 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:28.665556 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:28.667263 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:28.669878 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:28.670113 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:28.670374 23151 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:28.670563 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:28.717504 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.193:34953
I20260709 12:21:28.717710 30695 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.193:34953 every 8 connection(s)
I20260709 12:21:28.722919 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:28.731375 30700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:28.732702 30701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:28.735004 30703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:28.738075 23151 server_base.cc:1061] running on GCE node
I20260709 12:21:28.740284 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:28.740531 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:28.740815 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599688740794 us; error 0 us; skew 500 ppm
I20260709 12:21:28.741457 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:28.745199 23151 webserver.cc:533] Webserver started at http://127.22.155.194:40199/ using document root <none> and password file <none>
I20260709 12:21:28.745877 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:28.746091 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:28.746501 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:28.746733 30696 heartbeater.cc:344] Connected to a master server at 127.22.155.254:37753
I20260709 12:21:28.747318 30696 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:28.748522 30696 heartbeater.cc:507] Master 127.22.155.254:37753 requested a full tablet report, sending...
I20260709 12:21:28.748593 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/ts-1-root/instance:
uuid: "4a9042c4154c442297159d1c9f1186b9"
format_stamp: "Formatted at 2026-07-09 12:21:28 on dist-test-slave-p7fg"
I20260709 12:21:28.751523 30569 ts_manager.cc:194] Registered new tserver with Master: 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:28.754117 30569 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36704
I20260709 12:21:28.754732 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:21:28.759801 30708 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:28.760844 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:21:28.761173 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/ts-1-root
uuid: "4a9042c4154c442297159d1c9f1186b9"
format_stamp: "Formatted at 2026-07-09 12:21:28 on dist-test-slave-p7fg"
I20260709 12:21:28.761490 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:28.776840 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:28.778218 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:28.779886 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:28.782582 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:28.782824 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:28.783082 23151 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:28.783260 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:28.832545 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.194:44363
I20260709 12:21:28.832737 30770 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.194:44363 every 8 connection(s)
I20260709 12:21:28.838294 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:28.847690 30774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:28.849622 30775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:28.850833 30777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:28.853344 23151 server_base.cc:1061] running on GCE node
I20260709 12:21:28.853963 30771 heartbeater.cc:344] Connected to a master server at 127.22.155.254:37753
I20260709 12:21:28.854449 30771 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:28.854525 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:28.854862 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:28.855054 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599688855030 us; error 0 us; skew 500 ppm
I20260709 12:21:28.855355 30771 heartbeater.cc:507] Master 127.22.155.254:37753 requested a full tablet report, sending...
I20260709 12:21:28.855778 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:28.857899 30569 ts_manager.cc:194] Registered new tserver with Master: 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:28.859035 23151 webserver.cc:533] Webserver started at http://127.22.155.195:45953/ using document root <none> and password file <none>
I20260709 12:21:28.859771 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:28.860023 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:28.860036 30569 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36714
I20260709 12:21:28.860528 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:28.862097 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/ts-2-root/instance:
uuid: "20c7a0cd21c3449587fdeeff565557d3"
format_stamp: "Formatted at 2026-07-09 12:21:28 on dist-test-slave-p7fg"
I20260709 12:21:28.867228 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:21:28.871565 30782 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:28.872563 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:21:28.873010 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/ts-2-root
uuid: "20c7a0cd21c3449587fdeeff565557d3"
format_stamp: "Formatted at 2026-07-09 12:21:28 on dist-test-slave-p7fg"
I20260709 12:21:28.873402 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:28.892434 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:28.893932 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:28.895699 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:28.898270 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:28.898509 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:28.898766 23151 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:28.898947 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:28.948268 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.195:45287
I20260709 12:21:28.948423 30844 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.195:45287 every 8 connection(s)
I20260709 12:21:28.954219 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:28.963762 30848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:28.964013 30849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:28.967940 30851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:28.968247 30845 heartbeater.cc:344] Connected to a master server at 127.22.155.254:37753
I20260709 12:21:28.968829 23151 server_base.cc:1061] running on GCE node
I20260709 12:21:28.969091 30845 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:28.970156 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:21:28.970247 30845 heartbeater.cc:507] Master 127.22.155.254:37753 requested a full tablet report, sending...
W20260709 12:21:28.970525 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:28.970784 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599688970751 us; error 0 us; skew 500 ppm
I20260709 12:21:28.971572 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:28.972966 30569 ts_manager.cc:194] Registered new tserver with Master: 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:28.974459 30569 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36728
I20260709 12:21:28.975481 23151 webserver.cc:533] Webserver started at http://127.22.155.196:40389/ using document root <none> and password file <none>
I20260709 12:21:28.976357 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:28.976682 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:28.977066 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:28.978741 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/ts-3-root/instance:
uuid: "d3ab9d21f8864b50a71b49c7d624584a"
format_stamp: "Formatted at 2026-07-09 12:21:28 on dist-test-slave-p7fg"
I20260709 12:21:28.984400 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:21:28.988438 30856 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:28.989560 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:21:28.989964 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/ts-3-root
uuid: "d3ab9d21f8864b50a71b49c7d624584a"
format_stamp: "Formatted at 2026-07-09 12:21:28 on dist-test-slave-p7fg"
I20260709 12:21:28.990298 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:29.010491 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:29.012027 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:29.013864 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:29.016145 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:29.016397 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:29.016707 23151 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:29.016918 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:29.066316 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.196:33441
I20260709 12:21:29.066511 30918 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.196:33441 every 8 connection(s)
I20260709 12:21:29.083137 30919 heartbeater.cc:344] Connected to a master server at 127.22.155.254:37753
I20260709 12:21:29.083683 30919 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:29.084561 30919 heartbeater.cc:507] Master 127.22.155.254:37753 requested a full tablet report, sending...
I20260709 12:21:29.087152 30569 ts_manager.cc:194] Registered new tserver with Master: d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:29.087888 23151 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.01765994s
I20260709 12:21:29.089288 30569 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36736
I20260709 12:21:29.120751 30569 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36746:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:21:29.372010 30736 tablet_service.cc:1511] Processing CreateTablet for tablet aec2e3f6d6be4c038a84a15ea8b61235 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:21:29.373667 30736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aec2e3f6d6be4c038a84a15ea8b61235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.378283 30810 tablet_service.cc:1511] Processing CreateTablet for tablet aec2e3f6d6be4c038a84a15ea8b61235 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:21:29.379957 30810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aec2e3f6d6be4c038a84a15ea8b61235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.387181 30735 tablet_service.cc:1511] Processing CreateTablet for tablet f0d63226f015480c84967f90ac595cc0 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:21:29.388015 30809 tablet_service.cc:1511] Processing CreateTablet for tablet 815af3bc37df4d158766ac2e615de683 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:21:29.388823 30735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d63226f015480c84967f90ac595cc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.389513 30809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 815af3bc37df4d158766ac2e615de683. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.397202 30734 tablet_service.cc:1511] Processing CreateTablet for tablet 0fb4b46162a04eeda49624c82070758e (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:21:29.397679 30808 tablet_service.cc:1511] Processing CreateTablet for tablet 0fb4b46162a04eeda49624c82070758e (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:21:29.398857 30734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fb4b46162a04eeda49624c82070758e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.398993 30808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fb4b46162a04eeda49624c82070758e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.402235 30884 tablet_service.cc:1511] Processing CreateTablet for tablet f0d63226f015480c84967f90ac595cc0 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:21:29.403859 30884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d63226f015480c84967f90ac595cc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.406077 30883 tablet_service.cc:1511] Processing CreateTablet for tablet 815af3bc37df4d158766ac2e615de683 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:21:29.408020 30883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 815af3bc37df4d158766ac2e615de683. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.409977 30882 tablet_service.cc:1511] Processing CreateTablet for tablet 0fb4b46162a04eeda49624c82070758e (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:21:29.411491 30882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fb4b46162a04eeda49624c82070758e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.414165 30807 tablet_service.cc:1511] Processing CreateTablet for tablet 0b6381e285f94a7ca02f638d09d0b3c2 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:21:29.415722 30807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b6381e285f94a7ca02f638d09d0b3c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.416214 30881 tablet_service.cc:1511] Processing CreateTablet for tablet 9be8d04f2ad34fd5b7c66aa68c8fa47a (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:21:29.417882 30881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be8d04f2ad34fd5b7c66aa68c8fa47a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.422235 30880 tablet_service.cc:1511] Processing CreateTablet for tablet eb65e812f06540bc9f1c2b1e3e13d41c (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:21:29.423875 30880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb65e812f06540bc9f1c2b1e3e13d41c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.425940 30806 tablet_service.cc:1511] Processing CreateTablet for tablet eb65e812f06540bc9f1c2b1e3e13d41c (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:21:29.427438 30806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb65e812f06540bc9f1c2b1e3e13d41c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.429306 30879 tablet_service.cc:1511] Processing CreateTablet for tablet c148832de74745608d983f2184cbf23f (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:21:29.429920 30805 tablet_service.cc:1511] Processing CreateTablet for tablet c148832de74745608d983f2184cbf23f (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:21:29.430986 30879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c148832de74745608d983f2184cbf23f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.431464 30805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c148832de74745608d983f2184cbf23f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.433943 30804 tablet_service.cc:1511] Processing CreateTablet for tablet 9361d602cd814a70acf6a5867a109d74 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:21:29.435417 30804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9361d602cd814a70acf6a5867a109d74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.436560 30878 tablet_service.cc:1511] Processing CreateTablet for tablet 7695652594064f568b2df572cb76e12a (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:21:29.438202 30878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7695652594064f568b2df572cb76e12a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.440445 30733 tablet_service.cc:1511] Processing CreateTablet for tablet 0b6381e285f94a7ca02f638d09d0b3c2 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:21:29.442021 30733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b6381e285f94a7ca02f638d09d0b3c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.443348 30877 tablet_service.cc:1511] Processing CreateTablet for tablet cabc74dfa2e44e0580c268f61d17e024 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:21:29.444929 30877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cabc74dfa2e44e0580c268f61d17e024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.445946 30732 tablet_service.cc:1511] Processing CreateTablet for tablet 9be8d04f2ad34fd5b7c66aa68c8fa47a (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:21:29.447423 30732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be8d04f2ad34fd5b7c66aa68c8fa47a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.449903 30803 tablet_service.cc:1511] Processing CreateTablet for tablet cabc74dfa2e44e0580c268f61d17e024 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:21:29.450453 30876 tablet_service.cc:1511] Processing CreateTablet for tablet 18a8098230e4404c9d5743dcac2c5aaa (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:21:29.451351 30803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cabc74dfa2e44e0580c268f61d17e024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.452019 30876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a8098230e4404c9d5743dcac2c5aaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.453944 30802 tablet_service.cc:1511] Processing CreateTablet for tablet 18a8098230e4404c9d5743dcac2c5aaa (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:21:29.455389 30802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a8098230e4404c9d5743dcac2c5aaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.457859 30875 tablet_service.cc:1511] Processing CreateTablet for tablet 9ac7c8095aaa457494024d09dfaaf1bb (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:21:29.459573 30875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ac7c8095aaa457494024d09dfaaf1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.459975 30731 tablet_service.cc:1511] Processing CreateTablet for tablet c148832de74745608d983f2184cbf23f (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:21:29.463244 30730 tablet_service.cc:1511] Processing CreateTablet for tablet 9361d602cd814a70acf6a5867a109d74 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:21:29.457962 30801 tablet_service.cc:1511] Processing CreateTablet for tablet de462b3788724f21b93b5cbb295c085a (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:21:29.470163 30729 tablet_service.cc:1511] Processing CreateTablet for tablet 7695652594064f568b2df572cb76e12a (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:21:29.473806 30728 tablet_service.cc:1511] Processing CreateTablet for tablet 18a8098230e4404c9d5743dcac2c5aaa (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:21:29.481004 30731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c148832de74745608d983f2184cbf23f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.481951 30728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a8098230e4404c9d5743dcac2c5aaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.482705 30801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de462b3788724f21b93b5cbb295c085a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.485448 30730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9361d602cd814a70acf6a5867a109d74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.491178 30727 tablet_service.cc:1511] Processing CreateTablet for tablet de462b3788724f21b93b5cbb295c085a (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:21:29.497176 30729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7695652594064f568b2df572cb76e12a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.501102 30727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de462b3788724f21b93b5cbb295c085a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:29.516422 30617 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:29.538141 30661 tablet_service.cc:1511] Processing CreateTablet for tablet aec2e3f6d6be4c038a84a15ea8b61235 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:21:29.539925 30661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aec2e3f6d6be4c038a84a15ea8b61235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.542092 30660 tablet_service.cc:1511] Processing CreateTablet for tablet f0d63226f015480c84967f90ac595cc0 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:21:29.543637 30660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d63226f015480c84967f90ac595cc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.558116 30659 tablet_service.cc:1511] Processing CreateTablet for tablet 815af3bc37df4d158766ac2e615de683 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:21:29.559870 30659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 815af3bc37df4d158766ac2e615de683. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.562037 30658 tablet_service.cc:1511] Processing CreateTablet for tablet 0b6381e285f94a7ca02f638d09d0b3c2 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:21:29.563760 30658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b6381e285f94a7ca02f638d09d0b3c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.565997 30657 tablet_service.cc:1511] Processing CreateTablet for tablet 9be8d04f2ad34fd5b7c66aa68c8fa47a (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:21:29.567572 30657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be8d04f2ad34fd5b7c66aa68c8fa47a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.570297 30656 tablet_service.cc:1511] Processing CreateTablet for tablet eb65e812f06540bc9f1c2b1e3e13d41c (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:21:29.571832 30656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb65e812f06540bc9f1c2b1e3e13d41c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.574441 30655 tablet_service.cc:1511] Processing CreateTablet for tablet 9361d602cd814a70acf6a5867a109d74 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:21:29.575989 30655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9361d602cd814a70acf6a5867a109d74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.578392 30654 tablet_service.cc:1511] Processing CreateTablet for tablet 7695652594064f568b2df572cb76e12a (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:21:29.579813 30654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7695652594064f568b2df572cb76e12a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.585704 30653 tablet_service.cc:1511] Processing CreateTablet for tablet cabc74dfa2e44e0580c268f61d17e024 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:21:29.592447 30810 tablet_service.cc:1511] Processing CreateTablet for tablet 006658e1213f4f8da089a9570e0a76b9 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:21:29.593861 30810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 006658e1213f4f8da089a9570e0a76b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.614888 30652 tablet_service.cc:1511] Processing CreateTablet for tablet de462b3788724f21b93b5cbb295c085a (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:21:29.616711 30652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de462b3788724f21b93b5cbb295c085a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.617374 30727 tablet_service.cc:1511] Processing CreateTablet for tablet 9ac7c8095aaa457494024d09dfaaf1bb (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:21:29.618229 30735 tablet_service.cc:1511] Processing CreateTablet for tablet 5c179d47d7f146ed83b56ea632997aa7 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:21:29.618749 30727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ac7c8095aaa457494024d09dfaaf1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.627578 30806 tablet_service.cc:1511] Processing CreateTablet for tablet 5c179d47d7f146ed83b56ea632997aa7 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:21:29.633359 30653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cabc74dfa2e44e0580c268f61d17e024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.643301 30806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c179d47d7f146ed83b56ea632997aa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.659993 30940 tablet_bootstrap.cc:492] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:29.679510 30736 tablet_service.cc:1511] Processing CreateTablet for tablet e87d449e2aa442ec87cb2b55b61d4496 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:21:29.686378 30736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e87d449e2aa442ec87cb2b55b61d4496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.710690 30658 tablet_service.cc:1511] Processing CreateTablet for tablet 9ac7c8095aaa457494024d09dfaaf1bb (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:21:29.717175 30658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ac7c8095aaa457494024d09dfaaf1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.717388 30803 tablet_service.cc:1511] Processing CreateTablet for tablet e87d449e2aa442ec87cb2b55b61d4496 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:21:29.719444 30803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e87d449e2aa442ec87cb2b55b61d4496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.731420 30939 tablet_bootstrap.cc:492] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:29.738270 30735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c179d47d7f146ed83b56ea632997aa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.739791 30877 tablet_service.cc:1511] Processing CreateTablet for tablet 006658e1213f4f8da089a9570e0a76b9 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:21:29.751569 30939 tablet_bootstrap.cc:654] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:29.760001 30696 heartbeater.cc:499] Master 127.22.155.254:37753 was elected leader, sending a full tablet report...
I20260709 12:21:29.761475 30733 tablet_service.cc:1511] Processing CreateTablet for tablet b78acfb4f1d649e4821c390039d2ede5 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:21:29.764130 30733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b78acfb4f1d649e4821c390039d2ede5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.772758 30881 tablet_service.cc:1511] Processing CreateTablet for tablet 5c179d47d7f146ed83b56ea632997aa7 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:21:29.774060 30940 tablet_bootstrap.cc:654] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:29.782585 30882 tablet_service.cc:1511] Processing CreateTablet for tablet b78acfb4f1d649e4821c390039d2ede5 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:21:29.793081 30878 tablet_service.cc:1511] Processing CreateTablet for tablet b33ccb8b23d8455a990ef1cb50271887 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:21:29.795353 30807 tablet_service.cc:1511] Processing CreateTablet for tablet b33ccb8b23d8455a990ef1cb50271887 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:21:29.800539 30807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33ccb8b23d8455a990ef1cb50271887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.801337 30881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c179d47d7f146ed83b56ea632997aa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.803229 30941 tablet_bootstrap.cc:492] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:29.804598 30880 tablet_service.cc:1511] Processing CreateTablet for tablet 4326b71a8ff545259df55b4ab0564f48 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:21:29.806056 30880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4326b71a8ff545259df55b4ab0564f48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.809235 30882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b78acfb4f1d649e4821c390039d2ede5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.813192 30804 tablet_service.cc:1511] Processing CreateTablet for tablet 4326b71a8ff545259df55b4ab0564f48 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:21:29.795818 30660 tablet_service.cc:1511] Processing CreateTablet for tablet 006658e1213f4f8da089a9570e0a76b9 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:21:29.814596 30804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4326b71a8ff545259df55b4ab0564f48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.815515 30660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 006658e1213f4f8da089a9570e0a76b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.814596 30878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33ccb8b23d8455a990ef1cb50271887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.800254 30728 tablet_service.cc:1511] Processing CreateTablet for tablet 4326b71a8ff545259df55b4ab0564f48 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:21:29.856089 30941 tablet_bootstrap.cc:654] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:29.858800 30657 tablet_service.cc:1511] Processing CreateTablet for tablet e87d449e2aa442ec87cb2b55b61d4496 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:21:29.851826 30942 tablet_bootstrap.cc:492] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:29.860981 30728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4326b71a8ff545259df55b4ab0564f48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.861313 30877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 006658e1213f4f8da089a9570e0a76b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.863196 30771 heartbeater.cc:499] Master 127.22.155.254:37753 was elected leader, sending a full tablet report...
I20260709 12:21:29.866012 30939 tablet_bootstrap.cc:492] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:29.872227 30939 ts_tablet_manager.cc:1403] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.141s	user 0.014s	sys 0.000s
I20260709 12:21:29.878585 30939 raft_consensus.cc:359] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:29.879352 30939 raft_consensus.cc:385] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:29.879655 30939 raft_consensus.cc:740] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:29.886929 30939 consensus_queue.cc:260] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:29.901409 30881 tablet_service.cc:1511] Processing CreateTablet for tablet 2d372d3fc5dd43d1880a4a932c83d7da (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:21:29.902456 30736 tablet_service.cc:1511] Processing CreateTablet for tablet 4f5d808cf6da46a0894e888635591cc8 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:21:29.903141 30881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d372d3fc5dd43d1880a4a932c83d7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.903811 30736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f5d808cf6da46a0894e888635591cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.915210 30654 tablet_service.cc:1511] Processing CreateTablet for tablet b78acfb4f1d649e4821c390039d2ede5 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:21:29.918334 30653 tablet_service.cc:1511] Processing CreateTablet for tablet 4f5d808cf6da46a0894e888635591cc8 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:21:29.860275 30657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e87d449e2aa442ec87cb2b55b61d4496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.929028 30942 tablet_bootstrap.cc:654] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:29.915210 30658 tablet_service.cc:1511] Processing CreateTablet for tablet b33ccb8b23d8455a990ef1cb50271887 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
W20260709 12:21:29.932171 30556 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 46835.9us
I20260709 12:21:29.946424 30654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b78acfb4f1d649e4821c390039d2ede5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.949323 30653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f5d808cf6da46a0894e888635591cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.949000 30804 tablet_service.cc:1511] Processing CreateTablet for tablet 4f5d808cf6da46a0894e888635591cc8 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:21:29.951017 30804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f5d808cf6da46a0894e888635591cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.948951 30728 tablet_service.cc:1511] Processing CreateTablet for tablet 2d372d3fc5dd43d1880a4a932c83d7da (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:21:29.949000 30661 tablet_service.cc:1511] Processing CreateTablet for tablet 2d372d3fc5dd43d1880a4a932c83d7da (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:21:29.953596 30728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d372d3fc5dd43d1880a4a932c83d7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.954059 30661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d372d3fc5dd43d1880a4a932c83d7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.960414 30658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33ccb8b23d8455a990ef1cb50271887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.964205 30803 tablet_service.cc:1511] Processing CreateTablet for tablet 2fee969f4c2a4579ab7911212a86bf67 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:21:29.970198 30803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fee969f4c2a4579ab7911212a86bf67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.977952 30845 heartbeater.cc:499] Master 127.22.155.254:37753 was elected leader, sending a full tablet report...
I20260709 12:21:29.994757 30941 tablet_bootstrap.cc:492] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:29.995453 30941 ts_tablet_manager.cc:1403] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.195s	user 0.017s	sys 0.017s
I20260709 12:21:29.994757 30940 tablet_bootstrap.cc:492] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:29.996089 30880 tablet_service.cc:1511] Processing CreateTablet for tablet 2fee969f4c2a4579ab7911212a86bf67 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:21:29.997097 30940 ts_tablet_manager.cc:1403] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.337s	user 0.027s	sys 0.039s
I20260709 12:21:29.997624 30880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fee969f4c2a4579ab7911212a86bf67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.997754 30939 ts_tablet_manager.cc:1434] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.125s	user 0.006s	sys 0.021s
I20260709 12:21:30.008734 30656 tablet_service.cc:1511] Processing CreateTablet for tablet 2fee969f4c2a4579ab7911212a86bf67 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:21:30.010295 30656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fee969f4c2a4579ab7911212a86bf67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.016772 30939 tablet_bootstrap.cc:492] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:30.024246 30804 tablet_service.cc:1511] Processing CreateTablet for tablet 439d52649ecc46e58d714b9351576dd5 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:21:30.026358 30804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 439d52649ecc46e58d714b9351576dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.010305 30727 tablet_service.cc:1511] Processing CreateTablet for tablet 439d52649ecc46e58d714b9351576dd5 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:21:30.042929 30728 tablet_service.cc:1511] Processing CreateTablet for tablet b7f3fc82ff104135851cce7357eda3ec (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:21:30.043126 30941 raft_consensus.cc:359] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:30.055152 30941 raft_consensus.cc:385] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.050242 30878 tablet_service.cc:1511] Processing CreateTablet for tablet 439d52649ecc46e58d714b9351576dd5 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:21:30.055563 30941 raft_consensus.cc:740] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:30.056519 30878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 439d52649ecc46e58d714b9351576dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.056569 30941 consensus_queue.cc:260] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:30.057461 30807 tablet_service.cc:1511] Processing CreateTablet for tablet b7f3fc82ff104135851cce7357eda3ec (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:21:30.059187 30807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f3fc82ff104135851cce7357eda3ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.054315 30939 tablet_bootstrap.cc:654] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:30.054028 30656 tablet_service.cc:1511] Processing CreateTablet for tablet b7f3fc82ff104135851cce7357eda3ec (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:21:30.075696 30656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f3fc82ff104135851cce7357eda3ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.048769 30727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 439d52649ecc46e58d714b9351576dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.081459 30728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f3fc82ff104135851cce7357eda3ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.084774 30877 tablet_service.cc:1511] Processing CreateTablet for tablet 38606820b9b349d3ad9f9fae03de5e86 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:21:30.086705 30877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38606820b9b349d3ad9f9fae03de5e86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.092891 30919 heartbeater.cc:499] Master 127.22.155.254:37753 was elected leader, sending a full tablet report...
I20260709 12:21:30.093763 30940 raft_consensus.cc:359] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:30.095094 30940 raft_consensus.cc:385] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.095561 30940 raft_consensus.cc:740] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
W20260709 12:21:30.096899 30772 tablet.cc:2406] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:21:30.113936 30940 consensus_queue.cc:260] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:30.121704 30654 tablet_service.cc:1511] Processing CreateTablet for tablet 38606820b9b349d3ad9f9fae03de5e86 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:21:30.122844 30942 tablet_bootstrap.cc:492] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:30.123378 30654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38606820b9b349d3ad9f9fae03de5e86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.124897 30942 ts_tablet_manager.cc:1403] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.299s	user 0.029s	sys 0.002s
I20260709 12:21:30.138123 30942 raft_consensus.cc:359] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:30.150985 30733 tablet_service.cc:1511] Processing CreateTablet for tablet 38606820b9b349d3ad9f9fae03de5e86 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:21:30.157368 30939 tablet_bootstrap.cc:492] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:30.157980 30939 ts_tablet_manager.cc:1403] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.142s	user 0.005s	sys 0.018s
I20260709 12:21:30.160372 30941 ts_tablet_manager.cc:1434] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.165s	user 0.009s	sys 0.017s
I20260709 12:21:30.161749 30941 tablet_bootstrap.cc:492] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:30.146708 30942 raft_consensus.cc:385] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.165148 30942 raft_consensus.cc:740] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:30.166100 30942 consensus_queue.cc:260] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:30.166874 30733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38606820b9b349d3ad9f9fae03de5e86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.166893 30806 tablet_service.cc:1511] Processing CreateTablet for tablet b7bda85e3c87401d84e81120f451dec8 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:21:30.168802 30806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7bda85e3c87401d84e81120f451dec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.168874 30940 ts_tablet_manager.cc:1434] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.171s	user 0.016s	sys 0.000s
I20260709 12:21:30.169351 30939 raft_consensus.cc:359] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:30.170419 30939 raft_consensus.cc:385] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.170778 30946 raft_consensus.cc:493] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.171350 30946 raft_consensus.cc:515] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:30.170065 30940 tablet_bootstrap.cc:492] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:30.170809 30939 raft_consensus.cc:740] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:30.187740 30939 consensus_queue.cc:260] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:30.201630 30882 tablet_service.cc:1511] Processing CreateTablet for tablet b7bda85e3c87401d84e81120f451dec8 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:21:30.203084 30882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7bda85e3c87401d84e81120f451dec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.205754 30942 ts_tablet_manager.cc:1434] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.002s
I20260709 12:21:30.207064 30942 tablet_bootstrap.cc:492] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:30.209959 30653 tablet_service.cc:1511] Processing CreateTablet for tablet b7bda85e3c87401d84e81120f451dec8 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:21:30.211378 30941 tablet_bootstrap.cc:654] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:30.211678 30653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7bda85e3c87401d84e81120f451dec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.221598 30736 tablet_service.cc:1511] Processing CreateTablet for tablet 4f8edecc2bf945e2bf553a7708f0f2cb (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:21:30.223522 30736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f8edecc2bf945e2bf553a7708f0f2cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.238768 30942 tablet_bootstrap.cc:654] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:30.246196 30946 leader_election.cc:290] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:30.248085 30941 tablet_bootstrap.cc:492] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:30.248742 30941 ts_tablet_manager.cc:1403] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.087s	user 0.014s	sys 0.000s
I20260709 12:21:30.251718 30941 raft_consensus.cc:359] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:30.252403 30941 raft_consensus.cc:385] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.252696 30941 raft_consensus.cc:740] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:30.253536 30941 consensus_queue.cc:260] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:30.256369 30941 ts_tablet_manager.cc:1434] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:21:30.257808 30941 tablet_bootstrap.cc:492] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:30.265079 30940 tablet_bootstrap.cc:654] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:30.265545 30948 raft_consensus.cc:493] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.266130 30948 raft_consensus.cc:515] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:30.267864 30941 tablet_bootstrap.cc:654] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:30.271582 30948 leader_election.cc:290] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:30.284719 30941 tablet_bootstrap.cc:492] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:30.286512 30941 ts_tablet_manager.cc:1403] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.013s
I20260709 12:21:30.287662 30950 raft_consensus.cc:493] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.288431 30950 raft_consensus.cc:515] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:30.293959 30804 tablet_service.cc:1511] Processing CreateTablet for tablet 4f8edecc2bf945e2bf553a7708f0f2cb (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:21:30.296044 30804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f8edecc2bf945e2bf553a7708f0f2cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.297737 30654 tablet_service.cc:1511] Processing CreateTablet for tablet 0fc72ff638c0425f9c75bb21e2b99dd3 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:21:30.299194 30654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fc72ff638c0425f9c75bb21e2b99dd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.301592 30950 leader_election.cc:290] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:30.304155 30939 ts_tablet_manager.cc:1434] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.146s	user 0.012s	sys 0.000s
I20260709 12:21:30.305477 30939 tablet_bootstrap.cc:492] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:30.349507 30880 tablet_service.cc:1511] Processing CreateTablet for tablet 4f8edecc2bf945e2bf553a7708f0f2cb (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:21:30.350675 30727 tablet_service.cc:1511] Processing CreateTablet for tablet 0fc72ff638c0425f9c75bb21e2b99dd3 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:21:30.351951 30880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f8edecc2bf945e2bf553a7708f0f2cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.353061 30727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fc72ff638c0425f9c75bb21e2b99dd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.370366 30942 tablet_bootstrap.cc:492] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:30.371106 30942 ts_tablet_manager.cc:1403] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.164s	user 0.024s	sys 0.029s
I20260709 12:21:30.359776 30941 raft_consensus.cc:359] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:30.374886 30941 raft_consensus.cc:385] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.375173 30941 raft_consensus.cc:740] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:30.375965 30941 consensus_queue.cc:260] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:30.386694 30942 raft_consensus.cc:359] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:30.387653 30942 raft_consensus.cc:385] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.387953 30942 raft_consensus.cc:740] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:30.406351 30941 ts_tablet_manager.cc:1434] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.119s	user 0.008s	sys 0.000s
I20260709 12:21:30.407163 30939 tablet_bootstrap.cc:654] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:30.413312 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb65e812f06540bc9f1c2b1e3e13d41c" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:30.421970 30940 tablet_bootstrap.cc:492] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:30.421656 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec2e3f6d6be4c038a84a15ea8b61235" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:30.422672 30940 ts_tablet_manager.cc:1403] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.253s	user 0.042s	sys 0.036s
W20260709 12:21:30.423689 30785 leader_election.cc:343] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:30.424021 30712 leader_election.cc:343] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:30.425690 30807 tablet_service.cc:1511] Processing CreateTablet for tablet 0fc72ff638c0425f9c75bb21e2b99dd3 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:21:30.426344 30940 raft_consensus.cc:359] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:30.427191 30807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fc72ff638c0425f9c75bb21e2b99dd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.427142 30940 raft_consensus.cc:385] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.427681 30940 raft_consensus.cc:740] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:30.428714 30941 tablet_bootstrap.cc:492] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:30.428671 30940 consensus_queue.cc:260] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:30.430100 30942 consensus_queue.cc:260] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:30.431154 30940 ts_tablet_manager.cc:1434] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:21:30.432420 30940 tablet_bootstrap.cc:492] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:30.434401 30958 raft_consensus.cc:493] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.434994 30958 raft_consensus.cc:515] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:30.437479 30958 leader_election.cc:290] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:30.439461 30942 ts_tablet_manager.cc:1434] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.001s
I20260709 12:21:30.439738 30940 tablet_bootstrap.cc:654] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:30.440711 30942 tablet_bootstrap.cc:492] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:30.446120 30939 tablet_bootstrap.cc:492] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:30.446959 30939 ts_tablet_manager.cc:1403] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.142s	user 0.015s	sys 0.000s
I20260709 12:21:30.450750 30939 raft_consensus.cc:359] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:30.451666 30939 raft_consensus.cc:385] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.452098 30939 raft_consensus.cc:740] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:30.452296 30942 tablet_bootstrap.cc:654] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:30.453087 30939 consensus_queue.cc:260] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:30.442924 30941 tablet_bootstrap.cc:654] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:30.455899 30939 ts_tablet_manager.cc:1434] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:21:30.457353 30939 tablet_bootstrap.cc:492] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:30.503645 30948 raft_consensus.cc:493] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.505455 30948 raft_consensus.cc:515] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:30.508265 30882 tablet_service.cc:1511] Processing CreateTablet for tablet c48114d81f8f4cf08f9665b697bc5560 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:21:30.510687 30948 leader_election.cc:290] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:30.511538 30882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48114d81f8f4cf08f9665b697bc5560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.514917 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec2e3f6d6be4c038a84a15ea8b61235" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:30.516420 30941 tablet_bootstrap.cc:492] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:30.501811 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de462b3788724f21b93b5cbb295c085a" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:30.517689 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de462b3788724f21b93b5cbb295c085a" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:30.516134 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d63226f015480c84967f90ac595cc0" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:30.519387 30746 raft_consensus.cc:2468] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 0.
W20260709 12:21:30.522173 30712 leader_election.cc:343] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:30.507686 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d63226f015480c84967f90ac595cc0" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:30.517683 30941 ts_tablet_manager.cc:1403] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.002s
I20260709 12:21:30.535230 30656 tablet_service.cc:1511] Processing CreateTablet for tablet c48114d81f8f4cf08f9665b697bc5560 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:21:30.537919 30634 leader_election.cc:304] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:30.538483 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb65e812f06540bc9f1c2b1e3e13d41c" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
W20260709 12:21:30.549829 30709 leader_election.cc:343] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:30.551064 30709 leader_election.cc:304] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:30.553933 30958 raft_consensus.cc:2749] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:30.559010 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b6381e285f94a7ca02f638d09d0b3c2" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
W20260709 12:21:30.564409 30783 leader_election.cc:343] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:30.564749 30636 leader_election.cc:343] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:30.565331 30783 leader_election.cc:304] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:30.566846 30950 raft_consensus.cc:2749] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:30.570055 30709 leader_election.cc:343] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:30.573475 30948 raft_consensus.cc:2804] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:30.589895 30948 raft_consensus.cc:493] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:30.590395 30948 raft_consensus.cc:3060] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.592327 30880 tablet_service.cc:1511] Processing CreateTablet for tablet baad7ab904cc431381366c54397a57ef (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:21:30.594441 30880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baad7ab904cc431381366c54397a57ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.596037 30951 raft_consensus.cc:493] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.574683 30939 tablet_bootstrap.cc:654] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:30.597173 30942 tablet_bootstrap.cc:492] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:30.596926 30951 raft_consensus.cc:515] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:30.598176 30942 ts_tablet_manager.cc:1403] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.158s	user 0.048s	sys 0.024s
I20260709 12:21:30.577688 30804 tablet_service.cc:1511] Processing CreateTablet for tablet baad7ab904cc431381366c54397a57ef (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:21:30.603384 30804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baad7ab904cc431381366c54397a57ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.602865 30951 leader_election.cc:290] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:30.608274 30942 raft_consensus.cc:359] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:30.609310 30942 raft_consensus.cc:385] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.609697 30942 raft_consensus.cc:740] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:30.610411 30807 tablet_service.cc:1511] Processing CreateTablet for tablet fda0258f575243bd910da13e828fb6f6 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:21:30.611106 30942 consensus_queue.cc:260] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
W20260709 12:21:30.578976 30617 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:30.582942 30941 raft_consensus.cc:359] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:30.585121 30656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48114d81f8f4cf08f9665b697bc5560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.613317 30807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fda0258f575243bd910da13e828fb6f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.614634 30942 ts_tablet_manager.cc:1434] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 12:21:30.614760 30654 tablet_service.cc:1511] Processing CreateTablet for tablet baad7ab904cc431381366c54397a57ef (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:21:30.616467 30654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baad7ab904cc431381366c54397a57ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.616961 30942 tablet_bootstrap.cc:492] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:30.620774 30941 raft_consensus.cc:385] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.621243 30941 raft_consensus.cc:740] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:30.622397 30941 consensus_queue.cc:260] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:30.624162 30877 tablet_service.cc:1511] Processing CreateTablet for tablet fda0258f575243bd910da13e828fb6f6 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:21:30.625949 30877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fda0258f575243bd910da13e828fb6f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.626365 30942 tablet_bootstrap.cc:654] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:30.626153 30636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 77600us
I20260709 12:21:30.586989 30940 tablet_bootstrap.cc:492] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:30.631035 30940 ts_tablet_manager.cc:1403] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.199s	user 0.007s	sys 0.022s
I20260709 12:21:30.630923 30709 leader_election.cc:304] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
W20260709 12:21:30.632326 30709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 62359us
I20260709 12:21:30.632570 30958 raft_consensus.cc:2749] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:30.633507 30634 leader_election.cc:343] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:30.635100 30948 raft_consensus.cc:515] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:30.640579 30940 raft_consensus.cc:359] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:30.647878 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b6381e285f94a7ca02f638d09d0b3c2" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:30.649370 30727 tablet_service.cc:1511] Processing CreateTablet for tablet c48114d81f8f4cf08f9665b697bc5560 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
W20260709 12:21:30.650244 30637 leader_election.cc:343] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:30.651036 30727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48114d81f8f4cf08f9665b697bc5560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.650895 30637 leader_election.cc:304] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:30.660544 30939 tablet_bootstrap.cc:492] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:30.661499 30939 ts_tablet_manager.cc:1403] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.204s	user 0.009s	sys 0.016s
I20260709 12:21:30.663944 30806 tablet_service.cc:1511] Processing CreateTablet for tablet 82bb30237ea045c79aa6eb181bc3e692 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:21:30.665633 30948 leader_election.cc:290] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:30.666011 30806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82bb30237ea045c79aa6eb181bc3e692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.666819 30948 raft_consensus.cc:2749] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:30.670598 30942 tablet_bootstrap.cc:492] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:30.671269 30942 ts_tablet_manager.cc:1403] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.055s	user 0.019s	sys 0.000s
I20260709 12:21:30.675866 30948 raft_consensus.cc:493] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.676455 30948 raft_consensus.cc:515] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:30.677301 30878 tablet_service.cc:1511] Processing CreateTablet for tablet e93f0e0819f8466fad08603e540dc22e (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:21:30.677927 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d63226f015480c84967f90ac595cc0" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:30.678798 30878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93f0e0819f8466fad08603e540dc22e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.680233 30948 leader_election.cc:290] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:30.680938 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be8d04f2ad34fd5b7c66aa68c8fa47a" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:30.681770 30894 raft_consensus.cc:2468] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 0.
W20260709 12:21:30.683357 30636 leader_election.cc:343] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:30.683156 30803 tablet_service.cc:1511] Processing CreateTablet for tablet e946ad6dd9cb42ad93987cebde13ba9a (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:21:30.685743 30803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e946ad6dd9cb42ad93987cebde13ba9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.692690 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d63226f015480c84967f90ac595cc0" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:30.686141 30736 tablet_service.cc:1511] Processing CreateTablet for tablet fda0258f575243bd910da13e828fb6f6 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:21:30.693511 30746 raft_consensus.cc:3060] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.694831 30736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fda0258f575243bd910da13e828fb6f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.652151 30940 raft_consensus.cc:385] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.698799 30940 raft_consensus.cc:740] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:30.700130 30940 consensus_queue.cc:260] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:30.703300 30940 ts_tablet_manager.cc:1434] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.001s
I20260709 12:21:30.707582 30746 raft_consensus.cc:2468] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:30.684211 30636 leader_election.cc:304] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:30.709324 30948 raft_consensus.cc:2804] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:30.709811 30948 raft_consensus.cc:493] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:30.710170 30948 raft_consensus.cc:3060] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.721915 30733 tablet_service.cc:1511] Processing CreateTablet for tablet 82bb30237ea045c79aa6eb181bc3e692 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:21:30.723580 30733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82bb30237ea045c79aa6eb181bc3e692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.724891 30634 leader_election.cc:304] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:30.725142 30940 tablet_bootstrap.cc:492] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:30.727125 30942 raft_consensus.cc:359] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:30.728129 30942 raft_consensus.cc:385] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.728503 30942 raft_consensus.cc:740] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:30.729306 30939 raft_consensus.cc:359] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:30.730233 30939 raft_consensus.cc:385] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.730607 30939 raft_consensus.cc:740] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:30.720341 30728 tablet_service.cc:1511] Processing CreateTablet for tablet e93f0e0819f8466fad08603e540dc22e (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:21:30.731855 30728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93f0e0819f8466fad08603e540dc22e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.737617 30939 consensus_queue.cc:260] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:30.743610 30939 ts_tablet_manager.cc:1434] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.082s	user 0.005s	sys 0.003s
W20260709 12:21:30.736244 30637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 85612.3us
I20260709 12:21:30.748507 30942 consensus_queue.cc:260] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:30.749894 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be8d04f2ad34fd5b7c66aa68c8fa47a" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:30.751899 30877 tablet_service.cc:1511] Processing CreateTablet for tablet e946ad6dd9cb42ad93987cebde13ba9a (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:21:30.754861 30976 raft_consensus.cc:2804] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:30.763414 30976 raft_consensus.cc:697] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:21:30.764503 30976 consensus_queue.cc:237] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:30.761759 30735 tablet_service.cc:1511] Processing CreateTablet for tablet 77a02078ac834032ac607943e7b3d175 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:21:30.768428 30877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e946ad6dd9cb42ad93987cebde13ba9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.758203 30941 ts_tablet_manager.cc:1434] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.228s	user 0.015s	sys 0.008s
I20260709 12:21:30.776098 30735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a02078ac834032ac607943e7b3d175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.776103 30940 tablet_bootstrap.cc:654] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:30.781481 30634 leader_election.cc:343] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:30.782639 30654 tablet_service.cc:1511] Processing CreateTablet for tablet 82bb30237ea045c79aa6eb181bc3e692 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:21:30.783577 30941 tablet_bootstrap.cc:492] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:30.783664 30657 tablet_service.cc:1511] Processing CreateTablet for tablet e946ad6dd9cb42ad93987cebde13ba9a (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:21:30.785837 30942 ts_tablet_manager.cc:1434] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.114s	user 0.007s	sys 0.001s
I20260709 12:21:30.785915 30653 tablet_service.cc:1511] Processing CreateTablet for tablet e93f0e0819f8466fad08603e540dc22e (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:21:30.787396 30942 tablet_bootstrap.cc:492] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:30.788487 30939 tablet_bootstrap.cc:492] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:30.788553 30566 catalog_manager.cc:5697] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:30.784168 30654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82bb30237ea045c79aa6eb181bc3e692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.792462 30653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93f0e0819f8466fad08603e540dc22e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.793210 30657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e946ad6dd9cb42ad93987cebde13ba9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.794509 30807 tablet_service.cc:1511] Processing CreateTablet for tablet 77a02078ac834032ac607943e7b3d175 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:21:30.795836 30807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a02078ac834032ac607943e7b3d175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.801265 30881 tablet_service.cc:1511] Processing CreateTablet for tablet 77a02078ac834032ac607943e7b3d175 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:21:30.802935 30881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a02078ac834032ac607943e7b3d175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.774389 30948 raft_consensus.cc:515] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:30.811906 30948 leader_election.cc:290] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:30.812906 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be8d04f2ad34fd5b7c66aa68c8fa47a" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:30.813643 30894 raft_consensus.cc:3060] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.817231 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be8d04f2ad34fd5b7c66aa68c8fa47a" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:30.818418 30661 tablet_service.cc:1511] Processing CreateTablet for tablet 7f56cad4068d4388bf572777bcfb89b3 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260709 12:21:30.818987 30634 leader_election.cc:343] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:30.820099 30661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f56cad4068d4388bf572777bcfb89b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.833066 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be8d04f2ad34fd5b7c66aa68c8fa47a" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:30.834424 30670 raft_consensus.cc:2393] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3ab9d21f8864b50a71b49c7d624584a in current term 1: Already voted for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in this term.
I20260709 12:21:30.842631 30734 tablet_service.cc:1511] Processing CreateTablet for tablet 7f56cad4068d4388bf572777bcfb89b3 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:21:30.844259 30734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f56cad4068d4388bf572777bcfb89b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.848448 30805 tablet_service.cc:1511] Processing CreateTablet for tablet 7f56cad4068d4388bf572777bcfb89b3 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:21:30.850037 30805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f56cad4068d4388bf572777bcfb89b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.850498 30882 tablet_service.cc:1511] Processing CreateTablet for tablet 6a1ba3aa111d4c5e8558a89abec0aa64 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:21:30.852038 30882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a1ba3aa111d4c5e8558a89abec0aa64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.853847 30950 raft_consensus.cc:493] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.854416 30950 raft_consensus.cc:515] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:30.854725 30729 tablet_service.cc:1511] Processing CreateTablet for tablet 6a1ba3aa111d4c5e8558a89abec0aa64 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:21:30.855366 30894 raft_consensus.cc:2468] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:30.856215 30729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a1ba3aa111d4c5e8558a89abec0aa64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.857652 30950 leader_election.cc:290] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:30.861627 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb4b46162a04eeda49624c82070758e" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:30.862432 30893 raft_consensus.cc:2468] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 0.
I20260709 12:21:30.865623 30636 leader_election.cc:304] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:30.867369 30785 leader_election.cc:304] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:30.867781 30940 tablet_bootstrap.cc:492] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:30.868484 30950 raft_consensus.cc:2804] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:30.869189 30950 raft_consensus.cc:493] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:30.869571 30950 raft_consensus.cc:3060] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.868458 30940 ts_tablet_manager.cc:1403] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.144s	user 0.010s	sys 0.006s
I20260709 12:21:30.872437 30948 raft_consensus.cc:2804] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:30.875975 30948 raft_consensus.cc:697] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:21:30.877094 30948 consensus_queue.cc:237] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:30.882228 30656 tablet_service.cc:1511] Processing CreateTablet for tablet 6a1ba3aa111d4c5e8558a89abec0aa64 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:21:30.884320 30656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a1ba3aa111d4c5e8558a89abec0aa64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.884423 30810 tablet_service.cc:1511] Processing CreateTablet for tablet b2f2ae9f62734cf59b3d5477d92760cb (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:21:30.891307 30810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2f2ae9f62734cf59b3d5477d92760cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.893894 30951 raft_consensus.cc:493] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.894510 30951 raft_consensus.cc:515] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:30.925693 30939 tablet_bootstrap.cc:654] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:30.941432 30880 tablet_service.cc:1511] Processing CreateTablet for tablet b2f2ae9f62734cf59b3d5477d92760cb (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:21:30.943075 30880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2f2ae9f62734cf59b3d5477d92760cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.948155 30660 tablet_service.cc:1511] Processing CreateTablet for tablet b2f2ae9f62734cf59b3d5477d92760cb (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:21:30.948755 30976 raft_consensus.cc:493] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.949539 30976 raft_consensus.cc:515] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:30.950690 30660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2f2ae9f62734cf59b3d5477d92760cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.950706 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be8d04f2ad34fd5b7c66aa68c8fa47a" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:30.954005 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec2e3f6d6be4c038a84a15ea8b61235" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:30.954371 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec2e3f6d6be4c038a84a15ea8b61235" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:30.954828 30746 raft_consensus.cc:2468] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 0.
I20260709 12:21:30.955271 30820 raft_consensus.cc:2468] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 0.
I20260709 12:21:30.956171 30634 leader_election.cc:304] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:30.957376 30978 raft_consensus.cc:2804] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:30.957835 30978 raft_consensus.cc:493] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:30.958199 30978 raft_consensus.cc:3060] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.952343 30976 leader_election.cc:290] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
W20260709 12:21:30.959740 30857 leader_election.cc:343] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:30.960415 30857 leader_election.cc:304] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:30.963217 30942 tablet_bootstrap.cc:654] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:30.967144 30950 raft_consensus.cc:515] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:30.967566 30978 raft_consensus.cc:515] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:30.969607 30951 leader_election.cc:290] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:30.970444 30951 raft_consensus.cc:2749] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:30.978108 30940 raft_consensus.cc:359] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:30.982339 30801 tablet_service.cc:1511] Processing CreateTablet for tablet 69a04a5cd9b143daba902d508029dcb5 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:21:30.998852 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec2e3f6d6be4c038a84a15ea8b61235" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:30.999075 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb4b46162a04eeda49624c82070758e" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:30.970528 30941 tablet_bootstrap.cc:654] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:31.004266 30801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69a04a5cd9b143daba902d508029dcb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.005865 30978 leader_election.cc:290] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:31.006671 30657 tablet_service.cc:1511] Processing CreateTablet for tablet f61dc8e98f804681b0815e953b2d2ad1 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:21:31.006985 30727 tablet_service.cc:1511] Processing CreateTablet for tablet 69a04a5cd9b143daba902d508029dcb5 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:21:31.008234 30657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f61dc8e98f804681b0815e953b2d2ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.004720 30746 raft_consensus.cc:3060] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:31.004850 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec2e3f6d6be4c038a84a15ea8b61235" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:31.000337 30878 tablet_service.cc:1511] Processing CreateTablet for tablet 69a04a5cd9b143daba902d508029dcb5 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:21:31.009112 30820 raft_consensus.cc:3060] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:31.009678 30878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69a04a5cd9b143daba902d508029dcb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.002633 30940 raft_consensus.cc:385] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:31.013065 30940 raft_consensus.cc:740] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:31.013933 30940 consensus_queue.cc:260] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:31.026531 30727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69a04a5cd9b143daba902d508029dcb5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:31.024042 30783 leader_election.cc:343] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:31.031633 30820 raft_consensus.cc:2468] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:31.038769 30951 raft_consensus.cc:493] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.054708 30958 raft_consensus.cc:493] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.055368 30958 raft_consensus.cc:515] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:31.059129 30958 leader_election.cc:290] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:31.061049 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb4b46162a04eeda49624c82070758e" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:31.061420 30939 tablet_bootstrap.cc:492] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:31.062001 30939 ts_tablet_manager.cc:1403] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.274s	user 0.011s	sys 0.005s
I20260709 12:21:31.062824 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b6381e285f94a7ca02f638d09d0b3c2" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:31.051373 30951 raft_consensus.cc:515] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:31.063580 30670 raft_consensus.cc:2468] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 0.
W20260709 12:21:31.065516 30783 leader_election.cc:343] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:31.065810 30951 leader_election.cc:290] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:31.066601 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b6381e285f94a7ca02f638d09d0b3c2" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:31.067108 30709 leader_election.cc:304] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
W20260709 12:21:31.068145 30712 leader_election.cc:343] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:31.065428 30939 raft_consensus.cc:359] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:31.068821 30939 raft_consensus.cc:385] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:31.069211 30939 raft_consensus.cc:740] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:31.069281 30958 raft_consensus.cc:2804] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:31.069748 30958 raft_consensus.cc:493] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:31.070143 30958 raft_consensus.cc:3060] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:31.070252 30939 consensus_queue.cc:260] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:31.032480 30746 raft_consensus.cc:2468] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:31.081866 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb4b46162a04eeda49624c82070758e" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:31.082641 30894 raft_consensus.cc:3060] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:31.089149 30807 tablet_service.cc:1511] Processing CreateTablet for tablet f61dc8e98f804681b0815e953b2d2ad1 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:21:31.090667 30807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f61dc8e98f804681b0815e953b2d2ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.091320 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
W20260709 12:21:31.093159 30860 leader_election.cc:343] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:31.033600 30637 leader_election.cc:304] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
W20260709 12:21:31.094285 30637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 60801.2us
I20260709 12:21:31.077905 30950 leader_election.cc:290] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:31.097150 30653 tablet_service.cc:1511] Processing CreateTablet for tablet fd8dacaad53349ebb29c67fe11853fab (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
W20260709 12:21:31.053211 30857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 93667.6us
I20260709 12:21:31.098559 30653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd8dacaad53349ebb29c67fe11853fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.099797 30948 raft_consensus.cc:2804] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:31.100613 30948 raft_consensus.cc:697] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:21:31.101627 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7695652594064f568b2df572cb76e12a" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:31.104030 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7695652594064f568b2df572cb76e12a" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:31.105391 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:31.140610 30735 tablet_service.cc:1511] Processing CreateTablet for tablet f61dc8e98f804681b0815e953b2d2ad1 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
W20260709 12:21:31.144815 30857 leader_election.cc:343] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:31.145952 30857 leader_election.cc:343] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:31.146488 30857 leader_election.cc:304] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:31.157753 30984 raft_consensus.cc:2749] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:31.155962 30735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f61dc8e98f804681b0815e953b2d2ad1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:31.168087 30553 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 67833.4us
I20260709 12:21:31.179248 30941 tablet_bootstrap.cc:492] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:31.179936 30733 tablet_service.cc:1511] Processing CreateTablet for tablet fd8dacaad53349ebb29c67fe11853fab (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:21:31.181542 30733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd8dacaad53349ebb29c67fe11853fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.183718 30803 tablet_service.cc:1511] Processing CreateTablet for tablet 5c645f524d71421eb842b8b854f95597 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:21:31.185081 30803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c645f524d71421eb842b8b854f95597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.186779 30958 raft_consensus.cc:515] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:31.168337 30942 tablet_bootstrap.cc:492] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
W20260709 12:21:31.170136 30857 leader_election.cc:343] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:31.173185 30555 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 80413.1us
I20260709 12:21:31.174402 30940 ts_tablet_manager.cc:1434] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.303s	user 0.008s	sys 0.015s
I20260709 12:21:31.175096 30894 raft_consensus.cc:2468] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:31.180008 30941 ts_tablet_manager.cc:1403] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.397s	user 0.022s	sys 0.031s
I20260709 12:21:31.194697 30989 raft_consensus.cc:493] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.213941 30989 raft_consensus.cc:515] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:31.214982 30785 leader_election.cc:304] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:31.197973 30940 tablet_bootstrap.cc:492] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:31.220623 30989 leader_election.cc:290] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:31.221310 30989 raft_consensus.cc:2804] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:31.221777 30989 raft_consensus.cc:697] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:31.198451 30948 consensus_queue.cc:237] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:31.225793 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a8098230e4404c9d5743dcac2c5aaa" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:31.227828 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a8098230e4404c9d5743dcac2c5aaa" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
W20260709 12:21:31.228025 30783 leader_election.cc:343] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:31.222685 30989 consensus_queue.cc:237] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:31.202318 30880 tablet_service.cc:1511] Processing CreateTablet for tablet fd8dacaad53349ebb29c67fe11853fab (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
W20260709 12:21:31.229527 30785 leader_election.cc:343] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:31.230182 30880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd8dacaad53349ebb29c67fe11853fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.193408 30942 ts_tablet_manager.cc:1403] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.406s	user 0.023s	sys 0.000s
I20260709 12:21:31.208882 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b6381e285f94a7ca02f638d09d0b3c2" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:31.230857 30670 raft_consensus.cc:3060] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:31.231091 30940 tablet_bootstrap.cc:654] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:31.206153 30877 tablet_service.cc:1511] Processing CreateTablet for tablet 5c645f524d71421eb842b8b854f95597 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:21:31.233546 30877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c645f524d71421eb842b8b854f95597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.196957 30661 tablet_service.cc:1511] Processing CreateTablet for tablet 5c645f524d71421eb842b8b854f95597 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:21:31.235471 30661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c645f524d71421eb842b8b854f95597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.228099 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b6381e285f94a7ca02f638d09d0b3c2" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:31.200778 30939 ts_tablet_manager.cc:1434] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.138s	user 0.007s	sys 0.008s
W20260709 12:21:31.238713 30712 leader_election.cc:343] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:31.239724 30939 tablet_bootstrap.cc:492] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:31.191690 30857 leader_election.cc:304] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:31.245201 30984 raft_consensus.cc:2749] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:31.219673 30958 leader_election.cc:290] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:31.230031 30785 leader_election.cc:304] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:31.254184 30950 raft_consensus.cc:2749] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:31.258263 30941 raft_consensus.cc:359] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
W20260709 12:21:31.260493 30857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 90399.7us
I20260709 12:21:31.270819 30670 raft_consensus.cc:2468] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:31.272670 30709 leader_election.cc:304] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3
W20260709 12:21:31.272729 30555 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 71521.7us
I20260709 12:21:31.274132 30958 raft_consensus.cc:2804] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:31.274730 30958 raft_consensus.cc:697] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
W20260709 12:21:31.275656 30556 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 50183.8us
I20260709 12:21:31.276695 30958 consensus_queue.cc:237] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
W20260709 12:21:31.277717 30553 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 67058.6us
I20260709 12:21:31.260493 30941 raft_consensus.cc:385] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:31.281165 30941 raft_consensus.cc:740] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:31.282105 30941 consensus_queue.cc:260] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:31.285058 30941 ts_tablet_manager.cc:1434] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.071s	user 0.005s	sys 0.004s
I20260709 12:21:31.284833 30810 tablet_service.cc:1511] Processing CreateTablet for tablet 4b26f10a0fb7476098bdb142c864895e (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:21:31.286235 30810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b26f10a0fb7476098bdb142c864895e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.286274 30941 tablet_bootstrap.cc:492] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:31.297185 30729 tablet_service.cc:1511] Processing CreateTablet for tablet 4b26f10a0fb7476098bdb142c864895e (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:21:31.300531 30729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b26f10a0fb7476098bdb142c864895e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.300247 30653 tablet_service.cc:1511] Processing CreateTablet for tablet bac2bacfc36f49459fc2b2b2d8afb01d (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:21:31.300964 30882 tablet_service.cc:1511] Processing CreateTablet for tablet 4b26f10a0fb7476098bdb142c864895e (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:21:31.301239 30734 tablet_service.cc:1511] Processing CreateTablet for tablet bac2bacfc36f49459fc2b2b2d8afb01d (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:21:31.302584 30734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac2bacfc36f49459fc2b2b2d8afb01d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.302584 30882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b26f10a0fb7476098bdb142c864895e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.312943 30653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac2bacfc36f49459fc2b2b2d8afb01d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.315752 30940 tablet_bootstrap.cc:492] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:31.316356 30940 ts_tablet_manager.cc:1403] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.119s	user 0.012s	sys 0.019s
I20260709 12:21:31.317692 30942 raft_consensus.cc:359] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:31.318493 30942 raft_consensus.cc:385] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:31.318792 30942 raft_consensus.cc:740] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:31.323524 30948 consensus_queue.cc:1048] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:31.322839 30940 raft_consensus.cc:359] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:31.329130 30940 raft_consensus.cc:385] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:31.329483 30940 raft_consensus.cc:740] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:31.329912 30565 catalog_manager.cc:5697] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:31.333274 30565 catalog_manager.cc:5697] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:31.335793 30939 tablet_bootstrap.cc:654] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:31.319573 30942 consensus_queue.cc:260] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:31.343801 30940 consensus_queue.cc:260] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:31.349467 30940 ts_tablet_manager.cc:1434] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:21:31.350607 30940 tablet_bootstrap.cc:492] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
W20260709 12:21:31.351089 30634 consensus_peers.cc:597] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:31.355154 30569 catalog_manager.cc:5697] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:31.360584 30636 consensus_peers.cc:597] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 -> Peer d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441): Couldn't send request to peer d3ab9d21f8864b50a71b49c7d624584a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:31.362542 30881 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7a0a060aca4bdf912b9291106aaa74 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:21:31.363981 30881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7a0a060aca4bdf912b9291106aaa74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.372076 30803 tablet_service.cc:1511] Processing CreateTablet for tablet bac2bacfc36f49459fc2b2b2d8afb01d (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:21:31.373569 30803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac2bacfc36f49459fc2b2b2d8afb01d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.378144 30942 ts_tablet_manager.cc:1434] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.121s	user 0.008s	sys 0.000s
I20260709 12:21:31.389722 30940 tablet_bootstrap.cc:654] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:31.387674 30566 catalog_manager.cc:5697] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:31.394795 30942 tablet_bootstrap.cc:492] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:31.399849 30661 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7a0a060aca4bdf912b9291106aaa74 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:21:31.401572 30661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7a0a060aca4bdf912b9291106aaa74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.405200 30727 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7a0a060aca4bdf912b9291106aaa74 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:21:31.406809 30727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7a0a060aca4bdf912b9291106aaa74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.430099 30942 tablet_bootstrap.cc:654] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:31.432116 30807 tablet_service.cc:1511] Processing CreateTablet for tablet 5fcceeadce924e3493e4e91cb49e2f2e (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:21:31.433609 30807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fcceeadce924e3493e4e91cb49e2f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.457890 30976 consensus_queue.cc:1048] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:31.463024 30941 tablet_bootstrap.cc:654] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:31.467165 30882 tablet_service.cc:1511] Processing CreateTablet for tablet 5fcceeadce924e3493e4e91cb49e2f2e (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:21:31.474867 30882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fcceeadce924e3493e4e91cb49e2f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.475647 30653 tablet_service.cc:1511] Processing CreateTablet for tablet 5fcceeadce924e3493e4e91cb49e2f2e (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:21:31.477537 30653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fcceeadce924e3493e4e91cb49e2f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.481268 30958 raft_consensus.cc:493] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.481866 30958 raft_consensus.cc:515] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:31.487039 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c148832de74745608d983f2184cbf23f" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:31.488184 30958 leader_election.cc:290] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
W20260709 12:21:31.489279 30712 leader_election.cc:343] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:31.490844 30729 tablet_service.cc:1511] Processing CreateTablet for tablet fffb9d78e773452ab44ae35b5d65fdb2 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:21:31.492704 30729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fffb9d78e773452ab44ae35b5d65fdb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.523290 30939 tablet_bootstrap.cc:492] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:31.523481 30877 tablet_service.cc:1511] Processing CreateTablet for tablet fffb9d78e773452ab44ae35b5d65fdb2 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:21:31.524556 30810 tablet_service.cc:1511] Processing CreateTablet for tablet fffb9d78e773452ab44ae35b5d65fdb2 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:21:31.525995 30810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fffb9d78e773452ab44ae35b5d65fdb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.531291 30877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fffb9d78e773452ab44ae35b5d65fdb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.524016 30939 ts_tablet_manager.cc:1403] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.285s	user 0.017s	sys 0.028s
I20260709 12:21:31.542426 30657 tablet_service.cc:1511] Processing CreateTablet for tablet e243e0f019f54586877c9a61b2fc83ac (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:21:31.543872 30657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e243e0f019f54586877c9a61b2fc83ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.546826 30880 tablet_service.cc:1511] Processing CreateTablet for tablet 46ea2bd624354824ada8b141b94ab5f0 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:21:31.548409 30880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ea2bd624354824ada8b141b94ab5f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.548266 30734 tablet_service.cc:1511] Processing CreateTablet for tablet e243e0f019f54586877c9a61b2fc83ac (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:21:31.550496 30941 tablet_bootstrap.cc:492] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:31.550313 30803 tablet_service.cc:1511] Processing CreateTablet for tablet e243e0f019f54586877c9a61b2fc83ac (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:21:31.552790 30942 tablet_bootstrap.cc:492] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:31.552791 30803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e243e0f019f54586877c9a61b2fc83ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.553547 30942 ts_tablet_manager.cc:1403] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.159s	user 0.017s	sys 0.006s
I20260709 12:21:31.536269 30939 raft_consensus.cc:359] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:31.556012 30939 raft_consensus.cc:385] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:31.556357 30939 raft_consensus.cc:740] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:31.557343 30939 consensus_queue.cc:260] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:31.558787 30734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e243e0f019f54586877c9a61b2fc83ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.551126 30941 ts_tablet_manager.cc:1403] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.265s	user 0.018s	sys 0.004s
I20260709 12:21:31.569597 30942 raft_consensus.cc:359] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:31.573686 30660 tablet_service.cc:1511] Processing CreateTablet for tablet 46ea2bd624354824ada8b141b94ab5f0 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:21:31.574738 30727 tablet_service.cc:1511] Processing CreateTablet for tablet 46ea2bd624354824ada8b141b94ab5f0 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:21:31.583940 30735 tablet_service.cc:1511] Processing CreateTablet for tablet 100eb209359a46d8b6c900d5a401586e (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:21:31.575229 30660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ea2bd624354824ada8b141b94ab5f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.581777 30801 tablet_service.cc:1511] Processing CreateTablet for tablet 100eb209359a46d8b6c900d5a401586e (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:21:31.578924 30656 tablet_service.cc:1511] Processing CreateTablet for tablet 7ca6811dc9854dfaa1295db38c91c0fd (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:21:31.585446 30881 tablet_service.cc:1511] Processing CreateTablet for tablet 7ca6811dc9854dfaa1295db38c91c0fd (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:21:31.581184 30939 ts_tablet_manager.cc:1434] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 12:21:31.597285 30882 tablet_service.cc:1511] Processing CreateTablet for tablet 100eb209359a46d8b6c900d5a401586e (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:21:31.598618 30882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 100eb209359a46d8b6c900d5a401586e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.601408 30939 tablet_bootstrap.cc:492] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:31.602231 30881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ca6811dc9854dfaa1295db38c91c0fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.590677 30807 tablet_service.cc:1511] Processing CreateTablet for tablet 7ca6811dc9854dfaa1295db38c91c0fd (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:21:31.583606 30941 raft_consensus.cc:359] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:31.603364 30941 raft_consensus.cc:385] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:31.603696 30941 raft_consensus.cc:740] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:31.604467 30940 tablet_bootstrap.cc:492] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:31.594894 30801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 100eb209359a46d8b6c900d5a401586e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.605140 30940 ts_tablet_manager.cc:1403] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.255s	user 0.011s	sys 0.015s
I20260709 12:21:31.607754 30807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ca6811dc9854dfaa1295db38c91c0fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.611275 30940 raft_consensus.cc:359] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:31.612130 30940 raft_consensus.cc:385] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:31.604561 30941 consensus_queue.cc:260] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:31.613683 30654 tablet_service.cc:1511] Processing CreateTablet for tablet 4682db2f801d4701a9c03cb1e4b32fd0 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:21:31.615401 30941 ts_tablet_manager.cc:1434] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.048s	user 0.003s	sys 0.003s
W20260709 12:21:31.619593 30617 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:31.589268 30727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ea2bd624354824ada8b141b94ab5f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.619783 30941 tablet_bootstrap.cc:492] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:31.595904 30656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ca6811dc9854dfaa1295db38c91c0fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.624960 30654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4682db2f801d4701a9c03cb1e4b32fd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.572013 30942 raft_consensus.cc:385] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:31.625521 30942 raft_consensus.cc:740] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:31.626473 30942 consensus_queue.cc:260] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:31.627601 30735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 100eb209359a46d8b6c900d5a401586e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.628963 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c148832de74745608d983f2184cbf23f" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:31.629683 30893 raft_consensus.cc:2468] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 0.
I20260709 12:21:31.631312 30711 leader_election.cc:304] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3
I20260709 12:21:31.632544 30958 raft_consensus.cc:2804] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:31.632939 30958 raft_consensus.cc:493] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:31.633306 30958 raft_consensus.cc:3060] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:31.612411 30940 raft_consensus.cc:740] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:31.640691 30942 ts_tablet_manager.cc:1434] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.002s
I20260709 12:21:31.642022 30942 tablet_bootstrap.cc:492] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:31.653348 30939 tablet_bootstrap.cc:654] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:31.662859 30989 consensus_queue.cc:1048] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:31.692986 30940 consensus_queue.cc:260] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:31.696072 30940 ts_tablet_manager.cc:1434] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.091s	user 0.007s	sys 0.002s
I20260709 12:21:31.703595 30958 raft_consensus.cc:515] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:31.705044 30734 tablet_service.cc:1511] Processing CreateTablet for tablet 4682db2f801d4701a9c03cb1e4b32fd0 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:21:31.684316 30989 raft_consensus.cc:493] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.711989 30734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4682db2f801d4701a9c03cb1e4b32fd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.711669 30989 raft_consensus.cc:515] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:31.713275 30805 tablet_service.cc:1511] Processing CreateTablet for tablet 4682db2f801d4701a9c03cb1e4b32fd0 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:21:31.715282 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815af3bc37df4d158766ac2e615de683" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:31.717003 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815af3bc37df4d158766ac2e615de683" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
W20260709 12:21:31.718871 30785 leader_election.cc:343] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:31.720207 30783 leader_election.cc:343] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:31.720762 30989 leader_election.cc:290] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:31.720809 30783 leader_election.cc:304] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:31.722664 30989 raft_consensus.cc:2749] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:31.731721 30805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4682db2f801d4701a9c03cb1e4b32fd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.732692 30948 raft_consensus.cc:493] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.733274 30948 raft_consensus.cc:515] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:31.700393 30941 tablet_bootstrap.cc:654] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:31.739164 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac7c8095aaa457494024d09dfaaf1bb" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:31.742337 30939 tablet_bootstrap.cc:492] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:31.744282 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac7c8095aaa457494024d09dfaaf1bb" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:31.747802 30978 consensus_queue.cc:1048] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:31.748238 30942 tablet_bootstrap.cc:654] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:31.749928 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c148832de74745608d983f2184cbf23f" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:31.751454 30958 leader_election.cc:290] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:31.753093 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c148832de74745608d983f2184cbf23f" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:31.755873 30892 raft_consensus.cc:3060] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:31.758301 30712 leader_election.cc:343] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:31.758580 30940 tablet_bootstrap.cc:492] T 0b6381e285f94a7ca02f638d09d0b3c2 P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:31.761530 30984 raft_consensus.cc:493] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.762195 30984 raft_consensus.cc:515] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:31.764599 30939 ts_tablet_manager.cc:1403] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.163s	user 0.022s	sys 0.033s
I20260709 12:21:31.766088 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb65e812f06540bc9f1c2b1e3e13d41c" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:31.766857 30820 raft_consensus.cc:2468] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 0.
I20260709 12:21:31.767076 30807 tablet_service.cc:1511] Processing CreateTablet for tablet c4e2f4d39a39493b8404958a5aaaa7af (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:21:31.768422 30860 leader_election.cc:304] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
W20260709 12:21:31.755172 30634 leader_election.cc:343] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:31.771342 30877 tablet_service.cc:1511] Processing CreateTablet for tablet d99734494b57424691503918c73f294e (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:21:31.768441 30807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4e2f4d39a39493b8404958a5aaaa7af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.750814 30948 leader_election.cc:290] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:31.781790 30877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d99734494b57424691503918c73f294e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.778851 30984 leader_election.cc:290] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:31.783947 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb65e812f06540bc9f1c2b1e3e13d41c" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:31.795311 30958 consensus_queue.cc:1048] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:21:31.796473 30857 leader_election.cc:343] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:31.796532 30992 raft_consensus.cc:493] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.799038 30992 raft_consensus.cc:515] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:31.799324 30882 tablet_service.cc:1511] Processing CreateTablet for tablet c4e2f4d39a39493b8404958a5aaaa7af (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:21:31.800647 30882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4e2f4d39a39493b8404958a5aaaa7af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.801297 30992 leader_election.cc:290] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
W20260709 12:21:31.807060 30783 consensus_peers.cc:597] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:31.774188 30939 raft_consensus.cc:359] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:31.794585 30984 raft_consensus.cc:2804] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:31.813186 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be8d04f2ad34fd5b7c66aa68c8fa47a" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:31.815845 30941 tablet_bootstrap.cc:492] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:31.826318 30941 ts_tablet_manager.cc:1403] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.207s	user 0.014s	sys 0.002s
I20260709 12:21:31.826797 30984 raft_consensus.cc:493] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:31.827380 30984 raft_consensus.cc:3060] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:31.830161 30941 raft_consensus.cc:359] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:31.831070 30941 raft_consensus.cc:385] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:31.822885 30734 tablet_service.cc:1511] Processing CreateTablet for tablet d99734494b57424691503918c73f294e (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:21:31.826534 30948 consensus_queue.cc:1048] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:31.810032 30657 tablet_service.cc:1511] Processing CreateTablet for tablet d99734494b57424691503918c73f294e (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:21:31.808772 30939 raft_consensus.cc:385] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:31.850699 30939 raft_consensus.cc:740] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:31.851662 30939 consensus_queue.cc:260] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:31.853313 30657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d99734494b57424691503918c73f294e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.853690 30656 tablet_service.cc:1511] Processing CreateTablet for tablet c4e2f4d39a39493b8404958a5aaaa7af (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:21:31.854228 30939 ts_tablet_manager.cc:1434] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.089s	user 0.008s	sys 0.000s
I20260709 12:21:31.848165 30734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d99734494b57424691503918c73f294e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.844696 30941 raft_consensus.cc:740] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
W20260709 12:21:31.861886 30636 leader_election.cc:343] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:31.862426 30636 leader_election.cc:304] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:31.863288 30948 raft_consensus.cc:493] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.863816 30948 raft_consensus.cc:515] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:31.866200 30948 leader_election.cc:290] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:31.865778 30984 raft_consensus.cc:515] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:31.862785 30939 tablet_bootstrap.cc:492] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:31.869227 30940 tablet_bootstrap.cc:654] T 0b6381e285f94a7ca02f638d09d0b3c2 P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:31.869201 30941 consensus_queue.cc:260] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:31.886252 30735 tablet_service.cc:1511] Processing CreateTablet for tablet 44af5a494fec45679774bc9eb1007f9b (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:21:31.887481 30941 ts_tablet_manager.cc:1434] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
I20260709 12:21:31.888098 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:31.888345 30892 raft_consensus.cc:2468] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
W20260709 12:21:31.890039 30637 leader_election.cc:343] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:31.878736 30656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4e2f4d39a39493b8404958a5aaaa7af. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:31.893913 30712 consensus_peers.cc:597] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Couldn't send request to peer 20c7a0cd21c3449587fdeeff565557d3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:31.877941 30948 raft_consensus.cc:2749] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:31.898085 30735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44af5a494fec45679774bc9eb1007f9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.918418 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be8d04f2ad34fd5b7c66aa68c8fa47a" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:31.919955 30984 leader_election.cc:290] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:31.927850 30941 tablet_bootstrap.cc:492] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:31.928107 30805 tablet_service.cc:1511] Processing CreateTablet for tablet 44af5a494fec45679774bc9eb1007f9b (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:21:31.929718 30805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44af5a494fec45679774bc9eb1007f9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.931406 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb65e812f06540bc9f1c2b1e3e13d41c" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:31.933354 30942 tablet_bootstrap.cc:492] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:31.935568 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb65e812f06540bc9f1c2b1e3e13d41c" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:31.937449 30711 leader_election.cc:304] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3
W20260709 12:21:31.940577 30857 leader_election.cc:343] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:31.946652 30881 tablet_service.cc:1511] Processing CreateTablet for tablet 44af5a494fec45679774bc9eb1007f9b (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:21:31.949100 30654 tablet_service.cc:1511] Processing CreateTablet for tablet 81434413f4d7497a8ae5f95db857f819 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:21:31.943938 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:31.951488 30745 raft_consensus.cc:3060] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:31.962710 30654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81434413f4d7497a8ae5f95db857f819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.965045 30958 raft_consensus.cc:2804] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:31.965636 30711 leader_election.cc:304] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:31.967607 30819 raft_consensus.cc:3060] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:31.968009 30942 ts_tablet_manager.cc:1403] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.325s	user 0.017s	sys 0.008s
I20260709 12:21:31.971735 30881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44af5a494fec45679774bc9eb1007f9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.972853 30958 raft_consensus.cc:697] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:31.982034 30958 consensus_queue.cc:237] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:31.970018 30892 raft_consensus.cc:2468] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 0.
I20260709 12:21:32.008399 30636 leader_election.cc:304] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3
I20260709 12:21:32.018653 30656 tablet_service.cc:1511] Processing CreateTablet for tablet 4faf21b4ff034e548c19569963419851 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:21:32.019428 30978 raft_consensus.cc:2804] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:32.019863 30978 raft_consensus.cc:493] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.020179 30656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4faf21b4ff034e548c19569963419851. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:32.020226 30978 raft_consensus.cc:3060] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.025126 30727 tablet_service.cc:1511] Processing CreateTablet for tablet 81434413f4d7497a8ae5f95db857f819 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:21:32.026436 30727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81434413f4d7497a8ae5f95db857f819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:32.029937 30882 tablet_service.cc:1511] Processing CreateTablet for tablet 4faf21b4ff034e548c19569963419851 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:21:32.030721 30819 raft_consensus.cc:2468] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:32.031205 30882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4faf21b4ff034e548c19569963419851. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:32.032950 30860 leader_election.cc:304] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:32.035035 30807 tablet_service.cc:1511] Processing CreateTablet for tablet 81434413f4d7497a8ae5f95db857f819 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:21:32.036298 30807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81434413f4d7497a8ae5f95db857f819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:32.036892 30984 raft_consensus.cc:2804] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:32.037432 30984 raft_consensus.cc:697] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:32.038319 30984 consensus_queue.cc:237] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:32.048419 30801 tablet_service.cc:1511] Processing CreateTablet for tablet f7e24a3b2b9d4270a8b8466d3c6313ab (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:21:32.049798 30942 raft_consensus.cc:359] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:32.049885 30801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7e24a3b2b9d4270a8b8466d3c6313ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:32.056615 30877 tablet_service.cc:1511] Processing CreateTablet for tablet f7e24a3b2b9d4270a8b8466d3c6313ab (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:21:32.058070 30877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7e24a3b2b9d4270a8b8466d3c6313ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:32.050645 30942 raft_consensus.cc:385] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.065156 30942 raft_consensus.cc:740] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.066229 30942 consensus_queue.cc:260] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:32.062439 30939 tablet_bootstrap.cc:654] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.064683 30940 tablet_bootstrap.cc:492] T 0b6381e285f94a7ca02f638d09d0b3c2 P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:32.055253 30941 tablet_bootstrap.cc:654] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.069038 30940 ts_tablet_manager.cc:1403] T 0b6381e285f94a7ca02f638d09d0b3c2 P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.311s	user 0.017s	sys 0.015s
I20260709 12:21:32.072319 30940 raft_consensus.cc:359] T 0b6381e285f94a7ca02f638d09d0b3c2 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:32.073273 30940 raft_consensus.cc:385] T 0b6381e285f94a7ca02f638d09d0b3c2 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.073706 30940 raft_consensus.cc:740] T 0b6381e285f94a7ca02f638d09d0b3c2 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.075508 30940 consensus_queue.cc:260] T 0b6381e285f94a7ca02f638d09d0b3c2 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:32.072970 30978 raft_consensus.cc:515] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:32.075786 30734 tablet_service.cc:1511] Processing CreateTablet for tablet 4faf21b4ff034e548c19569963419851 (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:21:32.078389 30734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4faf21b4ff034e548c19569963419851. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:32.079893 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
W20260709 12:21:32.081646 30637 leader_election.cc:343] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:32.055909 31016 log.cc:927] Time spent T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:21:32.097431 30654 tablet_service.cc:1511] Processing CreateTablet for tablet f7e24a3b2b9d4270a8b8466d3c6313ab (DEFAULT_TABLE table=test-workload [id=63e31764ee15494c8848313eb0420f73]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:21:32.100805 30942 ts_tablet_manager.cc:1434] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.121s	user 0.009s	sys 0.000s
I20260709 12:21:32.101502 30654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7e24a3b2b9d4270a8b8466d3c6313ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:32.102285 30942 tablet_bootstrap.cc:492] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:32.110261 30978 leader_election.cc:290] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:32.104105 30566 catalog_manager.cc:5697] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:32.115422 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:32.116295 30892 raft_consensus.cc:3060] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.140336 31024 raft_consensus.cc:493] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.141337 31024 raft_consensus.cc:515] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:32.142686 31018 raft_consensus.cc:493] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.143254 31018 raft_consensus.cc:515] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:32.144994 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a8098230e4404c9d5743dcac2c5aaa" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:32.145778 30820 raft_consensus.cc:2468] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 0.
I20260709 12:21:32.147432 30712 leader_election.cc:304] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
I20260709 12:21:32.148319 30958 raft_consensus.cc:2804] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:32.148804 30958 raft_consensus.cc:493] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.149358 30958 raft_consensus.cc:3060] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.150134 30940 ts_tablet_manager.cc:1434] T 0b6381e285f94a7ca02f638d09d0b3c2 P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.000s
I20260709 12:21:32.151533 30940 tablet_bootstrap.cc:492] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:32.160501 30958 raft_consensus.cc:515] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:32.162662 31024 leader_election.cc:290] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:32.148684 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a8098230e4404c9d5743dcac2c5aaa" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:32.164605 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de462b3788724f21b93b5cbb295c085a" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:32.165748 30958 leader_election.cc:290] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:32.166617 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a8098230e4404c9d5743dcac2c5aaa" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
W20260709 12:21:32.165841 30711 leader_election.cc:343] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.167145 30820 raft_consensus.cc:3060] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.168615 31018 leader_election.cc:290] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:32.163611 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de462b3788724f21b93b5cbb295c085a" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:32.169324 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a8098230e4404c9d5743dcac2c5aaa" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:32.169842 30746 raft_consensus.cc:2468] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 0.
W20260709 12:21:32.170784 30711 leader_election.cc:343] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:32.167095 30783 leader_election.cc:343] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.171969 30565 catalog_manager.cc:5697] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a reported cstate change: term changed from 0 to 1, leader changed from <none> to d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196). New cstate: current_term: 1 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:32.173408 30783 leader_election.cc:304] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:32.174285 31018 raft_consensus.cc:2804] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:32.174693 31018 raft_consensus.cc:493] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.175062 31018 raft_consensus.cc:3060] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.175685 30942 tablet_bootstrap.cc:654] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.175761 30820 raft_consensus.cc:2468] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:32.177186 30712 leader_election.cc:304] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:32.178653 30958 raft_consensus.cc:2804] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:32.179221 30958 raft_consensus.cc:697] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:32.179859 30892 raft_consensus.cc:2468] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:32.180136 30958 consensus_queue.cc:237] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:32.187898 30636 leader_election.cc:304] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3
I20260709 12:21:32.189620 30978 raft_consensus.cc:2804] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:32.190332 30978 raft_consensus.cc:697] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:21:32.191238 30941 tablet_bootstrap.cc:492] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:32.191820 30941 ts_tablet_manager.cc:1403] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.295s	user 0.021s	sys 0.022s
I20260709 12:21:32.191486 30978 consensus_queue.cc:237] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:32.195178 30941 raft_consensus.cc:359] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:32.195899 30941 raft_consensus.cc:385] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.196157 30941 raft_consensus.cc:740] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.198732 31021 raft_consensus.cc:2749] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:32.199868 30939 tablet_bootstrap.cc:492] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:32.200402 30939 ts_tablet_manager.cc:1403] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.338s	user 0.041s	sys 0.009s
I20260709 12:21:32.201756 30940 tablet_bootstrap.cc:654] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.208063 31018 raft_consensus.cc:515] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:32.210445 30941 consensus_queue.cc:260] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:32.212168 31018 leader_election.cc:290] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:32.212769 30941 ts_tablet_manager.cc:1434] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 12:21:32.212363 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de462b3788724f21b93b5cbb295c085a" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:32.215323 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de462b3788724f21b93b5cbb295c085a" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:32.215552 30941 tablet_bootstrap.cc:492] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
W20260709 12:21:32.215656 30783 leader_election.cc:343] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.216042 30745 raft_consensus.cc:3060] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.220715 30942 tablet_bootstrap.cc:492] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:32.221297 30942 ts_tablet_manager.cc:1403] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.119s	user 0.015s	sys 0.005s
I20260709 12:21:32.221702 30569 catalog_manager.cc:5697] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:32.224164 30942 raft_consensus.cc:359] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:32.224872 30942 raft_consensus.cc:385] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.225135 30942 raft_consensus.cc:740] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.226033 30939 raft_consensus.cc:359] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:32.226650 30939 raft_consensus.cc:385] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.226861 30939 raft_consensus.cc:740] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.229980 30939 consensus_queue.cc:260] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:32.231874 30942 consensus_queue.cc:260] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:32.234411 30939 ts_tablet_manager.cc:1434] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.002s
I20260709 12:21:32.236822 30942 ts_tablet_manager.cc:1434] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:21:32.238152 30745 raft_consensus.cc:2468] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:32.238520 30939 tablet_bootstrap.cc:492] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:32.239547 30783 leader_election.cc:304] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:32.240268 30940 tablet_bootstrap.cc:492] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:32.240902 30940 ts_tablet_manager.cc:1403] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.090s	user 0.015s	sys 0.013s
I20260709 12:21:32.241348 31018 raft_consensus.cc:2804] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:32.241837 30941 tablet_bootstrap.cc:654] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.241914 31018 raft_consensus.cc:697] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:32.243255 31018 consensus_queue.cc:237] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:32.243960 30940 raft_consensus.cc:359] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:32.238560 30942 tablet_bootstrap.cc:492] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:32.246924 30939 tablet_bootstrap.cc:654] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.253129 30940 raft_consensus.cc:385] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.253532 30940 raft_consensus.cc:740] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.255556 30940 consensus_queue.cc:260] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:32.258136 30942 tablet_bootstrap.cc:654] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.260028 30939 tablet_bootstrap.cc:492] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:32.260702 30939 ts_tablet_manager.cc:1403] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.000s
I20260709 12:21:32.263871 30939 raft_consensus.cc:359] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:32.264442 30939 raft_consensus.cc:385] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.264748 30939 raft_consensus.cc:740] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.265601 30939 consensus_queue.cc:260] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:32.266973 30978 raft_consensus.cc:493] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.267490 30978 raft_consensus.cc:515] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:32.269693 30940 ts_tablet_manager.cc:1434] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.028s	user 0.002s	sys 0.004s
I20260709 12:21:32.270025 30941 tablet_bootstrap.cc:492] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:32.270016 30978 leader_election.cc:290] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:32.273092 30984 raft_consensus.cc:493] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.271898 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7695652594064f568b2df572cb76e12a" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:32.273928 30892 raft_consensus.cc:2468] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 0.
I20260709 12:21:32.275206 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7695652594064f568b2df572cb76e12a" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:32.276196 30745 raft_consensus.cc:2468] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 0.
I20260709 12:21:32.277006 30636 leader_election.cc:304] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:32.278002 30978 raft_consensus.cc:2804] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:32.278410 30978 raft_consensus.cc:493] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.278762 30978 raft_consensus.cc:3060] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.280831 30939 ts_tablet_manager.cc:1434] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.003s
I20260709 12:21:32.282485 30939 tablet_bootstrap.cc:492] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:32.282857 30568 catalog_manager.cc:5697] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:32.273265 30941 ts_tablet_manager.cc:1403] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.002s
I20260709 12:21:32.273727 30984 raft_consensus.cc:515] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:32.286525 30984 leader_election.cc:290] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:32.289084 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d63226f015480c84967f90ac595cc0" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:32.289780 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d63226f015480c84967f90ac595cc0" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:32.292132 30857 leader_election.cc:304] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:32.293695 30984 raft_consensus.cc:2749] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:32.295074 30939 tablet_bootstrap.cc:654] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.288754 30565 catalog_manager.cc:5697] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:32.307545 30941 raft_consensus.cc:359] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:32.309917 30941 raft_consensus.cc:385] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.308861 30939 tablet_bootstrap.cc:492] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:32.310302 30941 raft_consensus.cc:740] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.308955 30978 raft_consensus.cc:515] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:32.311033 30939 ts_tablet_manager.cc:1403] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.011s
I20260709 12:21:32.270886 30940 tablet_bootstrap.cc:492] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:32.313756 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7695652594064f568b2df572cb76e12a" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:32.314391 30892 raft_consensus.cc:3060] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.319618 30940 tablet_bootstrap.cc:654] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.322710 30892 raft_consensus.cc:2468] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:32.324775 30636 leader_election.cc:304] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:32.326128 30948 raft_consensus.cc:2804] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:32.326649 30948 raft_consensus.cc:697] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:21:32.327559 30948 consensus_queue.cc:237] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:32.329022 30940 tablet_bootstrap.cc:492] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:32.329517 30940 ts_tablet_manager.cc:1403] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.059s	user 0.006s	sys 0.005s
I20260709 12:21:32.323351 30939 raft_consensus.cc:359] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:32.332140 30939 raft_consensus.cc:385] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.332505 30939 raft_consensus.cc:740] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.332528 30940 raft_consensus.cc:359] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:32.333494 30940 raft_consensus.cc:385] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.333882 30940 raft_consensus.cc:740] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.333537 30939 consensus_queue.cc:260] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:32.334595 30940 consensus_queue.cc:260] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:32.335016 30893 raft_consensus.cc:3060] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.335999 30939 ts_tablet_manager.cc:1434] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:21:32.337245 30940 ts_tablet_manager.cc:1434] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:21:32.337260 30939 tablet_bootstrap.cc:492] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:32.338768 30940 tablet_bootstrap.cc:492] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:32.345768 30940 tablet_bootstrap.cc:654] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.323498 30941 consensus_queue.cc:260] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:32.353986 30940 tablet_bootstrap.cc:492] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:32.359474 30940 ts_tablet_manager.cc:1403] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.003s
I20260709 12:21:32.359603 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7695652594064f568b2df572cb76e12a" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:32.360719 30745 raft_consensus.cc:3060] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.362488 30940 raft_consensus.cc:359] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:32.364864 30940 raft_consensus.cc:385] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.365190 30940 raft_consensus.cc:740] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.363570 30568 catalog_manager.cc:5697] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:32.366109 30942 tablet_bootstrap.cc:492] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:32.366731 30942 ts_tablet_manager.cc:1403] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.128s	user 0.017s	sys 0.046s
I20260709 12:21:32.369048 30940 consensus_queue.cc:260] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:32.369985 30942 raft_consensus.cc:359] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:32.370987 30942 raft_consensus.cc:385] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.371269 30942 raft_consensus.cc:740] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.371723 30940 ts_tablet_manager.cc:1434] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:21:32.358282 30978 leader_election.cc:290] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:32.372012 30942 consensus_queue.cc:260] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:32.373979 30939 tablet_bootstrap.cc:654] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.375128 30942 ts_tablet_manager.cc:1434] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.003s
I20260709 12:21:32.376267 30942 tablet_bootstrap.cc:492] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:32.360834 30941 ts_tablet_manager.cc:1434] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.001s
W20260709 12:21:32.382454 30712 consensus_peers.cc:597] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 -> Peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Couldn't send request to peer 20c7a0cd21c3449587fdeeff565557d3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:32.383014 30942 tablet_bootstrap.cc:654] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.383087 30940 tablet_bootstrap.cc:492] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:32.385658 30941 tablet_bootstrap.cc:492] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:32.387265 30745 raft_consensus.cc:2468] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:32.393811 30820 raft_consensus.cc:3060] T 0b6381e285f94a7ca02f638d09d0b3c2 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.404992 30941 tablet_bootstrap.cc:654] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.407919 30942 tablet_bootstrap.cc:492] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:32.408567 30942 ts_tablet_manager.cc:1403] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.004s
I20260709 12:21:32.412110 30942 raft_consensus.cc:359] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:32.412925 30942 raft_consensus.cc:385] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.413193 30942 raft_consensus.cc:740] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.413932 30942 consensus_queue.cc:260] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:32.417932 30942 ts_tablet_manager.cc:1434] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:21:32.426448 30942 tablet_bootstrap.cc:492] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:32.426555 30939 tablet_bootstrap.cc:492] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:32.427256 30939 ts_tablet_manager.cc:1403] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.090s	user 0.009s	sys 0.012s
I20260709 12:21:32.431304 30939 raft_consensus.cc:359] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:32.432018 30939 raft_consensus.cc:385] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.432315 30939 raft_consensus.cc:740] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.433027 30939 consensus_queue.cc:260] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:32.434917 30940 tablet_bootstrap.cc:654] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.437240 30939 ts_tablet_manager.cc:1434] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:21:32.441702 30939 tablet_bootstrap.cc:492] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:32.446717 30984 raft_consensus.cc:493] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.447341 30984 raft_consensus.cc:515] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:32.447955 30941 tablet_bootstrap.cc:492] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:32.448228 30942 tablet_bootstrap.cc:654] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.448509 30941 ts_tablet_manager.cc:1403] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.067s	user 0.017s	sys 0.008s
I20260709 12:21:32.448596 30940 tablet_bootstrap.cc:492] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:32.449384 30940 ts_tablet_manager.cc:1403] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.067s	user 0.007s	sys 0.012s
I20260709 12:21:32.450973 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a8098230e4404c9d5743dcac2c5aaa" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:32.451503 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a8098230e4404c9d5743dcac2c5aaa" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:32.451782 30820 raft_consensus.cc:2393] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3ab9d21f8864b50a71b49c7d624584a in current term 1: Already voted for candidate 4a9042c4154c442297159d1c9f1186b9 in this term.
I20260709 12:21:32.452006 30941 raft_consensus.cc:359] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:32.452812 30941 raft_consensus.cc:385] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.453258 30941 raft_consensus.cc:740] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.452872 30940 raft_consensus.cc:359] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:32.453657 30857 leader_election.cc:304] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:32.453817 30940 raft_consensus.cc:385] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.454016 30941 consensus_queue.cc:260] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:32.454403 30940 raft_consensus.cc:740] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.454980 31012 raft_consensus.cc:3060] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.455564 30940 consensus_queue.cc:260] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:32.459227 30940 ts_tablet_manager.cc:1434] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:21:32.460496 30940 tablet_bootstrap.cc:492] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:32.462345 30942 tablet_bootstrap.cc:492] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:32.463222 30984 leader_election.cc:290] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:32.466629 30940 tablet_bootstrap.cc:654] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.467110 30942 ts_tablet_manager.cc:1403] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.010s
I20260709 12:21:32.470386 30942 raft_consensus.cc:359] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:32.471303 30942 raft_consensus.cc:385] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.471625 30942 raft_consensus.cc:740] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.471786 30941 ts_tablet_manager.cc:1434] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 12:21:32.473886 30941 tablet_bootstrap.cc:492] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:32.478652 30940 tablet_bootstrap.cc:492] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:32.479219 30940 ts_tablet_manager.cc:1403] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.001s
I20260709 12:21:32.472975 30942 consensus_queue.cc:260] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:32.482278 30941 tablet_bootstrap.cc:654] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.482702 30940 raft_consensus.cc:359] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:32.483577 30940 raft_consensus.cc:385] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.483858 30940 raft_consensus.cc:740] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.484579 30940 consensus_queue.cc:260] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:32.485278 30942 ts_tablet_manager.cc:1434] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:21:32.486368 30942 tablet_bootstrap.cc:492] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:32.490615 31012 raft_consensus.cc:2749] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:32.493072 30942 tablet_bootstrap.cc:654] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:32.491883 30857 consensus_peers.cc:597] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:32.495404 30939 tablet_bootstrap.cc:654] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.501093 30942 tablet_bootstrap.cc:492] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:32.499191 30940 ts_tablet_manager.cc:1434] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:21:32.501915 30942 ts_tablet_manager.cc:1403] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:21:32.504004 30940 tablet_bootstrap.cc:492] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:32.506429 30942 raft_consensus.cc:359] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:32.507193 30942 raft_consensus.cc:385] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.507480 30942 raft_consensus.cc:740] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.508176 30942 consensus_queue.cc:260] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:32.509764 30948 raft_consensus.cc:493] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.510658 30942 ts_tablet_manager.cc:1434] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:32.510322 30948 raft_consensus.cc:515] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:32.511798 30942 tablet_bootstrap.cc:492] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:32.513293 30948 leader_election.cc:290] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:32.513561 30940 tablet_bootstrap.cc:654] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.515049 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de462b3788724f21b93b5cbb295c085a" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:32.516460 30745 raft_consensus.cc:2393] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in current term 1: Already voted for candidate 20c7a0cd21c3449587fdeeff565557d3 in this term.
I20260709 12:21:32.519013 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de462b3788724f21b93b5cbb295c085a" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:32.520390 30942 tablet_bootstrap.cc:654] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.521128 30941 tablet_bootstrap.cc:492] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:32.520875 30637 leader_election.cc:304] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:32.522593 30976 raft_consensus.cc:3060] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.523442 30941 ts_tablet_manager.cc:1403] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.050s	user 0.021s	sys 0.010s
I20260709 12:21:32.529788 30941 raft_consensus.cc:359] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:32.530527 30941 raft_consensus.cc:385] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.530826 30941 raft_consensus.cc:740] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.531708 30941 consensus_queue.cc:260] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:32.535748 30939 tablet_bootstrap.cc:492] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:32.536152 30976 raft_consensus.cc:2749] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:32.536334 30939 ts_tablet_manager.cc:1403] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.098s	user 0.008s	sys 0.005s
I20260709 12:21:32.538286 30941 ts_tablet_manager.cc:1434] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.001s
I20260709 12:21:32.538897 30939 raft_consensus.cc:359] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:32.539503 30939 raft_consensus.cc:385] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.539750 30939 raft_consensus.cc:740] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.539937 30941 tablet_bootstrap.cc:492] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:32.543246 30940 tablet_bootstrap.cc:492] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:32.540500 30939 consensus_queue.cc:260] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:32.559166 30940 ts_tablet_manager.cc:1403] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.057s	user 0.025s	sys 0.014s
I20260709 12:21:32.562533 30940 raft_consensus.cc:359] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:32.563232 30940 raft_consensus.cc:385] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.563498 30940 raft_consensus.cc:740] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.564262 30940 consensus_queue.cc:260] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:32.568364 30941 tablet_bootstrap.cc:654] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.569190 30958 consensus_queue.cc:1048] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:32.570295 30940 ts_tablet_manager.cc:1434] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:21:32.571440 30940 tablet_bootstrap.cc:492] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:32.578078 30940 tablet_bootstrap.cc:654] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.578118 30939 ts_tablet_manager.cc:1434] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.041s	user 0.010s	sys 0.012s
I20260709 12:21:32.581985 30942 tablet_bootstrap.cc:492] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:32.582664 30942 ts_tablet_manager.cc:1403] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.071s	user 0.024s	sys 0.013s
I20260709 12:21:32.583448 30976 raft_consensus.cc:493] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.584048 30976 raft_consensus.cc:515] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:32.586349 30976 leader_election.cc:290] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:32.586779 30948 raft_consensus.cc:493] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.587280 30948 raft_consensus.cc:515] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:32.588950 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815af3bc37df4d158766ac2e615de683" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:32.589651 30948 leader_election.cc:290] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:32.590144 30819 raft_consensus.cc:2468] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 0.
I20260709 12:21:32.586206 30942 raft_consensus.cc:359] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:32.591060 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9361d602cd814a70acf6a5867a109d74" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:32.591420 30942 raft_consensus.cc:385] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.591722 30942 raft_consensus.cc:740] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.591773 30818 raft_consensus.cc:2468] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 0.
I20260709 12:21:32.593374 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9361d602cd814a70acf6a5867a109d74" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:32.594456 30745 raft_consensus.cc:2468] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 0.
I20260709 12:21:32.596477 31021 raft_consensus.cc:493] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.597215 31021 raft_consensus.cc:515] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:32.599092 30950 raft_consensus.cc:493] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.599684 30950 raft_consensus.cc:515] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:32.602684 30950 leader_election.cc:290] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:32.589229 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815af3bc37df4d158766ac2e615de683" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:32.604192 30893 raft_consensus.cc:2468] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 0.
I20260709 12:21:32.605274 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9361d602cd814a70acf6a5867a109d74" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:32.605965 30818 raft_consensus.cc:2468] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 0.
I20260709 12:21:32.606384 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006658e1213f4f8da089a9570e0a76b9" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:32.607034 30893 raft_consensus.cc:2468] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 0.
I20260709 12:21:32.607632 31024 consensus_queue.cc:1048] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:32.608179 30785 leader_election.cc:304] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:32.608547 30712 leader_election.cc:304] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
I20260709 12:21:32.607712 30958 consensus_queue.cc:1048] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:21:32.609865 31024 raft_consensus.cc:2804] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:32.610498 31024 raft_consensus.cc:493] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.610944 31024 raft_consensus.cc:3060] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.593689 30637 leader_election.cc:304] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:32.612879 30950 raft_consensus.cc:2804] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:32.613492 30948 raft_consensus.cc:2804] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:32.613615 30637 leader_election.cc:304] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:32.614264 30948 raft_consensus.cc:493] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.614780 30948 raft_consensus.cc:3060] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.615571 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006658e1213f4f8da089a9570e0a76b9" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:32.613468 30950 raft_consensus.cc:493] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.616770 30950 raft_consensus.cc:3060] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:32.617264 30783 leader_election.cc:343] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.612928 31021 leader_election.cc:290] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:32.618324 30976 raft_consensus.cc:2804] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:32.619065 30976 raft_consensus.cc:493] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.619555 30976 raft_consensus.cc:3060] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:32.630501 30617 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:32.632956 30958 raft_consensus.cc:493] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.633837 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9361d602cd814a70acf6a5867a109d74" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:32.633636 30958 raft_consensus.cc:515] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:32.635970 31018 raft_consensus.cc:493] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.636490 31018 raft_consensus.cc:515] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:32.637856 30958 leader_election.cc:290] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:32.638726 31018 leader_election.cc:290] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:32.639396 30984 raft_consensus.cc:493] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.640026 30984 raft_consensus.cc:515] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:32.642740 30984 leader_election.cc:290] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:32.646814 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c179d47d7f146ed83b56ea632997aa7" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:32.648494 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c179d47d7f146ed83b56ea632997aa7" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:32.649276 30820 raft_consensus.cc:2468] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 0.
I20260709 12:21:32.650942 30860 leader_election.cc:304] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:32.655601 30984 raft_consensus.cc:2804] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:32.656023 30984 raft_consensus.cc:493] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.656384 30984 raft_consensus.cc:3060] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:32.661558 30857 leader_election.cc:343] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.665458 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87d449e2aa442ec87cb2b55b61d4496" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:32.598717 30942 consensus_queue.cc:260] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:32.672992 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87d449e2aa442ec87cb2b55b61d4496" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:32.673142 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87d449e2aa442ec87cb2b55b61d4496" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:32.673611 31012 raft_consensus.cc:493] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.674000 30745 raft_consensus.cc:2468] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 0.
I20260709 12:21:32.674129 31012 raft_consensus.cc:515] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:32.675139 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87d449e2aa442ec87cb2b55b61d4496" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
W20260709 12:21:32.676808 30709 leader_election.cc:343] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.682874 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4326b71a8ff545259df55b4ab0564f48" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:32.683084 31012 leader_election.cc:290] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:32.683669 30745 raft_consensus.cc:2468] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 0.
I20260709 12:21:32.673877 30820 raft_consensus.cc:2468] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 0.
I20260709 12:21:32.685107 30857 leader_election.cc:304] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:32.692343 30978 raft_consensus.cc:493] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.692989 30978 raft_consensus.cc:515] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:32.683701 31012 consensus_queue.cc:1048] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:21:32.693246 31018 consensus_queue.cc:1048] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:32.695390 30978 leader_election.cc:290] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:32.697300 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb65e812f06540bc9f1c2b1e3e13d41c" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:32.698465 30939 tablet_bootstrap.cc:492] T 5c179d47d7f146ed83b56ea632997aa7 P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:32.685984 30942 ts_tablet_manager.cc:1434] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.103s	user 0.009s	sys 0.000s
I20260709 12:21:32.697196 30783 leader_election.cc:304] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
I20260709 12:21:32.710142 30942 tablet_bootstrap.cc:492] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:32.700460 30948 raft_consensus.cc:515] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:32.701920 30950 raft_consensus.cc:515] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:32.703042 30976 raft_consensus.cc:515] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:32.703310 31024 raft_consensus.cc:515] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:32.714768 31024 leader_election.cc:290] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:32.705709 31067 raft_consensus.cc:2804] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:32.715488 31067 raft_consensus.cc:493] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.715998 31067 raft_consensus.cc:3060] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.717422 30950 leader_election.cc:290] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:32.718364 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006658e1213f4f8da089a9570e0a76b9" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:32.718997 30893 raft_consensus.cc:3060] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:32.710027 30783 leader_election.cc:343] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.698616 30820 raft_consensus.cc:2393] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in current term 1: Already voted for candidate d3ab9d21f8864b50a71b49c7d624584a in this term.
I20260709 12:21:32.724720 30948 leader_election.cc:290] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:32.725415 31012 raft_consensus.cc:493] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.725983 31012 raft_consensus.cc:515] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:32.728792 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815af3bc37df4d158766ac2e615de683" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:32.729470 30819 raft_consensus.cc:3060] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.720139 31018 raft_consensus.cc:2804] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:32.732818 30893 raft_consensus.cc:2468] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:32.733093 31018 raft_consensus.cc:493] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:32.720328 30860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 65509.7us
I20260709 12:21:32.736536 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006658e1213f4f8da089a9570e0a76b9" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:32.736784 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9361d602cd814a70acf6a5867a109d74" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:32.737396 31012 leader_election.cc:290] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:32.737515 30817 raft_consensus.cc:3060] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.736450 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9361d602cd814a70acf6a5867a109d74" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:32.733253 30712 leader_election.cc:304] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:32.739253 30785 leader_election.cc:304] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:32.739624 31024 raft_consensus.cc:2804] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:32.734624 30984 raft_consensus.cc:515] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:32.740352 30950 raft_consensus.cc:2804] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:32.740525 31024 raft_consensus.cc:493] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.735024 31018 raft_consensus.cc:3060] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.742245 30984 leader_election.cc:290] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:32.746184 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac7c8095aaa457494024d09dfaaf1bb" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
W20260709 12:21:32.746903 30783 leader_election.cc:343] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.750697 30942 tablet_bootstrap.cc:654] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.759788 30940 tablet_bootstrap.cc:492] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:32.760490 30940 ts_tablet_manager.cc:1403] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.189s	user 0.040s	sys 0.055s
I20260709 12:21:32.743762 31024 raft_consensus.cc:3060] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.746923 30671 raft_consensus.cc:2468] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 0.
I20260709 12:21:32.753702 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4326b71a8ff545259df55b4ab0564f48" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:32.769081 30669 raft_consensus.cc:2393] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 in current term 1: Already voted for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in this term.
I20260709 12:21:32.764274 30940 raft_consensus.cc:359] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:32.776237 30939 tablet_bootstrap.cc:654] T 5c179d47d7f146ed83b56ea632997aa7 P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.777247 30940 raft_consensus.cc:385] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.777575 30940 raft_consensus.cc:740] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.766494 30818 raft_consensus.cc:3060] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.780675 30940 consensus_queue.cc:260] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:32.767238 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac7c8095aaa457494024d09dfaaf1bb" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:32.782605 30941 tablet_bootstrap.cc:492] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:32.785249 30941 ts_tablet_manager.cc:1403] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.246s	user 0.057s	sys 0.051s
I20260709 12:21:32.768407 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c179d47d7f146ed83b56ea632997aa7" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:32.768858 30857 leader_election.cc:304] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:32.786664 30816 raft_consensus.cc:2468] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 0.
I20260709 12:21:32.805956 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb65e812f06540bc9f1c2b1e3e13d41c" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:32.806556 30978 consensus_queue.cc:1048] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:32.808113 31066 raft_consensus.cc:2804] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:32.808571 31066 raft_consensus.cc:493] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.808944 31066 raft_consensus.cc:3060] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.785638 30950 raft_consensus.cc:697] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:32.833765 31070 raft_consensus.cc:493] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.834386 31070 raft_consensus.cc:515] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:32.839462 30940 ts_tablet_manager.cc:1434] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.079s	user 0.022s	sys 0.015s
I20260709 12:21:32.843561 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9361d602cd814a70acf6a5867a109d74" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
W20260709 12:21:32.832592 30857 leader_election.cc:343] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.844782 30746 raft_consensus.cc:2393] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in current term 1: Already voted for candidate 4a9042c4154c442297159d1c9f1186b9 in this term.
W20260709 12:21:32.845513 30857 leader_election.cc:343] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.847795 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb4b46162a04eeda49624c82070758e" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:32.848542 31018 raft_consensus.cc:515] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:32.850224 30636 leader_election.cc:304] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:32.850813 31018 leader_election.cc:290] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:32.851593 30948 raft_consensus.cc:3060] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.856213 30976 leader_election.cc:290] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:32.858577 30950 consensus_queue.cc:237] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:32.860563 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815af3bc37df4d158766ac2e615de683" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:32.860935 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c179d47d7f146ed83b56ea632997aa7" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:32.861240 30893 raft_consensus.cc:3060] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.861694 30816 raft_consensus.cc:3060] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.861238 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87d449e2aa442ec87cb2b55b61d4496" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:32.840138 30819 raft_consensus.cc:2468] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
W20260709 12:21:32.871729 30783 leader_election.cc:343] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.871970 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87d449e2aa442ec87cb2b55b61d4496" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:32.875938 31067 raft_consensus.cc:515] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:32.853756 30817 raft_consensus.cc:2468] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:32.882663 31073 raft_consensus.cc:493] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.883018 31069 raft_consensus.cc:493] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.883351 31073 raft_consensus.cc:515] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:32.883662 31069 raft_consensus.cc:515] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:32.884363 30948 raft_consensus.cc:2749] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:32.880582 31070 leader_election.cc:290] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:32.885907 31024 raft_consensus.cc:515] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:32.886970 31069 leader_election.cc:290] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:32.887809 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c148832de74745608d983f2184cbf23f" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:32.893327 30637 leader_election.cc:304] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:32.893972 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c148832de74745608d983f2184cbf23f" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:32.894311 30978 raft_consensus.cc:2804] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:32.894829 30978 raft_consensus.cc:697] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:21:32.895700 30978 consensus_queue.cc:237] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:32.896374 31074 consensus_queue.cc:1048] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:32.899288 30940 tablet_bootstrap.cc:492] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:32.891808 30746 raft_consensus.cc:2393] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c7a0cd21c3449587fdeeff565557d3 in current term 1: Already voted for candidate 4a9042c4154c442297159d1c9f1186b9 in this term.
I20260709 12:21:32.914340 30942 tablet_bootstrap.cc:492] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:32.915107 30942 ts_tablet_manager.cc:1403] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.205s	user 0.015s	sys 0.008s
I20260709 12:21:32.911080 30948 consensus_queue.cc:1048] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:21:32.921185 30948 consensus_queue.cc:1048] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:32.929967 30940 tablet_bootstrap.cc:654] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.908735 31067 leader_election.cc:290] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
W20260709 12:21:32.946156 30783 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 56076.5us
I20260709 12:21:32.947839 30893 raft_consensus.cc:2468] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:32.948952 30712 leader_election.cc:304] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:32.918860 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9361d602cd814a70acf6a5867a109d74" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:32.962270 31071 raft_consensus.cc:2804] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:32.962781 30783 leader_election.cc:304] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:32.963025 31071 raft_consensus.cc:697] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:32.964318 30818 raft_consensus.cc:2393] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in current term 1: Already voted for candidate 4a9042c4154c442297159d1c9f1186b9 in this term.
I20260709 12:21:32.965103 30744 raft_consensus.cc:3060] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.964389 31071 consensus_queue.cc:237] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:32.946524 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4326b71a8ff545259df55b4ab0564f48" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:32.965145 31075 raft_consensus.cc:2749] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:32.987205 30745 raft_consensus.cc:3060] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.979195 31073 leader_election.cc:290] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:32.982569 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:32.989827 30891 raft_consensus.cc:2468] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:32.991228 30785 leader_election.cc:304] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:32.985743 31066 raft_consensus.cc:515] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:32.974668 30637 leader_election.cc:304] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:32.993434 31024 leader_election.cc:290] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:32.994753 30948 raft_consensus.cc:2749] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:21:32.996572 30818 raft_consensus.cc:3060] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.996824 30783 leader_election.cc:304] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:32.997356 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:32.998803 31075 raft_consensus.cc:2749] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:21:33.000334 30815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4326b71a8ff545259df55b4ab0564f48" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:33.001062 30815 raft_consensus.cc:3060] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:33.001956 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87d449e2aa442ec87cb2b55b61d4496" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:33.002946 30819 raft_consensus.cc:2393] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 in current term 1: Already voted for candidate 20c7a0cd21c3449587fdeeff565557d3 in this term.
I20260709 12:21:33.004937 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb4b46162a04eeda49624c82070758e" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:33.009047 30941 raft_consensus.cc:359] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.009847 30941 raft_consensus.cc:385] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.010138 30941 raft_consensus.cc:740] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:33.005046 30816 raft_consensus.cc:2468] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:33.013962 30939 tablet_bootstrap.cc:492] T 5c179d47d7f146ed83b56ea632997aa7 P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:33.014487 30939 ts_tablet_manager.cc:1403] T 5c179d47d7f146ed83b56ea632997aa7 P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.323s	user 0.023s	sys 0.013s
I20260709 12:21:33.021533 30941 consensus_queue.cc:260] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.020144 30942 raft_consensus.cc:359] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.027058 30942 raft_consensus.cc:385] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.027554 30942 raft_consensus.cc:740] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:33.028427 30942 consensus_queue.cc:260] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.033011 30815 raft_consensus.cc:2468] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:33.049329 30941 ts_tablet_manager.cc:1434] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.263s	user 0.007s	sys 0.002s
I20260709 12:21:33.055225 30942 ts_tablet_manager.cc:1434] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.140s	user 0.010s	sys 0.000s
I20260709 12:21:33.041666 30711 leader_election.cc:304] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:33.067411 31084 consensus_queue.cc:1048] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:21:33.062196 31073 raft_consensus.cc:2804] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:33.073881 30743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac7c8095aaa457494024d09dfaaf1bb" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
W20260709 12:21:33.075845 30857 leader_election.cc:343] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:33.078646 30940 tablet_bootstrap.cc:492] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:33.079211 30940 ts_tablet_manager.cc:1403] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.198s	user 0.008s	sys 0.037s
I20260709 12:21:33.080534 30942 tablet_bootstrap.cc:492] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:33.082964 30940 raft_consensus.cc:359] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.083658 30940 raft_consensus.cc:385] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.083952 30940 raft_consensus.cc:740] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:33.063380 31066 leader_election.cc:290] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:33.087740 30940 consensus_queue.cc:260] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.079098 30939 raft_consensus.cc:359] T 5c179d47d7f146ed83b56ea632997aa7 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:33.090243 30939 raft_consensus.cc:385] T 5c179d47d7f146ed83b56ea632997aa7 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.090643 30939 raft_consensus.cc:740] T 5c179d47d7f146ed83b56ea632997aa7 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:33.057057 30860 leader_election.cc:304] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:33.088335 31012 raft_consensus.cc:493] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.100764 30939 consensus_queue.cc:260] T 5c179d47d7f146ed83b56ea632997aa7 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:33.106174 30940 ts_tablet_manager.cc:1434] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.002s
I20260709 12:21:33.107264 30940 tablet_bootstrap.cc:492] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:33.101032 31071 raft_consensus.cc:2749] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:33.113207 30940 tablet_bootstrap.cc:654] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:33.113266 30942 tablet_bootstrap.cc:654] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:33.104862 31066 raft_consensus.cc:2804] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:21:33.114527 30860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 61653.5us
W20260709 12:21:33.120716 31078 log.cc:927] Time spent T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:21:33.121606 30860 leader_election.cc:304] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:33.100449 31012 raft_consensus.cc:515] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.129877 30984 raft_consensus.cc:2804] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:33.130455 30984 raft_consensus.cc:697] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:33.131474 30984 consensus_queue.cc:237] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:33.132447 30939 ts_tablet_manager.cc:1434] T 5c179d47d7f146ed83b56ea632997aa7 P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.118s	user 0.008s	sys 0.002s
I20260709 12:21:33.114703 30745 raft_consensus.cc:2468] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:33.146375 30939 tablet_bootstrap.cc:492] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:33.156030 30941 tablet_bootstrap.cc:492] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:33.155927 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac7c8095aaa457494024d09dfaaf1bb" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:33.156765 31073 raft_consensus.cc:493] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:33.156802 30669 raft_consensus.cc:3060] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:33.168375 31012 leader_election.cc:290] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:33.157500 31073 raft_consensus.cc:3060] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:33.177561 30668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ccb8b23d8455a990ef1cb50271887" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:33.178489 30668 raft_consensus.cc:2468] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 0.
I20260709 12:21:33.180845 30857 leader_election.cc:304] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:33.182080 31012 raft_consensus.cc:2804] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:33.182622 31012 raft_consensus.cc:493] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:33.183094 31012 raft_consensus.cc:3060] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:33.183329 31069 raft_consensus.cc:493] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.183988 31069 raft_consensus.cc:515] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.185426 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87d449e2aa442ec87cb2b55b61d4496" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:33.187227 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ccb8b23d8455a990ef1cb50271887" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
W20260709 12:21:33.192543 30709 leader_election.cc:343] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:33.193410 30709 leader_election.cc:304] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:33.193910 31073 raft_consensus.cc:515] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.194787 31071 raft_consensus.cc:2749] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:21:33.196187 31073 leader_election.cc:290] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:33.197733 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:33.201960 31069 leader_election.cc:290] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:33.202592 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ccb8b23d8455a990ef1cb50271887" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:33.203182 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ccb8b23d8455a990ef1cb50271887" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:33.203346 30817 raft_consensus.cc:2468] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 0.
I20260709 12:21:33.203831 30670 raft_consensus.cc:2468] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 0.
I20260709 12:21:33.193331 30941 tablet_bootstrap.cc:654] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:33.210482 30783 leader_election.cc:304] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:33.216451 31073 raft_consensus.cc:2804] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:33.219249 31073 raft_consensus.cc:493] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:33.219681 31073 raft_consensus.cc:3060] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:33.220285 30942 tablet_bootstrap.cc:492] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:33.220923 30942 ts_tablet_manager.cc:1403] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.141s	user 0.021s	sys 0.000s
I20260709 12:21:33.226152 30940 tablet_bootstrap.cc:492] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:33.226824 30940 ts_tablet_manager.cc:1403] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.120s	user 0.025s	sys 0.003s
I20260709 12:21:33.228250 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:33.229168 30939 tablet_bootstrap.cc:654] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:33.229836 30783 leader_election.cc:304] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:33.233551 31069 raft_consensus.cc:2749] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:33.235252 30942 raft_consensus.cc:359] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:33.236017 30942 raft_consensus.cc:385] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.236265 30942 raft_consensus.cc:740] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:33.231843 30669 raft_consensus.cc:2468] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:33.240458 30857 leader_election.cc:304] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:33.242439 31067 raft_consensus.cc:2804] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:33.225797 31066 raft_consensus.cc:697] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:33.243206 31067 raft_consensus.cc:697] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:33.223897 31012 raft_consensus.cc:515] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.245199 30891 raft_consensus.cc:2393] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c7a0cd21c3449587fdeeff565557d3 in current term 1: Already voted for candidate d3ab9d21f8864b50a71b49c7d624584a in this term.
I20260709 12:21:33.244801 31067 consensus_queue.cc:237] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:33.246822 31066 consensus_queue.cc:237] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:33.249895 30942 consensus_queue.cc:260] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:33.250573 31012 leader_election.cc:290] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:33.254777 30568 catalog_manager.cc:5697] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:33.261809 30569 catalog_manager.cc:5697] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:33.264869 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ccb8b23d8455a990ef1cb50271887" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:33.268901 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ccb8b23d8455a990ef1cb50271887" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:33.270006 30669 raft_consensus.cc:3060] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:33.280786 30942 ts_tablet_manager.cc:1434] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 12:21:33.295984 31073 raft_consensus.cc:515] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.297562 30817 raft_consensus.cc:2393] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d3ab9d21f8864b50a71b49c7d624584a in current term 1: Already voted for candidate 20c7a0cd21c3449587fdeeff565557d3 in this term.
I20260709 12:21:33.295962 30940 raft_consensus.cc:359] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:33.298817 30940 raft_consensus.cc:385] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.299083 30940 raft_consensus.cc:740] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:33.300580 30940 consensus_queue.cc:260] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:33.302014 30978 consensus_queue.cc:1048] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:33.304077 31073 leader_election.cc:290] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:33.305106 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ccb8b23d8455a990ef1cb50271887" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:33.305444 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ccb8b23d8455a990ef1cb50271887" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:33.306079 30891 raft_consensus.cc:2393] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c7a0cd21c3449587fdeeff565557d3 in current term 1: Already voted for candidate d3ab9d21f8864b50a71b49c7d624584a in this term.
I20260709 12:21:33.307818 30785 leader_election.cc:304] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:33.308578 30940 ts_tablet_manager.cc:1434] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.001s
I20260709 12:21:33.310290 30940 tablet_bootstrap.cc:492] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:33.313927 30976 consensus_queue.cc:1048] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:33.316342 30942 tablet_bootstrap.cc:492] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:33.323125 30669 raft_consensus.cc:2468] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:33.324648 30857 leader_election.cc:304] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3
I20260709 12:21:33.325598 31012 raft_consensus.cc:2804] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:33.326167 31012 raft_consensus.cc:697] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:33.315932 31073 raft_consensus.cc:2749] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:21:33.332592 30940 tablet_bootstrap.cc:654] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:33.340298 31012 consensus_queue.cc:237] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.355198 30941 tablet_bootstrap.cc:492] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:33.355859 30941 ts_tablet_manager.cc:1403] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.200s	user 0.027s	sys 0.029s
I20260709 12:21:33.360339 30941 raft_consensus.cc:359] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:33.361214 30941 raft_consensus.cc:385] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.361553 30941 raft_consensus.cc:740] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:33.363111 30941 consensus_queue.cc:260] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:33.368323 30939 tablet_bootstrap.cc:492] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:33.368975 30939 ts_tablet_manager.cc:1403] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.223s	user 0.016s	sys 0.013s
I20260709 12:21:33.371026 30941 ts_tablet_manager.cc:1434] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 12:21:33.372900 30941 tablet_bootstrap.cc:492] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:33.371485 30942 tablet_bootstrap.cc:654] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:33.382376 30942 tablet_bootstrap.cc:492] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:33.382804 30942 ts_tablet_manager.cc:1403] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.092s	user 0.008s	sys 0.004s
I20260709 12:21:33.383109 30941 tablet_bootstrap.cc:654] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:33.383220 30940 tablet_bootstrap.cc:492] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:33.383939 30940 ts_tablet_manager.cc:1403] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.074s	user 0.013s	sys 0.003s
I20260709 12:21:33.385425 30942 raft_consensus.cc:359] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:33.386137 30942 raft_consensus.cc:385] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.386399 30942 raft_consensus.cc:740] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:33.386888 30940 raft_consensus.cc:359] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.386782 30939 raft_consensus.cc:359] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:33.387132 30942 consensus_queue.cc:260] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:33.387781 30940 raft_consensus.cc:385] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.387985 30939 raft_consensus.cc:385] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.388152 30940 raft_consensus.cc:740] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:33.388537 30939 raft_consensus.cc:740] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:33.389746 30942 ts_tablet_manager.cc:1434] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:21:33.389901 30940 consensus_queue.cc:260] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.391108 30942 tablet_bootstrap.cc:492] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:33.392225 30940 ts_tablet_manager.cc:1434] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:21:33.393239 30940 tablet_bootstrap.cc:492] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:33.397475 30941 tablet_bootstrap.cc:492] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:33.389745 30939 consensus_queue.cc:260] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:33.398146 30941 ts_tablet_manager.cc:1403] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.011s
I20260709 12:21:33.398219 30942 tablet_bootstrap.cc:654] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:33.399150 30940 tablet_bootstrap.cc:654] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:33.401566 30941 raft_consensus.cc:359] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.402472 30941 raft_consensus.cc:385] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.402499 30939 ts_tablet_manager.cc:1434] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.001s
I20260709 12:21:33.406499 30939 tablet_bootstrap.cc:492] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:33.409971 30565 catalog_manager.cc:5697] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:33.416220 30783 consensus_peers.cc:597] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:33.402840 30941 raft_consensus.cc:740] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:33.425024 30941 consensus_queue.cc:260] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.427232 30941 ts_tablet_manager.cc:1434] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:21:33.428440 30941 tablet_bootstrap.cc:492] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:33.431694 30939 tablet_bootstrap.cc:654] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:33.435279 31073 consensus_queue.cc:1048] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:33.439174 30566 catalog_manager.cc:5697] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a reported cstate change: term changed from 0 to 1, leader changed from <none> to d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196). New cstate: current_term: 1 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:33.440282 31084 raft_consensus.cc:493] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.440872 30941 tablet_bootstrap.cc:654] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:33.443665 31084 raft_consensus.cc:515] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.446128 31084 leader_election.cc:290] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:33.444741 30566 catalog_manager.cc:5697] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a reported cstate change: term changed from 0 to 1, leader changed from <none> to d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196). New cstate: current_term: 1 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:33.448431 30566 catalog_manager.cc:5697] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a reported cstate change: term changed from 0 to 1, leader changed from <none> to d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196). New cstate: current_term: 1 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:33.449385 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fee969f4c2a4579ab7911212a86bf67" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:33.450424 30818 raft_consensus.cc:2468] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 0.
I20260709 12:21:33.452243 30637 leader_election.cc:304] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:33.452955 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fee969f4c2a4579ab7911212a86bf67" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
W20260709 12:21:33.454614 30636 leader_election.cc:343] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:33.441679 30940 tablet_bootstrap.cc:492] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:33.442534 30942 tablet_bootstrap.cc:492] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:33.458504 31084 raft_consensus.cc:2804] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:33.459228 31084 raft_consensus.cc:493] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:33.459298 30942 ts_tablet_manager.cc:1403] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.068s	user 0.020s	sys 0.017s
I20260709 12:21:33.459998 30940 ts_tablet_manager.cc:1403] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.021s
I20260709 12:21:33.462507 31084 raft_consensus.cc:3060] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:33.469800 30942 raft_consensus.cc:359] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.470600 30942 raft_consensus.cc:385] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.463200 30940 raft_consensus.cc:359] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.470880 30942 raft_consensus.cc:740] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:33.471095 30940 raft_consensus.cc:385] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.471503 30940 raft_consensus.cc:740] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:33.471689 30942 consensus_queue.cc:260] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.472357 30940 consensus_queue.cc:260] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.474988 30940 ts_tablet_manager.cc:1434] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 12:21:33.476147 30942 ts_tablet_manager.cc:1434] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:21:33.476202 30940 tablet_bootstrap.cc:492] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:33.478603 30942 tablet_bootstrap.cc:492] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:33.482999 31012 raft_consensus.cc:493] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.483651 31012 raft_consensus.cc:515] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.486044 31012 leader_election.cc:290] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:33.487401 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fee969f4c2a4579ab7911212a86bf67" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:33.487870 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fee969f4c2a4579ab7911212a86bf67" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:33.488193 30818 raft_consensus.cc:2468] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 0.
I20260709 12:21:33.489377 30860 leader_election.cc:304] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:33.490195 31012 raft_consensus.cc:2804] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:33.490597 31012 raft_consensus.cc:493] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:33.490936 31012 raft_consensus.cc:3060] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:33.491678 31084 raft_consensus.cc:515] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.496752 30671 raft_consensus.cc:2393] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3ab9d21f8864b50a71b49c7d624584a in current term 1: Already voted for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in this term.
I20260709 12:21:33.497093 30940 tablet_bootstrap.cc:654] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:33.500572 30942 tablet_bootstrap.cc:654] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:33.506505 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fee969f4c2a4579ab7911212a86bf67" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:33.507545 30818 raft_consensus.cc:3060] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:33.506573 31012 raft_consensus.cc:515] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.517464 31024 raft_consensus.cc:493] T 5c179d47d7f146ed83b56ea632997aa7 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.518206 31024 raft_consensus.cc:515] T 5c179d47d7f146ed83b56ea632997aa7 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:33.523025 31084 leader_election.cc:290] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:33.524185 30818 raft_consensus.cc:2468] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:33.524787 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fee969f4c2a4579ab7911212a86bf67" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:33.525790 30891 raft_consensus.cc:2393] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in current term 1: Already voted for candidate d3ab9d21f8864b50a71b49c7d624584a in this term.
I20260709 12:21:33.526432 31018 raft_consensus.cc:493] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.526682 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c179d47d7f146ed83b56ea632997aa7" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:33.527112 31018 raft_consensus.cc:515] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:33.527855 30818 raft_consensus.cc:2393] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 in current term 1: Already voted for candidate d3ab9d21f8864b50a71b49c7d624584a in this term.
I20260709 12:21:33.525796 30637 leader_election.cc:304] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:33.529477 31018 leader_election.cc:290] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:33.530345 31024 leader_election.cc:290] T 5c179d47d7f146ed83b56ea632997aa7 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:33.530572 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fee969f4c2a4579ab7911212a86bf67" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:33.531425 30671 raft_consensus.cc:2393] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d3ab9d21f8864b50a71b49c7d624584a in current term 1: Already voted for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in this term.
I20260709 12:21:33.526829 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c179d47d7f146ed83b56ea632997aa7" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:33.532334 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5d808cf6da46a0894e888635591cc8" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:33.532943 31084 raft_consensus.cc:2804] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:33.533524 31084 raft_consensus.cc:697] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:21:33.533948 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5d808cf6da46a0894e888635591cc8" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:33.534423 31084 consensus_queue.cc:237] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
W20260709 12:21:33.535763 30783 leader_election.cc:343] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:33.536579 30783 leader_election.cc:343] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:33.536360 31071 consensus_queue.cc:1048] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:33.538619 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fee969f4c2a4579ab7911212a86bf67" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:33.539445 30818 raft_consensus.cc:2393] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d3ab9d21f8864b50a71b49c7d624584a in current term 1: Already voted for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in this term.
I20260709 12:21:33.542577 31067 consensus_queue.cc:1048] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:33.545245 30711 leader_election.cc:304] T 5c179d47d7f146ed83b56ea632997aa7 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:33.546429 31024 raft_consensus.cc:3060] T 5c179d47d7f146ed83b56ea632997aa7 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:33.532977 31012 leader_election.cc:290] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:33.537055 30783 leader_election.cc:304] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:33.559031 31018 raft_consensus.cc:2749] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:33.560310 30860 leader_election.cc:304] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:33.561622 30958 consensus_queue.cc:1048] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:33.561687 31012 raft_consensus.cc:2749] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:21:33.572018 30939 tablet_bootstrap.cc:492] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:33.572896 30939 ts_tablet_manager.cc:1403] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.167s	user 0.014s	sys 0.001s
I20260709 12:21:33.569072 30941 tablet_bootstrap.cc:492] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:33.574164 30941 ts_tablet_manager.cc:1403] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.146s	user 0.015s	sys 0.047s
I20260709 12:21:33.576371 30565 catalog_manager.cc:5697] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a reported cstate change: term changed from 0 to 1, leader changed from <none> to d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196). New cstate: current_term: 1 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:33.574378 31012 consensus_queue.cc:1048] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:33.578800 30939 raft_consensus.cc:359] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:33.579720 30939 raft_consensus.cc:385] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.580245 30939 raft_consensus.cc:740] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:33.583273 30941 raft_consensus.cc:359] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.584739 30939 consensus_queue.cc:260] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:33.601613 31067 raft_consensus.cc:493] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.606664 30941 raft_consensus.cc:385] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.606864 31067 raft_consensus.cc:515] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:33.606673 30566 catalog_manager.cc:5697] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:33.609396 31067 leader_election.cc:290] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:33.610136 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d372d3fc5dd43d1880a4a932c83d7da" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:33.607146 30941 raft_consensus.cc:740] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
W20260709 12:21:33.611764 30857 leader_election.cc:343] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:33.612458 30939 ts_tablet_manager.cc:1434] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 12:21:33.612689 30941 consensus_queue.cc:260] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.613752 30939 tablet_bootstrap.cc:492] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:33.615406 30941 ts_tablet_manager.cc:1434] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 12:21:33.616988 30941 tablet_bootstrap.cc:492] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:33.619913 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d372d3fc5dd43d1880a4a932c83d7da" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:33.620774 30742 raft_consensus.cc:2468] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 0.
I20260709 12:21:33.629422 30818 raft_consensus.cc:1240] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Rejecting Update request from peer 4e9c812ece8a42efa063dc7bd5ea25e4 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:33.634794 31084 consensus_queue.cc:1059] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:33.624436 30939 tablet_bootstrap.cc:654] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:33.635836 30976 raft_consensus.cc:3055] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:33.637089 30976 raft_consensus.cc:740] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:21:33.638235 30976 consensus_queue.cc:260] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.640023 30976 raft_consensus.cc:3060] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:33.654723 30958 raft_consensus.cc:493] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.655423 30958 raft_consensus.cc:515] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:33.659412 30958 leader_election.cc:290] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:33.664103 31084 raft_consensus.cc:493] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.664772 31084 raft_consensus.cc:515] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:33.660363 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac7c8095aaa457494024d09dfaaf1bb" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:33.666733 30671 raft_consensus.cc:2393] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 in current term 1: Already voted for candidate d3ab9d21f8864b50a71b49c7d624584a in this term.
I20260709 12:21:33.667418 31084 leader_election.cc:290] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:33.670270 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78acfb4f1d649e4821c390039d2ede5" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:33.671079 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78acfb4f1d649e4821c390039d2ede5" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:33.672179 30892 raft_consensus.cc:2468] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 0.
I20260709 12:21:33.673556 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac7c8095aaa457494024d09dfaaf1bb" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
W20260709 12:21:33.675590 30634 leader_election.cc:343] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:33.677225 30711 leader_election.cc:304] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:33.677522 30636 leader_election.cc:304] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:33.678542 30958 raft_consensus.cc:3060] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:33.678735 31084 raft_consensus.cc:2804] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:33.679272 31084 raft_consensus.cc:493] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:33.679522 31084 raft_consensus.cc:3060] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:33.624145 31024 raft_consensus.cc:2749] T 5c179d47d7f146ed83b56ea632997aa7 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:33.698408 30942 tablet_bootstrap.cc:492] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:33.696255 30857 leader_election.cc:304] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:33.701874 30942 ts_tablet_manager.cc:1403] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.224s	user 0.024s	sys 0.035s
I20260709 12:21:33.697901 31084 raft_consensus.cc:515] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:33.694427 30940 tablet_bootstrap.cc:492] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:33.702843 31066 raft_consensus.cc:2804] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:33.703433 31066 raft_consensus.cc:493] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:33.703634 30940 ts_tablet_manager.cc:1403] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.228s	user 0.011s	sys 0.003s
I20260709 12:21:33.703816 31066 raft_consensus.cc:3060] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:33.704890 30942 raft_consensus.cc:359] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:33.705649 30942 raft_consensus.cc:385] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.705935 30942 raft_consensus.cc:740] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:33.706749 30942 consensus_queue.cc:260] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:33.688620 30958 raft_consensus.cc:2749] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:33.709096 30942 ts_tablet_manager.cc:1434] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:21:33.707105 30940 raft_consensus.cc:359] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:33.709649 30940 raft_consensus.cc:385] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.710346 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78acfb4f1d649e4821c390039d2ede5" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:33.714612 30891 raft_consensus.cc:3060] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:33.700273 30939 tablet_bootstrap.cc:492] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:33.715866 30939 ts_tablet_manager.cc:1403] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.102s	user 0.026s	sys 0.010s
I20260709 12:21:33.710865 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78acfb4f1d649e4821c390039d2ede5" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:33.720206 30940 raft_consensus.cc:740] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:33.712849 31067 consensus_queue.cc:1048] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:33.712770 31066 raft_consensus.cc:515] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:33.703882 31084 leader_election.cc:290] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:33.711308 30942 tablet_bootstrap.cc:492] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:33.721539 30940 consensus_queue.cc:260] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
W20260709 12:21:33.728703 30617 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:33.729126 30939 raft_consensus.cc:359] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:33.769776 30939 raft_consensus.cc:385] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.770119 30939 raft_consensus.cc:740] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:33.770709 31066 leader_election.cc:290] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:33.729765 31067 consensus_queue.cc:1048] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260709 12:21:33.771072 30939 consensus_queue.cc:260] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:33.771579 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d372d3fc5dd43d1880a4a932c83d7da" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:33.772675 30891 raft_consensus.cc:2468] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:33.773710 30939 ts_tablet_manager.cc:1434] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.058s	user 0.023s	sys 0.015s
W20260709 12:21:33.721042 30634 leader_election.cc:343] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:33.774353 30636 leader_election.cc:304] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:33.774467 31018 raft_consensus.cc:493] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.774873 30939 tablet_bootstrap.cc:492] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
W20260709 12:21:33.775084 30857 leader_election.cc:343] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:33.788915 31018 raft_consensus.cc:515] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
W20260709 12:21:33.789495 30634 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 68520.2us
I20260709 12:21:33.792805 31084 raft_consensus.cc:2804] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:33.793399 31084 raft_consensus.cc:697] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:21:33.793987 30942 tablet_bootstrap.cc:654] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:33.795426 30940 ts_tablet_manager.cc:1434] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.091s	user 0.007s	sys 0.010s
I20260709 12:21:33.795461 30939 tablet_bootstrap.cc:654] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:33.797683 31018 leader_election.cc:290] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:33.798861 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439d52649ecc46e58d714b9351576dd5" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:33.798712 31084 consensus_queue.cc:237] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:33.798580 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d372d3fc5dd43d1880a4a932c83d7da" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:33.800201 30745 raft_consensus.cc:3060] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:33.801151 30783 leader_election.cc:343] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:33.801872 30940 tablet_bootstrap.cc:492] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:33.807588 30939 tablet_bootstrap.cc:492] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:33.808200 30939 ts_tablet_manager.cc:1403] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.016s
I20260709 12:21:33.810874 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439d52649ecc46e58d714b9351576dd5" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:33.822620 30891 raft_consensus.cc:2468] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 0.
I20260709 12:21:33.817610 30940 tablet_bootstrap.cc:654] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:33.816426 30939 raft_consensus.cc:359] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:33.825559 30939 raft_consensus.cc:385] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.825902 30939 raft_consensus.cc:740] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:33.825806 31012 consensus_queue.cc:1048] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:33.827272 30939 consensus_queue.cc:260] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:33.830001 30939 ts_tablet_manager.cc:1434] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:21:33.831118 30939 tablet_bootstrap.cc:492] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:33.833060 30785 leader_election.cc:304] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:33.834800 31018 raft_consensus.cc:2804] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:33.835330 31018 raft_consensus.cc:493] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:33.835783 31018 raft_consensus.cc:3060] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:33.839095 30939 tablet_bootstrap.cc:654] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:33.767999 30941 tablet_bootstrap.cc:654] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:33.857453 31012 consensus_queue.cc:1048] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:33.859504 30745 raft_consensus.cc:2468] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:33.859843 30939 tablet_bootstrap.cc:492] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:33.864601 30940 tablet_bootstrap.cc:492] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:33.865449 30939 ts_tablet_manager.cc:1403] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.005s
I20260709 12:21:33.866948 30857 leader_election.cc:304] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:33.868775 30939 raft_consensus.cc:359] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:33.869518 30939 raft_consensus.cc:385] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.869791 30939 raft_consensus.cc:740] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:33.870519 30939 consensus_queue.cc:260] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:33.872831 31012 raft_consensus.cc:2804] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:33.873464 31012 raft_consensus.cc:697] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:33.873602 30939 ts_tablet_manager.cc:1434] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 12:21:33.874903 30939 tablet_bootstrap.cc:492] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:33.874670 31012 consensus_queue.cc:237] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:33.873471 31018 raft_consensus.cc:515] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:33.877905 30976 raft_consensus.cc:493] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.878484 30976 raft_consensus.cc:515] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.879105 31018 leader_election.cc:290] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:33.882798 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006658e1213f4f8da089a9570e0a76b9" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:33.884498 30939 tablet_bootstrap.cc:654] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:33.887508 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439d52649ecc46e58d714b9351576dd5" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
W20260709 12:21:33.889616 30783 leader_election.cc:343] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:33.891995 30976 leader_election.cc:290] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:33.904850 31067 consensus_queue.cc:1048] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:33.907820 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006658e1213f4f8da089a9570e0a76b9" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:33.912523 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439d52649ecc46e58d714b9351576dd5" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:33.917410 30891 raft_consensus.cc:3060] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:33.919832 30636 leader_election.cc:304] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:33.929983 30978 raft_consensus.cc:2749] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:33.865509 30940 ts_tablet_manager.cc:1403] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.004s
I20260709 12:21:33.936017 30566 catalog_manager.cc:5697] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:33.949609 31069 raft_consensus.cc:493] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.950362 31069 raft_consensus.cc:515] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:33.952491 31069 leader_election.cc:290] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:33.954289 31128 raft_consensus.cc:493] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.954888 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:33.955474 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:33.954946 31128 raft_consensus.cc:515] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
W20260709 12:21:33.957082 30783 leader_election.cc:343] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:33.959019 31128 leader_election.cc:290] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:33.959606 30941 tablet_bootstrap.cc:492] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:33.960129 30941 ts_tablet_manager.cc:1403] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.343s	user 0.013s	sys 0.001s
I20260709 12:21:33.960188 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5d808cf6da46a0894e888635591cc8" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
W20260709 12:21:33.960189 30785 leader_election.cc:343] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:33.960985 30817 raft_consensus.cc:2468] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 0.
I20260709 12:21:33.961278 30785 leader_election.cc:304] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:33.962453 30712 leader_election.cc:304] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
I20260709 12:21:33.962947 30941 raft_consensus.cc:359] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:33.962615 31018 raft_consensus.cc:2749] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:33.965425 31128 raft_consensus.cc:2804] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:33.965824 31128 raft_consensus.cc:493] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:33.966138 31128 raft_consensus.cc:3060] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:33.975659 31128 raft_consensus.cc:515] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:33.981655 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5d808cf6da46a0894e888635591cc8" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:33.981822 31128 leader_election.cc:290] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:33.982420 30817 raft_consensus.cc:3060] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:33.963665 30941 raft_consensus.cc:385] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.983434 30941 raft_consensus.cc:740] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:33.984115 30941 consensus_queue.cc:260] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:33.986550 30941 ts_tablet_manager.cc:1434] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:21:33.988071 30941 tablet_bootstrap.cc:492] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:33.990015 30817 raft_consensus.cc:2468] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:33.990727 30978 consensus_queue.cc:1048] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:33.991266 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5d808cf6da46a0894e888635591cc8" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:33.991415 30712 leader_election.cc:304] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
I20260709 12:21:33.992386 30958 raft_consensus.cc:2804] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:33.992897 30958 raft_consensus.cc:697] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:33.993788 30958 consensus_queue.cc:237] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:33.960898 30940 raft_consensus.cc:359] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:33.995081 30940 raft_consensus.cc:385] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.995383 30940 raft_consensus.cc:740] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:33.996116 30940 consensus_queue.cc:260] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:33.992820 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5d808cf6da46a0894e888635591cc8" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:34.000129 30942 tablet_bootstrap.cc:492] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
W20260709 12:21:34.000519 30857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 84289.7us
I20260709 12:21:34.000741 30942 ts_tablet_manager.cc:1403] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.290s	user 0.015s	sys 0.027s
I20260709 12:21:34.005905 30565 catalog_manager.cc:5697] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a reported cstate change: term changed from 0 to 1, leader changed from <none> to d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196). New cstate: current_term: 1 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:34.006827 30942 raft_consensus.cc:359] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:34.027812 30942 raft_consensus.cc:385] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.027633 30976 consensus_queue.cc:1048] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:34.028116 30942 raft_consensus.cc:740] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.028927 30942 consensus_queue.cc:260] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:34.031289 30942 ts_tablet_manager.cc:1434] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 12:21:34.032793 30942 tablet_bootstrap.cc:492] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:34.013614 30941 tablet_bootstrap.cc:654] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.014330 30669 raft_consensus.cc:3060] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:34.014469 30709 leader_election.cc:343] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:34.041706 30709 leader_election.cc:343] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:34.052294 31024 raft_consensus.cc:493] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.053150 31024 raft_consensus.cc:515] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:34.064261 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78acfb4f1d649e4821c390039d2ede5" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:34.065495 30893 raft_consensus.cc:2393] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 in current term 1: Already voted for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in this term.
I20260709 12:21:34.066397 30941 tablet_bootstrap.cc:492] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:34.067052 30941 ts_tablet_manager.cc:1403] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.079s	user 0.009s	sys 0.002s
I20260709 12:21:34.023741 30940 ts_tablet_manager.cc:1434] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.000s
I20260709 12:21:34.023897 30958 raft_consensus.cc:493] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.068617 30958 raft_consensus.cc:515] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:34.069235 30940 tablet_bootstrap.cc:492] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:34.020200 31067 consensus_queue.cc:1048] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:34.075132 30942 tablet_bootstrap.cc:654] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.085716 31024 leader_election.cc:290] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:34.087131 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78acfb4f1d649e4821c390039d2ede5" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:34.089697 30939 tablet_bootstrap.cc:492] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:34.089839 30709 leader_election.cc:304] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:34.090299 30939 ts_tablet_manager.cc:1403] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.216s	user 0.043s	sys 0.069s
I20260709 12:21:34.090314 30941 raft_consensus.cc:359] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:34.092823 30941 raft_consensus.cc:385] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.093113 30941 raft_consensus.cc:740] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.093940 30941 consensus_queue.cc:260] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:34.094532 30958 leader_election.cc:290] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:34.095351 30958 raft_consensus.cc:3060] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.095592 30940 tablet_bootstrap.cc:654] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.096887 30939 raft_consensus.cc:359] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:34.097194 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f3fc82ff104135851cce7357eda3ec" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:34.097678 30939 raft_consensus.cc:385] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.098081 30817 raft_consensus.cc:2468] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 0.
I20260709 12:21:34.098294 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f3fc82ff104135851cce7357eda3ec" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:34.100047 30941 ts_tablet_manager.cc:1434] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:21:34.097959 30939 raft_consensus.cc:740] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
W20260709 12:21:34.101029 30709 leader_election.cc:343] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:34.102137 30939 consensus_queue.cc:260] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:34.102448 30712 leader_election.cc:304] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:34.101126 30941 tablet_bootstrap.cc:492] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:34.103982 31128 raft_consensus.cc:2804] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:34.104364 31128 raft_consensus.cc:493] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.104710 31128 raft_consensus.cc:3060] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.109315 30941 tablet_bootstrap.cc:654] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.111207 30566 catalog_manager.cc:5697] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:34.027099 30891 raft_consensus.cc:2468] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:34.129607 30942 tablet_bootstrap.cc:492] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:34.130237 30942 ts_tablet_manager.cc:1403] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.098s	user 0.011s	sys 0.012s
I20260709 12:21:34.132019 30785 leader_election.cc:304] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:34.133451 31069 raft_consensus.cc:2804] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:34.133585 30942 raft_consensus.cc:359] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:34.134001 31069 raft_consensus.cc:697] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:34.134819 31067 raft_consensus.cc:493] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.134995 31069 consensus_queue.cc:237] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:34.135389 31067 raft_consensus.cc:515] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:34.137624 31067 leader_election.cc:290] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:34.139832 31128 raft_consensus.cc:515] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:34.140369 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38606820b9b349d3ad9f9fae03de5e86" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
W20260709 12:21:34.142396 30857 leader_election.cc:343] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:34.143733 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f3fc82ff104135851cce7357eda3ec" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
W20260709 12:21:34.145912 30709 leader_election.cc:343] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:34.145908 30942 raft_consensus.cc:385] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.158301 30942 raft_consensus.cc:740] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.159391 30942 consensus_queue.cc:260] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:34.167186 31128 leader_election.cc:290] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:34.167659 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38606820b9b349d3ad9f9fae03de5e86" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:34.169267 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f3fc82ff104135851cce7357eda3ec" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:34.170190 30817 raft_consensus.cc:3060] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:34.183495 30857 leader_election.cc:343] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:34.184242 30857 leader_election.cc:304] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:34.185794 31067 raft_consensus.cc:2749] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:34.183404 30942 ts_tablet_manager.cc:1434] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.003s
I20260709 12:21:34.189769 30942 tablet_bootstrap.cc:492] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:34.119105 30958 raft_consensus.cc:2749] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:34.193341 30939 ts_tablet_manager.cc:1434] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.103s	user 0.012s	sys 0.023s
I20260709 12:21:34.194583 30939 tablet_bootstrap.cc:492] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:34.196385 30940 tablet_bootstrap.cc:492] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:34.197319 30940 ts_tablet_manager.cc:1403] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.128s	user 0.016s	sys 0.016s
I20260709 12:21:34.201033 30939 tablet_bootstrap.cc:654] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.202186 30817 raft_consensus.cc:2468] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:34.206358 30941 tablet_bootstrap.cc:492] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:34.208788 30941 ts_tablet_manager.cc:1403] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.108s	user 0.028s	sys 0.008s
I20260709 12:21:34.209539 30712 leader_election.cc:304] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:34.209815 30940 raft_consensus.cc:359] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:34.210662 30940 raft_consensus.cc:385] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.211153 30940 raft_consensus.cc:740] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.212029 30940 consensus_queue.cc:260] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:34.211578 30941 raft_consensus.cc:359] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:34.212306 30567 catalog_manager.cc:5697] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:34.213536 30941 raft_consensus.cc:385] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.213946 30941 raft_consensus.cc:740] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.214728 30941 consensus_queue.cc:260] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:34.215013 30940 ts_tablet_manager.cc:1434] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 12:21:34.216400 30940 tablet_bootstrap.cc:492] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:34.216890 30941 ts_tablet_manager.cc:1434] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:21:34.210719 30958 raft_consensus.cc:2804] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:34.218142 30939 tablet_bootstrap.cc:492] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:34.218746 30939 ts_tablet_manager.cc:1403] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 12:21:34.218840 30958 raft_consensus.cc:697] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:34.220834 30958 consensus_queue.cc:237] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:34.221690 30939 raft_consensus.cc:359] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:34.222429 30939 raft_consensus.cc:385] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.222743 30939 raft_consensus.cc:740] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.223167 30940 tablet_bootstrap.cc:654] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.223467 30939 consensus_queue.cc:260] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:34.225432 30941 tablet_bootstrap.cc:492] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:34.231391 30941 tablet_bootstrap.cc:654] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.208040 30942 tablet_bootstrap.cc:654] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.236114 30939 ts_tablet_manager.cc:1434] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:21:34.237711 30939 tablet_bootstrap.cc:492] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:34.241048 30940 tablet_bootstrap.cc:492] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:34.241776 30940 ts_tablet_manager.cc:1403] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.007s
I20260709 12:21:34.246140 30940 raft_consensus.cc:359] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:34.246860 30940 raft_consensus.cc:385] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.247138 30940 raft_consensus.cc:740] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.247406 30942 tablet_bootstrap.cc:492] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:34.248184 30942 ts_tablet_manager.cc:1403] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.059s	user 0.008s	sys 0.002s
I20260709 12:21:34.247857 30940 consensus_queue.cc:260] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:34.255461 30939 tablet_bootstrap.cc:654] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.252668 30942 raft_consensus.cc:359] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:34.256616 30942 raft_consensus.cc:385] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.256961 30942 raft_consensus.cc:740] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.257777 30942 consensus_queue.cc:260] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:34.258858 30940 ts_tablet_manager.cc:1434] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:21:34.259959 30940 tablet_bootstrap.cc:492] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:34.260190 30942 ts_tablet_manager.cc:1434] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:21:34.260605 30669 raft_consensus.cc:3060] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.261198 30976 raft_consensus.cc:493] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.261754 30976 raft_consensus.cc:515] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:34.262276 30941 tablet_bootstrap.cc:492] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:34.262944 30941 ts_tablet_manager.cc:1403] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.009s
I20260709 12:21:34.265884 31069 raft_consensus.cc:493] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.266095 30941 raft_consensus.cc:359] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:34.266489 31069 raft_consensus.cc:515] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:34.267488 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5d808cf6da46a0894e888635591cc8" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:34.268362 30817 raft_consensus.cc:2393] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in current term 1: Already voted for candidate 4a9042c4154c442297159d1c9f1186b9 in this term.
I20260709 12:21:34.269346 31069 leader_election.cc:290] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:34.270089 30976 leader_election.cc:290] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:34.270282 30941 raft_consensus.cc:385] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.270949 30941 raft_consensus.cc:740] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.271993 30941 consensus_queue.cc:260] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:34.265940 30940 tablet_bootstrap.cc:654] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.273820 30942 tablet_bootstrap.cc:492] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:34.268210 30566 catalog_manager.cc:5697] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:34.276621 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8edecc2bf945e2bf553a7708f0f2cb" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:34.277401 30742 raft_consensus.cc:2468] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 0.
I20260709 12:21:34.280068 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8edecc2bf945e2bf553a7708f0f2cb" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:34.280238 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5d808cf6da46a0894e888635591cc8" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:34.280874 30891 raft_consensus.cc:2468] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 0.
I20260709 12:21:34.282282 30785 leader_election.cc:304] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:34.283217 31069 raft_consensus.cc:2804] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:34.283586 31069 raft_consensus.cc:493] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.283902 31069 raft_consensus.cc:3060] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.289474 30634 leader_election.cc:304] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:34.292083 30942 tablet_bootstrap.cc:654] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.291813 30976 raft_consensus.cc:3060] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.302626 31067 consensus_queue.cc:1048] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:34.303649 30939 tablet_bootstrap.cc:492] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:34.304277 30939 ts_tablet_manager.cc:1403] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.008s
I20260709 12:21:34.304584 30978 consensus_queue.cc:1048] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:34.309799 30941 ts_tablet_manager.cc:1434] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 12:21:34.313685 31069 raft_consensus.cc:515] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:34.340359 30978 raft_consensus.cc:493] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.341233 31069 leader_election.cc:290] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:34.341503 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8edecc2bf945e2bf553a7708f0f2cb" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:34.342460 30893 raft_consensus.cc:3060] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.342808 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8edecc2bf945e2bf553a7708f0f2cb" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:34.343451 30742 raft_consensus.cc:3060] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.344170 30976 raft_consensus.cc:2749] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:34.345018 31084 raft_consensus.cc:493] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.346458 31084 raft_consensus.cc:515] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:34.347558 30978 raft_consensus.cc:515] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:34.349561 31084 leader_election.cc:290] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:34.350589 31084 raft_consensus.cc:493] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.351250 31084 raft_consensus.cc:515] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:34.352149 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d372d3fc5dd43d1880a4a932c83d7da" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:34.345749 30941 tablet_bootstrap.cc:492] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:34.353042 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38606820b9b349d3ad9f9fae03de5e86" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:34.349855 30978 leader_election.cc:290] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:34.357546 30939 raft_consensus.cc:359] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:34.358214 30939 raft_consensus.cc:385] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.358492 30939 raft_consensus.cc:740] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.359335 30939 consensus_queue.cc:260] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:34.360109 30894 raft_consensus.cc:2468] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 0.
I20260709 12:21:34.368151 30939 ts_tablet_manager.cc:1434] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.064s	user 0.009s	sys 0.000s
I20260709 12:21:34.370086 31066 consensus_queue.cc:1048] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:34.373425 30893 raft_consensus.cc:2468] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:34.374047 30939 tablet_bootstrap.cc:492] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:34.372020 31084 leader_election.cc:290] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:34.382706 30785 leader_election.cc:304] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:34.383746 31018 raft_consensus.cc:2804] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:34.377833 30636 leader_election.cc:304] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:34.385792 30978 raft_consensus.cc:2804] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:34.386200 30978 raft_consensus.cc:493] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.386543 30978 raft_consensus.cc:3060] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.388959 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87d449e2aa442ec87cb2b55b61d4496" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:34.389832 30817 raft_consensus.cc:2393] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in current term 1: Already voted for candidate 20c7a0cd21c3449587fdeeff565557d3 in this term.
I20260709 12:21:34.392257 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38606820b9b349d3ad9f9fae03de5e86" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:34.392948 30746 raft_consensus.cc:2468] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 0.
I20260709 12:21:34.392812 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87d449e2aa442ec87cb2b55b61d4496" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:34.393989 30743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d372d3fc5dd43d1880a4a932c83d7da" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:34.394230 30741 raft_consensus.cc:2393] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in current term 1: Already voted for candidate 4a9042c4154c442297159d1c9f1186b9 in this term.
I20260709 12:21:34.396781 30940 tablet_bootstrap.cc:492] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:34.397318 30940 ts_tablet_manager.cc:1403] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.138s	user 0.024s	sys 0.003s
I20260709 12:21:34.413686 30941 tablet_bootstrap.cc:654] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.417747 30940 raft_consensus.cc:359] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:34.418911 30940 raft_consensus.cc:385] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.419283 30940 raft_consensus.cc:740] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.420501 30940 consensus_queue.cc:260] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:34.435423 30634 leader_election.cc:304] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:34.438100 30742 raft_consensus.cc:2468] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:34.439602 31084 raft_consensus.cc:2749] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:34.443687 31018 raft_consensus.cc:697] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:34.447216 30940 ts_tablet_manager.cc:1434] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 12:21:34.454017 30939 tablet_bootstrap.cc:654] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.445578 30634 leader_election.cc:304] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:34.456547 30940 tablet_bootstrap.cc:492] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:34.460242 31018 consensus_queue.cc:237] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:34.459467 31084 raft_consensus.cc:3060] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.472766 30940 tablet_bootstrap.cc:654] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.474907 30942 tablet_bootstrap.cc:492] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:34.475696 30942 ts_tablet_manager.cc:1403] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.202s	user 0.013s	sys 0.015s
I20260709 12:21:34.478072 30941 tablet_bootstrap.cc:492] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:34.478669 30941 ts_tablet_manager.cc:1403] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.148s	user 0.022s	sys 0.003s
I20260709 12:21:34.485656 30941 raft_consensus.cc:359] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:34.486421 30941 raft_consensus.cc:385] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.486693 30941 raft_consensus.cc:740] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.487411 30941 consensus_queue.cc:260] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:34.502416 31155 raft_consensus.cc:493] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.503067 31155 raft_consensus.cc:515] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:34.505604 31155 leader_election.cc:290] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:34.507042 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439d52649ecc46e58d714b9351576dd5" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:34.507977 30891 raft_consensus.cc:2393] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 in current term 1: Already voted for candidate 20c7a0cd21c3449587fdeeff565557d3 in this term.
I20260709 12:21:34.507826 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439d52649ecc46e58d714b9351576dd5" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:34.510931 31084 raft_consensus.cc:2749] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:34.511426 30976 consensus_queue.cc:1048] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:34.505204 30978 raft_consensus.cc:515] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:34.513587 30712 leader_election.cc:304] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:34.514736 31155 raft_consensus.cc:3060] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.512492 30942 raft_consensus.cc:359] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:34.516523 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38606820b9b349d3ad9f9fae03de5e86" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:34.517262 30891 raft_consensus.cc:3060] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.517452 30978 leader_election.cc:290] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:34.516779 30942 raft_consensus.cc:385] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.518252 30942 raft_consensus.cc:740] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.516525 30941 ts_tablet_manager.cc:1434] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.004s
I20260709 12:21:34.520488 30941 tablet_bootstrap.cc:492] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:34.520982 30939 tablet_bootstrap.cc:492] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:34.521432 30939 ts_tablet_manager.cc:1403] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.148s	user 0.016s	sys 0.010s
I20260709 12:21:34.525075 31155 raft_consensus.cc:2749] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:34.525238 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38606820b9b349d3ad9f9fae03de5e86" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:34.524904 30942 consensus_queue.cc:260] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:34.526152 30742 raft_consensus.cc:3060] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.530830 30891 raft_consensus.cc:2468] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:34.532596 30636 leader_election.cc:304] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:34.533599 31177 raft_consensus.cc:2804] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:34.534132 31177 raft_consensus.cc:697] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:21:34.535267 30940 tablet_bootstrap.cc:492] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:34.534987 31177 consensus_queue.cc:237] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:34.535828 30940 ts_tablet_manager.cc:1403] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.088s	user 0.013s	sys 0.013s
I20260709 12:21:34.537590 30958 consensus_queue.cc:1048] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:34.538333 30942 ts_tablet_manager.cc:1434] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.000s
I20260709 12:21:34.539786 30942 tablet_bootstrap.cc:492] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:34.544466 30568 catalog_manager.cc:5697] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:34.548465 30942 tablet_bootstrap.cc:654] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.554814 30941 tablet_bootstrap.cc:654] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.562906 30942 tablet_bootstrap.cc:492] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:34.563481 30942 ts_tablet_manager.cc:1403] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.004s
I20260709 12:21:34.564675 31018 raft_consensus.cc:493] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.565260 31018 raft_consensus.cc:515] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:34.576958 31155 consensus_queue.cc:1048] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:34.597772 30742 raft_consensus.cc:2468] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:34.602210 30939 raft_consensus.cc:359] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:34.604044 31067 raft_consensus.cc:493] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.603648 30942 raft_consensus.cc:359] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:34.604883 30940 raft_consensus.cc:359] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:34.607031 30939 raft_consensus.cc:385] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.607537 30940 raft_consensus.cc:385] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.607175 31067 raft_consensus.cc:515] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:34.607913 30940 raft_consensus.cc:740] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.607904 30939 raft_consensus.cc:740] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.609256 30940 consensus_queue.cc:260] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:34.609745 31067 leader_election.cc:290] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:34.607993 30942 raft_consensus.cc:385] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.610502 30942 raft_consensus.cc:740] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.611212 30942 consensus_queue.cc:260] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:34.609381 30939 consensus_queue.cc:260] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:34.615382 30940 ts_tablet_manager.cc:1434] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.079s	user 0.002s	sys 0.018s
I20260709 12:21:34.616550 30940 tablet_bootstrap.cc:492] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:34.617218 30939 ts_tablet_manager.cc:1434] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.096s	user 0.012s	sys 0.003s
I20260709 12:21:34.618366 30939 tablet_bootstrap.cc:492] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:34.618167 31069 consensus_queue.cc:1048] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:34.619632 30942 ts_tablet_manager.cc:1434] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.001s
I20260709 12:21:34.621855 30941 tablet_bootstrap.cc:492] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:34.622407 30941 ts_tablet_manager.cc:1403] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.102s	user 0.007s	sys 0.007s
I20260709 12:21:34.625523 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:34.626730 30942 tablet_bootstrap.cc:492] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:34.627532 30939 tablet_bootstrap.cc:654] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.632306 31018 leader_election.cc:290] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:34.625458 30941 raft_consensus.cc:359] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:34.633227 30941 raft_consensus.cc:385] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.633563 30941 raft_consensus.cc:740] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.635054 30941 consensus_queue.cc:260] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:34.636475 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda0258f575243bd910da13e828fb6f6" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:34.638113 30941 ts_tablet_manager.cc:1434] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.006s
W20260709 12:21:34.638365 30783 leader_election.cc:343] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:34.639197 30941 tablet_bootstrap.cc:492] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:34.639580 31157 consensus_queue.cc:1048] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:34.639796 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda0258f575243bd910da13e828fb6f6" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:34.640905 30893 raft_consensus.cc:2468] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 0.
W20260709 12:21:34.644675 30857 leader_election.cc:343] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:34.644896 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:34.646092 30566 catalog_manager.cc:5697] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:34.647074 31171 raft_consensus.cc:493] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.648815 31171 raft_consensus.cc:515] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:34.648855 30785 leader_election.cc:304] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:34.655037 31018 raft_consensus.cc:2804] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:34.655313 30940 tablet_bootstrap.cc:654] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.655510 31018 raft_consensus.cc:493] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.655728 31171 leader_election.cc:290] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:34.649462 30818 raft_consensus.cc:2468] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 0.
I20260709 12:21:34.657574 30860 leader_election.cc:304] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:34.658403 31142 raft_consensus.cc:2804] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:34.658855 31142 raft_consensus.cc:493] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.659194 31142 raft_consensus.cc:3060] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.659454 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc72ff638c0425f9c75bb21e2b99dd3" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:34.658293 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc72ff638c0425f9c75bb21e2b99dd3" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:34.662511 30942 tablet_bootstrap.cc:654] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.675585 30941 tablet_bootstrap.cc:654] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.676393 30742 raft_consensus.cc:2468] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 0.
I20260709 12:21:34.656024 31018 raft_consensus.cc:3060] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.661774 30670 raft_consensus.cc:2468] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 0.
I20260709 12:21:34.680744 31084 raft_consensus.cc:493] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.695513 30783 leader_election.cc:304] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
I20260709 12:21:34.692816 31084 raft_consensus.cc:515] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:34.724891 31171 raft_consensus.cc:2804] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:34.725373 31171 raft_consensus.cc:493] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.725730 31171 raft_consensus.cc:3060] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.746677 31084 leader_election.cc:290] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:34.750092 31142 raft_consensus.cc:515] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:34.750842 30815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f3fc82ff104135851cce7357eda3ec" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:34.754053 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f3fc82ff104135851cce7357eda3ec" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:34.731899 31067 raft_consensus.cc:493] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.786521 31067 raft_consensus.cc:515] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:34.794788 31067 leader_election.cc:290] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:34.796271 31142 leader_election.cc:290] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:34.797183 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:34.797978 30817 raft_consensus.cc:3060] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.801278 30942 tablet_bootstrap.cc:492] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:34.801831 30942 ts_tablet_manager.cc:1403] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.175s	user 0.016s	sys 0.004s
I20260709 12:21:34.803968 31018 raft_consensus.cc:515] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:34.805763 31066 raft_consensus.cc:493] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:34.806455 31018 leader_election.cc:290] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:34.806373 31066 raft_consensus.cc:515] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:34.807740 30634 leader_election.cc:304] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:34.809760 30942 raft_consensus.cc:359] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:34.810911 30942 raft_consensus.cc:385] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.811352 30942 raft_consensus.cc:740] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.812189 30942 consensus_queue.cc:260] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:34.825187 31171 raft_consensus.cc:515] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
W20260709 12:21:34.814703 30783 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 124173us
I20260709 12:21:34.818900 30817 raft_consensus.cc:2468] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:34.827543 31171 leader_election.cc:290] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:34.814157 31084 raft_consensus.cc:2749] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:34.831522 30815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:34.832954 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda0258f575243bd910da13e828fb6f6" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:34.838233 30939 tablet_bootstrap.cc:492] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:34.838778 30939 ts_tablet_manager.cc:1403] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.221s	user 0.019s	sys 0.028s
I20260709 12:21:34.833034 30860 leader_election.cc:304] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:34.840103 31142 raft_consensus.cc:2804] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:21:34.814438 30785 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 64263.3us
I20260709 12:21:34.842399 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda0258f575243bd910da13e828fb6f6" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:34.843242 30893 raft_consensus.cc:3060] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.840554 31142 raft_consensus.cc:697] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:34.809412 31066 leader_election.cc:290] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:34.845321 31142 consensus_queue.cc:237] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:34.832495 30815 raft_consensus.cc:2393] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3ab9d21f8864b50a71b49c7d624584a in current term 2: Already voted for candidate 20c7a0cd21c3449587fdeeff565557d3 in this term.
I20260709 12:21:34.864089 30939 raft_consensus.cc:359] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:34.866781 30939 raft_consensus.cc:385] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.867202 30939 raft_consensus.cc:740] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.854256 30669 raft_consensus.cc:3060] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.867463 30942 ts_tablet_manager.cc:1434] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.065s	user 0.009s	sys 0.000s
I20260709 12:21:34.869378 30942 tablet_bootstrap.cc:492] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
W20260709 12:21:34.869812 30617 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:34.872174 30940 tablet_bootstrap.cc:492] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:34.872757 30940 ts_tablet_manager.cc:1403] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.256s	user 0.012s	sys 0.011s
I20260709 12:21:34.877239 30942 tablet_bootstrap.cc:654] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.877985 30940 raft_consensus.cc:359] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:34.878912 30940 raft_consensus.cc:385] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.879293 30940 raft_consensus.cc:740] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.881719 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc72ff638c0425f9c75bb21e2b99dd3" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:34.882355 30742 raft_consensus.cc:3060] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.878156 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc72ff638c0425f9c75bb21e2b99dd3" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:34.882936 30670 raft_consensus.cc:3060] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.885182 30939 consensus_queue.cc:260] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:34.887111 31190 raft_consensus.cc:493] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.887945 30939 ts_tablet_manager.cc:1434] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.003s
W20260709 12:21:34.853374 30857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 71341.6us
I20260709 12:21:34.887668 31190 raft_consensus.cc:515] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:34.890921 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48114d81f8f4cf08f9665b697bc5560" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:34.891106 31190 leader_election.cc:290] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
W20260709 12:21:34.893352 30857 leader_election.cc:343] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:34.894403 30668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:34.898131 30668 raft_consensus.cc:2468] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 2.
I20260709 12:21:34.898983 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:34.903100 30891 raft_consensus.cc:2468] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:34.905611 30785 leader_election.cc:304] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:34.905913 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:34.906728 31190 raft_consensus.cc:2804] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:34.907102 31190 raft_consensus.cc:493] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.907414 31190 raft_consensus.cc:3060] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:34.899518 30941 tablet_bootstrap.cc:492] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:34.910712 30941 ts_tablet_manager.cc:1403] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.272s	user 0.039s	sys 0.019s
I20260709 12:21:34.911875 30893 raft_consensus.cc:2468] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:34.880054 30940 consensus_queue.cc:260] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:34.901909 30670 raft_consensus.cc:2468] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:34.913021 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48114d81f8f4cf08f9665b697bc5560" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:34.913045 30939 tablet_bootstrap.cc:492] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:34.921263 30940 ts_tablet_manager.cc:1434] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 12:21:34.922449 30940 tablet_bootstrap.cc:492] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
W20260709 12:21:34.904768 30783 leader_election.cc:343] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:34.924052 30742 raft_consensus.cc:2468] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:34.925304 31194 consensus_queue.cc:1048] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:34.926873 30941 raft_consensus.cc:359] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:34.929733 30941 raft_consensus.cc:385] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.930094 30941 raft_consensus.cc:740] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.931046 30941 consensus_queue.cc:260] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:34.929399 30939 tablet_bootstrap.cc:654] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.932245 31157 consensus_queue.cc:1048] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:34.934641 30941 ts_tablet_manager.cc:1434] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.002s
I20260709 12:21:34.937700 30941 tablet_bootstrap.cc:492] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:34.939635 31190 raft_consensus.cc:515] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:34.941774 30783 leader_election.cc:304] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
I20260709 12:21:34.942871 31195 raft_consensus.cc:2804] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:34.943445 31195 raft_consensus.cc:697] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:34.944449 31195 consensus_queue.cc:237] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:34.946532 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:34.947248 30891 raft_consensus.cc:3060] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:21:34.920387 30857 leader_election.cc:304] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3
W20260709 12:21:34.953657 30857 leader_election.cc:343] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:34.955973 30857 leader_election.cc:343] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:34.956458 30891 raft_consensus.cc:2468] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 3.
I20260709 12:21:34.957552 30785 leader_election.cc:304] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:34.966583 31194 raft_consensus.cc:2804] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:34.967130 31194 raft_consensus.cc:697] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:34.968031 31194 consensus_queue.cc:237] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:34.971143 30941 tablet_bootstrap.cc:654] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.964015 30942 tablet_bootstrap.cc:492] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:34.979797 31069 consensus_queue.cc:1048] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:34.980595 30942 ts_tablet_manager.cc:1403] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.112s	user 0.012s	sys 0.002s
I20260709 12:21:34.980773 30785 leader_election.cc:304] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:34.981676 31069 raft_consensus.cc:2804] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:34.982144 31069 raft_consensus.cc:697] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:34.972018 30940 tablet_bootstrap.cc:654] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.983666 30942 raft_consensus.cc:359] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:34.984385 30942 raft_consensus.cc:385] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.984776 30942 raft_consensus.cc:740] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.982941 31069 consensus_queue.cc:237] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:34.985586 30942 consensus_queue.cc:260] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:34.987967 30942 ts_tablet_manager.cc:1434] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:21:34.989085 30942 tablet_bootstrap.cc:492] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:34.997583 31171 consensus_queue.cc:1048] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:34.961766 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:34.979420 31193 raft_consensus.cc:2764] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:21:34.979665 30939 tablet_bootstrap.cc:492] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:35.002188 30939 ts_tablet_manager.cc:1403] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.108s	user 0.012s	sys 0.002s
I20260709 12:21:35.005764 30669 raft_consensus.cc:2468] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 2.
I20260709 12:21:35.014910 31069 raft_consensus.cc:493] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.015581 31069 raft_consensus.cc:515] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:34.956519 30857 leader_election.cc:304] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:35.020211 31069 leader_election.cc:290] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:35.030805 30939 raft_consensus.cc:359] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:35.031570 30939 raft_consensus.cc:385] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.031847 30939 raft_consensus.cc:740] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.033617 30939 consensus_queue.cc:260] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:35.033005 31193 raft_consensus.cc:2749] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:35.026259 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bb30237ea045c79aa6eb181bc3e692" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:35.038738 30939 ts_tablet_manager.cc:1434] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:21:35.037818 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bb30237ea045c79aa6eb181bc3e692" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:35.036031 31069 raft_consensus.cc:493] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.044415 31069 raft_consensus.cc:515] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:35.048882 30668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:35.049589 30668 raft_consensus.cc:3060] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:35.051149 31194 raft_consensus.cc:493] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.051700 31194 raft_consensus.cc:515] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
W20260709 12:21:35.052279 30783 leader_election.cc:343] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:35.055649 30940 tablet_bootstrap.cc:492] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:35.056195 30940 ts_tablet_manager.cc:1403] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.134s	user 0.013s	sys 0.019s
I20260709 12:21:35.059010 30940 raft_consensus.cc:359] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:35.059680 30940 raft_consensus.cc:385] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.059947 30940 raft_consensus.cc:740] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.035544 31190 leader_election.cc:290] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:35.063184 30940 consensus_queue.cc:260] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:35.065825 30942 tablet_bootstrap.cc:654] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.063099 30565 catalog_manager.cc:5697] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:35.067435 30939 tablet_bootstrap.cc:492] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
W20260709 12:21:35.060801 30783 leader_election.cc:343] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:35.069494 30940 ts_tablet_manager.cc:1434] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 12:21:35.069727 30783 leader_election.cc:304] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:35.063771 30976 consensus_queue.cc:1048] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:21:35.070565 30940 tablet_bootstrap.cc:492] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:35.076936 31171 raft_consensus.cc:2749] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:35.078161 30668 raft_consensus.cc:2468] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 3.
I20260709 12:21:35.081058 30940 tablet_bootstrap.cc:654] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:35.060585 30857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 104644us
I20260709 12:21:35.068193 30565 catalog_manager.cc:5697] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:35.092096 31204 log.cc:927] Time spent T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:21:35.093693 31193 raft_consensus.cc:493] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.094410 31193 raft_consensus.cc:515] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:35.095392 30668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87d449e2aa442ec87cb2b55b61d4496" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:35.098840 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baad7ab904cc431381366c54397a57ef" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:35.099573 30817 raft_consensus.cc:2468] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 0.
I20260709 12:21:35.101266 30860 leader_election.cc:304] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:35.102501 31143 raft_consensus.cc:2804] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:35.102918 31143 raft_consensus.cc:493] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.103250 31143 raft_consensus.cc:3060] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.096114 30668 raft_consensus.cc:2468] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:35.109050 30941 tablet_bootstrap.cc:492] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:35.109758 30941 ts_tablet_manager.cc:1403] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.172s	user 0.015s	sys 0.009s
I20260709 12:21:35.112702 31193 leader_election.cc:290] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:35.111421 30568 catalog_manager.cc:5697] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a reported cstate change: term changed from 0 to 1, leader changed from <none> to d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196). New cstate: current_term: 1 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:35.113363 31069 leader_election.cc:290] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:35.116549 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baad7ab904cc431381366c54397a57ef" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:35.120081 31194 leader_election.cc:290] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:35.127686 30941 raft_consensus.cc:359] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:35.129557 30941 raft_consensus.cc:385] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.129895 30941 raft_consensus.cc:740] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
W20260709 12:21:35.128821 30857 leader_election.cc:343] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:35.132201 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baad7ab904cc431381366c54397a57ef" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:35.132817 30941 consensus_queue.cc:260] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:35.132202 31143 raft_consensus.cc:515] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:35.137307 30941 ts_tablet_manager.cc:1434] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:21:35.138401 30941 tablet_bootstrap.cc:492] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:35.143600 30940 tablet_bootstrap.cc:492] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:35.144160 30940 ts_tablet_manager.cc:1403] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.074s	user 0.015s	sys 0.013s
I20260709 12:21:35.145387 30941 tablet_bootstrap.cc:654] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.146922 30940 raft_consensus.cc:359] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:35.147678 30940 raft_consensus.cc:385] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.147961 30940 raft_consensus.cc:740] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.149130 30894 raft_consensus.cc:2393] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c7a0cd21c3449587fdeeff565557d3 in current term 1: Already voted for candidate d3ab9d21f8864b50a71b49c7d624584a in this term.
I20260709 12:21:35.151930 30940 consensus_queue.cc:260] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:35.153419 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87d449e2aa442ec87cb2b55b61d4496" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:35.153470 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baad7ab904cc431381366c54397a57ef" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:35.154249 30741 raft_consensus.cc:2468] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:35.154734 31143 leader_election.cc:290] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:35.154152 30940 ts_tablet_manager.cc:1434] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 12:21:35.154332 30817 raft_consensus.cc:3060] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.155586 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baad7ab904cc431381366c54397a57ef" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:35.156184 30940 tablet_bootstrap.cc:492] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:35.156847 30670 raft_consensus.cc:2468] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 0.
I20260709 12:21:35.159729 30942 tablet_bootstrap.cc:492] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:35.168601 30942 ts_tablet_manager.cc:1403] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.180s	user 0.008s	sys 0.011s
I20260709 12:21:35.166496 30976 consensus_queue.cc:1048] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:35.166430 30783 leader_election.cc:304] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
I20260709 12:21:35.171589 31194 raft_consensus.cc:2804] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:35.175966 30942 raft_consensus.cc:359] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:35.164856 30940 tablet_bootstrap.cc:654] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.181905 30939 tablet_bootstrap.cc:654] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.184548 30976 raft_consensus.cc:493] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.185250 30976 raft_consensus.cc:515] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:35.185568 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baad7ab904cc431381366c54397a57ef" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:35.186723 30670 raft_consensus.cc:3060] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.187572 30976 leader_election.cc:290] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:35.188269 31194 raft_consensus.cc:493] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.189525 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:35.189957 31194 raft_consensus.cc:3060] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.190421 30818 raft_consensus.cc:2393] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in current term 1: Already voted for candidate d3ab9d21f8864b50a71b49c7d624584a in this term.
I20260709 12:21:35.183089 30783 leader_election.cc:304] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:35.193228 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:35.195163 30636 leader_election.cc:304] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:35.196357 30978 raft_consensus.cc:3060] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.204412 30978 raft_consensus.cc:2749] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:35.177220 30942 raft_consensus.cc:385] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.205216 30942 raft_consensus.cc:740] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.206207 30942 consensus_queue.cc:260] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:35.207780 30670 raft_consensus.cc:2468] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:35.210500 30942 ts_tablet_manager.cc:1434] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.002s
I20260709 12:21:35.210487 30940 tablet_bootstrap.cc:492] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:35.212610 30942 tablet_bootstrap.cc:492] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:35.213306 30940 ts_tablet_manager.cc:1403] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.057s	user 0.014s	sys 0.004s
I20260709 12:21:35.215193 30941 tablet_bootstrap.cc:492] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:35.215756 30941 ts_tablet_manager.cc:1403] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.078s	user 0.029s	sys 0.017s
I20260709 12:21:35.218353 30817 raft_consensus.cc:2468] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:35.218945 30941 raft_consensus.cc:359] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:35.218973 31069 raft_consensus.cc:2764] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:21:35.219825 30941 raft_consensus.cc:385] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.222813 30941 raft_consensus.cc:740] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.223220 31196 raft_consensus.cc:493] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.223968 30942 tablet_bootstrap.cc:654] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.223774 31196 raft_consensus.cc:515] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:35.224570 30941 consensus_queue.cc:260] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:35.225320 30857 leader_election.cc:304] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:35.227034 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48114d81f8f4cf08f9665b697bc5560" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:35.227373 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48114d81f8f4cf08f9665b697bc5560" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:35.235142 30891 raft_consensus.cc:2468] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 0.
I20260709 12:21:35.235448 30670 raft_consensus.cc:2468] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 0.
I20260709 12:21:35.236150 30940 raft_consensus.cc:359] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:35.236430 30711 leader_election.cc:304] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:35.236918 30940 raft_consensus.cc:385] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.226706 31196 leader_election.cc:290] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:35.227208 30568 catalog_manager.cc:5697] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 1 to 3, leader changed from 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193) to 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195). New cstate: current_term: 3 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:35.230785 30941 ts_tablet_manager.cc:1434] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:21:35.237207 30940 raft_consensus.cc:740] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.237409 30958 raft_consensus.cc:2804] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:35.240829 30958 raft_consensus.cc:493] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.241324 30958 raft_consensus.cc:3060] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.241045 30940 consensus_queue.cc:260] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:35.242871 30942 tablet_bootstrap.cc:492] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:35.243491 30942 ts_tablet_manager.cc:1403] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.004s
I20260709 12:21:35.238890 30941 tablet_bootstrap.cc:492] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:35.250975 31193 raft_consensus.cc:2804] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:35.251499 31193 raft_consensus.cc:697] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:35.252276 31193 consensus_queue.cc:237] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:35.255300 30958 raft_consensus.cc:515] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:35.258985 30942 raft_consensus.cc:359] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:35.259837 30942 raft_consensus.cc:385] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.260177 30942 raft_consensus.cc:740] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.260196 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48114d81f8f4cf08f9665b697bc5560" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:35.261209 30893 raft_consensus.cc:3060] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.271891 30958 leader_election.cc:290] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:35.274098 30940 ts_tablet_manager.cc:1434] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 12:21:35.274389 30941 tablet_bootstrap.cc:654] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.276322 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48114d81f8f4cf08f9665b697bc5560" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:35.277029 30670 raft_consensus.cc:3060] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.261188 30942 consensus_queue.cc:260] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:35.275195 30940 tablet_bootstrap.cc:492] T 69a04a5cd9b143daba902d508029dcb5 P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:35.284798 30939 tablet_bootstrap.cc:492] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:35.285915 30939 ts_tablet_manager.cc:1403] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.219s	user 0.026s	sys 0.004s
I20260709 12:21:35.290370 30893 raft_consensus.cc:2468] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:35.298153 30670 raft_consensus.cc:2468] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:35.291965 30942 ts_tablet_manager.cc:1434] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 12:21:35.294077 31143 consensus_queue.cc:1048] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:21:35.299301 30711 leader_election.cc:304] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:35.299677 30942 tablet_bootstrap.cc:492] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:35.300274 31196 raft_consensus.cc:2804] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:35.300781 31196 raft_consensus.cc:697] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:35.295810 30939 raft_consensus.cc:359] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:35.302026 30939 raft_consensus.cc:385] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.302448 30939 raft_consensus.cc:740] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.303326 30939 consensus_queue.cc:260] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:35.305807 30939 ts_tablet_manager.cc:1434] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:21:35.306137 30942 tablet_bootstrap.cc:654] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.307075 30939 tablet_bootstrap.cc:492] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:35.301633 31196 consensus_queue.cc:237] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:35.290019 31194 raft_consensus.cc:515] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:35.310639 31194 leader_election.cc:290] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:35.311640 30940 tablet_bootstrap.cc:654] T 69a04a5cd9b143daba902d508029dcb5 P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.314368 30668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87d449e2aa442ec87cb2b55b61d4496" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:35.315124 30668 raft_consensus.cc:3060] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.316341 30939 tablet_bootstrap.cc:654] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.324504 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87d449e2aa442ec87cb2b55b61d4496" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:35.325448 30742 raft_consensus.cc:3060] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.327389 30566 catalog_manager.cc:5697] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a reported cstate change: term changed from 0 to 1, leader changed from <none> to d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196). New cstate: current_term: 1 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:35.333498 30958 raft_consensus.cc:493] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.334263 30958 raft_consensus.cc:515] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:35.371152 31069 raft_consensus.cc:493] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.373198 31157 raft_consensus.cc:493] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.385439 31157 raft_consensus.cc:515] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:35.386497 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93f0e0819f8466fad08603e540dc22e" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:35.387255 30893 raft_consensus.cc:2468] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 0.
I20260709 12:21:35.387761 31157 leader_election.cc:290] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:35.400131 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda0258f575243bd910da13e828fb6f6" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:35.401093 30894 raft_consensus.cc:2393] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 in current term 1: Already voted for candidate 20c7a0cd21c3449587fdeeff565557d3 in this term.
I20260709 12:21:35.400166 30711 leader_election.cc:304] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:35.403164 31195 consensus_queue.cc:1048] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:35.404883 30671 raft_consensus.cc:1275] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Refusing update from remote peer 20c7a0cd21c3449587fdeeff565557d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:35.405792 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93f0e0819f8466fad08603e540dc22e" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:35.407239 31171 consensus_queue.cc:1048] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.376752 30958 leader_election.cc:290] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:35.408324 30958 raft_consensus.cc:2804] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:35.408725 30958 raft_consensus.cc:493] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.409060 30958 raft_consensus.cc:3060] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.384011 31069 raft_consensus.cc:515] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:35.436522 30939 tablet_bootstrap.cc:492] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:35.437141 30939 ts_tablet_manager.cc:1403] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.130s	user 0.011s	sys 0.011s
I20260709 12:21:35.433385 30668 raft_consensus.cc:2468] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 2.
I20260709 12:21:35.451831 30783 leader_election.cc:304] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:35.457512 31194 raft_consensus.cc:2804] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:35.458456 31194 raft_consensus.cc:697] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:35.459760 31194 consensus_queue.cc:237] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:35.462627 30940 tablet_bootstrap.cc:492] T 69a04a5cd9b143daba902d508029dcb5 P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:35.463184 30940 ts_tablet_manager.cc:1403] T 69a04a5cd9b143daba902d508029dcb5 P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.188s	user 0.022s	sys 0.048s
I20260709 12:21:35.435891 31171 consensus_queue.cc:1048] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:21:35.467746 30940 raft_consensus.cc:359] T 69a04a5cd9b143daba902d508029dcb5 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:35.469286 30940 raft_consensus.cc:385] T 69a04a5cd9b143daba902d508029dcb5 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.469616 30940 raft_consensus.cc:740] T 69a04a5cd9b143daba902d508029dcb5 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.470425 30940 consensus_queue.cc:260] T 69a04a5cd9b143daba902d508029dcb5 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:35.472283 30940 ts_tablet_manager.cc:1434] T 69a04a5cd9b143daba902d508029dcb5 P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
W20260709 12:21:35.449577 30709 leader_election.cc:343] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:35.473269 30940 tablet_bootstrap.cc:492] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:35.477432 31069 leader_election.cc:290] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:35.479295 30668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e946ad6dd9cb42ad93987cebde13ba9a" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:35.479586 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e946ad6dd9cb42ad93987cebde13ba9a" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
W20260709 12:21:35.488575 30783 leader_election.cc:343] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:35.505131 30941 tablet_bootstrap.cc:492] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
W20260709 12:21:35.505683 30785 leader_election.cc:343] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:35.506316 30785 leader_election.cc:304] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:35.505793 30941 ts_tablet_manager.cc:1403] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.267s	user 0.022s	sys 0.007s
I20260709 12:21:35.507822 31195 raft_consensus.cc:2749] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:35.510960 30941 raft_consensus.cc:359] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:35.511718 30941 raft_consensus.cc:385] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.511981 30941 raft_consensus.cc:740] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.512204 30743 raft_consensus.cc:3060] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.512766 30894 raft_consensus.cc:1275] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Refusing update from remote peer 20c7a0cd21c3449587fdeeff565557d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:35.517030 30940 tablet_bootstrap.cc:654] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.517385 31190 consensus_queue.cc:1048] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.525664 30742 raft_consensus.cc:2468] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 2.
I20260709 12:21:35.529033 30939 raft_consensus.cc:359] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:35.529390 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda0258f575243bd910da13e828fb6f6" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:35.529804 30939 raft_consensus.cc:385] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.530167 30939 raft_consensus.cc:740] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.530797 30939 consensus_queue.cc:260] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
W20260709 12:21:35.492126 30709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 46317.7us
I20260709 12:21:35.489303 31193 consensus_queue.cc:1048] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:21:35.534843 30942 tablet_bootstrap.cc:492] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:35.535465 30942 ts_tablet_manager.cc:1403] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.236s	user 0.053s	sys 0.075s
I20260709 12:21:35.538594 30942 raft_consensus.cc:359] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:35.539577 30942 raft_consensus.cc:385] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.543172 30942 raft_consensus.cc:740] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.544145 30942 consensus_queue.cc:260] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:35.548750 31195 raft_consensus.cc:493] T 69a04a5cd9b143daba902d508029dcb5 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.549252 30942 ts_tablet_manager.cc:1434] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:21:35.549369 31195 raft_consensus.cc:515] T 69a04a5cd9b143daba902d508029dcb5 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:35.550546 30942 tablet_bootstrap.cc:492] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:35.556432 30941 consensus_queue.cc:260] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:35.565433 30939 ts_tablet_manager.cc:1434] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.128s	user 0.007s	sys 0.001s
I20260709 12:21:35.570145 30941 ts_tablet_manager.cc:1434] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 12:21:35.559736 31084 raft_consensus.cc:493] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.580179 30939 tablet_bootstrap.cc:492] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:35.559784 31195 leader_election.cc:290] T 69a04a5cd9b143daba902d508029dcb5 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:35.561434 31171 consensus_queue.cc:1048] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:21:35.590468 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a04a5cd9b143daba902d508029dcb5" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:35.591169 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a04a5cd9b143daba902d508029dcb5" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
W20260709 12:21:35.592130 30783 leader_election.cc:343] T 69a04a5cd9b143daba902d508029dcb5 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:35.583089 31084 raft_consensus.cc:515] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:35.602217 30939 tablet_bootstrap.cc:654] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.594281 30941 tablet_bootstrap.cc:492] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
W20260709 12:21:35.592713 30785 leader_election.cc:343] T 69a04a5cd9b143daba902d508029dcb5 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:35.609180 30712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 67091us
I20260709 12:21:35.613415 30712 leader_election.cc:304] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:35.614359 30940 tablet_bootstrap.cc:492] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:35.615114 30940 ts_tablet_manager.cc:1403] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.142s	user 0.018s	sys 0.018s
I20260709 12:21:35.611482 30785 leader_election.cc:304] T 69a04a5cd9b143daba902d508029dcb5 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:35.621095 31171 raft_consensus.cc:2749] T 69a04a5cd9b143daba902d508029dcb5 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:35.621821 31171 raft_consensus.cc:493] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.621930 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e946ad6dd9cb42ad93987cebde13ba9a" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:35.622328 31171 raft_consensus.cc:515] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:35.622956 30817 raft_consensus.cc:2468] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 0.
I20260709 12:21:35.623097 31195 raft_consensus.cc:493] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.617777 30565 catalog_manager.cc:5697] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 0 to 2, leader changed from <none> to 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195). New cstate: current_term: 2 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:35.627390 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a02078ac834032ac607943e7b3d175" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:35.640784 30894 raft_consensus.cc:2468] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 0.
I20260709 12:21:35.625895 31195 raft_consensus.cc:515] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:35.631064 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a02078ac834032ac607943e7b3d175" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:35.645491 30785 leader_election.cc:304] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:35.656100 31190 raft_consensus.cc:2804] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:35.656745 31190 raft_consensus.cc:493] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.657202 31190 raft_consensus.cc:3060] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.645718 30746 raft_consensus.cc:2468] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 0.
I20260709 12:21:35.648048 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56cad4068d4388bf572777bcfb89b3" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:35.661036 30568 catalog_manager.cc:5697] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:35.624599 31171 leader_election.cc:290] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:35.673259 30942 tablet_bootstrap.cc:654] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:35.681751 31227 log.cc:927] Time spent T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:21:35.644376 31195 leader_election.cc:290] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:35.627995 31084 leader_election.cc:290] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
W20260709 12:21:35.683049 30783 leader_election.cc:343] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:35.628961 30637 leader_election.cc:304] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:35.685772 30958 raft_consensus.cc:515] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:35.694190 30958 leader_election.cc:290] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:35.660789 31194 consensus_queue.cc:1048] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.050s
I20260709 12:21:35.695915 30940 raft_consensus.cc:359] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:35.697031 30940 raft_consensus.cc:385] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.697381 30940 raft_consensus.cc:740] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.698293 30940 consensus_queue.cc:260] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
W20260709 12:21:35.700416 31226 log.cc:927] Time spent T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:21:35.705056 30668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93f0e0819f8466fad08603e540dc22e" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
W20260709 12:21:35.705540 30637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 76729.7us
I20260709 12:21:35.705971 31190 raft_consensus.cc:515] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:35.706780 30940 ts_tablet_manager.cc:1434] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.091s	user 0.006s	sys 0.001s
I20260709 12:21:35.707860 30940 tablet_bootstrap.cc:492] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:35.708252 31190 leader_election.cc:290] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
W20260709 12:21:35.708588 30709 leader_election.cc:343] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:35.708801 30978 raft_consensus.cc:2804] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:35.724531 30978 raft_consensus.cc:493] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.725029 30978 raft_consensus.cc:3060] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.724829 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e946ad6dd9cb42ad93987cebde13ba9a" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:35.725582 30891 raft_consensus.cc:2468] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 0.
I20260709 12:21:35.710539 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a02078ac834032ac607943e7b3d175" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:35.712770 30668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56cad4068d4388bf572777bcfb89b3" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:35.712957 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a02078ac834032ac607943e7b3d175" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:35.752321 31234 raft_consensus.cc:493] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.738193 30894 raft_consensus.cc:3060] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.741082 30741 raft_consensus.cc:3060] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.772914 30941 tablet_bootstrap.cc:654] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.777153 31193 consensus_queue.cc:1048] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:35.779526 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93f0e0819f8466fad08603e540dc22e" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:35.780489 30892 raft_consensus.cc:3060] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.762812 31234 raft_consensus.cc:515] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:35.789698 31234 leader_election.cc:290] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:35.791188 30668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f2ae9f62734cf59b3d5477d92760cb" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
W20260709 12:21:35.793658 30857 leader_election.cc:343] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:35.800777 31224 raft_consensus.cc:2749] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:35.805027 30741 raft_consensus.cc:2468] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:35.808564 30978 raft_consensus.cc:515] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:35.809249 31234 consensus_queue.cc:1048] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:35.813755 30783 leader_election.cc:304] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
W20260709 12:21:35.819208 30783 leader_election.cc:343] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:35.819651 30783 leader_election.cc:304] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:35.816524 30894 raft_consensus.cc:2468] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:35.829087 30942 tablet_bootstrap.cc:492] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:35.829686 30942 ts_tablet_manager.cc:1403] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.279s	user 0.018s	sys 0.001s
I20260709 12:21:35.823342 31069 raft_consensus.cc:2749] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:35.834688 31224 consensus_queue.cc:1048] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:35.835409 30815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f2ae9f62734cf59b3d5477d92760cb" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:35.836108 30815 raft_consensus.cc:2468] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 0.
I20260709 12:21:35.846529 30942 raft_consensus.cc:359] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:35.847409 30942 raft_consensus.cc:385] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.847690 30942 raft_consensus.cc:740] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.848759 31236 raft_consensus.cc:2804] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:35.849778 30940 tablet_bootstrap.cc:654] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.850334 31236 raft_consensus.cc:697] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:35.852265 31236 consensus_queue.cc:237] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:35.848429 30942 consensus_queue.cc:260] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:35.860966 30939 tablet_bootstrap.cc:492] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:35.861575 30939 ts_tablet_manager.cc:1403] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.282s	user 0.043s	sys 0.025s
I20260709 12:21:35.891744 30942 ts_tablet_manager.cc:1434] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 12:21:35.904181 30860 leader_election.cc:304] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:35.906302 31193 raft_consensus.cc:2804] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:35.906772 31193 raft_consensus.cc:493] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.907104 31193 raft_consensus.cc:3060] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.878352 30892 raft_consensus.cc:2468] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:35.908525 30978 leader_election.cc:290] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:35.914281 30942 tablet_bootstrap.cc:492] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:35.915319 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e946ad6dd9cb42ad93987cebde13ba9a" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:35.917410 30816 raft_consensus.cc:3060] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.918525 31224 consensus_queue.cc:1048] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:35.930294 30939 raft_consensus.cc:359] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:35.931280 30939 raft_consensus.cc:385] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.931810 30939 raft_consensus.cc:740] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.932521 30939 consensus_queue.cc:260] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:35.938259 30939 ts_tablet_manager.cc:1434] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.000s
I20260709 12:21:35.942850 30711 leader_election.cc:304] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:35.946398 31157 raft_consensus.cc:2804] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:35.946954 31157 raft_consensus.cc:697] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:35.947824 31157 consensus_queue.cc:237] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:35.956621 30939 tablet_bootstrap.cc:492] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:35.962361 30565 catalog_manager.cc:5697] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:35.957691 30816 raft_consensus.cc:2468] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:35.987226 30742 raft_consensus.cc:1275] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Refusing update from remote peer 20c7a0cd21c3449587fdeeff565557d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:21:35.991782 30637 leader_election.cc:304] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:35.993058 31084 raft_consensus.cc:2804] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:35.993603 31084 raft_consensus.cc:697] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:21:35.999993 30940 tablet_bootstrap.cc:492] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:36.000841 30940 ts_tablet_manager.cc:1403] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.293s	user 0.029s	sys 0.034s
I20260709 12:21:35.998980 31069 consensus_queue.cc:1048] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:21:36.002493 31084 consensus_queue.cc:237] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:36.014060 30940 raft_consensus.cc:359] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:36.015021 30940 raft_consensus.cc:385] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.016642 30940 raft_consensus.cc:740] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.017597 30940 consensus_queue.cc:260] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:36.031591 30940 ts_tablet_manager.cc:1434] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 12:21:36.033283 30939 tablet_bootstrap.cc:654] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.033346 30940 tablet_bootstrap.cc:492] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:36.055415 30941 tablet_bootstrap.cc:492] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:36.056281 30941 ts_tablet_manager.cc:1403] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.462s	user 0.006s	sys 0.013s
I20260709 12:21:36.067968 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e946ad6dd9cb42ad93987cebde13ba9a" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:36.068795 30893 raft_consensus.cc:3060] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:36.042716 31193 raft_consensus.cc:515] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
W20260709 12:21:36.057618 30636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 90217.2us
I20260709 12:21:36.073408 31238 raft_consensus.cc:493] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.073994 31238 raft_consensus.cc:515] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:36.076113 31238 leader_election.cc:290] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:36.077889 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
W20260709 12:21:36.082482 30785 leader_election.cc:343] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.083083 30670 raft_consensus.cc:1275] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Refusing update from remote peer 20c7a0cd21c3449587fdeeff565557d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:21:36.087754 30940 tablet_bootstrap.cc:654] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.089663 31142 raft_consensus.cc:493] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.090365 31142 raft_consensus.cc:515] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:36.093153 31142 leader_election.cc:290] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:36.100308 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1ba3aa111d4c5e8558a89abec0aa64" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:36.106249 31069 consensus_queue.cc:1048] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:36.117978 30668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
W20260709 12:21:36.124838 30783 leader_election.cc:343] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.125365 30783 leader_election.cc:304] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:36.127120 31195 raft_consensus.cc:2749] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:36.140105 30568 catalog_manager.cc:5697] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:36.142010 30941 raft_consensus.cc:359] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:36.154695 30941 raft_consensus.cc:385] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.155140 30941 raft_consensus.cc:740] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.156046 30941 consensus_queue.cc:260] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:36.162171 30941 ts_tablet_manager.cc:1434] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.105s	user 0.003s	sys 0.004s
I20260709 12:21:36.163522 30941 tablet_bootstrap.cc:492] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
W20260709 12:21:36.146019 30857 leader_election.cc:343] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.189545 30942 tablet_bootstrap.cc:654] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.189801 30941 tablet_bootstrap.cc:654] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.140563 30893 raft_consensus.cc:2468] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:36.226773 31193 leader_election.cc:290] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:36.234678 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f2ae9f62734cf59b3d5477d92760cb" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:36.235347 30816 raft_consensus.cc:3060] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:36.238991 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f2ae9f62734cf59b3d5477d92760cb" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:36.258179 30816 raft_consensus.cc:2468] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:36.245914 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1ba3aa111d4c5e8558a89abec0aa64" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:36.266407 30860 leader_election.cc:304] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:36.267396 31193 raft_consensus.cc:2804] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:36.267925 31193 raft_consensus.cc:697] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:36.268851 31193 consensus_queue.cc:237] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:36.273154 30939 tablet_bootstrap.cc:492] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:36.273937 30939 ts_tablet_manager.cc:1403] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.335s	user 0.018s	sys 0.000s
I20260709 12:21:36.286870 30939 raft_consensus.cc:359] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:36.287806 30939 raft_consensus.cc:385] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.288143 30939 raft_consensus.cc:740] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
W20260709 12:21:36.289714 30857 leader_election.cc:343] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.289158 30939 consensus_queue.cc:260] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
W20260709 12:21:36.291060 30857 leader_election.cc:343] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.291990 30857 leader_election.cc:304] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:36.293679 31143 raft_consensus.cc:2749] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:36.313186 31236 consensus_queue.cc:1048] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:36.315888 30939 ts_tablet_manager.cc:1434] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 12:21:36.317081 30939 tablet_bootstrap.cc:492] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
W20260709 12:21:36.320269 30617 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:36.329941 30941 tablet_bootstrap.cc:492] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:36.331022 30941 ts_tablet_manager.cc:1403] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.168s	user 0.019s	sys 0.003s
I20260709 12:21:36.333930 30940 tablet_bootstrap.cc:492] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:36.334455 30940 ts_tablet_manager.cc:1403] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.302s	user 0.039s	sys 0.054s
I20260709 12:21:36.339067 30566 catalog_manager.cc:5697] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a reported cstate change: term changed from 0 to 1, leader changed from <none> to d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196). New cstate: current_term: 1 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:36.349283 30939 tablet_bootstrap.cc:654] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.354564 30942 tablet_bootstrap.cc:492] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:36.355062 30942 ts_tablet_manager.cc:1403] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.461s	user 0.030s	sys 0.028s
I20260709 12:21:36.358085 30942 raft_consensus.cc:359] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:36.358625 30942 raft_consensus.cc:385] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.358857 30942 raft_consensus.cc:740] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.359443 30942 consensus_queue.cc:260] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:36.361693 30942 ts_tablet_manager.cc:1434] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:21:36.362529 30942 tablet_bootstrap.cc:492] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:36.365219 30940 raft_consensus.cc:359] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:36.367285 30942 tablet_bootstrap.cc:654] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.371767 30568 catalog_manager.cc:5697] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:36.372098 30941 raft_consensus.cc:359] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:36.373194 30941 raft_consensus.cc:385] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.372155 30940 raft_consensus.cc:385] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.373584 30941 raft_consensus.cc:740] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.373818 30940 raft_consensus.cc:740] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.374856 30941 consensus_queue.cc:260] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:36.377656 30940 consensus_queue.cc:260] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:36.379197 30941 ts_tablet_manager.cc:1434] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.002s
I20260709 12:21:36.380308 30941 tablet_bootstrap.cc:492] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:36.380759 31195 consensus_queue.cc:1048] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:36.380802 30940 ts_tablet_manager.cc:1434] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.003s
I20260709 12:21:36.386013 30940 tablet_bootstrap.cc:492] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:36.390178 30939 tablet_bootstrap.cc:492] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:36.390743 30939 ts_tablet_manager.cc:1403] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.074s	user 0.024s	sys 0.003s
I20260709 12:21:36.392486 30940 tablet_bootstrap.cc:654] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.394464 30939 raft_consensus.cc:359] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:36.395249 30939 raft_consensus.cc:385] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.395519 30939 raft_consensus.cc:740] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.396189 30939 consensus_queue.cc:260] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:36.400815 30939 ts_tablet_manager.cc:1434] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:21:36.401958 31157 raft_consensus.cc:493] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.402498 31157 raft_consensus.cc:515] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:36.404767 31157 leader_election.cc:290] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:36.405925 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bb30237ea045c79aa6eb181bc3e692" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:36.406255 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bb30237ea045c79aa6eb181bc3e692" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:36.406649 30671 raft_consensus.cc:2468] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 0.
I20260709 12:21:36.406865 30818 raft_consensus.cc:2468] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 0.
I20260709 12:21:36.407462 30939 tablet_bootstrap.cc:492] T 69a04a5cd9b143daba902d508029dcb5 P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:36.408341 30709 leader_election.cc:304] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:36.409225 31157 raft_consensus.cc:2804] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:36.409614 31157 raft_consensus.cc:493] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:36.409938 31157 raft_consensus.cc:3060] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:36.420229 30941 tablet_bootstrap.cc:654] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.418942 31157 raft_consensus.cc:515] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:36.427202 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bb30237ea045c79aa6eb181bc3e692" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:36.428074 30671 raft_consensus.cc:3060] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:36.427608 30940 tablet_bootstrap.cc:492] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:36.431329 30940 ts_tablet_manager.cc:1403] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.000s
I20260709 12:21:36.436748 31256 consensus_queue.cc:1048] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:36.438565 30940 raft_consensus.cc:359] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:36.439410 30940 raft_consensus.cc:385] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.439692 30940 raft_consensus.cc:740] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.440289 30941 tablet_bootstrap.cc:492] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:36.440402 30940 consensus_queue.cc:260] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:36.441835 31256 raft_consensus.cc:493] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.442401 31256 raft_consensus.cc:515] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:36.442996 30940 ts_tablet_manager.cc:1434] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:21:36.444089 30940 tablet_bootstrap.cc:492] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:36.445242 30941 ts_tablet_manager.cc:1403] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.004s
I20260709 12:21:36.445884 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93f0e0819f8466fad08603e540dc22e" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:36.446902 30891 raft_consensus.cc:2393] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in current term 1: Already voted for candidate 4a9042c4154c442297159d1c9f1186b9 in this term.
I20260709 12:21:36.446941 30942 tablet_bootstrap.cc:492] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:36.447654 30942 ts_tablet_manager.cc:1403] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.085s	user 0.008s	sys 0.008s
I20260709 12:21:36.448460 30941 raft_consensus.cc:359] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:36.450621 30942 raft_consensus.cc:359] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:36.451377 30942 raft_consensus.cc:385] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.451635 30942 raft_consensus.cc:740] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.451747 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93f0e0819f8466fad08603e540dc22e" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:36.452376 30942 consensus_queue.cc:260] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:36.453843 30634 leader_election.cc:304] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:36.454967 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bb30237ea045c79aa6eb181bc3e692" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:36.455587 30816 raft_consensus.cc:3060] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:36.456517 30939 tablet_bootstrap.cc:654] T 69a04a5cd9b143daba902d508029dcb5 P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.459281 31157 leader_election.cc:290] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:36.459491 30942 ts_tablet_manager.cc:1434] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:21:36.460938 30942 tablet_bootstrap.cc:492] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:36.460990 30941 raft_consensus.cc:385] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.461524 30941 raft_consensus.cc:740] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.462260 30941 consensus_queue.cc:260] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:36.454838 30671 raft_consensus.cc:2468] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:36.464478 31084 raft_consensus.cc:3060] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:36.467199 30941 ts_tablet_manager.cc:1434] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:21:36.468272 30941 tablet_bootstrap.cc:492] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:36.473299 30709 leader_election.cc:304] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:36.474677 31233 raft_consensus.cc:2804] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:36.475258 31233 raft_consensus.cc:697] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:36.476140 31233 consensus_queue.cc:237] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:36.479461 30941 tablet_bootstrap.cc:654] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.486891 30942 tablet_bootstrap.cc:654] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.487074 31255 consensus_queue.cc:1048] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:21:36.489292 31177 raft_consensus.cc:493] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.490090 31177 raft_consensus.cc:515] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:36.497079 31177 leader_election.cc:290] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:36.497677 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56cad4068d4388bf572777bcfb89b3" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:36.498364 30818 raft_consensus.cc:2468] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 0.
I20260709 12:21:36.499506 30637 leader_election.cc:304] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:36.500743 31177 raft_consensus.cc:2804] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:36.501102 31177 raft_consensus.cc:493] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:36.501408 31177 raft_consensus.cc:3060] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:36.444854 31256 leader_election.cc:290] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:36.505530 30568 catalog_manager.cc:5697] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:36.515369 30940 tablet_bootstrap.cc:654] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.518888 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56cad4068d4388bf572777bcfb89b3" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:36.519640 30741 raft_consensus.cc:2468] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 0.
I20260709 12:21:36.534039 31084 raft_consensus.cc:2749] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:36.536085 30816 raft_consensus.cc:2468] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:36.538992 30940 tablet_bootstrap.cc:492] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:36.539678 30940 ts_tablet_manager.cc:1403] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.096s	user 0.013s	sys 0.000s
I20260709 12:21:36.542806 30940 raft_consensus.cc:359] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:36.543498 30940 raft_consensus.cc:385] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.543772 30940 raft_consensus.cc:740] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.544447 31177 raft_consensus.cc:515] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:36.556872 30939 tablet_bootstrap.cc:492] T 69a04a5cd9b143daba902d508029dcb5 P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:36.557166 30942 tablet_bootstrap.cc:492] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:36.557459 30939 ts_tablet_manager.cc:1403] T 69a04a5cd9b143daba902d508029dcb5 P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.156s	user 0.024s	sys 0.007s
I20260709 12:21:36.557786 30942 ts_tablet_manager.cc:1403] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.097s	user 0.008s	sys 0.009s
I20260709 12:21:36.559110 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56cad4068d4388bf572777bcfb89b3" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:36.559474 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56cad4068d4388bf572777bcfb89b3" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:36.559777 30818 raft_consensus.cc:3060] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:36.544569 30940 consensus_queue.cc:260] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:36.560168 30741 raft_consensus.cc:3060] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:36.538992 30941 tablet_bootstrap.cc:492] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:36.561137 30941 ts_tablet_manager.cc:1403] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.093s	user 0.022s	sys 0.016s
I20260709 12:21:36.561566 30939 raft_consensus.cc:359] T 69a04a5cd9b143daba902d508029dcb5 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:36.562314 30939 raft_consensus.cc:385] T 69a04a5cd9b143daba902d508029dcb5 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.562604 30939 raft_consensus.cc:740] T 69a04a5cd9b143daba902d508029dcb5 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.562718 31157 consensus_queue.cc:1048] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:36.564090 30939 consensus_queue.cc:260] T 69a04a5cd9b143daba902d508029dcb5 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:36.565218 30942 raft_consensus.cc:359] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:36.566010 30942 raft_consensus.cc:385] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.566295 30942 raft_consensus.cc:740] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.581614 30818 raft_consensus.cc:2468] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:36.583467 30942 consensus_queue.cc:260] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:36.566805 30939 ts_tablet_manager.cc:1434] T 69a04a5cd9b143daba902d508029dcb5 P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:21:36.583860 31177 leader_election.cc:290] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:36.584794 30637 leader_election.cc:304] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:36.580057 31157 consensus_queue.cc:1048] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:21:36.585672 31177 raft_consensus.cc:2804] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:36.586859 31177 raft_consensus.cc:697] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:21:36.587694 30942 ts_tablet_manager.cc:1434] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:21:36.588963 30942 tablet_bootstrap.cc:492] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:36.588258 31177 consensus_queue.cc:237] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:36.585646 30939 tablet_bootstrap.cc:492] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:36.573668 30741 raft_consensus.cc:2468] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:36.583559 30941 raft_consensus.cc:359] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:36.593978 30941 raft_consensus.cc:385] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.594409 30941 raft_consensus.cc:740] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.597402 30939 tablet_bootstrap.cc:654] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.600502 30941 consensus_queue.cc:260] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:36.608299 30942 tablet_bootstrap.cc:654] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.608934 30941 ts_tablet_manager.cc:1434] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.001s
I20260709 12:21:36.610605 30941 tablet_bootstrap.cc:492] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:36.610864 30940 ts_tablet_manager.cc:1434] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.000s
I20260709 12:21:36.611827 30940 tablet_bootstrap.cc:492] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:36.616232 30565 catalog_manager.cc:5697] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:36.620582 30941 tablet_bootstrap.cc:654] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.623960 30942 tablet_bootstrap.cc:492] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:36.624568 30942 ts_tablet_manager.cc:1403] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.003s
I20260709 12:21:36.627606 30942 raft_consensus.cc:359] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:36.628378 30942 raft_consensus.cc:385] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.628721 30942 raft_consensus.cc:740] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.630890 30942 consensus_queue.cc:260] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:36.637161 30942 ts_tablet_manager.cc:1434] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 12:21:36.637389 30939 tablet_bootstrap.cc:492] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:36.638001 30939 ts_tablet_manager.cc:1403] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.053s	user 0.006s	sys 0.007s
I20260709 12:21:36.638259 30942 tablet_bootstrap.cc:492] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:36.639079 30940 tablet_bootstrap.cc:654] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.641819 30939 raft_consensus.cc:359] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:36.642633 30939 raft_consensus.cc:385] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.642920 30939 raft_consensus.cc:740] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.643745 30939 consensus_queue.cc:260] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:36.644975 30941 tablet_bootstrap.cc:492] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:36.646136 30939 ts_tablet_manager.cc:1434] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:36.646525 30941 ts_tablet_manager.cc:1403] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.000s
I20260709 12:21:36.647135 30939 tablet_bootstrap.cc:492] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:36.646534 30942 tablet_bootstrap.cc:654] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.649619 30941 raft_consensus.cc:359] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:36.650415 30941 raft_consensus.cc:385] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.650720 30941 raft_consensus.cc:740] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.651677 30941 consensus_queue.cc:260] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:36.653816 30939 tablet_bootstrap.cc:654] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.655381 30941 ts_tablet_manager.cc:1434] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:21:36.657997 31236 raft_consensus.cc:493] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.658670 31236 raft_consensus.cc:515] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:36.687750 31193 raft_consensus.cc:493] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.688776 31193 raft_consensus.cc:515] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:36.713877 31224 raft_consensus.cc:493] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.714744 31224 raft_consensus.cc:515] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:36.734885 30941 tablet_bootstrap.cc:492] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:36.737604 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a04a5cd9b143daba902d508029dcb5" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:36.738759 30742 raft_consensus.cc:2468] T 69a04a5cd9b143daba902d508029dcb5 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 0.
I20260709 12:21:36.744491 31232 raft_consensus.cc:493] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.745230 31232 raft_consensus.cc:515] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:36.763656 31143 raft_consensus.cc:493] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.763149 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b26f10a0fb7476098bdb142c864895e" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:36.761881 31236 leader_election.cc:290] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:36.767230 31171 raft_consensus.cc:493] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.768163 31232 leader_election.cc:290] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:36.775123 30893 raft_consensus.cc:2468] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 0.
I20260709 12:21:36.775187 31171 raft_consensus.cc:515] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:36.769799 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1ba3aa111d4c5e8558a89abec0aa64" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:36.771231 31193 leader_election.cc:290] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:36.773542 31224 leader_election.cc:290] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:36.773595 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61dc8e98f804681b0815e953b2d2ad1" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:36.796020 30940 tablet_bootstrap.cc:492] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:36.796859 30940 ts_tablet_manager.cc:1403] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.185s	user 0.012s	sys 0.013s
I20260709 12:21:36.789086 30670 raft_consensus.cc:2468] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 0.
W20260709 12:21:36.805286 30709 leader_election.cc:343] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.779657 31143 raft_consensus.cc:515] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:36.799430 30785 leader_election.cc:304] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:36.800784 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61dc8e98f804681b0815e953b2d2ad1" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:36.799470 30857 leader_election.cc:304] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:36.815220 30816 raft_consensus.cc:2468] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 0.
I20260709 12:21:36.819898 31284 raft_consensus.cc:2804] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:36.820371 31284 raft_consensus.cc:493] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:36.820710 31284 raft_consensus.cc:3060] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:36.814707 30709 leader_election.cc:304] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:36.829082 30958 raft_consensus.cc:2804] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:36.829499 30958 raft_consensus.cc:493] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:36.829819 30958 raft_consensus.cc:3060] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:36.807463 31171 leader_election.cc:290] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:36.834267 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a04a5cd9b143daba902d508029dcb5" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:36.835001 30816 raft_consensus.cc:2468] T 69a04a5cd9b143daba902d508029dcb5 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 0.
I20260709 12:21:36.835120 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac2bacfc36f49459fc2b2b2d8afb01d" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:36.831369 31238 raft_consensus.cc:2804] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:36.838152 31238 raft_consensus.cc:493] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:36.838583 31238 raft_consensus.cc:3060] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:36.829618 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b26f10a0fb7476098bdb142c864895e" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:36.842437 30958 raft_consensus.cc:515] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:36.843780 30670 raft_consensus.cc:3060] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:36.844811 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac2bacfc36f49459fc2b2b2d8afb01d" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
W20260709 12:21:36.846011 30783 leader_election.cc:343] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.850639 31143 leader_election.cc:290] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:36.853295 30941 tablet_bootstrap.cc:654] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.827725 30712 leader_election.cc:304] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:36.877597 31224 raft_consensus.cc:2804] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:21:36.877760 30712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 52341.8us
I20260709 12:21:36.878167 31224 raft_consensus.cc:493] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:36.878464 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd8dacaad53349ebb29c67fe11853fab" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:36.861977 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1ba3aa111d4c5e8558a89abec0aa64" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:36.879343 30893 raft_consensus.cc:2468] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 0.
I20260709 12:21:36.862462 30942 tablet_bootstrap.cc:492] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:36.880129 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd8dacaad53349ebb29c67fe11853fab" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:36.880447 30942 ts_tablet_manager.cc:1403] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.242s	user 0.047s	sys 0.083s
I20260709 12:21:36.883548 30942 raft_consensus.cc:359] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:36.884100 30942 raft_consensus.cc:385] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.884341 30942 raft_consensus.cc:740] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.861585 30958 leader_election.cc:290] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:36.872152 31284 raft_consensus.cc:515] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:36.873373 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1ba3aa111d4c5e8558a89abec0aa64" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:36.885054 30942 consensus_queue.cc:260] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:36.878734 31224 raft_consensus.cc:3060] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:36.874706 31282 raft_consensus.cc:493] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.886014 31282 raft_consensus.cc:515] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:36.887454 30942 ts_tablet_manager.cc:1434] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
W20260709 12:21:36.880266 30857 leader_election.cc:343] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.888549 30942 tablet_bootstrap.cc:492] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:36.885265 30669 raft_consensus.cc:3060] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:36.868652 31238 raft_consensus.cc:515] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
W20260709 12:21:36.856117 30783 leader_election.cc:343] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:36.893559 30857 leader_election.cc:343] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.894338 31067 consensus_queue.cc:1048] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:36.894731 30857 leader_election.cc:304] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:36.895617 31143 raft_consensus.cc:2749] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:36.895723 30783 leader_election.cc:343] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.896224 30783 leader_election.cc:304] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:36.898000 30940 raft_consensus.cc:359] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:36.898801 30940 raft_consensus.cc:385] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.899085 30940 raft_consensus.cc:740] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.899771 30940 consensus_queue.cc:260] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:36.901171 31282 leader_election.cc:290] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:36.901753 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b26f10a0fb7476098bdb142c864895e" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:36.902397 30893 raft_consensus.cc:3060] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:36.904706 31238 leader_election.cc:290] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:36.907145 31248 raft_consensus.cc:493] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.921007 31248 raft_consensus.cc:515] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:36.922762 30893 raft_consensus.cc:2468] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:36.923409 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a04a5cd9b143daba902d508029dcb5" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:36.924062 30816 raft_consensus.cc:3060] T 69a04a5cd9b143daba902d508029dcb5 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:36.907701 31069 raft_consensus.cc:2749] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:36.920871 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:36.925971 30817 raft_consensus.cc:2468] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 0.
I20260709 12:21:36.906216 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:36.913188 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a04a5cd9b143daba902d508029dcb5" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:36.911748 31143 consensus_queue.cc:1048] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:21:36.913300 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1ba3aa111d4c5e8558a89abec0aa64" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:36.911162 31284 leader_election.cc:290] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:36.912581 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b26f10a0fb7476098bdb142c864895e" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:36.931965 30939 tablet_bootstrap.cc:492] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:36.938774 30892 raft_consensus.cc:3060] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:36.939608 30746 raft_consensus.cc:3060] T 69a04a5cd9b143daba902d508029dcb5 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:36.942109 31248 leader_election.cc:290] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:36.942996 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f2ae9f62734cf59b3d5477d92760cb" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:36.945374 30939 ts_tablet_manager.cc:1403] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.298s	user 0.014s	sys 0.015s
I20260709 12:21:36.945766 30940 ts_tablet_manager.cc:1434] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.148s	user 0.005s	sys 0.004s
I20260709 12:21:36.946586 30785 leader_election.cc:304] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:36.951491 30940 tablet_bootstrap.cc:492] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:36.947893 30816 raft_consensus.cc:2468] T 69a04a5cd9b143daba902d508029dcb5 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:36.952888 30942 tablet_bootstrap.cc:654] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:36.952680 30857 leader_election.cc:343] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.909785 30669 raft_consensus.cc:2468] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:36.956147 31171 raft_consensus.cc:2804] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:36.962409 31171 raft_consensus.cc:697] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:36.963333 31171 consensus_queue.cc:237] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:36.964300 30709 leader_election.cc:304] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:36.965435 30860 leader_election.cc:304] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:36.965884 31232 raft_consensus.cc:2804] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:36.966423 31232 raft_consensus.cc:697] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:36.967350 31232 consensus_queue.cc:237] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:36.969455 30941 tablet_bootstrap.cc:492] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:36.971585 30941 ts_tablet_manager.cc:1403] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.237s	user 0.020s	sys 0.008s
I20260709 12:21:36.958463 31224 raft_consensus.cc:515] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:36.974082 31143 raft_consensus.cc:2804] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:36.986402 31143 raft_consensus.cc:493] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:36.986830 31143 raft_consensus.cc:3060] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:36.990084 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61dc8e98f804681b0815e953b2d2ad1" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:36.984653 30892 raft_consensus.cc:2468] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
W20260709 12:21:36.991860 30709 leader_election.cc:343] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.994318 31224 leader_election.cc:290] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
W20260709 12:21:36.995478 30783 leader_election.cc:343] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.996778 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61dc8e98f804681b0815e953b2d2ad1" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:37.000216 30816 raft_consensus.cc:3060] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.016372 31143 raft_consensus.cc:515] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:37.021865 30816 raft_consensus.cc:2468] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:37.015211 30746 raft_consensus.cc:2468] T 69a04a5cd9b143daba902d508029dcb5 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:37.029131 30939 raft_consensus.cc:359] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:37.030836 30860 leader_election.cc:304] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:37.040057 30939 raft_consensus.cc:385] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.035221 30567 catalog_manager.cc:5697] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:37.031087 30565 catalog_manager.cc:5697] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:37.040544 30939 raft_consensus.cc:740] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.046689 30939 consensus_queue.cc:260] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:37.050981 30939 ts_tablet_manager.cc:1434] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.101s	user 0.006s	sys 0.001s
I20260709 12:21:37.052017 30939 tablet_bootstrap.cc:492] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:37.044034 31224 consensus_queue.cc:1048] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:21:37.054000 31143 leader_election.cc:290] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:37.047314 30712 leader_election.cc:304] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:37.041055 31193 raft_consensus.cc:2804] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.060416 31224 raft_consensus.cc:2804] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.061084 31224 raft_consensus.cc:697] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:37.061985 31224 consensus_queue.cc:237] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:37.068539 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
W20260709 12:21:37.072984 30857 leader_election.cc:343] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.086097 30941 raft_consensus.cc:359] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:37.087066 30941 raft_consensus.cc:385] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.088830 30941 raft_consensus.cc:740] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.089779 30941 consensus_queue.cc:260] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:37.091773 31084 consensus_queue.cc:1048] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:37.094151 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f2ae9f62734cf59b3d5477d92760cb" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:37.080222 31193 raft_consensus.cc:697] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:37.101006 30815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:37.107328 31232 consensus_queue.cc:1048] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:37.124567 30942 tablet_bootstrap.cc:492] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:37.125661 30942 ts_tablet_manager.cc:1403] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.237s	user 0.009s	sys 0.005s
I20260709 12:21:37.134382 30940 tablet_bootstrap.cc:654] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.145699 30942 raft_consensus.cc:359] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:37.147440 30941 ts_tablet_manager.cc:1434] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.175s	user 0.008s	sys 0.000s
I20260709 12:21:37.148828 30942 raft_consensus.cc:385] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.149511 30942 raft_consensus.cc:740] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.149716 30941 tablet_bootstrap.cc:492] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:37.130666 30815 raft_consensus.cc:3060] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.154131 30636 leader_election.cc:304] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:37.161239 30942 consensus_queue.cc:260] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:37.132303 31248 consensus_queue.cc:1048] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:21:37.156410 31171 raft_consensus.cc:493] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.157425 31177 raft_consensus.cc:2749] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:37.180402 30939 tablet_bootstrap.cc:654] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.186641 30942 ts_tablet_manager.cc:1434] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 12:21:37.189859 30942 tablet_bootstrap.cc:492] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:37.173357 31171 raft_consensus.cc:515] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:37.199637 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcceeadce924e3493e4e91cb49e2f2e" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:37.207216 30892 raft_consensus.cc:2468] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 0.
I20260709 12:21:37.210383 30785 leader_election.cc:304] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:37.211571 31194 raft_consensus.cc:2804] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.212035 31194 raft_consensus.cc:493] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.212472 31194 raft_consensus.cc:3060] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.168098 31193 consensus_queue.cc:237] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:37.218804 30941 tablet_bootstrap.cc:654] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.204156 31171 leader_election.cc:290] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:37.232560 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcceeadce924e3493e4e91cb49e2f2e" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
W20260709 12:21:37.234742 30783 leader_election.cc:343] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.261674 31143 raft_consensus.cc:493] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.265249 31143 raft_consensus.cc:515] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:37.268607 31143 leader_election.cc:290] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:37.271673 31194 raft_consensus.cc:515] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:37.275173 30940 tablet_bootstrap.cc:492] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:37.277647 30940 ts_tablet_manager.cc:1403] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.327s	user 0.008s	sys 0.007s
I20260709 12:21:37.280272 30942 tablet_bootstrap.cc:654] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.281153 30940 raft_consensus.cc:359] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:37.290016 30940 raft_consensus.cc:385] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.291009 30940 raft_consensus.cc:740] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.293573 30940 consensus_queue.cc:260] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:37.293892 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcceeadce924e3493e4e91cb49e2f2e" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:37.296036 31194 leader_election.cc:290] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
W20260709 12:21:37.297914 30783 leader_election.cc:343] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.298713 30939 tablet_bootstrap.cc:492] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:37.299279 30939 ts_tablet_manager.cc:1403] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.247s	user 0.026s	sys 0.047s
I20260709 12:21:37.302407 30939 raft_consensus.cc:359] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:37.303388 30939 raft_consensus.cc:385] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.303715 30939 raft_consensus.cc:740] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.304489 30939 consensus_queue.cc:260] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:37.306547 30939 ts_tablet_manager.cc:1434] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:21:37.307694 30939 tablet_bootstrap.cc:492] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:37.256351 30815 raft_consensus.cc:2468] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:37.358752 30940 ts_tablet_manager.cc:1434] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.000s
I20260709 12:21:37.371670 30940 tablet_bootstrap.cc:492] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:37.368965 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcceeadce924e3493e4e91cb49e2f2e" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
W20260709 12:21:37.373298 30711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 178434us
I20260709 12:21:37.401803 30892 raft_consensus.cc:3060] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.432137 31303 raft_consensus.cc:493] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.438155 31303 raft_consensus.cc:515] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:37.440747 30942 tablet_bootstrap.cc:492] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:37.441419 30942 ts_tablet_manager.cc:1403] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.254s	user 0.017s	sys 0.019s
I20260709 12:21:37.444723 30942 raft_consensus.cc:359] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:37.445427 30942 raft_consensus.cc:385] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.402516 30860 leader_election.cc:304] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:37.450819 30940 tablet_bootstrap.cc:654] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.445708 30942 raft_consensus.cc:740] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.464890 31193 raft_consensus.cc:2804] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:21:37.470443 30860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 85905.5us
I20260709 12:21:37.449044 31303 leader_election.cc:290] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:37.478303 30939 tablet_bootstrap.cc:654] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.479207 30942 consensus_queue.cc:260] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:37.470567 31193 raft_consensus.cc:697] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:37.500375 30942 ts_tablet_manager.cc:1434] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.059s	user 0.004s	sys 0.003s
I20260709 12:21:37.501335 30942 tablet_bootstrap.cc:492] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:37.510210 31193 consensus_queue.cc:237] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
W20260709 12:21:37.512511 30783 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 70819.1us
I20260709 12:21:37.512243 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd8dacaad53349ebb29c67fe11853fab" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:37.528048 30891 raft_consensus.cc:2468] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 0.
I20260709 12:21:37.526549 30892 raft_consensus.cc:2468] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:37.542744 30941 tablet_bootstrap.cc:492] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:37.543372 30941 ts_tablet_manager.cc:1403] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.394s	user 0.031s	sys 0.022s
I20260709 12:21:37.573796 30941 raft_consensus.cc:359] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:37.574661 30941 raft_consensus.cc:385] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.575590 30941 raft_consensus.cc:740] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.578540 30941 consensus_queue.cc:260] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:37.579360 30939 tablet_bootstrap.cc:492] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:37.579999 30939 ts_tablet_manager.cc:1403] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.273s	user 0.024s	sys 0.001s
I20260709 12:21:37.591262 30940 tablet_bootstrap.cc:492] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:37.592511 30668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a0a060aca4bdf912b9291106aaa74" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:37.592198 30940 ts_tablet_manager.cc:1403] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.221s	user 0.016s	sys 0.008s
I20260709 12:21:37.598838 30940 raft_consensus.cc:359] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:37.599794 30940 raft_consensus.cc:385] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.600347 30940 raft_consensus.cc:740] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.603376 30940 consensus_queue.cc:260] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:37.591262 30939 raft_consensus.cc:359] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:37.604786 30939 raft_consensus.cc:385] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.605208 30939 raft_consensus.cc:740] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.605921 30939 consensus_queue.cc:260] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:37.571837 30785 leader_election.cc:304] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:37.616122 31238 raft_consensus.cc:2804] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.616724 31238 raft_consensus.cc:697] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:37.616815 31084 raft_consensus.cc:493] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.617563 31084 raft_consensus.cc:515] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:37.617681 31238 consensus_queue.cc:237] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:37.620036 31084 leader_election.cc:290] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
W20260709 12:21:37.621945 30785 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 68216.5us
I20260709 12:21:37.628157 30942 tablet_bootstrap.cc:654] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.608566 30940 ts_tablet_manager.cc:1434] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:21:37.640522 30940 tablet_bootstrap.cc:492] T 7ca6811dc9854dfaa1295db38c91c0fd P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:37.629182 30941 ts_tablet_manager.cc:1434] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.086s	user 0.009s	sys 0.001s
I20260709 12:21:37.632385 31308 consensus_queue.cc:1048] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:37.645780 31303 raft_consensus.cc:493] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.610337 30939 ts_tablet_manager.cc:1434] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:21:37.646543 31303 raft_consensus.cc:515] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:37.647452 30939 tablet_bootstrap.cc:492] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:37.648926 31303 leader_election.cc:290] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:37.650779 30940 tablet_bootstrap.cc:654] T 7ca6811dc9854dfaa1295db38c91c0fd P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.650900 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac2bacfc36f49459fc2b2b2d8afb01d" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:37.651907 30818 raft_consensus.cc:2468] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 0.
W20260709 12:21:37.704592 30617 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:37.711591 30711 leader_election.cc:304] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:37.725106 31298 raft_consensus.cc:2804] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.724967 31301 consensus_queue.cc:1048] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:37.725639 31298 raft_consensus.cc:493] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.726022 31298 raft_consensus.cc:3060] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.698078 30712 leader_election.cc:304] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
W20260709 12:21:37.731556 30712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 44450.7us
I20260709 12:21:37.734830 31303 raft_consensus.cc:2804] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.735443 31303 raft_consensus.cc:493] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.735913 31303 raft_consensus.cc:3060] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.754943 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a0a060aca4bdf912b9291106aaa74" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:37.748404 30939 tablet_bootstrap.cc:654] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.993546 30745 raft_consensus.cc:3060] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.038460 31322 raft_consensus.cc:493] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.039229 31322 raft_consensus.cc:515] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:38.041405 31322 leader_election.cc:290] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:38.043962 30940 tablet_bootstrap.cc:492] T 7ca6811dc9854dfaa1295db38c91c0fd P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:38.044746 30940 ts_tablet_manager.cc:1403] T 7ca6811dc9854dfaa1295db38c91c0fd P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.404s	user 0.039s	sys 0.063s
I20260709 12:21:38.047760 30940 raft_consensus.cc:359] T 7ca6811dc9854dfaa1295db38c91c0fd P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:38.050107 31282 raft_consensus.cc:493] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.051074 31282 raft_consensus.cc:515] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:38.053974 31282 leader_election.cc:290] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:38.058805 30940 raft_consensus.cc:385] T 7ca6811dc9854dfaa1295db38c91c0fd P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.059155 30940 raft_consensus.cc:740] T 7ca6811dc9854dfaa1295db38c91c0fd P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.060022 30940 consensus_queue.cc:260] T 7ca6811dc9854dfaa1295db38c91c0fd P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:38.062381 30940 ts_tablet_manager.cc:1434] T 7ca6811dc9854dfaa1295db38c91c0fd P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:21:38.063431 30940 tablet_bootstrap.cc:492] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:38.064337 31298 raft_consensus.cc:515] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:38.067833 31298 leader_election.cc:290] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:38.070425 30940 tablet_bootstrap.cc:654] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.080487 31308 consensus_queue.cc:1048] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:38.081769 30565 catalog_manager.cc:5697] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:38.101724 30940 tablet_bootstrap.cc:492] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:38.102368 30940 ts_tablet_manager.cc:1403] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.010s
I20260709 12:21:38.102834 30568 catalog_manager.cc:5697] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a reported cstate change: term changed from 0 to 1, leader changed from <none> to d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196). New cstate: current_term: 1 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:38.102842 31312 raft_consensus.cc:493] T 7ca6811dc9854dfaa1295db38c91c0fd P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.105700 31312 raft_consensus.cc:515] T 7ca6811dc9854dfaa1295db38c91c0fd P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:38.110215 30940 raft_consensus.cc:359] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:38.111014 30940 raft_consensus.cc:385] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.111295 30940 raft_consensus.cc:740] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.111976 30940 consensus_queue.cc:260] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:38.114763 30940 ts_tablet_manager.cc:1434] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:21:38.115911 30940 tablet_bootstrap.cc:492] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:38.116185 31232 raft_consensus.cc:493] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.116863 31232 raft_consensus.cc:515] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:38.117452 31312 leader_election.cc:290] T 7ca6811dc9854dfaa1295db38c91c0fd P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:38.119120 31232 leader_election.cc:290] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:38.121213 30888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca6811dc9854dfaa1295db38c91c0fd" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:38.122294 30940 tablet_bootstrap.cc:654] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:38.124481 30785 leader_election.cc:343] T 7ca6811dc9854dfaa1295db38c91c0fd P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.132668 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd8dacaad53349ebb29c67fe11853fab" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:38.134073 30742 raft_consensus.cc:2393] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in current term 1: Already voted for candidate 4a9042c4154c442297159d1c9f1186b9 in this term.
I20260709 12:21:38.139415 31305 consensus_queue.cc:1048] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:38.136380 31303 raft_consensus.cc:515] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
W20260709 12:21:38.145295 30857 leader_election.cc:343] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.147807 30743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ea2bd624354824ada8b141b94ab5f0" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:38.162842 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b26f10a0fb7476098bdb142c864895e" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:38.164057 30941 tablet_bootstrap.cc:492] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:38.166616 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac2bacfc36f49459fc2b2b2d8afb01d" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:38.167258 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac2bacfc36f49459fc2b2b2d8afb01d" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:38.168084 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd8dacaad53349ebb29c67fe11853fab" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:38.168318 30820 raft_consensus.cc:3060] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.168933 30670 raft_consensus.cc:2468] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 0.
W20260709 12:21:38.169060 30857 leader_election.cc:343] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.169592 30857 leader_election.cc:304] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:38.170647 30667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac2bacfc36f49459fc2b2b2d8afb01d" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:38.173875 30664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd8dacaad53349ebb29c67fe11853fab" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:38.174264 31330 raft_consensus.cc:2749] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:38.197962 30668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca6811dc9854dfaa1295db38c91c0fd" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:38.203013 30942 tablet_bootstrap.cc:492] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:38.203715 30942 ts_tablet_manager.cc:1403] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.703s	user 0.019s	sys 0.006s
I20260709 12:21:38.215307 30662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ea2bd624354824ada8b141b94ab5f0" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:38.218237 30664 raft_consensus.cc:3060] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:38.229127 30709 leader_election.cc:343] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:38.231135 30709 leader_election.cc:343] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.232796 31157 consensus_queue.cc:1048] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:38.239616 31232 consensus_queue.cc:1048] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:38.244899 31305 raft_consensus.cc:493] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.245733 31305 raft_consensus.cc:515] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:38.245071 31067 raft_consensus.cc:493] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:38.247383 31067 raft_consensus.cc:515] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:38.250169 31067 leader_election.cc:290] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:38.250286 31283 raft_consensus.cc:493] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.251120 31283 raft_consensus.cc:515] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:38.255029 31312 raft_consensus.cc:493] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.255756 31312 raft_consensus.cc:515] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
W20260709 12:21:38.265463 30709 consensus_peers.cc:597] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:38.265738 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:38.267105 30816 raft_consensus.cc:2393] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in current term 1: Already voted for candidate d3ab9d21f8864b50a71b49c7d624584a in this term.
I20260709 12:21:38.272265 31143 consensus_queue.cc:1048] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:38.244344 30942 raft_consensus.cc:359] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:38.283020 30942 raft_consensus.cc:385] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.283427 30942 raft_consensus.cc:740] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.285251 31312 leader_election.cc:290] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:38.293285 31305 leader_election.cc:290] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:38.296423 31283 leader_election.cc:290] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:38.300064 30939 tablet_bootstrap.cc:492] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:38.306355 30939 ts_tablet_manager.cc:1403] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.659s	user 0.011s	sys 0.014s
I20260709 12:21:38.307812 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100eb209359a46d8b6c900d5a401586e" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:38.308493 30887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd8dacaad53349ebb29c67fe11853fab" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:38.309558 30887 raft_consensus.cc:2468] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 0.
I20260709 12:21:38.300854 30820 raft_consensus.cc:2468] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:38.310673 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffb9d78e773452ab44ae35b5d65fdb2" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:38.315236 30942 consensus_queue.cc:260] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:38.316653 30893 raft_consensus.cc:2468] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 0.
W20260709 12:21:38.325344 30783 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 115505us
W20260709 12:21:38.326308 30783 consensus_peers.cc:597] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:38.327098 30783 leader_election.cc:343] T 7ca6811dc9854dfaa1295db38c91c0fd P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.347988 30783 leader_election.cc:304] T 7ca6811dc9854dfaa1295db38c91c0fd P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:38.332846 30942 ts_tablet_manager.cc:1434] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.129s	user 0.010s	sys 0.000s
I20260709 12:21:38.350682 30942 tablet_bootstrap.cc:492] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:38.333612 31303 leader_election.cc:290] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:38.336122 30941 tablet_bootstrap.cc:654] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.337993 30939 raft_consensus.cc:359] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:38.357595 30939 raft_consensus.cc:385] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.358125 30939 raft_consensus.cc:740] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
W20260709 12:21:38.343374 30785 leader_election.cc:343] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.330494 30890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:38.359328 30939 consensus_queue.cc:260] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:38.370446 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd8dacaad53349ebb29c67fe11853fab" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:38.371223 30893 raft_consensus.cc:3060] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:38.377458 30857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 208413us
W20260709 12:21:38.378926 30857 leader_election.cc:343] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.379873 31331 consensus_queue.cc:1048] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:38.381187 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100eb209359a46d8b6c900d5a401586e" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:38.359834 31305 raft_consensus.cc:2749] T 7ca6811dc9854dfaa1295db38c91c0fd P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:38.385421 30785 leader_election.cc:304] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:38.348423 30664 raft_consensus.cc:2468] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:38.396661 30940 tablet_bootstrap.cc:492] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:38.399653 30746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46508 (request call id 86) took 1083 ms. Trace:
I20260709 12:21:38.400167 30746 rpcz_store.cc:276] 0709 12:21:37.314372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.319776 (+  5404us) service_pool.cc:224] Handling call
0709 12:21:37.364622 (+ 44846us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:37.395416 (+ 30794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:37.398244 (+  2828us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:38.209676 (+811432us) spinlock_profiling.cc:243] Waited 5.52 ms on lock 0x7b180014fbc0. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a9d127ab1 00007f4a9d134281 00007f4a9422d2a6 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a95c45a11 00007f4a95c55372 00007f4a97387a01 00007f4a9734c43a
0709 12:21:38.211275 (+  1599us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b2c001000f8. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a95c45a11 00007f4a95c55372 00007f4a97387a01 00007f4a9734c43a 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2
0709 12:21:38.211934 (+   659us) log.cc:844] Serialized 26 byte log entry
0709 12:21:38.362227 (+150293us) raft_consensus.cc:1645] Marking committed up to 0
0709 12:21:38.365192 (+  2965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.371270 (+  6078us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:38.375227 (+  3957us) raft_consensus.cc:1685] finished
0709 12:21:38.375247 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:38.398020 (+ 22773us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":634,"raft.queue_time_us":5727,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":11486,"spinlock_wait_cycles":19539584,"thread_start_us":135456,"threads_started":1,"wal-append.queue_time_us":132405}
I20260709 12:21:38.402724 30668 raft_consensus.cc:3060] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.399410 30940 ts_tablet_manager.cc:1403] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.284s	user 0.088s	sys 0.099s
W20260709 12:21:38.397158 30783 leader_election.cc:343] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.386916 31305 raft_consensus.cc:2804] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:21:38.398170 30857 leader_election.cc:343] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.410037 31305 raft_consensus.cc:493] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.410535 31305 raft_consensus.cc:3060] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.403905 30887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b26f10a0fb7476098bdb142c864895e" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:38.413317 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be8d04f2ad34fd5b7c66aa68c8fa47a" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:38.397276 30565 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36714 (request call id 76) took 1194 ms. Trace:
I20260709 12:21:38.409086 30857 leader_election.cc:304] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:38.406167 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffb9d78e773452ab44ae35b5d65fdb2" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:38.419795 30565 rpcz_store.cc:276] 0709 12:21:37.195345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.195528 (+   183us) service_pool.cc:224] Handling call
0709 12:21:38.387158 (+1191630us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:38.090275 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:38.090890 (+   615us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:38.090932 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:21:38.090945 (+    13us) tablet.cc:662] Decoding operations
0709 12:21:38.091225 (+   280us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:38.091290 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:38.091312 (+    22us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:21:38.091463 (+   151us) tablet.cc:701] Row locks acquired
0709 12:21:38.091475 (+    12us) write_op.cc:260] PREPARE: finished
0709 12:21:38.091599 (+   124us) write_op.cc:270] Start()
0709 12:21:38.091736 (+   137us) write_op.cc:276] Timestamp: P: 1783599698091559 usec, L: 0
0709 12:21:38.091758 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:21:38.092402 (+   644us) log.cc:844] Serialized 543 byte log entry
0709 12:21:38.320137 (+227735us) op_driver.cc:464] REPLICATION: finished
0709 12:21:38.381128 (+ 60991us) write_op.cc:301] APPLY: starting
0709 12:21:38.381216 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:38.381317 (+   101us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:38.381458 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:38.381711 (+   253us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:38.381873 (+   162us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:21:38.381917 (+    44us) write_op.cc:312] APPLY: finished
0709 12:21:38.382099 (+   182us) log.cc:844] Serialized 22 byte log entry
0709 12:21:38.382279 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:38.382358 (+    79us) write_op.cc:454] Released schema lock
0709 12:21:38.382417 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:38.382759 (+   342us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:38.382791 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":63989,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":60718,"apply.run_cpu_time_us":1621,"apply.run_wall_time_us":1620,"num_ops":1,"prepare.queue_time_us":5088,"prepare.run_cpu_time_us":4948,"prepare.run_wall_time_us":35310,"raft.queue_time_us":249384,"raft.run_cpu_time_us":2360,"raft.run_wall_time_us":77449,"replication_time_us":228209,"thread_start_us":282634,"threads_started":4,"wal-append.queue_time_us":7204}]]}
W20260709 12:21:38.499253 30857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 58259us
W20260709 12:21:38.499191 30783 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 44860.4us
I20260709 12:21:38.505507 30712 leader_election.cc:304] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:38.505923 30663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e243e0f019f54586877c9a61b2fc83ac" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:38.506599 31303 raft_consensus.cc:2804] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:38.507094 31303 raft_consensus.cc:697] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:38.507972 31303 consensus_queue.cc:237] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:38.509913 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e243e0f019f54586877c9a61b2fc83ac" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
W20260709 12:21:38.510916 30712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 70466.3us
I20260709 12:21:38.519006 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be8d04f2ad34fd5b7c66aa68c8fa47a" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:38.520998 30893 raft_consensus.cc:2468] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:38.522873 30942 tablet_bootstrap.cc:654] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:38.526744 30783 leader_election.cc:343] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.527231 30783 leader_election.cc:304] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
W20260709 12:21:38.525882 30785 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 61600.2us
I20260709 12:21:38.530457 31283 raft_consensus.cc:2749] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:38.530680 30567 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36704 (request call id 70) took 1296 ms. Trace:
I20260709 12:21:38.531191 30567 rpcz_store.cc:276] 0709 12:21:37.234301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.234441 (+   140us) service_pool.cc:224] Handling call
0709 12:21:38.530581 (+1296140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":932011,"reported_tablets":3}
I20260709 12:21:38.500957 31143 raft_consensus.cc:2749] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:38.534075 30566 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36728 (request call id 75) took 1285 ms. Trace:
W20260709 12:21:38.534969 30783 leader_election.cc:343] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.534600 30566 rpcz_store.cc:276] 0709 12:21:37.249083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.249266 (+   183us) service_pool.cc:224] Handling call
0709 12:21:38.533986 (+1284720us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3976,"reported_tablets":1}
I20260709 12:21:38.507875 30939 ts_tablet_manager.cc:1434] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.199s	user 0.012s	sys 0.000s
I20260709 12:21:38.547720 30939 tablet_bootstrap.cc:492] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:38.505462 30940 raft_consensus.cc:359] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:38.554198 30940 raft_consensus.cc:385] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.554512 30940 raft_consensus.cc:740] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
W20260709 12:21:38.555668 30783 leader_election.cc:343] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.556188 30783 leader_election.cc:304] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:38.556990 31283 raft_consensus.cc:2749] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:38.560817 30940 consensus_queue.cc:260] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:38.534790 30711 leader_election.cc:304] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:38.567539 31301 raft_consensus.cc:2749] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:38.568333 30940 ts_tablet_manager.cc:1434] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.163s	user 0.008s	sys 0.009s
I20260709 12:21:38.569474 30940 tablet_bootstrap.cc:492] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:38.588760 30942 tablet_bootstrap.cc:492] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:38.591173 30942 ts_tablet_manager.cc:1403] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.241s	user 0.014s	sys 0.008s
I20260709 12:21:38.604977 30940 tablet_bootstrap.cc:654] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.608541 30942 raft_consensus.cc:359] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:38.621630 30942 raft_consensus.cc:385] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.627238 30942 raft_consensus.cc:740] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.628048 31143 consensus_queue.cc:1048] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:38.628345 30942 consensus_queue.cc:260] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:38.634407 30942 ts_tablet_manager.cc:1434] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 12:21:38.637225 30942 tablet_bootstrap.cc:492] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:38.637733 30940 tablet_bootstrap.cc:492] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:38.640064 30709 leader_election.cc:304] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:38.640579 30940 ts_tablet_manager.cc:1403] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.071s	user 0.019s	sys 0.003s
I20260709 12:21:38.641808 31232 raft_consensus.cc:2804] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:38.642408 31232 raft_consensus.cc:697] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:38.643404 31232 consensus_queue.cc:237] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:38.644229 30940 raft_consensus.cc:359] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:38.645545 30940 raft_consensus.cc:385] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.645856 30940 raft_consensus.cc:740] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.644459 30942 tablet_bootstrap.cc:654] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.651091 30940 consensus_queue.cc:260] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:38.659302 30857 leader_election.cc:304] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:38.662979 30940 ts_tablet_manager.cc:1434] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:21:38.664469 30940 tablet_bootstrap.cc:492] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:38.665107 31305 raft_consensus.cc:515] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:38.668147 31305 leader_election.cc:290] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:38.670080 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100eb209359a46d8b6c900d5a401586e" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
W20260709 12:21:38.672688 30783 leader_election.cc:343] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:38.680464 30860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 47493.2us
I20260709 12:21:38.685752 31067 raft_consensus.cc:2749] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:38.686617 31067 consensus_queue.cc:1048] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:38.683231 30636 leader_election.cc:304] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:38.691519 31177 raft_consensus.cc:2764] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:21:38.703074 30565 catalog_manager.cc:5697] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:38.703994 30942 tablet_bootstrap.cc:492] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:38.715322 31298 raft_consensus.cc:493] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.716112 31298 raft_consensus.cc:515] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:38.718091 31283 raft_consensus.cc:493] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.720360 31298 leader_election.cc:290] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:38.718767 31283 raft_consensus.cc:515] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:38.713544 30942 ts_tablet_manager.cc:1403] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.077s	user 0.007s	sys 0.010s
I20260709 12:21:38.724422 30668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4682db2f801d4701a9c03cb1e4b32fd0" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:38.725394 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4682db2f801d4701a9c03cb1e4b32fd0" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
W20260709 12:21:38.728109 30783 leader_election.cc:343] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:38.728873 30783 leader_election.cc:343] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.730877 30783 leader_election.cc:304] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:38.731864 31312 raft_consensus.cc:2749] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:38.724452 31283 leader_election.cc:290] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:38.735471 30942 raft_consensus.cc:359] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:38.736191 30942 raft_consensus.cc:385] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.739151 30940 tablet_bootstrap.cc:654] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.736431 30942 raft_consensus.cc:740] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.741269 30942 consensus_queue.cc:260] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:38.744954 30942 ts_tablet_manager.cc:1434] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 12:21:38.745905 30942 tablet_bootstrap.cc:492] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:38.762172 30940 tablet_bootstrap.cc:492] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:38.763513 30941 tablet_bootstrap.cc:492] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:38.764222 30941 ts_tablet_manager.cc:1403] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.600s	user 0.013s	sys 0.006s
I20260709 12:21:38.765008 30940 ts_tablet_manager.cc:1403] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.101s	user 0.014s	sys 0.000s
I20260709 12:21:38.767964 30941 raft_consensus.cc:359] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:38.768867 30941 raft_consensus.cc:385] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.770423 30942 tablet_bootstrap.cc:654] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.769541 30941 raft_consensus.cc:740] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.774569 30940 raft_consensus.cc:359] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:38.783314 30940 raft_consensus.cc:385] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.783912 30940 raft_consensus.cc:740] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.783244 30941 consensus_queue.cc:260] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:38.784682 30940 consensus_queue.cc:260] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:38.786975 30940 ts_tablet_manager.cc:1434] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:21:38.777074 30939 tablet_bootstrap.cc:654] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.791392 30941 ts_tablet_manager.cc:1434] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.010s
I20260709 12:21:38.792948 30941 tablet_bootstrap.cc:492] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:38.729779 30636 leader_election.cc:304] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
W20260709 12:21:38.780359 30712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 52606.8us
I20260709 12:21:38.793864 31084 raft_consensus.cc:2749] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:38.794000 30636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 64334us
I20260709 12:21:38.795274 31305 raft_consensus.cc:493] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.781219 30887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100eb209359a46d8b6c900d5a401586e" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:38.767761 30565 catalog_manager.cc:5697] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:38.781934 30860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 89967.6us
I20260709 12:21:38.796959 30887 raft_consensus.cc:3060] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.801985 30941 tablet_bootstrap.cc:654] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.811482 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a0a060aca4bdf912b9291106aaa74" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:38.812484 30892 raft_consensus.cc:2468] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 0.
I20260709 12:21:38.795814 31305 raft_consensus.cc:515] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:38.815096 31305 leader_election.cc:290] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:38.820573 30887 raft_consensus.cc:2468] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:38.823110 30662 raft_consensus.cc:3060] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.838994 30566 catalog_manager.cc:5697] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a reported cstate change: term changed from 0 to 1, leader changed from <none> to d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196). New cstate: current_term: 1 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:38.825599 30667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:38.827687 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:38.828214 30940 tablet_bootstrap.cc:492] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:38.857707 30785 leader_election.cc:304] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:38.830899 30942 tablet_bootstrap.cc:492] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:38.832918 30711 leader_election.cc:304] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:38.861330 30785 leader_election.cc:304] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:38.861625 31298 raft_consensus.cc:2804] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:38.862051 31298 raft_consensus.cc:493] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.862365 31298 raft_consensus.cc:3060] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.863608 31283 raft_consensus.cc:2804] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:38.864336 31283 raft_consensus.cc:697] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:38.865348 31283 consensus_queue.cc:237] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:38.836525 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a0a060aca4bdf912b9291106aaa74" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:38.867624 30942 ts_tablet_manager.cc:1403] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.122s	user 0.014s	sys 0.000s
I20260709 12:21:38.868369 30939 tablet_bootstrap.cc:492] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:38.868984 30939 ts_tablet_manager.cc:1403] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.322s	user 0.014s	sys 0.000s
I20260709 12:21:38.867904 30565 catalog_manager.cc:5697] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:38.874806 30767 debug-util.cc:398] Leaking SignalData structure 0x7b080021e7e0 after lost signal to thread 23154
W20260709 12:21:38.892689 30709 leader_election.cc:343] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.895323 31305 raft_consensus.cc:2749] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:38.896239 31312 raft_consensus.cc:493] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.896879 31312 raft_consensus.cc:515] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:38.900700 31312 leader_election.cc:290] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:38.901718 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44af5a494fec45679774bc9eb1007f9b" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
W20260709 12:21:38.903299 30783 leader_election.cc:343] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.905056 30887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44af5a494fec45679774bc9eb1007f9b" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
W20260709 12:21:38.906605 30785 leader_election.cc:343] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.907089 30785 leader_election.cc:304] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:38.910236 31195 raft_consensus.cc:2749] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:38.912967 30767 debug-util.cc:398] Leaking SignalData structure 0x7b08002a92e0 after lost signal to thread 30603
W20260709 12:21:38.915374 30767 debug-util.cc:398] Leaking SignalData structure 0x7b080024a600 after lost signal to thread 30695
I20260709 12:21:38.920344 31330 raft_consensus.cc:493] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.921113 31330 raft_consensus.cc:515] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:38.923171 30940 tablet_bootstrap.cc:654] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.923683 31330 leader_election.cc:290] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:38.925043 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffb9d78e773452ab44ae35b5d65fdb2" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
W20260709 12:21:38.925436 30767 debug-util.cc:398] Leaking SignalData structure 0x7b0800211340 after lost signal to thread 30770
I20260709 12:21:38.925781 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffb9d78e773452ab44ae35b5d65fdb2" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:38.925920 30817 raft_consensus.cc:2468] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 0.
W20260709 12:21:38.927424 30857 leader_election.cc:343] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.931275 30860 leader_election.cc:304] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:38.932881 31193 raft_consensus.cc:2804] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:38.933370 31193 raft_consensus.cc:493] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.933806 31193 raft_consensus.cc:3060] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.956367 31298 raft_consensus.cc:515] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:38.958839 31298 leader_election.cc:290] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:38.960259 30887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a0a060aca4bdf912b9291106aaa74" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:38.961647 30887 raft_consensus.cc:3060] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.960266 30939 raft_consensus.cc:359] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:38.968073 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a0a060aca4bdf912b9291106aaa74" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
W20260709 12:21:38.969640 30709 leader_election.cc:343] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.975416 31305 raft_consensus.cc:493] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.963250 30939 raft_consensus.cc:385] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.980967 30939 raft_consensus.cc:740] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.976085 31305 raft_consensus.cc:515] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:38.985173 31305 leader_election.cc:290] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:38.986429 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2f4d39a39493b8404958a5aaaa7af" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:38.987133 30887 raft_consensus.cc:2468] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:38.986575 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2f4d39a39493b8404958a5aaaa7af" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:38.988358 30711 leader_election.cc:304] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
W20260709 12:21:38.989022 30783 leader_election.cc:343] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.006851 31232 raft_consensus.cc:2804] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:39.007544 31232 raft_consensus.cc:697] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:38.939697 30942 raft_consensus.cc:359] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:39.015196 30942 raft_consensus.cc:385] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.015590 30942 raft_consensus.cc:740] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.016575 30942 consensus_queue.cc:260] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:39.019455 30894 raft_consensus.cc:2468] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 0.
I20260709 12:21:39.024605 30785 leader_election.cc:304] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
W20260709 12:21:39.027115 30617 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:39.028012 31171 raft_consensus.cc:2804] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:39.028564 31171 raft_consensus.cc:493] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.029037 31171 raft_consensus.cc:3060] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.033665 31330 raft_consensus.cc:493] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.034355 31330 raft_consensus.cc:515] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:39.008561 31232 consensus_queue.cc:237] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:39.046458 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99734494b57424691503918c73f294e" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:39.046685 30939 consensus_queue.cc:260] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:39.047684 31301 raft_consensus.cc:493] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:39.048395 30709 consensus_peers.cc:597] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:39.048249 31301 raft_consensus.cc:515] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
W20260709 12:21:39.050697 30857 leader_election.cc:343] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:38.927421 30767 debug-util.cc:398] Leaking SignalData structure 0x7b08003135a0 after lost signal to thread 30844
I20260709 12:21:39.057824 31330 leader_election.cc:290] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:39.064527 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99734494b57424691503918c73f294e" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:39.065845 30939 ts_tablet_manager.cc:1434] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.197s	user 0.007s	sys 0.001s
I20260709 12:21:39.067198 30939 tablet_bootstrap.cc:492] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:39.070024 30941 tablet_bootstrap.cc:492] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:39.070673 30941 ts_tablet_manager.cc:1403] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.278s	user 0.015s	sys 0.007s
W20260709 12:21:39.074445 30767 debug-util.cc:398] Leaking SignalData structure 0x7b08001b2100 after lost signal to thread 30918
W20260709 12:21:39.072302 30857 leader_election.cc:343] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:39.075642 30767 debug-util.cc:398] Leaking SignalData structure 0x7b0800199e40 after lost signal to thread 31224
I20260709 12:21:39.075778 30857 leader_election.cc:304] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:39.079094 31330 raft_consensus.cc:2749] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:39.081986 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e243e0f019f54586877c9a61b2fc83ac" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:39.096318 30940 tablet_bootstrap.cc:492] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:39.096946 30940 ts_tablet_manager.cc:1403] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.309s	user 0.012s	sys 0.001s
I20260709 12:21:39.100922 30940 raft_consensus.cc:359] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:39.101840 30940 raft_consensus.cc:385] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.102197 30940 raft_consensus.cc:740] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.107056 30940 consensus_queue.cc:260] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:39.109252 30940 ts_tablet_manager.cc:1434] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:21:39.110002 31301 leader_election.cc:290] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:39.110270 30940 tablet_bootstrap.cc:492] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3: Bootstrap starting.
I20260709 12:21:39.114729 30565 catalog_manager.cc:5697] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:39.111240 30709 leader_election.cc:343] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.119110 30941 raft_consensus.cc:359] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:39.120028 30941 raft_consensus.cc:385] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.119822 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e243e0f019f54586877c9a61b2fc83ac" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:39.120666 30818 raft_consensus.cc:2468] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 0.
I20260709 12:21:39.122112 30941 raft_consensus.cc:740] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.080386 31193 raft_consensus.cc:515] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:39.125877 31171 raft_consensus.cc:515] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:39.109282 30942 ts_tablet_manager.cc:1434] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.241s	user 0.009s	sys 0.000s
I20260709 12:21:39.129634 30942 tablet_bootstrap.cc:492] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:39.129664 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2f4d39a39493b8404958a5aaaa7af" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:39.130358 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2f4d39a39493b8404958a5aaaa7af" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:39.131183 30892 raft_consensus.cc:3060] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:39.131563 30783 leader_election.cc:343] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.131875 30712 leader_election.cc:304] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:39.133977 31303 raft_consensus.cc:2804] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:39.134404 31303 raft_consensus.cc:493] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.134773 31303 raft_consensus.cc:3060] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.137974 30939 tablet_bootstrap.cc:654] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.123056 30941 consensus_queue.cc:260] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:39.123057 30940 tablet_bootstrap.cc:654] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.128460 31171 leader_election.cc:290] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:39.157145 30941 ts_tablet_manager.cc:1434] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.086s	user 0.008s	sys 0.002s
I20260709 12:21:39.158335 30941 tablet_bootstrap.cc:492] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:39.163165 31193 leader_election.cc:290] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:39.163760 30892 raft_consensus.cc:2468] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:39.164472 30941 tablet_bootstrap.cc:654] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.165938 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffb9d78e773452ab44ae35b5d65fdb2" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:39.177309 31298 consensus_queue.cc:1048] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:39.175097 30785 leader_election.cc:304] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:39.179057 31171 raft_consensus.cc:2804] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:39.179581 31171 raft_consensus.cc:697] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:39.180513 31171 consensus_queue.cc:237] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
W20260709 12:21:39.181159 30857 leader_election.cc:343] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.167367 31301 consensus_queue.cc:1048] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:39.173406 30942 tablet_bootstrap.cc:654] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.193045 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffb9d78e773452ab44ae35b5d65fdb2" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:39.207131 30818 raft_consensus.cc:3060] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.235400 31303 raft_consensus.cc:515] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:39.238880 31301 consensus_queue.cc:1048] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:39.262737 30940 tablet_bootstrap.cc:492] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3: No bootstrap required, opened a new log
I20260709 12:21:39.263281 30940 ts_tablet_manager.cc:1403] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3: Time spent bootstrapping tablet: real 0.153s	user 0.019s	sys 0.003s
I20260709 12:21:39.252847 31307 raft_consensus.cc:493] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.279901 30942 tablet_bootstrap.cc:492] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:39.280484 30942 ts_tablet_manager.cc:1403] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.151s	user 0.012s	sys 0.009s
I20260709 12:21:39.287330 30818 raft_consensus.cc:2468] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:39.302947 30942 raft_consensus.cc:359] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:39.303771 30942 raft_consensus.cc:385] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.288874 31307 raft_consensus.cc:515] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:39.304055 30942 raft_consensus.cc:740] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.304793 30942 consensus_queue.cc:260] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:39.307112 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac2bacfc36f49459fc2b2b2d8afb01d" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:39.306614 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac2bacfc36f49459fc2b2b2d8afb01d" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:39.305884 31307 leader_election.cc:290] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:39.309012 30860 leader_election.cc:304] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:39.322429 30667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e243e0f019f54586877c9a61b2fc83ac" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:39.323271 30940 raft_consensus.cc:359] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:39.323851 31193 raft_consensus.cc:2804] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:39.324126 30940 raft_consensus.cc:385] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.324487 31193 raft_consensus.cc:697] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:39.324868 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e243e0f019f54586877c9a61b2fc83ac" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
W20260709 12:21:39.325279 30709 leader_election.cc:343] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.325446 31193 consensus_queue.cc:237] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:39.325495 30818 raft_consensus.cc:3060] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.318178 31303 leader_election.cc:290] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:39.320559 30634 leader_election.cc:304] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:39.333751 31307 raft_consensus.cc:2749] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:39.334100 31282 raft_consensus.cc:493] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.334646 31282 raft_consensus.cc:515] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:39.337316 31282 leader_election.cc:290] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:39.338438 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca6811dc9854dfaa1295db38c91c0fd" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:39.339124 30816 raft_consensus.cc:2468] T 7ca6811dc9854dfaa1295db38c91c0fd P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 0.
I20260709 12:21:39.340517 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca6811dc9854dfaa1295db38c91c0fd" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:39.340835 30860 leader_election.cc:304] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:39.341604 31305 consensus_queue.cc:1048] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:21:39.342320 30857 leader_election.cc:343] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.345314 30818 raft_consensus.cc:2468] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:39.347591 30712 leader_election.cc:304] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:39.349292 31303 raft_consensus.cc:2804] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:39.349839 31303 raft_consensus.cc:697] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:39.350934 31303 consensus_queue.cc:237] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:39.324505 30940 raft_consensus.cc:740] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.354301 30940 consensus_queue.cc:260] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:39.358068 30942 ts_tablet_manager.cc:1434] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.000s
I20260709 12:21:39.341650 31282 raft_consensus.cc:2804] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:39.366470 30940 ts_tablet_manager.cc:1434] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3: Time spent starting tablet: real 0.103s	user 0.007s	sys 0.001s
I20260709 12:21:39.371332 30942 tablet_bootstrap.cc:492] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:39.369675 31282 raft_consensus.cc:493] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.376595 31282 raft_consensus.cc:3060] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.363850 30567 catalog_manager.cc:5697] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:39.413836 30941 tablet_bootstrap.cc:492] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:39.414433 30941 ts_tablet_manager.cc:1403] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.256s	user 0.014s	sys 0.000s
I20260709 12:21:39.436079 30941 raft_consensus.cc:359] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:39.437801 30941 raft_consensus.cc:385] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.438118 30941 raft_consensus.cc:740] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.438979 30941 consensus_queue.cc:260] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:39.441390 30939 tablet_bootstrap.cc:492] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:39.442234 30941 ts_tablet_manager.cc:1434] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 12:21:39.442272 30939 ts_tablet_manager.cc:1403] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.375s	user 0.018s	sys 0.019s
I20260709 12:21:39.444272 30942 tablet_bootstrap.cc:654] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.446714 30939 raft_consensus.cc:359] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:39.447808 31282 raft_consensus.cc:515] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:39.448166 30939 raft_consensus.cc:385] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.449981 30939 raft_consensus.cc:740] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.450222 31282 leader_election.cc:290] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:39.451618 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca6811dc9854dfaa1295db38c91c0fd" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:39.452273 30818 raft_consensus.cc:3060] T 7ca6811dc9854dfaa1295db38c91c0fd P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.454077 30566 catalog_manager.cc:5697] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:39.454706 30939 consensus_queue.cc:260] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:39.457175 30939 ts_tablet_manager.cc:1434] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 12:21:39.458165 30941 tablet_bootstrap.cc:492] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:39.458297 30939 tablet_bootstrap.cc:492] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:39.461158 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca6811dc9854dfaa1295db38c91c0fd" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
W20260709 12:21:39.465186 30783 consensus_peers.cc:597] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:39.465562 30857 leader_election.cc:343] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.466985 30818 raft_consensus.cc:2468] T 7ca6811dc9854dfaa1295db38c91c0fd P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:39.468560 30860 leader_election.cc:304] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:39.470360 31330 raft_consensus.cc:2804] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:39.470860 31330 raft_consensus.cc:697] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:39.471710 31330 consensus_queue.cc:237] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:39.489319 30941 tablet_bootstrap.cc:654] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.508085 30565 catalog_manager.cc:5697] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a reported cstate change: term changed from 0 to 1, leader changed from <none> to d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196). New cstate: current_term: 1 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:39.509786 31312 raft_consensus.cc:493] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.495141 30939 tablet_bootstrap.cc:654] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.516650 31312 raft_consensus.cc:515] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:39.519101 31312 leader_election.cc:290] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:39.522203 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81434413f4d7497a8ae5f95db857f819" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:39.522531 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81434413f4d7497a8ae5f95db857f819" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
W20260709 12:21:39.530061 30783 leader_election.cc:343] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:39.532393 30783 leader_election.cc:343] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.532893 30783 leader_election.cc:304] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:39.534618 31312 raft_consensus.cc:2749] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:39.545971 30942 tablet_bootstrap.cc:492] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:39.546591 30942 ts_tablet_manager.cc:1403] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.178s	user 0.010s	sys 0.007s
I20260709 12:21:39.549444 30942 raft_consensus.cc:359] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:39.551545 30942 raft_consensus.cc:385] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.551823 30942 raft_consensus.cc:740] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.553149 30942 consensus_queue.cc:260] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:39.556401 30942 ts_tablet_manager.cc:1434] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:21:39.557832 30942 tablet_bootstrap.cc:492] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:39.585944 30942 tablet_bootstrap.cc:654] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.587239 31298 consensus_queue.cc:1048] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:39.599514 30941 tablet_bootstrap.cc:492] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:39.600054 31305 consensus_queue.cc:1048] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:39.600433 30941 ts_tablet_manager.cc:1403] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.143s	user 0.015s	sys 0.006s
I20260709 12:21:39.608729 30565 catalog_manager.cc:5697] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a reported cstate change: term changed from 0 to 1, leader changed from <none> to d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196). New cstate: current_term: 1 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:39.619446 30942 tablet_bootstrap.cc:492] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:39.620038 30942 ts_tablet_manager.cc:1403] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.062s	user 0.023s	sys 0.002s
I20260709 12:21:39.621881 30939 tablet_bootstrap.cc:492] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:39.622392 30939 ts_tablet_manager.cc:1403] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.164s	user 0.026s	sys 0.006s
I20260709 12:21:39.623974 30941 raft_consensus.cc:359] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:39.633977 30941 raft_consensus.cc:385] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.625197 30939 raft_consensus.cc:359] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:39.634407 30941 raft_consensus.cc:740] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.634639 30939 raft_consensus.cc:385] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.635013 30939 raft_consensus.cc:740] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.635672 30939 consensus_queue.cc:260] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:39.627425 30942 raft_consensus.cc:359] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:39.636608 30942 raft_consensus.cc:385] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.636919 30942 raft_consensus.cc:740] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.637629 30942 consensus_queue.cc:260] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:39.639215 30662 raft_consensus.cc:3060] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.639698 30939 ts_tablet_manager.cc:1434] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.004s
I20260709 12:21:39.638883 30941 consensus_queue.cc:260] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:39.642623 30942 ts_tablet_manager.cc:1434] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.004s
I20260709 12:21:39.643644 30942 tablet_bootstrap.cc:492] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a: Bootstrap starting.
I20260709 12:21:39.645804 30939 tablet_bootstrap.cc:492] T 100eb209359a46d8b6c900d5a401586e P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:39.648798 30941 ts_tablet_manager.cc:1434] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.043s	user 0.003s	sys 0.006s
I20260709 12:21:39.651541 30941 tablet_bootstrap.cc:492] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:39.654846 30665 raft_consensus.cc:3060] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.672734 30941 tablet_bootstrap.cc:654] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.658215 30567 catalog_manager.cc:5697] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:39.676621 30942 tablet_bootstrap.cc:654] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.700500 31330 raft_consensus.cc:493] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.701109 31330 raft_consensus.cc:515] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:39.703203 31330 leader_election.cc:290] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:39.705217 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44af5a494fec45679774bc9eb1007f9b" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:39.706910 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44af5a494fec45679774bc9eb1007f9b" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:39.708036 30816 raft_consensus.cc:2468] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 0.
W20260709 12:21:39.708289 30857 leader_election.cc:343] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.711134 30860 leader_election.cc:304] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:39.711613 30939 tablet_bootstrap.cc:654] T 100eb209359a46d8b6c900d5a401586e P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.713023 31282 raft_consensus.cc:2804] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:39.713560 31282 raft_consensus.cc:493] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.713994 31282 raft_consensus.cc:3060] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.725351 31305 raft_consensus.cc:493] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.726276 31305 raft_consensus.cc:515] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:39.731796 30667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e24a3b2b9d4270a8b8466d3c6313ab" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:39.745982 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e24a3b2b9d4270a8b8466d3c6313ab" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:39.746989 30893 raft_consensus.cc:2468] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 0.
I20260709 12:21:39.749101 30942 tablet_bootstrap.cc:492] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a: No bootstrap required, opened a new log
I20260709 12:21:39.749728 30942 ts_tablet_manager.cc:1403] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a: Time spent bootstrapping tablet: real 0.106s	user 0.012s	sys 0.005s
W20260709 12:21:39.751915 30783 leader_election.cc:343] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.736352 31305 leader_election.cc:290] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:39.761703 30785 leader_election.cc:304] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:39.768529 31312 raft_consensus.cc:2804] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:39.769133 31312 raft_consensus.cc:493] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.769639 31312 raft_consensus.cc:3060] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.774544 30942 raft_consensus.cc:359] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:39.775488 30942 raft_consensus.cc:385] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.775810 30942 raft_consensus.cc:740] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.789741 31282 raft_consensus.cc:515] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:39.792798 31193 consensus_queue.cc:1048] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:39.806051 31084 raft_consensus.cc:493] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.808969 31084 raft_consensus.cc:515] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:39.776981 30942 consensus_queue.cc:260] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:39.815052 30942 ts_tablet_manager.cc:1434] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.000s
I20260709 12:21:39.818527 30941 tablet_bootstrap.cc:492] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:39.819193 30941 ts_tablet_manager.cc:1403] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.170s	user 0.025s	sys 0.037s
I20260709 12:21:39.818190 31301 consensus_queue.cc:1048] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:21:39.819849 30783 consensus_peers.cc:597] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:39.823206 31084 leader_election.cc:290] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:39.824282 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a0a060aca4bdf912b9291106aaa74" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:39.826753 30941 raft_consensus.cc:359] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:39.827661 30941 raft_consensus.cc:385] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.827936 30941 raft_consensus.cc:740] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.830582 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a0a060aca4bdf912b9291106aaa74" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:39.830760 30941 consensus_queue.cc:260] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:39.831389 31312 raft_consensus.cc:515] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:39.832424 30636 leader_election.cc:304] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:39.835126 31312 leader_election.cc:290] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:39.835947 30941 ts_tablet_manager.cc:1434] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.003s
I20260709 12:21:39.837155 30662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e24a3b2b9d4270a8b8466d3c6313ab" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:39.839577 30939 tablet_bootstrap.cc:492] T 100eb209359a46d8b6c900d5a401586e P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:39.839478 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e24a3b2b9d4270a8b8466d3c6313ab" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:39.840374 30939 ts_tablet_manager.cc:1403] T 100eb209359a46d8b6c900d5a401586e P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.195s	user 0.029s	sys 0.053s
I20260709 12:21:39.839488 30941 tablet_bootstrap.cc:492] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:39.847607 30939 raft_consensus.cc:359] T 100eb209359a46d8b6c900d5a401586e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
W20260709 12:21:39.848177 30783 leader_election.cc:343] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.844529 30892 raft_consensus.cc:3060] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.849439 31301 consensus_queue.cc:1048] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:39.848382 30939 raft_consensus.cc:385] T 100eb209359a46d8b6c900d5a401586e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.851847 30939 raft_consensus.cc:740] T 100eb209359a46d8b6c900d5a401586e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.852694 30939 consensus_queue.cc:260] T 100eb209359a46d8b6c900d5a401586e P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:39.855079 30939 ts_tablet_manager.cc:1434] T 100eb209359a46d8b6c900d5a401586e P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:21:39.856783 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44af5a494fec45679774bc9eb1007f9b" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:39.857796 30816 raft_consensus.cc:3060] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.859253 30941 tablet_bootstrap.cc:654] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.859992 30742 raft_consensus.cc:3060] T 100eb209359a46d8b6c900d5a401586e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.853045 31282 leader_election.cc:290] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:39.864657 30939 tablet_bootstrap.cc:492] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:39.890967 31298 raft_consensus.cc:493] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.891816 31298 raft_consensus.cc:515] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:39.895622 31298 leader_election.cc:290] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:39.898361 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffb9d78e773452ab44ae35b5d65fdb2" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:39.902793 30816 raft_consensus.cc:2468] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:39.939962 31157 raft_consensus.cc:493] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.955092 31084 raft_consensus.cc:2749] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:39.953560 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44af5a494fec45679774bc9eb1007f9b" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:39.957484 31157 raft_consensus.cc:515] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:39.998190 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffb9d78e773452ab44ae35b5d65fdb2" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:40.019517 30860 leader_election.cc:304] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:40.022445 30941 tablet_bootstrap.cc:492] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:40.023233 30941 ts_tablet_manager.cc:1403] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.184s	user 0.016s	sys 0.010s
W20260709 12:21:40.028877 31397 log.cc:927] Time spent T 100eb209359a46d8b6c900d5a401586e P 4a9042c4154c442297159d1c9f1186b9: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:21:40.032524 31405 raft_consensus.cc:493] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.033208 31405 raft_consensus.cc:515] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:40.035739 31405 leader_election.cc:290] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:40.037272 31404 raft_consensus.cc:2804] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:40.038281 31404 raft_consensus.cc:697] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:40.039467 31404 consensus_queue.cc:237] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:40.051421 31157 leader_election.cc:290] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
W20260709 12:21:40.095629 30860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 76192.8us
I20260709 12:21:40.052865 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ea2bd624354824ada8b141b94ab5f0" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:40.102464 30742 raft_consensus.cc:3060] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.104220 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ea2bd624354824ada8b141b94ab5f0" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:40.103497 30712 leader_election.cc:304] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:40.112888 30893 raft_consensus.cc:2468] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 0.
W20260709 12:21:40.116781 30857 leader_election.cc:343] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.117419 30939 tablet_bootstrap.cc:654] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.119203 30665 raft_consensus.cc:2468] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 0.
I20260709 12:21:40.137791 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcceeadce924e3493e4e91cb49e2f2e" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:40.139640 30711 leader_election.cc:304] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:40.141816 31412 raft_consensus.cc:2804] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:40.140033 30892 raft_consensus.cc:2468] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:40.130944 31298 raft_consensus.cc:2749] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:40.148185 31412 raft_consensus.cc:493] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.147236 31282 consensus_queue.cc:1048] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260709 12:21:40.156613 31331 consensus_queue.cc:1048] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:21:40.175639 31412 raft_consensus.cc:3060] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.178057 31411 raft_consensus.cc:493] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.215209 31411 raft_consensus.cc:515] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
W20260709 12:21:40.233261 30857 consensus_peers.cc:597] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:40.246168 31411 leader_election.cc:290] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:40.248724 30664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faf21b4ff034e548c19569963419851" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:40.255563 30941 raft_consensus.cc:359] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:40.256392 30941 raft_consensus.cc:385] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.259158 30941 raft_consensus.cc:740] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.261619 30941 consensus_queue.cc:260] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:40.261983 30664 raft_consensus.cc:3060] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.266008 30785 leader_election.cc:304] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:40.264601 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcceeadce924e3493e4e91cb49e2f2e" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:40.282608 31398 raft_consensus.cc:2804] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:21:40.291749 30857 leader_election.cc:343] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:40.345600 30617 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:40.352308 30941 ts_tablet_manager.cc:1434] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.329s	user 0.004s	sys 0.006s
W20260709 12:21:40.357368 30860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 46675.4us
I20260709 12:21:40.313138 31398 raft_consensus.cc:697] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:40.365253 30636 leader_election.cc:304] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:40.367091 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faf21b4ff034e548c19569963419851" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
W20260709 12:21:40.384804 30711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 227053us
W20260709 12:21:40.436770 30857 leader_election.cc:343] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.437721 30857 leader_election.cc:304] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:40.452589 31412 raft_consensus.cc:515] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:40.439999 31417 raft_consensus.cc:2749] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:40.457711 31412 leader_election.cc:290] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:40.472505 30888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ea2bd624354824ada8b141b94ab5f0" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:40.473426 30888 raft_consensus.cc:3060] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.472502 30668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ea2bd624354824ada8b141b94ab5f0" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:40.478888 30668 raft_consensus.cc:3060] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.400764 31398 consensus_queue.cc:237] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:40.502911 30939 tablet_bootstrap.cc:492] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:40.503808 30939 ts_tablet_manager.cc:1403] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.640s	user 0.024s	sys 0.021s
W20260709 12:21:40.505569 30709 consensus_peers.cc:597] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:40.534861 30668 raft_consensus.cc:2468] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:40.551963 30888 raft_consensus.cc:2468] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:40.559965 30939 raft_consensus.cc:359] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:40.573227 30939 raft_consensus.cc:385] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.573607 30939 raft_consensus.cc:740] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.574287 30939 consensus_queue.cc:260] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:40.575884 30939 ts_tablet_manager.cc:1434] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.000s
I20260709 12:21:40.578032 30939 tablet_bootstrap.cc:492] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:40.577107 30709 leader_election.cc:304] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:40.576229 30566 catalog_manager.cc:5697] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.597252 30941 tablet_bootstrap.cc:492] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:40.602541 31084 raft_consensus.cc:493] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.603229 31084 raft_consensus.cc:515] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:40.603807 31412 raft_consensus.cc:2804] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:40.604583 31412 raft_consensus.cc:697] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:40.605607 31412 consensus_queue.cc:237] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:40.611430 30939 tablet_bootstrap.cc:654] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.612665 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4682db2f801d4701a9c03cb1e4b32fd0" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:40.614893 31084 leader_election.cc:290] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:40.616875 30817 raft_consensus.cc:2468] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 0.
I20260709 12:21:40.624266 30637 leader_election.cc:304] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:40.625757 31416 raft_consensus.cc:2804] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:40.626176 31416 raft_consensus.cc:493] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.626325 30941 tablet_bootstrap.cc:654] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.626569 31416 raft_consensus.cc:3060] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.629257 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4682db2f801d4701a9c03cb1e4b32fd0" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:40.629987 30742 raft_consensus.cc:2468] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 0.
I20260709 12:21:40.666884 31408 raft_consensus.cc:2749] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:40.676962 30857 consensus_peers.cc:597] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:40.685604 31416 raft_consensus.cc:515] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:40.694916 31416 leader_election.cc:290] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:40.697798 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4682db2f801d4701a9c03cb1e4b32fd0" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:40.702502 30816 raft_consensus.cc:3060] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.706171 30941 tablet_bootstrap.cc:492] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:40.706772 30941 ts_tablet_manager.cc:1403] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.110s	user 0.013s	sys 0.005s
I20260709 12:21:40.708494 30939 tablet_bootstrap.cc:492] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:40.709097 30939 ts_tablet_manager.cc:1403] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.132s	user 0.022s	sys 0.003s
I20260709 12:21:40.710044 30941 raft_consensus.cc:359] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:40.710777 30941 raft_consensus.cc:385] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.711053 30941 raft_consensus.cc:740] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.711493 30816 raft_consensus.cc:2468] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:40.711836 30939 raft_consensus.cc:359] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:40.712683 30939 raft_consensus.cc:385] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.711727 30941 consensus_queue.cc:260] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:40.715170 30941 ts_tablet_manager.cc:1434] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:21:40.715909 30941 tablet_bootstrap.cc:492] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:40.713016 30939 raft_consensus.cc:740] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.717422 30939 consensus_queue.cc:260] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:40.720454 30939 ts_tablet_manager.cc:1434] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:21:40.721624 30939 tablet_bootstrap.cc:492] T 81434413f4d7497a8ae5f95db857f819 P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:40.721832 30941 tablet_bootstrap.cc:654] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.779549 30637 leader_election.cc:304] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:40.796118 31084 raft_consensus.cc:2804] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:40.819684 31084 raft_consensus.cc:697] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:21:40.822424 31084 consensus_queue.cc:237] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:40.835144 31411 consensus_queue.cc:1048] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:40.794500 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4682db2f801d4701a9c03cb1e4b32fd0" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:40.956070 30742 raft_consensus.cc:3060] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.988559 31419 raft_consensus.cc:493] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.079092 31419 raft_consensus.cc:515] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:41.089207 31419 leader_election.cc:290] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:41.099654 30941 tablet_bootstrap.cc:492] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:41.101004 30941 ts_tablet_manager.cc:1403] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.385s	user 0.007s	sys 0.012s
I20260709 12:21:40.946521 30565 catalog_manager.cc:5697] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a reported cstate change: term changed from 0 to 1, leader changed from <none> to d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196). New cstate: current_term: 1 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:41.140693 30662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99734494b57424691503918c73f294e" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:41.144016 30939 tablet_bootstrap.cc:654] T 81434413f4d7497a8ae5f95db857f819 P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:41.155025 30709 leader_election.cc:343] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.183533 31444 raft_consensus.cc:493] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.184785 31405 raft_consensus.cc:493] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:41.198843 31405 raft_consensus.cc:515] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:41.201736 31405 leader_election.cc:290] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:41.202512 31444 raft_consensus.cc:515] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:41.203738 30814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac2bacfc36f49459fc2b2b2d8afb01d" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:41.204043 30668 raft_consensus.cc:3060] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.191434 30742 raft_consensus.cc:2468] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
W20260709 12:21:41.222738 31442 log.cc:927] Time spent T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:21:41.234436 30941 raft_consensus.cc:359] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
W20260709 12:21:41.245419 30709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 90576.9us
W20260709 12:21:41.165087 30860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 86751.9us
W20260709 12:21:41.192107 30783 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 219428us
I20260709 12:21:41.236032 30941 raft_consensus.cc:385] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.255432 30941 raft_consensus.cc:740] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.265367 30888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99734494b57424691503918c73f294e" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:41.266516 30888 raft_consensus.cc:2468] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 0.
I20260709 12:21:41.282935 31444 leader_election.cc:290] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:41.276661 30941 consensus_queue.cc:260] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:41.316618 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca6811dc9854dfaa1295db38c91c0fd" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:41.322312 31428 consensus_queue.cc:1048] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:21:41.327291 30783 consensus_peers.cc:597] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:41.333230 30941 ts_tablet_manager.cc:1434] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.211s	user 0.011s	sys 0.001s
I20260709 12:21:41.335079 30941 tablet_bootstrap.cc:492] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:41.334401 30567 catalog_manager.cc:5697] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:41.346992 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac2bacfc36f49459fc2b2b2d8afb01d" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:41.371397 30887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca6811dc9854dfaa1295db38c91c0fd" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:41.374750 30939 tablet_bootstrap.cc:492] T 81434413f4d7497a8ae5f95db857f819 P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:41.375478 30939 ts_tablet_manager.cc:1403] T 81434413f4d7497a8ae5f95db857f819 P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.654s	user 0.022s	sys 0.007s
I20260709 12:21:41.390112 31420 consensus_queue.cc:1048] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:41.396315 30939 raft_consensus.cc:359] T 81434413f4d7497a8ae5f95db857f819 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:41.397284 30939 raft_consensus.cc:385] T 81434413f4d7497a8ae5f95db857f819 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.397614 30939 raft_consensus.cc:740] T 81434413f4d7497a8ae5f95db857f819 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.403285 30634 leader_election.cc:304] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:41.419118 31307 raft_consensus.cc:2749] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:41.420003 31444 consensus_queue.cc:1048] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:41.435226 30636 leader_election.cc:304] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:41.404089 30941 tablet_bootstrap.cc:654] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.406036 30711 leader_election.cc:304] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:41.412751 30664 raft_consensus.cc:3060] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:41.450724 30711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 44868.4us
I20260709 12:21:41.461530 31443 raft_consensus.cc:2804] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:41.462091 31443 raft_consensus.cc:493] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.462457 31443 raft_consensus.cc:3060] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.467702 31448 consensus_queue.cc:1048] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:21:41.474852 30939 consensus_queue.cc:260] T 81434413f4d7497a8ae5f95db857f819 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:41.491655 30939 ts_tablet_manager.cc:1434] T 81434413f4d7497a8ae5f95db857f819 P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.116s	user 0.009s	sys 0.000s
I20260709 12:21:41.503504 30939 tablet_bootstrap.cc:492] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:41.519867 31443 raft_consensus.cc:515] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:41.527001 31443 leader_election.cc:290] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:41.646185 30939 tablet_bootstrap.cc:654] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.747357 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99734494b57424691503918c73f294e" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
W20260709 12:21:41.756906 30712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 51949.3us
I20260709 12:21:41.743178 31445 raft_consensus.cc:493] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.766434 30892 raft_consensus.cc:3060] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.814222 31445 raft_consensus.cc:515] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:41.847167 30941 tablet_bootstrap.cc:492] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:41.847766 30941 ts_tablet_manager.cc:1403] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.513s	user 0.008s	sys 0.031s
I20260709 12:21:41.865583 31445 leader_election.cc:290] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
W20260709 12:21:41.874899 31462 log.cc:927] Time spent T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a: Append to log took a long time: real 0.079s	user 0.000s	sys 0.003s
W20260709 12:21:41.892078 31455 log.cc:927] Time spent T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Append to log took a long time: real 0.392s	user 0.002s	sys 0.000s
I20260709 12:21:41.911468 30892 raft_consensus.cc:2468] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:41.931123 30941 raft_consensus.cc:359] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:41.932418 30941 raft_consensus.cc:385] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.954270 30941 raft_consensus.cc:740] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.964468 30941 consensus_queue.cc:260] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:41.972664 30939 tablet_bootstrap.cc:492] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:41.973600 30939 ts_tablet_manager.cc:1403] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.471s	user 0.022s	sys 0.017s
I20260709 12:21:42.126564 30941 ts_tablet_manager.cc:1434] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.278s	user 0.010s	sys 0.000s
I20260709 12:21:42.124325 31307 raft_consensus.cc:2749] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:42.188118 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99734494b57424691503918c73f294e" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
W20260709 12:21:42.788102 30664 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.020s	sys 0.018s
W20260709 12:21:42.788807 30664 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.021s	sys 0.018s
I20260709 12:21:42.790006 30664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54882 (request call id 154) took 1380 ms. Trace:
I20260709 12:21:42.790624 30664 rpcz_store.cc:276] 0709 12:21:41.411485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.412017 (+   532us) service_pool.cc:224] Handling call
0709 12:21:41.412453 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:41.921736 (+509283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:41.952908 (+ 31172us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:41.953501 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 12:21:42.168674 (+215173us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:42.170388 (+  1714us) log.cc:844] Serialized 14 byte log entry
0709 12:21:42.789370 (+618982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.789536 (+   166us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:42.789611 (+    75us) raft_consensus.cc:1685] finished
0709 12:21:42.789637 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.789882 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1609,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":39,"raft.queue_time_us":442124,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":278,"thread_start_us":821013,"threads_started":2,"wal-append.queue_time_us":215117}
I20260709 12:21:43.140712 31417 raft_consensus.cc:493] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:43.141607 31417 raft_consensus.cc:515] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:43.144586 31417 leader_election.cc:290] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:43.145170 31417 raft_consensus.cc:493] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:43.145671 31417 raft_consensus.cc:515] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:43.147214 31193 raft_consensus.cc:493] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.147854 31417 leader_election.cc:290] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:43.147994 31193 raft_consensus.cc:515] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:43.149008 31417 raft_consensus.cc:493] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:43.149714 31417 raft_consensus.cc:515] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:43.153352 31417 leader_election.cc:290] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:43.153693 31193 leader_election.cc:290] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:43.154063 31417 raft_consensus.cc:493] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:43.154420 31193 raft_consensus.cc:493] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.155241 31417 raft_consensus.cc:515] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:43.155359 31193 raft_consensus.cc:515] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:43.157651 31193 leader_election.cc:290] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:43.157703 31417 leader_election.cc:290] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:43.159938 31487 raft_consensus.cc:493] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.160602 31487 raft_consensus.cc:515] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:43.162658 31487 leader_election.cc:290] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:43.163154 31487 raft_consensus.cc:493] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.163740 31487 raft_consensus.cc:515] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:43.165902 31487 leader_election.cc:290] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:43.170186 31487 raft_consensus.cc:493] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:43.170970 31487 raft_consensus.cc:515] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:43.171648 30665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54882 (request call id 158) took 1189 ms. Trace:
I20260709 12:21:43.172271 30665 rpcz_store.cc:276] 0709 12:21:41.981889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.984451 (+  2562us) service_pool.cc:224] Handling call
0709 12:21:43.170582 (+1186131us) spinlock_profiling.cc:243] Waited 5.25 ms on lock 0x7b5800000098. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c325fc0 00007f4a9c310929 00007f4a9c3103d2 00007f4a95887bd4
0709 12:21:43.170835 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:43.171090 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:43.171127 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:43.171192 (+    65us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:43.171232 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:43.171306 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:43.171463 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12068096}
I20260709 12:21:43.174228 31487 leader_election.cc:290] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:43.178488 30667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54882 (request call id 161) took 1195 ms. Trace:
I20260709 12:21:43.179306 30711 leader_election.cc:304] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:43.182014 31490 raft_consensus.cc:493] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:43.182418 30662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54882 (request call id 157) took 1200 ms. Trace:
I20260709 12:21:43.185897 30662 rpcz_store.cc:276] 0709 12:21:41.981567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.984588 (+  3021us) service_pool.cc:224] Handling call
0709 12:21:43.181374 (+1196786us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b5800000098. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227eee 000000000036eb39 00007f4a9c29b1e0 00007f4a9c3640c4 00007f4a9c364131 00007f4a9c325fc0 00007f4a9c310929 00007f4a9c3103d2 00007f4a95887bd4
0709 12:21:43.181627 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:43.181926 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:43.181969 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:43.182034 (+    65us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:43.182089 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:43.182172 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:43.182337 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44989696}
I20260709 12:21:43.187623 31488 raft_consensus.cc:493] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.188346 31488 raft_consensus.cc:515] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:43.182897 31490 raft_consensus.cc:515] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:43.179023 30667 rpcz_store.cc:276] 0709 12:21:41.982705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.177384 (+1194679us) service_pool.cc:224] Handling call
0709 12:21:43.177795 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:43.178011 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:43.178044 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:43.178093 (+    49us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:43.178134 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:43.178192 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:43.178322 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:43.192072 31417 raft_consensus.cc:493] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.192793 31417 raft_consensus.cc:515] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:43.194177 31490 leader_election.cc:290] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:43.194965 31417 leader_election.cc:290] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:43.195812 31490 raft_consensus.cc:493] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.196241 31418 raft_consensus.cc:493] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.197053 31418 raft_consensus.cc:515] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:43.196954 31490 raft_consensus.cc:515] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:43.199762 31418 leader_election.cc:290] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:43.200018 31490 leader_election.cc:290] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:43.200901 31330 raft_consensus.cc:493] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.201097 31490 raft_consensus.cc:2804] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:43.201758 31418 raft_consensus.cc:493] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:43.202059 31490 raft_consensus.cc:697] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:43.202487 31418 raft_consensus.cc:515] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:43.203723 30567 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36704 (request call id 83) took 1879 ms. Trace:
I20260709 12:21:43.203881 31490 consensus_queue.cc:237] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:43.205098 31193 raft_consensus.cc:493] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.205791 31193 raft_consensus.cc:515] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
W20260709 12:21:43.206775 30617 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:43.205554 31417 raft_consensus.cc:493] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:43.201505 31330 raft_consensus.cc:515] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:43.208735 31417 raft_consensus.cc:515] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
W20260709 12:21:43.199868 30692 debug-util.cc:398] Leaking SignalData structure 0x7b080023e320 after lost signal to thread 23154
W20260709 12:21:43.212461 30692 debug-util.cc:398] Leaking SignalData structure 0x7b08000e04e0 after lost signal to thread 30603
I20260709 12:21:43.204144 30567 rpcz_store.cc:276] 0709 12:21:41.324279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.324495 (+   216us) service_pool.cc:224] Handling call
0709 12:21:43.203629 (+1879134us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:41.369718 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:41.370325 (+   607us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:41.370353 (+    28us) write_op.cc:435] Acquired schema lock
0709 12:21:41.370377 (+    24us) tablet.cc:662] Decoding operations
0709 12:21:41.370715 (+   338us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:41.370758 (+    43us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:41.370784 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:21:41.370985 (+   201us) tablet.cc:701] Row locks acquired
0709 12:21:41.371003 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:21:41.371152 (+   149us) write_op.cc:270] Start()
0709 12:21:41.371263 (+   111us) write_op.cc:276] Timestamp: P: 1783599701371089 usec, L: 0
0709 12:21:41.371285 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:21:41.372016 (+   731us) log.cc:844] Serialized 543 byte log entry
0709 12:21:41.481267 (+109251us) op_driver.cc:464] REPLICATION: finished
0709 12:21:41.501436 (+ 20169us) write_op.cc:301] APPLY: starting
0709 12:21:41.501531 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:41.501626 (+    95us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:41.501748 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:41.502015 (+   267us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:41.502172 (+   157us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:21:41.502219 (+    47us) write_op.cc:312] APPLY: finished
0709 12:21:41.502426 (+   207us) log.cc:844] Serialized 22 byte log entry
0709 12:21:41.520834 (+ 18408us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:41.602700 (+ 81866us) write_op.cc:454] Released schema lock
0709 12:21:41.644997 (+ 42297us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:41.729839 (+ 84842us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:41.732543 (+  2704us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1486715,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":19500,"apply.run_cpu_time_us":2219,"apply.run_wall_time_us":219643,"num_ops":1,"prepare.queue_time_us":31893,"prepare.run_cpu_time_us":2596,"prepare.run_wall_time_us":2596,"replication_time_us":109795,"thread_start_us":20869,"threads_started":1}]]}
I20260709 12:21:43.196547 30565 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36736 (request call id 76) took 2703 ms. Trace:
I20260709 12:21:43.214339 30565 rpcz_store.cc:276] 0709 12:21:40.493171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.496779 (+  3608us) service_pool.cc:224] Handling call
0709 12:21:43.196431 (+2699652us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:41.357160 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:41.357948 (+   788us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:41.358025 (+    77us) write_op.cc:435] Acquired schema lock
0709 12:21:41.358062 (+    37us) tablet.cc:662] Decoding operations
0709 12:21:41.358557 (+   495us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:41.358668 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:41.358703 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:21:41.359036 (+   333us) tablet.cc:701] Row locks acquired
0709 12:21:41.359070 (+    34us) write_op.cc:260] PREPARE: finished
0709 12:21:41.359270 (+   200us) write_op.cc:270] Start()
0709 12:21:41.359430 (+   160us) write_op.cc:276] Timestamp: P: 1783599701359214 usec, L: 0
0709 12:21:41.359469 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 12:21:41.360366 (+   897us) log.cc:844] Serialized 543 byte log entry
0709 12:21:41.382103 (+ 21737us) op_driver.cc:464] REPLICATION: finished
0709 12:21:41.477138 (+ 95035us) write_op.cc:301] APPLY: starting
0709 12:21:41.477273 (+   135us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:41.477478 (+   205us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:41.477699 (+   221us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:41.478141 (+   442us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:41.478532 (+   391us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:21:41.478621 (+    89us) write_op.cc:312] APPLY: finished
0709 12:21:41.479038 (+   417us) log.cc:844] Serialized 22 byte log entry
0709 12:21:41.479260 (+   222us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:41.479346 (+    86us) write_op.cc:454] Released schema lock
0709 12:21:41.479421 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:41.505945 (+ 26524us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:41.505995 (+    50us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":94607,"apply.run_cpu_time_us":2968,"apply.run_wall_time_us":28754,"num_ops":1,"prepare.queue_time_us":106412,"prepare.run_cpu_time_us":3729,"prepare.run_wall_time_us":68769,"replication_time_us":22391,"thread_start_us":168944,"threads_started":2}]]}
I20260709 12:21:43.211412 31418 leader_election.cc:290] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:43.218693 31418 raft_consensus.cc:493] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:43.219344 31418 raft_consensus.cc:515] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:43.220623 31488 leader_election.cc:290] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:43.221751 31418 leader_election.cc:290] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:43.226433 31491 raft_consensus.cc:493] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:43.227031 31491 raft_consensus.cc:515] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
W20260709 12:21:43.229362 30711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 50159.8us
I20260709 12:21:43.230278 31491 leader_election.cc:290] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:43.233566 31494 raft_consensus.cc:493] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.234176 31494 raft_consensus.cc:515] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:43.235941 31494 leader_election.cc:290] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:43.240945 31495 raft_consensus.cc:493] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.241623 31495 raft_consensus.cc:515] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:43.246538 31494 raft_consensus.cc:493] T 69a04a5cd9b143daba902d508029dcb5 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.247293 30887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51180 (request call id 182) took 1275 ms. Trace:
I20260709 12:21:43.247846 31495 leader_election.cc:290] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:43.247918 30887 rpcz_store.cc:276] 0709 12:21:41.971513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.975377 (+  3864us) service_pool.cc:224] Handling call
0709 12:21:42.129019 (+153642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:43.246804 (+1117785us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:43.246842 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:43.246903 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:43.246943 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:43.247026 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:43.247195 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:43.250569 31496 raft_consensus.cc:493] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.249118 31495 raft_consensus.cc:493] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.247241 31494 raft_consensus.cc:515] T 69a04a5cd9b143daba902d508029dcb5 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:43.265381 31495 raft_consensus.cc:515] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:43.267596 31494 leader_election.cc:290] T 69a04a5cd9b143daba902d508029dcb5 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:43.267908 31495 leader_election.cc:290] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:43.268841 31496 raft_consensus.cc:515] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:43.271306 31496 leader_election.cc:290] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:43.274091 31479 raft_consensus.cc:493] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.274744 31479 raft_consensus.cc:515] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:43.276124 31481 raft_consensus.cc:493] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.276396 31486 raft_consensus.cc:493] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.276759 31481 raft_consensus.cc:515] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:43.277096 31486 raft_consensus.cc:515] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:43.278611 30939 raft_consensus.cc:359] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:43.279564 30939 raft_consensus.cc:385] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.279978 30939 raft_consensus.cc:740] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.287101 31481 leader_election.cc:290] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:43.288297 30887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44af5a494fec45679774bc9eb1007f9b" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.288877 31421 raft_consensus.cc:493] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.289559 31421 raft_consensus.cc:515] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:43.296247 30887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a04a5cd9b143daba902d508029dcb5" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.296726 31486 leader_election.cc:290] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:43.296904 31443 raft_consensus.cc:493] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.297645 31443 raft_consensus.cc:515] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:43.298453 31481 raft_consensus.cc:493] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.299182 31481 raft_consensus.cc:515] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:43.299863 31478 raft_consensus.cc:493] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.299965 31443 leader_election.cc:290] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:43.300262 30889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51180 (request call id 181) took 1340 ms. Trace:
I20260709 12:21:43.300566 31478 raft_consensus.cc:515] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:43.301227 31491 raft_consensus.cc:493] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:43.301770 31406 raft_consensus.cc:493] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.301386 31481 leader_election.cc:290] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:43.303355 30939 consensus_queue.cc:260] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:43.302124 31491 raft_consensus.cc:515] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:43.309963 31421 leader_election.cc:290] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:43.312423 31491 leader_election.cc:290] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:43.313349 31482 raft_consensus.cc:493] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.314188 31482 raft_consensus.cc:515] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:43.317201 31482 leader_election.cc:290] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:43.300809 30889 rpcz_store.cc:276] 0709 12:21:41.959815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.963467 (+  3652us) service_pool.cc:224] Handling call
0709 12:21:42.118407 (+154940us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.131800 (+ 13393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:43.299684 (+1167884us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:43.299739 (+    55us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:43.299798 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:43.299885 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:43.300029 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:43.320134 31478 leader_election.cc:290] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:43.310308 31443 raft_consensus.cc:493] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.302431 31406 raft_consensus.cc:515] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:43.319686 31494 raft_consensus.cc:493] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.319031 31411 raft_consensus.cc:493] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.320323 31410 raft_consensus.cc:493] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.325717 31486 raft_consensus.cc:493] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.326781 31485 raft_consensus.cc:493] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.319713 31405 raft_consensus.cc:493] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.326845 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44af5a494fec45679774bc9eb1007f9b" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:43.327495 30743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81434413f4d7497a8ae5f95db857f819" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:43.333354 31443 raft_consensus.cc:515] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:43.320531 31193 leader_election.cc:290] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:43.352339 31495 raft_consensus.cc:493] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.355937 31411 raft_consensus.cc:515] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:43.359563 31495 raft_consensus.cc:515] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:43.361075 31443 leader_election.cc:290] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
W20260709 12:21:43.328441 30709 leader_election.cc:343] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.361814 31411 leader_election.cc:290] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:43.344560 31410 raft_consensus.cc:515] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:43.363456 30939 ts_tablet_manager.cc:1434] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 1.389s	user 0.015s	sys 0.007s
W20260709 12:21:43.363809 30939 ts_tablet_manager.cc:1467] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9: Tablet startup took 1389ms
I20260709 12:21:43.357118 31486 raft_consensus.cc:515] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:43.328065 31492 raft_consensus.cc:493] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.333762 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5d808cf6da46a0894e888635591cc8" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:43.331313 31478 raft_consensus.cc:493] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.333902 30890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439d52649ecc46e58d714b9351576dd5" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.374814 31478 raft_consensus.cc:515] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:43.358379 30746 raft_consensus.cc:2468] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 0.
I20260709 12:21:43.356706 30743 raft_consensus.cc:2468] T 81434413f4d7497a8ae5f95db857f819 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 0.
I20260709 12:21:43.338737 31406 leader_election.cc:290] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:43.372402 31485 raft_consensus.cc:515] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:43.380010 31485 leader_election.cc:290] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:43.380143 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f2ae9f62734cf59b3d5477d92760cb" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.383651 31444 raft_consensus.cc:493] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.360464 30894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51180 (request call id 180) took 1401 ms. Trace:
I20260709 12:21:43.385118 30894 rpcz_store.cc:276] 0709 12:21:41.959401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.969331 (+  9930us) service_pool.cc:224] Handling call
0709 12:21:43.359373 (+1390042us) spinlock_profiling.cc:243] Waited 5.1 ms on lock 0x7b5800134d98. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c325fc0 00007f4a9c310929 00007f4a9c3103d2 00007f4a95887bd4
0709 12:21:43.359672 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:43.359926 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:43.359954 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:43.360006 (+    52us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:43.360043 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:43.360108 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:43.360249 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11735808}
I20260709 12:21:43.332391 31482 raft_consensus.cc:493] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.357043 31405 raft_consensus.cc:515] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:43.386837 31482 raft_consensus.cc:515] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:43.389401 31405 leader_election.cc:290] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:43.390050 30889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffb9d78e773452ab44ae35b5d65fdb2" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.392334 30890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d63226f015480c84967f90ac595cc0" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.392674 30889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b26f10a0fb7476098bdb142c864895e" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.393128 30890 raft_consensus.cc:2468] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:43.393405 30889 raft_consensus.cc:2468] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:43.394091 31193 raft_consensus.cc:493] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
W20260709 12:21:43.364135 30939 ts_tablet_manager.cc:1469] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9: Trace:
0709 12:21:31.884929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.885134 (+   205us) service_pool.cc:224] Handling call
0709 12:21:31.887297 (+  2163us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:21:31.887432 (+   135us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:21:31.982516 (+ 95084us) tablet_metadata.cc:665] Metadata flushed
0709 12:21:32.113399 (+130883us) tablet_replica.cc:206] Creating consensus instance
0709 12:21:32.137121 (+ 23722us) inbound_call.cc:177] Queueing success response
0709 12:21:41.493326 (+9356205us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:21:41.973997 (+480671us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:21:43.276111 (+1302114us) tablet_replica.cc:261] Starting instrumentation
0709 12:21:43.276738 (+   627us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":10928,"raft.queue_time_us":13125,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":2548,"tablet-open.queue_time_us":9368480}
I20260709 12:21:43.394778 31193 raft_consensus.cc:515] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:43.395864 30939 tablet_bootstrap.cc:492] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9: Bootstrap starting.
I20260709 12:21:43.394805 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4326b71a8ff545259df55b4ab0564f48" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.399305 31495 leader_election.cc:290] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:43.399881 31495 raft_consensus.cc:493] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.335502 31427 raft_consensus.cc:493] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.400507 31495 raft_consensus.cc:515] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:43.400842 31427 raft_consensus.cc:515] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:43.403337 31427 leader_election.cc:290] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:43.333590 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a02078ac834032ac607943e7b3d175" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.404166 30893 raft_consensus.cc:2468] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:43.335239 31494 raft_consensus.cc:515] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:43.372255 31491 raft_consensus.cc:493] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.373924 31492 raft_consensus.cc:515] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:43.346801 30668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54894 (request call id 131) took 2222 ms. Trace:
I20260709 12:21:43.415092 30666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc72ff638c0425f9c75bb21e2b99dd3" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:43.380954 31468 raft_consensus.cc:493] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.420409 31468 raft_consensus.cc:515] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:43.418984 30668 rpcz_store.cc:276] 0709 12:21:41.124447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.130277 (+  5830us) service_pool.cc:224] Handling call
0709 12:21:41.166628 (+ 36351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:41.324203 (+157575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:41.324246 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:41.324811 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 12:21:41.482761 (+157950us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:41.887373 (+404612us) log.cc:844] Serialized 14 byte log entry
0709 12:21:42.117901 (+230528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:43.346046 (+1228145us) spinlock_profiling.cc:243] Waited 36.8 ms on lock 0x7b5400828f54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734ce01 00007f4a9734b83e 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6
0709 12:21:43.346170 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:43.346248 (+    78us) raft_consensus.cc:1685] finished
0709 12:21:43.346436 (+   188us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:43.346675 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36785,"prepare.queue_time_us":285974,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":844,"raft.queue_time_us":42431,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":220,"spinlock_wait_cycles":84696832,"thread_start_us":729135,"threads_started":3,"wal-append.queue_time_us":157898,"wal-append.run_cpu_time_us":18968,"wal-append.run_wall_time_us":1722485}
I20260709 12:21:43.421118 31417 leader_election.cc:290] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:43.423005 31446 raft_consensus.cc:493] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:43.423681 31446 raft_consensus.cc:515] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
W20260709 12:21:43.425071 30692 debug-util.cc:398] Leaking SignalData structure 0x7b0800338a20 after lost signal to thread 30695
I20260709 12:21:43.426340 31492 leader_election.cc:290] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:43.381321 31448 raft_consensus.cc:493] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:43.384260 31444 raft_consensus.cc:515] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:43.427294 31448 raft_consensus.cc:515] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:43.428617 31418 raft_consensus.cc:493] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.429225 31418 raft_consensus.cc:515] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:43.429515 31494 leader_election.cc:290] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:43.422982 31468 leader_election.cc:290] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:43.412369 31491 raft_consensus.cc:515] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:43.454334 30889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb4b46162a04eeda49624c82070758e" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.455821 31495 leader_election.cc:290] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:43.366763 31410 leader_election.cc:290] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:43.455821 31491 leader_election.cc:290] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:43.414014 30941 tablet_bootstrap.cc:492] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:43.414472 30662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81434413f4d7497a8ae5f95db857f819" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:43.414721 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7695652594064f568b2df572cb76e12a" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:43.415024 30663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4682db2f801d4701a9c03cb1e4b32fd0" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:43.415791 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5d808cf6da46a0894e888635591cc8" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:43.418336 30890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ccb8b23d8455a990ef1cb50271887" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.347884 31479 leader_election.cc:290] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:43.430249 31494 raft_consensus.cc:493] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.431370 31418 leader_election.cc:290] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:43.431900 31427 raft_consensus.cc:493] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:43.435992 30814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2f4d39a39493b8404958a5aaaa7af" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:43.436591 30813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac2bacfc36f49459fc2b2b2d8afb01d" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:43.437088 30815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de462b3788724f21b93b5cbb295c085a" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:43.437692 30812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:43.438124 31486 leader_election.cc:290] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:43.473811 30666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be8d04f2ad34fd5b7c66aa68c8fa47a" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:43.474642 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2f4d39a39493b8404958a5aaaa7af" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:43.438421 31298 raft_consensus.cc:493] T 69a04a5cd9b143daba902d508029dcb5 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.475462 30671 raft_consensus.cc:2468] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 0.
I20260709 12:21:43.476102 31298 raft_consensus.cc:515] T 69a04a5cd9b143daba902d508029dcb5 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:43.405007 31193 leader_election.cc:290] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:43.438182 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcceeadce924e3493e4e91cb49e2f2e" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:43.440718 31446 leader_election.cc:290] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:43.441803 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61dc8e98f804681b0815e953b2d2ad1" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:43.467849 31427 raft_consensus.cc:515] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:43.479686 30819 raft_consensus.cc:2468] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:43.444957 31445 raft_consensus.cc:493] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.481020 31445 raft_consensus.cc:515] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:43.446087 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc72ff638c0425f9c75bb21e2b99dd3" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:43.483584 31445 leader_election.cc:290] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:43.485097 30885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1ba3aa111d4c5e8558a89abec0aa64" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.485562 31427 leader_election.cc:290] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:43.486092 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac7c8095aaa457494024d09dfaaf1bb" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.486272 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e946ad6dd9cb42ad93987cebde13ba9a" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:43.486518 30885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcceeadce924e3493e4e91cb49e2f2e" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.409947 31478 leader_election.cc:290] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:43.441704 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e946ad6dd9cb42ad93987cebde13ba9a" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.429760 31448 leader_election.cc:290] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:43.451432 30668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78acfb4f1d649e4821c390039d2ede5" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:43.493431 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd8dacaad53349ebb29c67fe11853fab" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.465721 31494 raft_consensus.cc:515] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:43.466588 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faf21b4ff034e548c19569963419851" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:43.498179 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2f4d39a39493b8404958a5aaaa7af" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.498816 31482 leader_election.cc:290] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:43.457007 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7695652594064f568b2df572cb76e12a" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.477092 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd8dacaad53349ebb29c67fe11853fab" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:43.478592 31298 leader_election.cc:290] T 69a04a5cd9b143daba902d508029dcb5 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:43.475373 30666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815af3bc37df4d158766ac2e615de683" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:43.509069 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7695652594064f568b2df572cb76e12a" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:43.510283 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc72ff638c0425f9c75bb21e2b99dd3" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:43.514194 30664 raft_consensus.cc:3060] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.516428 31495 raft_consensus.cc:493] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.516750 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac2bacfc36f49459fc2b2b2d8afb01d" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:43.517108 31495 raft_consensus.cc:515] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:43.467221 31500 raft_consensus.cc:493] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.519877 31330 leader_election.cc:290] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:43.519770 31500 raft_consensus.cc:515] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:43.509512 31494 leader_election.cc:290] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:43.523005 30939 tablet_bootstrap.cc:654] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.523144 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec2e3f6d6be4c038a84a15ea8b61235" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:43.530972 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.472250 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcceeadce924e3493e4e91cb49e2f2e" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:43.533425 30665 raft_consensus.cc:2468] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
W20260709 12:21:43.533905 30692 debug-util.cc:398] Leaking SignalData structure 0x7b0800193600 after lost signal to thread 30770
I20260709 12:21:43.508237 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61dc8e98f804681b0815e953b2d2ad1" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:43.498668 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb65e812f06540bc9f1c2b1e3e13d41c" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.468205 30667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d63226f015480c84967f90ac595cc0" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:43.509102 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de462b3788724f21b93b5cbb295c085a" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:43.494341 30885 raft_consensus.cc:2468] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:43.504048 30662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fee969f4c2a4579ab7911212a86bf67" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:43.507295 30743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1ba3aa111d4c5e8558a89abec0aa64" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:43.506740 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac7c8095aaa457494024d09dfaaf1bb" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
W20260709 12:21:43.547143 30692 debug-util.cc:398] Leaking SignalData structure 0x7b08003597c0 after lost signal to thread 30771
I20260709 12:21:43.509789 30813 raft_consensus.cc:2468] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
W20260709 12:21:43.551272 30785 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 62025.6us
I20260709 12:21:43.562875 31410 consensus_queue.cc:1048] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:21:43.567215 30746 raft_consensus.cc:2468] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:43.562405 30745 raft_consensus.cc:2468] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:43.567813 31502 raft_consensus.cc:493] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.531045 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ea2bd624354824ada8b141b94ab5f0" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.568395 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93f0e0819f8466fad08603e540dc22e" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:43.570204 31444 leader_election.cc:290] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:43.568760 30566 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36728 (request call id 87) took 2144 ms. Trace:
I20260709 12:21:43.570815 30566 rpcz_store.cc:276] 0709 12:21:41.404492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.404783 (+   291us) service_pool.cc:224] Handling call
0709 12:21:41.536374 (+131591us) spinlock_profiling.cc:243] Waited 97.1 ms on lock 0x7b540078bed4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b6090 00007f4a97354f3a 00007f4a9d10ae9c 00007f4a9d20904e 00007f4a9b6ca2a4 00007f4a9b6ca232 00007f4a9b6ca161 00007f4a9b6ca0dc 00007f4a9b6c9392 00007f4a9568748c 00007f4a956868c6
0709 12:21:43.548697 (+2012323us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1661237,"reported_tablets":4,"spinlock_wait_cycles":223380736}
I20260709 12:21:43.572814 30711 leader_election.cc:304] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:43.574334 31448 raft_consensus.cc:2804] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:43.574746 31448 raft_consensus.cc:493] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:43.575109 31448 raft_consensus.cc:3060] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:43.568544 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87d449e2aa442ec87cb2b55b61d4496" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:43.577171 30711 leader_election.cc:304] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:43.577405 30740 raft_consensus.cc:2468] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 2.
I20260709 12:21:43.577944 31492 raft_consensus.cc:493] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.578523 31492 raft_consensus.cc:515] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:43.578858 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ea2bd624354824ada8b141b94ab5f0" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:43.578831 30568 catalog_manager.cc:5697] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:43.581445 30692 debug-util.cc:398] Leaking SignalData structure 0x7b08003d0aa0 after lost signal to thread 30844
I20260709 12:21:43.597834 30636 leader_election.cc:304] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:43.599749 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38606820b9b349d3ad9f9fae03de5e86" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:43.601277 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56cad4068d4388bf572777bcfb89b3" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:43.567363 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e24a3b2b9d4270a8b8466d3c6313ab" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:43.602193 30662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a0a060aca4bdf912b9291106aaa74" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:43.603205 30662 raft_consensus.cc:2468] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:43.605142 30634 leader_election.cc:304] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:43.600343 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e243e0f019f54586877c9a61b2fc83ac" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:43.609068 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78acfb4f1d649e4821c390039d2ede5" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:43.609331 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a04a5cd9b143daba902d508029dcb5" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.609634 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d63226f015480c84967f90ac595cc0" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:43.610597 31500 leader_election.cc:290] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:43.610922 30666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de462b3788724f21b93b5cbb295c085a" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:43.611045 30888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda0258f575243bd910da13e828fb6f6" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.611593 30666 raft_consensus.cc:2468] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
W20260709 12:21:43.597517 30692 debug-util.cc:398] Leaking SignalData structure 0x7b0800104a80 after lost signal to thread 30845
I20260709 12:21:43.580895 31492 leader_election.cc:290] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:43.616709 30634 leader_election.cc:304] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:43.618291 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be8d04f2ad34fd5b7c66aa68c8fa47a" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:43.618974 31444 raft_consensus.cc:2749] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:43.619450 31405 raft_consensus.cc:2749] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:43.587146 31487 raft_consensus.cc:2804] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:43.620105 30813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87d449e2aa442ec87cb2b55b61d4496" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:43.609743 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c148832de74745608d983f2184cbf23f" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.620858 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a8098230e4404c9d5743dcac2c5aaa" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:43.619701 30667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87d449e2aa442ec87cb2b55b61d4496" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:43.622829 30637 leader_election.cc:304] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:43.623039 30636 leader_election.cc:304] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:43.584165 31406 raft_consensus.cc:493] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.628360 30634 leader_election.cc:304] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3
I20260709 12:21:43.629541 30667 raft_consensus.cc:2468] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 2.
I20260709 12:21:43.629957 30634 leader_election.cc:304] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:43.630074 31486 raft_consensus.cc:2804] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:43.630700 31486 raft_consensus.cc:493] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.630740 31405 raft_consensus.cc:2804] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:43.631443 31486 raft_consensus.cc:3060] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:43.631484 31405 raft_consensus.cc:493] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.632027 31482 raft_consensus.cc:2804] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:43.632272 31405 raft_consensus.cc:3060] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:43.632486 31482 raft_consensus.cc:493] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.632970 31482 raft_consensus.cc:3060] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:43.633010 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e243e0f019f54586877c9a61b2fc83ac" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:43.631711 30637 leader_election.cc:304] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:43.633939 30711 leader_election.cc:304] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:43.634186 31478 raft_consensus.cc:2804] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:43.634680 31478 raft_consensus.cc:493] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.635028 30894 raft_consensus.cc:2468] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:43.635412 31478 raft_consensus.cc:3060] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:43.622356 31487 raft_consensus.cc:493] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.634635 31307 raft_consensus.cc:2749] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:43.634618 30637 leader_election.cc:304] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:43.637460 31501 raft_consensus.cc:493] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.638239 31501 raft_consensus.cc:515] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:43.638754 31444 raft_consensus.cc:493] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.639074 31406 raft_consensus.cc:515] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:43.639358 31444 raft_consensus.cc:515] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:43.639817 31491 raft_consensus.cc:2804] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:43.640302 31491 raft_consensus.cc:493] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.640724 31491 raft_consensus.cc:3060] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:43.640806 31501 leader_election.cc:290] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:43.637627 31410 raft_consensus.cc:2804] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:43.641585 31406 leader_election.cc:290] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:43.637403 30636 leader_election.cc:304] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:43.641625 31444 leader_election.cc:290] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:43.643785 30857 leader_election.cc:304] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:43.641634 31410 raft_consensus.cc:493] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.644948 31422 raft_consensus.cc:493] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.636515 31487 raft_consensus.cc:3060] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:43.607389 31495 leader_election.cc:290] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
W20260709 12:21:43.651691 30857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 47047.8us
I20260709 12:21:43.651957 30636 leader_election.cc:304] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3
I20260709 12:21:43.653484 30636 leader_election.cc:304] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:43.655941 30785 leader_election.cc:304] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:43.654093 31307 raft_consensus.cc:2749] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:43.671509 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d63226f015480c84967f90ac595cc0" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:43.633962 30819 raft_consensus.cc:2468] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:43.673906 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f3fc82ff104135851cce7357eda3ec" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
W20260709 12:21:43.646287 30692 debug-util.cc:398] Leaking SignalData structure 0x7b0800044ea0 after lost signal to thread 30918
I20260709 12:21:43.680140 31495 raft_consensus.cc:2804] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:43.680713 31495 raft_consensus.cc:493] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.681198 31495 raft_consensus.cc:3060] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:43.681438 31503 raft_consensus.cc:493] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.682096 31503 raft_consensus.cc:515] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:43.684820 31496 raft_consensus.cc:493] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.685526 31496 raft_consensus.cc:515] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:43.687721 31496 leader_election.cc:290] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:43.688383 31418 raft_consensus.cc:2804] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:43.688854 31418 raft_consensus.cc:493] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.689217 31418 raft_consensus.cc:3060] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:43.675248 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a0a060aca4bdf912b9291106aaa74" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.690315 31445 raft_consensus.cc:493] T 7ca6811dc9854dfaa1295db38c91c0fd P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.690543 30711 leader_election.cc:304] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:43.690892 31445 raft_consensus.cc:515] T 7ca6811dc9854dfaa1295db38c91c0fd P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:43.672441 31506 raft_consensus.cc:493] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.692732 31506 raft_consensus.cc:515] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:43.693192 30888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.694669 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffb9d78e773452ab44ae35b5d65fdb2" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.568461 31502 raft_consensus.cc:515] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:43.695861 31422 raft_consensus.cc:515] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:43.696581 30814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f3fc82ff104135851cce7357eda3ec" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:43.677029 31485 raft_consensus.cc:2749] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:43.697314 30814 raft_consensus.cc:2468] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:43.651328 31410 raft_consensus.cc:3060] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:43.689692 31446 raft_consensus.cc:493] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.674388 31444 raft_consensus.cc:2804] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:43.698676 31446 raft_consensus.cc:515] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:43.693222 31500 raft_consensus.cc:493] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.699132 31444 raft_consensus.cc:493] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.699831 31444 raft_consensus.cc:3060] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:43.699713 31500 raft_consensus.cc:515] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:43.700198 31445 leader_election.cc:290] T 7ca6811dc9854dfaa1295db38c91c0fd P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:43.701596 31505 raft_consensus.cc:493] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.702286 31505 raft_consensus.cc:515] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:43.703388 31492 raft_consensus.cc:2749] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:43.704129 31499 raft_consensus.cc:493] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.704514 31307 raft_consensus.cc:493] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.704821 31499 raft_consensus.cc:515] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:43.705134 31307 raft_consensus.cc:515] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:43.706187 30637 leader_election.cc:304] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9
W20260709 12:21:43.707773 30857 leader_election.cc:343] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.709105 31496 raft_consensus.cc:493] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.709430 30857 leader_election.cc:304] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:43.709851 31496 raft_consensus.cc:515] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:43.710387 31330 raft_consensus.cc:2804] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:43.710855 31330 raft_consensus.cc:493] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.711229 31330 raft_consensus.cc:3060] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:43.705488 31498 raft_consensus.cc:493] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.708348 31408 raft_consensus.cc:2804] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:43.713079 31408 raft_consensus.cc:493] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.713534 31408 raft_consensus.cc:3060] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:43.716444 31498 raft_consensus.cc:515] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:43.717644 31445 raft_consensus.cc:493] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.720335 31501 raft_consensus.cc:493] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.721120 31501 raft_consensus.cc:515] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:43.722091 31481 raft_consensus.cc:493] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.722834 31481 raft_consensus.cc:515] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:43.684566 31503 leader_election.cc:290] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:43.676702 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a0a060aca4bdf912b9291106aaa74" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:43.732437 31506 leader_election.cc:290] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:43.718245 31445 raft_consensus.cc:515] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:43.733639 31501 leader_election.cc:290] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:43.734241 31481 leader_election.cc:290] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:43.735380 31446 leader_election.cc:290] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:43.736279 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b26f10a0fb7476098bdb142c864895e" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:43.747299 31307 leader_election.cc:290] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:43.736907 30743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7695652594064f568b2df572cb76e12a" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:43.748745 30743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38606820b9b349d3ad9f9fae03de5e86" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:43.749538 31500 leader_election.cc:290] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:43.704028 30668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac7c8095aaa457494024d09dfaaf1bb" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:43.763794 31498 leader_election.cc:290] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:43.764238 31499 leader_election.cc:290] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:43.764896 31446 raft_consensus.cc:493] T 0b6381e285f94a7ca02f638d09d0b3c2 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.765483 31446 raft_consensus.cc:515] T 0b6381e285f94a7ca02f638d09d0b3c2 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:43.738009 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93f0e0819f8466fad08603e540dc22e" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:43.766096 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.739158 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a0a060aca4bdf912b9291106aaa74" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:43.737848 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100eb209359a46d8b6c900d5a401586e" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:43.739476 30742 raft_consensus.cc:3060] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.767740 31496 leader_election.cc:290] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:43.769604 30888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.748261 31422 leader_election.cc:290] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:43.739476 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c148832de74745608d983f2184cbf23f" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:43.737176 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb4b46162a04eeda49624c82070758e" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:43.773382 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faf21b4ff034e548c19569963419851" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
W20260709 12:21:43.750362 30637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 44290.1us
I20260709 12:21:43.745574 31502 leader_election.cc:290] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:43.776206 30637 leader_election.cc:304] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:43.778980 30814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006658e1213f4f8da089a9570e0a76b9" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
W20260709 12:21:43.765810 30783 leader_election.cc:343] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.781652 30812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bb30237ea045c79aa6eb181bc3e692" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:43.779896 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:43.792991 30819 raft_consensus.cc:2468] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:43.776793 31481 raft_consensus.cc:493] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.794101 31481 raft_consensus.cc:515] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:43.796262 31481 leader_election.cc:290] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:43.788396 30888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c179d47d7f146ed83b56ea632997aa7" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.797276 30812 raft_consensus.cc:2468] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:43.767223 30941 tablet_bootstrap.cc:654] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.777863 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca6811dc9854dfaa1295db38c91c0fd" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.781178 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb65e812f06540bc9f1c2b1e3e13d41c" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:43.776440 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006658e1213f4f8da089a9570e0a76b9" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
W20260709 12:21:43.788034 30857 leader_election.cc:343] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:43.761307 30709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 103207us
I20260709 12:21:43.787978 30813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:43.788522 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a8098230e4404c9d5743dcac2c5aaa" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.789376 30885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.792308 31499 raft_consensus.cc:493] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.803117 30857 leader_election.cc:304] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:43.804553 30634 leader_election.cc:304] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:43.802282 30816 raft_consensus.cc:2468] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:43.748376 31445 leader_election.cc:290] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:43.773967 30745 raft_consensus.cc:2468] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:43.809641 30891 raft_consensus.cc:2468] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:43.817467 31418 raft_consensus.cc:515] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:43.818452 31499 raft_consensus.cc:515] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:43.819836 31418 leader_election.cc:290] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:43.820508 31485 raft_consensus.cc:2749] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:43.820737 31487 raft_consensus.cc:515] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:43.822220 30746 raft_consensus.cc:2393] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3ab9d21f8864b50a71b49c7d624584a in current term 2: Already voted for candidate 4a9042c4154c442297159d1c9f1186b9 in this term.
I20260709 12:21:43.822294 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baad7ab904cc431381366c54397a57ef" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:43.823132 30819 raft_consensus.cc:2468] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:43.825362 31487 leader_election.cc:290] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:43.825664 30637 leader_election.cc:304] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:43.826438 31485 raft_consensus.cc:2804] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:43.826588 30637 leader_election.cc:304] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:43.826855 31485 raft_consensus.cc:493] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.827246 31485 raft_consensus.cc:3060] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:43.827553 30812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f2ae9f62734cf59b3d5477d92760cb" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:43.827747 30637 leader_election.cc:304] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:43.810616 30811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439d52649ecc46e58d714b9351576dd5" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:43.828351 30812 raft_consensus.cc:2468] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:43.811884 30813 raft_consensus.cc:2468] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:43.812446 31498 raft_consensus.cc:2804] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:43.829953 31498 raft_consensus.cc:493] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.830302 31422 raft_consensus.cc:2804] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:43.815300 31446 leader_election.cc:290] T 0b6381e285f94a7ca02f638d09d0b3c2 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
W20260709 12:21:43.815609 30636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 53129.4us
I20260709 12:21:43.831156 31481 raft_consensus.cc:2804] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:43.831558 31481 raft_consensus.cc:493] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.831921 31481 raft_consensus.cc:3060] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:43.833583 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb65e812f06540bc9f1c2b1e3e13d41c" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.813088 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a02078ac834032ac607943e7b3d175" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:43.802578 31478 raft_consensus.cc:515] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:43.749534 31505 leader_election.cc:290] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:43.830385 31498 raft_consensus.cc:3060] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:43.830839 31422 raft_consensus.cc:493] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.813030 31482 raft_consensus.cc:515] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:43.856777 30857 leader_election.cc:304] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:43.857249 30637 leader_election.cc:304] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:43.858265 31331 raft_consensus.cc:2749] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:43.859054 31514 raft_consensus.cc:2804] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:43.848830 31410 raft_consensus.cc:515] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:43.824401 31408 raft_consensus.cc:515] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:43.830911 31501 raft_consensus.cc:2804] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:43.871223 30637 leader_election.cc:304] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:43.792125 31448 raft_consensus.cc:515] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:43.874498 31448 leader_election.cc:290] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:43.874891 30939 tablet_bootstrap.cc:492] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9: No bootstrap required, opened a new log
I20260709 12:21:43.875785 30939 ts_tablet_manager.cc:1403] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9: Time spent bootstrapping tablet: real 0.480s	user 0.006s	sys 0.036s
I20260709 12:21:43.869572 30709 leader_election.cc:304] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
W20260709 12:21:43.806878 30711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 116407us
I20260709 12:21:43.849274 31422 raft_consensus.cc:3060] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:43.859223 30857 leader_election.cc:304] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:43.877743 30637 leader_election.cc:304] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:43.877609 30709 leader_election.cc:304] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:43.884320 31492 raft_consensus.cc:2804] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:43.884884 31492 raft_consensus.cc:493] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.885360 31492 raft_consensus.cc:3060] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:43.862176 31410 leader_election.cc:290] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:43.897543 30857 leader_election.cc:304] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:43.903288 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec2e3f6d6be4c038a84a15ea8b61235" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:43.880131 31487 raft_consensus.cc:2804] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:43.879647 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda0258f575243bd910da13e828fb6f6" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:43.906833 30737 raft_consensus.cc:2468] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:43.907424 30740 raft_consensus.cc:1240] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Rejecting Update request from peer 4e9c812ece8a42efa063dc7bd5ea25e4 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:43.868374 30888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4326b71a8ff545259df55b4ab0564f48" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.859613 31514 raft_consensus.cc:493] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.870328 31499 leader_election.cc:290] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:43.877010 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baad7ab904cc431381366c54397a57ef" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.870777 31501 raft_consensus.cc:493] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:43.905982 31487 raft_consensus.cc:493] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:43.909438 31411 raft_consensus.cc:2749] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:21:43.923774 31508 log.cc:927] Time spent T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:21:43.923678 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac2bacfc36f49459fc2b2b2d8afb01d" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:43.867645 31405 raft_consensus.cc:515] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:43.912828 30857 leader_election.cc:304] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:43.916858 31331 raft_consensus.cc:2749] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:43.916970 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bb30237ea045c79aa6eb181bc3e692" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:43.921465 31307 raft_consensus.cc:2804] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:43.914529 31515 raft_consensus.cc:2804] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:43.937000 31501 raft_consensus.cc:3060] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:43.935690 31499 raft_consensus.cc:493] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.941033 31487 raft_consensus.cc:3060] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:43.959173 30857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 46602.8us
I20260709 12:21:43.976804 30857 leader_election.cc:304] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:43.970434 31307 raft_consensus.cc:493] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.919687 31491 raft_consensus.cc:515] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
W20260709 12:21:43.960127 30637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 82466.6us
I20260709 12:21:43.964536 31405 leader_election.cc:290] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:43.967096 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc72ff638c0425f9c75bb21e2b99dd3" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:43.921290 31514 raft_consensus.cc:3060] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:43.971101 31418 raft_consensus.cc:2749] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:43.946734 30885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baad7ab904cc431381366c54397a57ef" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:43.982577 31307 raft_consensus.cc:3060] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:43.971033 31515 raft_consensus.cc:493] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:43.981964 31499 raft_consensus.cc:515] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:44.006728 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffb9d78e773452ab44ae35b5d65fdb2" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:44.007177 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac7c8095aaa457494024d09dfaaf1bb" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:44.007802 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4682db2f801d4701a9c03cb1e4b32fd0" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:44.009493 30857 leader_election.cc:304] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:43.983518 31427 raft_consensus.cc:2749] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.017098 31482 leader_election.cc:290] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:44.018170 30939 raft_consensus.cc:359] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:44.018996 30939 raft_consensus.cc:385] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.019289 30939 raft_consensus.cc:740] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.020967 30939 consensus_queue.cc:260] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:44.007516 30813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcceeadce924e3493e4e91cb49e2f2e" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:44.010509 31515 raft_consensus.cc:3060] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.028797 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b26f10a0fb7476098bdb142c864895e" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:44.027958 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b26f10a0fb7476098bdb142c864895e" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:44.028450 30783 leader_election.cc:304] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.022912 31418 raft_consensus.cc:2749] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.039122 30941 tablet_bootstrap.cc:492] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:44.037899 30783 leader_election.cc:304] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:44.039718 30941 ts_tablet_manager.cc:1403] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.626s	user 0.026s	sys 0.028s
I20260709 12:21:44.041016 31505 raft_consensus.cc:2804] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:44.042596 31517 raft_consensus.cc:493] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:44.042907 31505 raft_consensus.cc:493] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:44.043605 31505 raft_consensus.cc:3060] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.043335 31517 raft_consensus.cc:515] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:44.045883 31517 leader_election.cc:290] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:44.049623 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de462b3788724f21b93b5cbb295c085a" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:44.051262 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda0258f575243bd910da13e828fb6f6" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:44.057548 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4326b71a8ff545259df55b4ab0564f48" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:44.058418 30819 raft_consensus.cc:2468] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:44.059480 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda0258f575243bd910da13e828fb6f6" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:44.038725 30814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb4b46162a04eeda49624c82070758e" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:44.061683 30814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb4b46162a04eeda49624c82070758e" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:44.062915 30814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a04a5cd9b143daba902d508029dcb5" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:44.064122 30814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a8098230e4404c9d5743dcac2c5aaa" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:44.065702 31491 leader_election.cc:290] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:44.073992 31408 leader_election.cc:290] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:44.080765 31479 raft_consensus.cc:2749] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:44.081302 30813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de462b3788724f21b93b5cbb295c085a" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:44.081861 31408 consensus_queue.cc:1059] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:44.082751 30813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ccb8b23d8455a990ef1cb50271887" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:44.084089 30813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac2bacfc36f49459fc2b2b2d8afb01d" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:44.084292 31408 raft_consensus.cc:3055] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:44.084822 31408 raft_consensus.cc:740] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:21:44.085981 31408 consensus_queue.cc:260] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:44.086802 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87d449e2aa442ec87cb2b55b61d4496" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:44.087517 31408 raft_consensus.cc:3060] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.088126 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87d449e2aa442ec87cb2b55b61d4496" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:44.089835 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56cad4068d4388bf572777bcfb89b3" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:44.091197 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fee969f4c2a4579ab7911212a86bf67" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:44.052553 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b26f10a0fb7476098bdb142c864895e" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:44.094630 30812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815af3bc37df4d158766ac2e615de683" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:44.095463 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e946ad6dd9cb42ad93987cebde13ba9a" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:44.096012 30812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c148832de74745608d983f2184cbf23f" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:44.097218 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8edecc2bf945e2bf553a7708f0f2cb" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:44.098727 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e243e0f019f54586877c9a61b2fc83ac" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:44.099701 31486 raft_consensus.cc:515] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:44.102217 31486 leader_election.cc:290] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:44.108294 31491 raft_consensus.cc:493] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.092370 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61dc8e98f804681b0815e953b2d2ad1" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:44.108927 31491 raft_consensus.cc:515] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:44.110004 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e24a3b2b9d4270a8b8466d3c6313ab" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:44.110251 31444 raft_consensus.cc:515] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:44.111203 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2f4d39a39493b8404958a5aaaa7af" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:44.113982 31499 leader_election.cc:290] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:44.114511 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcceeadce924e3493e4e91cb49e2f2e" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:44.041404 31478 leader_election.cc:290] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:44.055938 30811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2f4d39a39493b8404958a5aaaa7af" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:44.118443 31444 leader_election.cc:290] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:44.122081 30941 raft_consensus.cc:359] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:44.122844 30941 raft_consensus.cc:385] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.123126 30941 raft_consensus.cc:740] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.123430 31487 raft_consensus.cc:515] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:44.125695 30637 leader_election.cc:304] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:44.072481 31495 raft_consensus.cc:515] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:44.092108 31422 raft_consensus.cc:515] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:44.126541 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de462b3788724f21b93b5cbb295c085a" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:44.146113 30939 ts_tablet_manager.cc:1434] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9: Time spent starting tablet: real 0.270s	user 0.007s	sys 0.001s
I20260709 12:21:44.126870 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61dc8e98f804681b0815e953b2d2ad1" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:44.127940 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e243e0f019f54586877c9a61b2fc83ac" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:44.130285 31514 raft_consensus.cc:515] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:44.131554 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100eb209359a46d8b6c900d5a401586e" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:44.133026 31485 raft_consensus.cc:515] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:44.179663 31485 leader_election.cc:290] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:44.111282 31491 leader_election.cc:290] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
W20260709 12:21:44.145097 30783 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 107354us
I20260709 12:21:44.180781 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baad7ab904cc431381366c54397a57ef" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:44.180881 31505 raft_consensus.cc:515] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:44.154695 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d372d3fc5dd43d1880a4a932c83d7da" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:44.149271 31486 raft_consensus.cc:2749] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.155485 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac7c8095aaa457494024d09dfaaf1bb" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:44.156510 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87d449e2aa442ec87cb2b55b61d4496" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:44.156781 30815 raft_consensus.cc:1240] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Rejecting Update request from peer 4a9042c4154c442297159d1c9f1186b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:44.182591 30663 raft_consensus.cc:1240] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Rejecting Update request from peer 4a9042c4154c442297159d1c9f1186b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:44.145354 31492 raft_consensus.cc:515] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:44.183537 31330 raft_consensus.cc:515] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:44.151368 30941 consensus_queue.cc:260] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:44.158947 31487 leader_election.cc:290] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:44.185552 31492 leader_election.cc:290] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:44.152410 31506 raft_consensus.cc:2804] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:44.186280 31506 raft_consensus.cc:493] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:44.186440 30812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:44.186658 30662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d372d3fc5dd43d1880a4a932c83d7da" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:44.186684 31506 raft_consensus.cc:3060] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.161234 31307 raft_consensus.cc:515] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:44.187427 30662 raft_consensus.cc:2468] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:44.160095 30741 raft_consensus.cc:2393] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in current term 2: Already voted for candidate 4a9042c4154c442297159d1c9f1186b9 in this term.
I20260709 12:21:44.156510 31495 leader_election.cc:290] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:44.155551 31422 leader_election.cc:290] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:44.165995 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faf21b4ff034e548c19569963419851" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:44.188511 30890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c148832de74745608d983f2184cbf23f" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:44.169232 30634 leader_election.cc:304] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:44.189263 31330 leader_election.cc:290] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:44.190253 30634 leader_election.cc:304] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:44.169426 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d63226f015480c84967f90ac595cc0" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:44.163524 31498 raft_consensus.cc:515] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:44.181171 30783 leader_election.cc:304] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:44.181625 30820 raft_consensus.cc:3060] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.187871 30738 raft_consensus.cc:2393] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in current term 3: Already voted for candidate 4a9042c4154c442297159d1c9f1186b9 in this term.
I20260709 12:21:44.172873 30671 raft_consensus.cc:1240] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Rejecting Update request from peer 4a9042c4154c442297159d1c9f1186b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:44.189275 30890 raft_consensus.cc:3060] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.191331 30885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8edecc2bf945e2bf553a7708f0f2cb" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:44.197204 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d372d3fc5dd43d1880a4a932c83d7da" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:44.206310 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e243e0f019f54586877c9a61b2fc83ac" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:44.206460 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f3fc82ff104135851cce7357eda3ec" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:44.207481 31501 raft_consensus.cc:515] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:44.208076 31485 raft_consensus.cc:2749] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.208673 30668 raft_consensus.cc:1240] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Rejecting Update request from peer 4a9042c4154c442297159d1c9f1186b9 for earlier term 1. Current term is 2. Ops: []
W20260709 12:21:44.208873 30636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 49244.4us
I20260709 12:21:44.209005 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e243e0f019f54586877c9a61b2fc83ac" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:44.197834 30941 ts_tablet_manager.cc:1434] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.158s	user 0.006s	sys 0.001s
I20260709 12:21:44.209867 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a04a5cd9b143daba902d508029dcb5" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:44.210189 30636 leader_election.cc:304] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3
I20260709 12:21:44.210912 30941 tablet_bootstrap.cc:492] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:44.211714 31498 leader_election.cc:290] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:44.199291 30634 leader_election.cc:304] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:44.202406 30669 raft_consensus.cc:1240] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Rejecting Update request from peer 20c7a0cd21c3449587fdeeff565557d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:44.202214 30662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f3fc82ff104135851cce7357eda3ec" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:44.213982 30664 raft_consensus.cc:1240] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Rejecting Update request from peer 4a9042c4154c442297159d1c9f1186b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:44.214244 31486 raft_consensus.cc:2749] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.204217 31446 raft_consensus.cc:2749] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.215823 31523 raft_consensus.cc:2749] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.217461 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:44.219172 31501 leader_election.cc:290] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:44.219376 30634 leader_election.cc:304] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:44.221099 31479 raft_consensus.cc:2749] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:44.223476 31506 raft_consensus.cc:515] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:44.223951 30711 leader_election.cc:304] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.212414 31498 raft_consensus.cc:2804] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:44.235188 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a02078ac834032ac607943e7b3d175" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:44.236047 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faf21b4ff034e548c19569963419851" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:44.237133 30893 raft_consensus.cc:2468] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 0.
I20260709 12:21:44.241354 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d63226f015480c84967f90ac595cc0" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:44.245260 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bb30237ea045c79aa6eb181bc3e692" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:44.246865 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f3fc82ff104135851cce7357eda3ec" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:44.248957 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bb30237ea045c79aa6eb181bc3e692" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:44.249022 30812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f3fc82ff104135851cce7357eda3ec" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:44.251964 30888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b26f10a0fb7476098bdb142c864895e" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:44.253680 30887 raft_consensus.cc:1240] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Rejecting Update request from peer 4a9042c4154c442297159d1c9f1186b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:44.228821 31492 raft_consensus.cc:2749] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.259801 30637 leader_election.cc:304] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:44.260316 30820 raft_consensus.cc:2468] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 2.
I20260709 12:21:44.261379 31486 raft_consensus.cc:2749] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.261721 30637 leader_election.cc:304] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:44.263430 30665 raft_consensus.cc:2468] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 2.
I20260709 12:21:44.264839 31525 raft_consensus.cc:2749] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.268946 30663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bb30237ea045c79aa6eb181bc3e692" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:44.269320 30741 raft_consensus.cc:1240] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Rejecting Update request from peer 20c7a0cd21c3449587fdeeff565557d3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:44.269853 30663 raft_consensus.cc:2393] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c7a0cd21c3449587fdeeff565557d3 in current term 2: Already voted for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in this term.
I20260709 12:21:44.265113 30662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e946ad6dd9cb42ad93987cebde13ba9a" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:44.270754 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bb30237ea045c79aa6eb181bc3e692" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:44.242900 31498 raft_consensus.cc:493] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:44.266016 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ccb8b23d8455a990ef1cb50271887" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:44.271672 31498 raft_consensus.cc:3060] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.271924 30669 raft_consensus.cc:2468] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:44.267910 30668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f2ae9f62734cf59b3d5477d92760cb" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
W20260709 12:21:44.283681 30709 consensus_peers.cc:597] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:44.284936 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb65e812f06540bc9f1c2b1e3e13d41c" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:44.277643 30820 raft_consensus.cc:1240] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Rejecting Update request from peer d3ab9d21f8864b50a71b49c7d624584a for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:44.287254 30885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ccb8b23d8455a990ef1cb50271887" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:44.289062 30662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac2bacfc36f49459fc2b2b2d8afb01d" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:44.289323 30887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f2ae9f62734cf59b3d5477d92760cb" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:44.276896 30637 leader_election.cc:304] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:44.285899 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baad7ab904cc431381366c54397a57ef" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:44.293035 30941 tablet_bootstrap.cc:654] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.240090 31514 leader_election.cc:290] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
W20260709 12:21:44.294592 30709 leader_election.cc:343] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.291982 30885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:44.297712 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:44.298271 31501 raft_consensus.cc:2804] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:44.298686 30889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac7c8095aaa457494024d09dfaaf1bb" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:44.298867 31501 raft_consensus.cc:697] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:21:44.299734 30709 leader_election.cc:304] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:44.299798 31501 consensus_queue.cc:237] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:44.310238 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d372d3fc5dd43d1880a4a932c83d7da" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:44.312381 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcceeadce924e3493e4e91cb49e2f2e" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:44.313494 30663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:44.311333 31479 raft_consensus.cc:493] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.313947 31443 consensus_queue.cc:1059] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:21:44.314584 30665 raft_consensus.cc:1240] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Rejecting Update request from peer 20c7a0cd21c3449587fdeeff565557d3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:44.314575 31479 raft_consensus.cc:515] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:44.315181 31443 raft_consensus.cc:3055] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:44.315672 31443 raft_consensus.cc:740] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:44.316790 31448 consensus_queue.cc:1059] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:44.306373 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac2bacfc36f49459fc2b2b2d8afb01d" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:44.317763 30662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4682db2f801d4701a9c03cb1e4b32fd0" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:44.318079 31443 consensus_queue.cc:260] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:44.319375 30663 raft_consensus.cc:2393] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c7a0cd21c3449587fdeeff565557d3 in current term 2: Already voted for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in this term.
I20260709 12:21:44.292562 31525 raft_consensus.cc:493] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:44.317821 31448 raft_consensus.cc:3055] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:44.319366 31443 raft_consensus.cc:3060] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.320509 30664 raft_consensus.cc:1240] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Rejecting Update request from peer 20c7a0cd21c3449587fdeeff565557d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:44.300706 31492 raft_consensus.cc:2804] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:44.321226 31492 raft_consensus.cc:493] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:44.321643 31492 raft_consensus.cc:3060] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.320211 31525 raft_consensus.cc:515] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:44.323944 31525 leader_election.cc:290] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:44.324725 31448 raft_consensus.cc:740] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:44.326239 31448 consensus_queue.cc:260] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:44.312939 30709 leader_election.cc:304] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:44.327896 31448 raft_consensus.cc:3060] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.331099 30887 raft_consensus.cc:1240] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Rejecting Update request from peer 20c7a0cd21c3449587fdeeff565557d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:44.334559 31406 raft_consensus.cc:2804] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:44.335065 31406 raft_consensus.cc:697] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 [term 2 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:44.302441 31491 consensus_queue.cc:1059] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:21:44.335824 31446 consensus_queue.cc:1059] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:44.333282 31479 leader_election.cc:290] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:44.335996 31406 consensus_queue.cc:237] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:44.337613 31495 raft_consensus.cc:3055] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:44.337994 31495 raft_consensus.cc:740] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:44.338807 30741 raft_consensus.cc:1240] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Rejecting Update request from peer 20c7a0cd21c3449587fdeeff565557d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:44.340178 31487 raft_consensus.cc:3055] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:44.340674 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c148832de74745608d983f2184cbf23f" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:44.332099 30860 leader_election.cc:304] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:44.333465 30890 raft_consensus.cc:2468] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 2.
I20260709 12:21:44.336229 31502 consensus_queue.cc:1059] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:44.351878 30783 leader_election.cc:304] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.351179 30860 leader_election.cc:304] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
W20260709 12:21:44.356514 30857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 347093us
W20260709 12:21:44.357935 30857 leader_election.cc:343] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.360304 30857 leader_election.cc:304] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:44.355159 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcceeadce924e3493e4e91cb49e2f2e" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:44.361461 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4682db2f801d4701a9c03cb1e4b32fd0" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:44.362766 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca6811dc9854dfaa1295db38c91c0fd" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:44.342134 31487 raft_consensus.cc:740] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:44.362957 30887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44af5a494fec45679774bc9eb1007f9b" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:44.363920 31487 consensus_queue.cc:260] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:44.365207 31487 raft_consensus.cc:3060] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.361521 31422 raft_consensus.cc:2749] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:44.365494 30860 leader_election.cc:304] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:44.361490 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81434413f4d7497a8ae5f95db857f819" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:44.366133 31422 raft_consensus.cc:2749] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.366559 30712 leader_election.cc:304] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.366772 31418 raft_consensus.cc:2749] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.355906 31330 raft_consensus.cc:2749] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.368055 30860 leader_election.cc:304] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:44.374975 30857 leader_election.cc:304] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3
I20260709 12:21:44.380440 30712 leader_election.cc:304] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:44.384063 30860 leader_election.cc:304] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:44.384307 30636 leader_election.cc:304] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.366590 30744 raft_consensus.cc:2468] T 81434413f4d7497a8ae5f95db857f819 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 0.
I20260709 12:21:44.364876 30886 raft_consensus.cc:1240] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Rejecting Update request from peer 4a9042c4154c442297159d1c9f1186b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:44.400250 30636 leader_election.cc:304] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.399694 30860 leader_election.cc:304] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:44.359483 31505 leader_election.cc:290] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:44.341183 31515 raft_consensus.cc:515] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
W20260709 12:21:44.375705 30711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 68753.1us
W20260709 12:21:44.395964 31481 consensus_meta.cc:287] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent flushing consensus metadata: real 0.564s	user 0.009s	sys 0.004s
I20260709 12:21:44.417299 31481 raft_consensus.cc:515] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:44.417757 30711 leader_election.cc:304] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:44.419646 31481 leader_election.cc:290] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:44.375171 30670 raft_consensus.cc:1240] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Rejecting Update request from peer d3ab9d21f8864b50a71b49c7d624584a for earlier term 1. Current term is 2. Ops: []
W20260709 12:21:44.420548 31521 log.cc:927] Time spent T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:21:44.422741 30669 raft_consensus.cc:2393] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c7a0cd21c3449587fdeeff565557d3 in current term 2: Already voted for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in this term.
I20260709 12:21:44.423570 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c148832de74745608d983f2184cbf23f" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:44.402890 31490 raft_consensus.cc:2749] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.425945 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9361d602cd814a70acf6a5867a109d74" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:44.426340 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c179d47d7f146ed83b56ea632997aa7" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:44.427485 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4326b71a8ff545259df55b4ab0564f48" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:44.428272 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffb9d78e773452ab44ae35b5d65fdb2" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:44.429144 31524 raft_consensus.cc:2749] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.394933 30665 raft_consensus.cc:1240] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 LEADER]: Rejecting Update request from peer d3ab9d21f8864b50a71b49c7d624584a for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:44.430284 30664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87d449e2aa442ec87cb2b55b61d4496" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:44.431224 30664 raft_consensus.cc:2393] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 in current term 3: Already voted for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in this term.
I20260709 12:21:44.431371 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b6381e285f94a7ca02f638d09d0b3c2" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:44.412422 30666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2f4d39a39493b8404958a5aaaa7af" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:44.378456 31446 raft_consensus.cc:2749] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.382925 31489 raft_consensus.cc:2749] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:21:44.415155 30783 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 63384us
I20260709 12:21:44.383322 31330 raft_consensus.cc:2749] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.436558 30785 leader_election.cc:304] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:44.411759 30636 leader_election.cc:304] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.403913 31444 raft_consensus.cc:2749] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.416440 30860 leader_election.cc:304] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:44.427591 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b6381e285f94a7ca02f638d09d0b3c2" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:44.400558 31422 raft_consensus.cc:2749] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.414084 30857 leader_election.cc:304] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
W20260709 12:21:44.415867 31528 log.cc:927] Time spent T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:21:44.429194 30634 leader_election.cc:304] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:44.439374 30783 leader_election.cc:304] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.338862 31495 consensus_queue.cc:260] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:44.433683 31502 raft_consensus.cc:2804] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:44.425982 31307 leader_election.cc:290] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:44.432612 30664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9361d602cd814a70acf6a5867a109d74" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:44.434985 31411 raft_consensus.cc:2804] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:44.472846 31411 raft_consensus.cc:493] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:44.473368 31411 raft_consensus.cc:3060] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.474483 30568 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36714 (request call id 86) took 3087 ms. Trace:
I20260709 12:21:44.432942 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:44.433921 31298 raft_consensus.cc:3055] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:44.446509 30636 leader_election.cc:304] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.477538 31533 consensus_queue.cc:1059] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:21:44.477584 31298 raft_consensus.cc:740] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:44.478924 31532 raft_consensus.cc:3055] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:44.479387 31532 raft_consensus.cc:740] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:44.479274 31298 consensus_queue.cc:260] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:44.480554 31532 consensus_queue.cc:260] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:44.482200 31532 raft_consensus.cc:3060] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:44.434238 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a8098230e4404c9d5743dcac2c5aaa" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:44.433317 31506 leader_election.cc:290] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:44.449162 31427 raft_consensus.cc:3060] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.434929 31527 raft_consensus.cc:2749] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.451267 31502 raft_consensus.cc:493] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:44.485893 31502 raft_consensus.cc:3060] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.485737 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baad7ab904cc431381366c54397a57ef" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:44.452033 31481 raft_consensus.cc:2804] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:44.492759 31481 raft_consensus.cc:493] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:44.493122 31481 raft_consensus.cc:3060] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.488425 31515 leader_election.cc:290] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:44.500882 30812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca6811dc9854dfaa1295db38c91c0fd" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:44.479331 31485 raft_consensus.cc:2749] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.505059 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb65e812f06540bc9f1c2b1e3e13d41c" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:44.515158 30565 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36704 (request call id 84) took 1002 ms. Trace:
I20260709 12:21:44.458817 30889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca6811dc9854dfaa1295db38c91c0fd" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:44.444787 31331 raft_consensus.cc:2749] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.431249 31492 raft_consensus.cc:515] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:44.455793 31530 raft_consensus.cc:2804] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:44.453501 31496 consensus_queue.cc:1059] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:21:44.454107 31446 raft_consensus.cc:2804] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:44.462734 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de462b3788724f21b93b5cbb295c085a" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
W20260709 12:21:44.528213 30636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 82588.1us
I20260709 12:21:44.529052 31530 raft_consensus.cc:493] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:44.529579 31530 raft_consensus.cc:3060] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.532997 30671 raft_consensus.cc:2393] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 in current term 2: Already voted for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in this term.
I20260709 12:21:44.529717 30636 leader_election.cc:304] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.446350 31418 consensus_queue.cc:1059] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:21:44.445905 31514 raft_consensus.cc:2749] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.467152 30663 raft_consensus.cc:1240] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Rejecting Update request from peer 4a9042c4154c442297159d1c9f1186b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:44.537482 31525 raft_consensus.cc:2749] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.468441 30662 raft_consensus.cc:1240] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Rejecting Update request from peer d3ab9d21f8864b50a71b49c7d624584a for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:44.468742 30668 raft_consensus.cc:2393] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c7a0cd21c3449587fdeeff565557d3 in current term 2: Already voted for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in this term.
W20260709 12:21:44.483620 30709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:44.537714 31446 raft_consensus.cc:697] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [term 2 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:44.545324 30667 raft_consensus.cc:1240] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Rejecting Update request from peer d3ab9d21f8864b50a71b49c7d624584a for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:44.545547 31446 consensus_queue.cc:237] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:44.548194 31495 raft_consensus.cc:3060] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.549136 31331 raft_consensus.cc:3055] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:44.549567 31331 raft_consensus.cc:740] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:44.550016 31492 leader_election.cc:290] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:44.550491 31331 consensus_queue.cc:260] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:44.551921 31331 raft_consensus.cc:3060] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:44.526043 30857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 80686.2us
I20260709 12:21:44.553422 30857 leader_election.cc:304] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3
I20260709 12:21:44.554268 31330 raft_consensus.cc:2804] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:44.554773 31330 raft_consensus.cc:493] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:44.555199 31330 raft_consensus.cc:3060] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.564932 30815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f2ae9f62734cf59b3d5477d92760cb" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:44.564982 31481 raft_consensus.cc:515] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:44.474905 30568 rpcz_store.cc:276] 0709 12:21:41.387394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.387578 (+   184us) service_pool.cc:224] Handling call
0709 12:21:41.923973 (+536395us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b540078bed4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b6090 00007f4a97354f3a 00007f4a9d10ae9c 00007f4a9d20904e 00007f4a9b6ca2a4 00007f4a9b6ca232 00007f4a9b6ca161 00007f4a9b6ca0dc 00007f4a9b6c9392 00007f4a9568748c 00007f4a956868c6
0709 12:21:44.474406 (+2550433us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:43.666338 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:43.667000 (+   662us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:43.667035 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:21:43.667053 (+    18us) tablet.cc:662] Decoding operations
0709 12:21:43.667575 (+   522us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:43.667650 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:43.667683 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:21:43.667883 (+   200us) tablet.cc:701] Row locks acquired
0709 12:21:43.667900 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:21:43.668050 (+   150us) write_op.cc:270] Start()
0709 12:21:43.668168 (+   118us) write_op.cc:276] Timestamp: P: 1783599703668002 usec, L: 0
0709 12:21:43.668187 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:21:43.669177 (+   990us) log.cc:844] Serialized 543 byte log entry
0709 12:21:44.279698 (+610521us) op_driver.cc:464] REPLICATION: finished
0709 12:21:44.448185 (+168487us) write_op.cc:301] APPLY: starting
0709 12:21:44.448286 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:44.454103 (+  5817us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:44.459491 (+  5388us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:44.459747 (+   256us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:44.459914 (+   167us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:21:44.459964 (+    50us) write_op.cc:312] APPLY: finished
0709 12:21:44.460150 (+   186us) log.cc:844] Serialized 22 byte log entry
0709 12:21:44.460333 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:44.460432 (+    99us) write_op.cc:454] Released schema lock
0709 12:21:44.460476 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:44.460892 (+   416us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:44.460929 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1296385,"reported_tablets":3,"spinlock_wait_cycles":263356800,"child_traces":[["op",{"apply.queue_time_us":161060,"apply.run_cpu_time_us":1893,"apply.run_wall_time_us":12693,"num_ops":1,"prepare.queue_time_us":83784,"prepare.run_cpu_time_us":65590,"prepare.run_wall_time_us":273585,"raft.queue_time_us":237404,"raft.run_cpu_time_us":17112,"raft.run_wall_time_us":158546,"replication_time_us":611323,"thread_start_us":409234,"threads_started":4,"wal-append.queue_time_us":223788}]]}
I20260709 12:21:44.535420 30636 leader_election.cc:304] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.452766 30783 leader_election.cc:304] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.537182 30565 rpcz_store.cc:276] 0709 12:21:43.513025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.513210 (+   185us) service_pool.cc:224] Handling call
0709 12:21:44.515026 (+1001816us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29895,"reported_tablets":5}
I20260709 12:21:44.542601 31298 raft_consensus.cc:3060] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:44.571719 30783 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 119064us
I20260709 12:21:44.571203 31496 raft_consensus.cc:3060] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:44.543648 30711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 125970us
I20260709 12:21:44.580837 31492 consensus_queue.cc:1048] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:44.584692 31498 raft_consensus.cc:515] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
W20260709 12:21:44.586702 30636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 51394.3us
I20260709 12:21:44.588315 31515 raft_consensus.cc:2749] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.590088 31411 raft_consensus.cc:515] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:44.590961 31534 consensus_queue.cc:1059] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:44.592865 31443 raft_consensus.cc:3055] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:44.543319 30812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81434413f4d7497a8ae5f95db857f819" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:44.608075 30783 leader_election.cc:304] T 7ca6811dc9854dfaa1295db38c91c0fd P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.609860 30783 leader_election.cc:304] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.592473 31411 leader_election.cc:290] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:44.593518 31443 raft_consensus.cc:740] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:44.616528 31443 consensus_queue.cc:260] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:44.617923 31443 raft_consensus.cc:3060] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.613646 30783 leader_election.cc:304] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.612170 31532 consensus_queue.cc:1059] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:21:44.614642 30666 raft_consensus.cc:1240] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Rejecting Update request from peer 20c7a0cd21c3449587fdeeff565557d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:44.612947 30636 leader_election.cc:304] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.615512 31445 raft_consensus.cc:3060] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.611317 31506 raft_consensus.cc:2749] T 7ca6811dc9854dfaa1295db38c91c0fd P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.627226 31505 raft_consensus.cc:3055] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:44.627334 30812 raft_consensus.cc:2393] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in current term 1: Already voted for candidate 20c7a0cd21c3449587fdeeff565557d3 in this term.
W20260709 12:21:44.636538 30712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 250671us
I20260709 12:21:44.637418 30712 leader_election.cc:304] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:44.638273 31492 consensus_queue.cc:1059] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:44.638588 31537 raft_consensus.cc:2749] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.655267 30783 leader_election.cc:304] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.656345 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f2ae9f62734cf59b3d5477d92760cb" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:44.635435 31505 raft_consensus.cc:740] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:44.669235 30783 leader_election.cc:304] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.627470 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb4b46162a04eeda49624c82070758e" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:44.645061 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb65e812f06540bc9f1c2b1e3e13d41c" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:44.653276 31448 consensus_queue.cc:1059] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:21:44.676318 30663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d372d3fc5dd43d1880a4a932c83d7da" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:44.673105 30888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d372d3fc5dd43d1880a4a932c83d7da" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:44.648491 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81434413f4d7497a8ae5f95db857f819" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:44.685308 30739 raft_consensus.cc:3060] T 81434413f4d7497a8ae5f95db857f819 P 4a9042c4154c442297159d1c9f1186b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.677099 30668 raft_consensus.cc:1240] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Rejecting Update request from peer d3ab9d21f8864b50a71b49c7d624584a for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:44.685850 31427 raft_consensus.cc:2749] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.687121 30857 leader_election.cc:304] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
W20260709 12:21:44.687871 30712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 50534.6us
I20260709 12:21:44.634847 31532 raft_consensus.cc:2749] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.686264 30812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006658e1213f4f8da089a9570e0a76b9" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:44.716109 31411 consensus_queue.cc:1059] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:44.678853 30815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81434413f4d7497a8ae5f95db857f819" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:44.716922 30739 raft_consensus.cc:2468] T 81434413f4d7497a8ae5f95db857f819 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:44.717636 30815 raft_consensus.cc:2393] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in current term 1: Already voted for candidate 20c7a0cd21c3449587fdeeff565557d3 in this term.
I20260709 12:21:44.716324 31418 raft_consensus.cc:2749] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.695883 30745 raft_consensus.cc:1240] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Rejecting Update request from peer 20c7a0cd21c3449587fdeeff565557d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:44.718160 30634 leader_election.cc:304] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:44.696743 30887 raft_consensus.cc:1240] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Rejecting Update request from peer 20c7a0cd21c3449587fdeeff565557d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:44.719170 31408 raft_consensus.cc:2804] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:44.693459 31533 raft_consensus.cc:3060] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.719787 31408 raft_consensus.cc:697] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:21:44.720181 31496 raft_consensus.cc:2749] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.720939 31408 consensus_queue.cc:237] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:44.645041 31481 leader_election.cc:290] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:44.722220 30820 raft_consensus.cc:2468] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 2.
I20260709 12:21:44.723690 30890 raft_consensus.cc:1240] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Rejecting Update request from peer 20c7a0cd21c3449587fdeeff565557d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:44.697790 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87d449e2aa442ec87cb2b55b61d4496" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:44.724716 31505 consensus_queue.cc:260] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:44.725131 31418 consensus_queue.cc:1059] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:44.726193 31505 raft_consensus.cc:3060] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.726259 31418 consensus_queue.cc:1059] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:44.727568 31527 raft_consensus.cc:3055] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:44.727902 31527 raft_consensus.cc:740] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
W20260709 12:21:44.678395 30786 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:44.728770 31527 consensus_queue.cc:260] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:44.697940 30741 raft_consensus.cc:1240] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Rejecting Update request from peer 20c7a0cd21c3449587fdeeff565557d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:44.730139 31527 raft_consensus.cc:3060] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.698428 31330 raft_consensus.cc:515] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:44.731223 30889 raft_consensus.cc:1240] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Rejecting Update request from peer 20c7a0cd21c3449587fdeeff565557d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:44.676334 31535 consensus_queue.cc:1059] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:21:44.699853 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44af5a494fec45679774bc9eb1007f9b" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:44.700907 31448 raft_consensus.cc:3055] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:44.685858 31502 raft_consensus.cc:515] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:44.733634 31448 raft_consensus.cc:740] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:44.735355 31502 leader_election.cc:290] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:44.701130 31506 consensus_queue.cc:1059] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:44.676482 30666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a0a060aca4bdf912b9291106aaa74" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:44.644439 31498 leader_election.cc:290] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:44.702728 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a02078ac834032ac607943e7b3d175" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:44.737161 31506 raft_consensus.cc:3055] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:44.635217 31478 raft_consensus.cc:2749] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.696954 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de462b3788724f21b93b5cbb295c085a" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:44.677085 30667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcceeadce924e3493e4e91cb49e2f2e" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:44.738957 30667 raft_consensus.cc:2393] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d3ab9d21f8864b50a71b49c7d624584a in current term 2: Already voted for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in this term.
I20260709 12:21:44.739616 30666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faf21b4ff034e548c19569963419851" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
W20260709 12:21:44.740996 30709 leader_election.cc:343] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.743810 30816 raft_consensus.cc:2468] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 3.
I20260709 12:21:44.707455 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81434413f4d7497a8ae5f95db857f819" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:44.639631 31490 raft_consensus.cc:3055] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:44.745349 31490 raft_consensus.cc:740] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:44.708294 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81434413f4d7497a8ae5f95db857f819" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:44.746348 30744 raft_consensus.cc:2393] T 81434413f4d7497a8ae5f95db857f819 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c7a0cd21c3449587fdeeff565557d3 in current term 1: Already voted for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in this term.
I20260709 12:21:44.672242 31446 raft_consensus.cc:2749] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.732146 31422 raft_consensus.cc:3055] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:44.747653 31422 raft_consensus.cc:740] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:44.734848 31448 consensus_queue.cc:260] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:44.717500 31411 raft_consensus.cc:3055] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:44.748512 31422 consensus_queue.cc:260] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:44.749351 31411 raft_consensus.cc:740] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:44.737612 31506 raft_consensus.cc:740] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:44.749918 31422 raft_consensus.cc:3060] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.714296 30712 leader_election.cc:304] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.750761 31411 consensus_queue.cc:260] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:44.749096 31448 raft_consensus.cc:3060] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.752104 30712 leader_election.cc:304] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:44.752892 31298 raft_consensus.cc:2749] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.753527 31502 raft_consensus.cc:2749] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.732250 31330 leader_election.cc:290] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:44.756610 30712 leader_election.cc:304] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.763147 30712 leader_election.cc:304] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.764868 30712 leader_election.cc:304] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.766249 30712 leader_election.cc:304] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.766312 30636 leader_election.cc:304] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.767657 30712 leader_election.cc:304] T 69a04a5cd9b143daba902d508029dcb5 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.770380 30712 leader_election.cc:304] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
W20260709 12:21:44.773519 30617 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:44.783485 30636 leader_election.cc:304] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.785000 30712 leader_election.cc:304] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.769049 31492 raft_consensus.cc:2749] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.769058 31502 raft_consensus.cc:2749] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.788266 31481 raft_consensus.cc:2749] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.791672 30667 raft_consensus.cc:1240] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Rejecting Update request from peer d3ab9d21f8864b50a71b49c7d624584a for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:44.748500 31490 consensus_queue.cc:260] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:44.784003 31487 raft_consensus.cc:2804] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:44.681845 31530 raft_consensus.cc:515] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:44.783864 31534 raft_consensus.cc:2749] T 69a04a5cd9b143daba902d508029dcb5 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.769069 31298 raft_consensus.cc:2749] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.790505 31406 raft_consensus.cc:2749] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.804811 30941 tablet_bootstrap.cc:492] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:44.794625 31408 raft_consensus.cc:2749] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.797405 31502 raft_consensus.cc:2749] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.810109 30941 ts_tablet_manager.cc:1403] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.599s	user 0.031s	sys 0.046s
I20260709 12:21:44.799002 31411 raft_consensus.cc:3060] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.795270 31490 raft_consensus.cc:3060] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.807090 30565 catalog_manager.cc:5697] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 1 to 2, leader changed from d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196) to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:44.789878 31495 consensus_queue.cc:1059] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:21:44.800807 31487 raft_consensus.cc:493] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:44.827464 31487 raft_consensus.cc:3060] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.827860 30887 raft_consensus.cc:1240] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Rejecting Update request from peer 20c7a0cd21c3449587fdeeff565557d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:44.799826 30711 leader_election.cc:304] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.750770 31506 consensus_queue.cc:260] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:44.850509 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ccb8b23d8455a990ef1cb50271887" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:44.852671 30783 leader_election.cc:304] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:44.854702 30783 leader_election.cc:304] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
W20260709 12:21:44.855320 30857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 56137.5us
I20260709 12:21:44.838290 31533 raft_consensus.cc:2749] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.843532 31530 leader_election.cc:290] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:44.842510 31445 raft_consensus.cc:2749] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.860316 30783 leader_election.cc:304] T 69a04a5cd9b143daba902d508029dcb5 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:44.861707 30941 raft_consensus.cc:359] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:44.863852 30941 raft_consensus.cc:385] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.864156 30941 raft_consensus.cc:740] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.859040 31446 raft_consensus.cc:2749] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.859278 31443 raft_consensus.cc:2749] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.869431 30819 raft_consensus.cc:1240] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Rejecting Update request from peer d3ab9d21f8864b50a71b49c7d624584a for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:44.873172 30815 raft_consensus.cc:1240] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Rejecting Update request from peer d3ab9d21f8864b50a71b49c7d624584a for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:44.875166 31532 raft_consensus.cc:3055] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:44.875615 31532 raft_consensus.cc:740] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:44.876151 30941 consensus_queue.cc:260] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:44.876572 31532 consensus_queue.cc:260] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:44.880780 31331 raft_consensus.cc:3055] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:44.880980 31532 raft_consensus.cc:3060] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.881271 31331 raft_consensus.cc:740] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:44.881995 30941 ts_tablet_manager.cc:1434] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.000s
I20260709 12:21:44.883296 30941 tablet_bootstrap.cc:492] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:44.884341 31495 raft_consensus.cc:2749] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.885275 31495 consensus_queue.cc:1059] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:44.832593 31527 consensus_queue.cc:1059] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:21:44.910444 31506 raft_consensus.cc:3060] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.915432 30815 raft_consensus.cc:1275] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:44.919111 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda0258f575243bd910da13e828fb6f6" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:44.921137 31527 raft_consensus.cc:3055] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:44.921698 31527 raft_consensus.cc:740] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:44.922745 31527 consensus_queue.cc:260] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
W20260709 12:21:44.866638 30711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 76593.3us
I20260709 12:21:44.926322 31519 consensus_queue.cc:1048] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:44.928944 31331 consensus_queue.cc:260] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:44.907711 31446 consensus_queue.cc:1059] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:21:44.903389 31530 raft_consensus.cc:2749] T 69a04a5cd9b143daba902d508029dcb5 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.930727 31331 raft_consensus.cc:3060] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.935845 31495 raft_consensus.cc:3055] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:44.936316 31446 raft_consensus.cc:3055] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:44.936417 31495 raft_consensus.cc:740] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:44.936861 31446 raft_consensus.cc:740] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:44.937587 31495 consensus_queue.cc:260] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:44.939085 31495 raft_consensus.cc:3060] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.944681 31445 consensus_queue.cc:1059] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:44.946552 31539 raft_consensus.cc:3055] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:44.946977 31539 raft_consensus.cc:740] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:44.950742 31527 raft_consensus.cc:3060] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.947937 31539 consensus_queue.cc:260] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:44.953439 31539 raft_consensus.cc:3060] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.956905 31487 raft_consensus.cc:515] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:44.937760 31446 consensus_queue.cc:260] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:44.959162 31446 raft_consensus.cc:3060] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.908051 30817 raft_consensus.cc:2468] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 2.
I20260709 12:21:44.980326 31487 leader_election.cc:290] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:45.001904 30783 leader_election.cc:304] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:45.003029 31539 raft_consensus.cc:3060] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:45.003867 30783 leader_election.cc:304] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:45.006112 30783 leader_election.cc:304] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:45.006453 31530 raft_consensus.cc:2749] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:45.021690 30941 tablet_bootstrap.cc:654] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.025876 31543 raft_consensus.cc:2749] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:45.029623 30783 leader_election.cc:304] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:45.031358 30783 leader_election.cc:304] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:45.033735 30783 leader_election.cc:304] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:45.034301 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda0258f575243bd910da13e828fb6f6" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:45.034583 31546 raft_consensus.cc:2749] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:45.034531 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb4b46162a04eeda49624c82070758e" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:45.035331 30745 raft_consensus.cc:1240] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Rejecting Update request from peer d3ab9d21f8864b50a71b49c7d624584a for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:45.035920 31506 raft_consensus.cc:2749] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:45.038056 30783 leader_election.cc:304] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:45.039990 30783 leader_election.cc:304] T 0b6381e285f94a7ca02f638d09d0b3c2 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:45.040161 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faf21b4ff034e548c19569963419851" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:45.040866 30891 raft_consensus.cc:3060] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.036849 30670 raft_consensus.cc:3060] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.042371 31506 raft_consensus.cc:2749] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:45.045797 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a0a060aca4bdf912b9291106aaa74" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:45.036913 31496 raft_consensus.cc:2749] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:45.053856 30783 leader_election.cc:304] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:45.055724 30891 raft_consensus.cc:2468] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:45.056028 31532 raft_consensus.cc:2749] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:45.061264 30891 raft_consensus.cc:3060] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:45.054400 30737 raft_consensus.cc:1240] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Rejecting Update request from peer d3ab9d21f8864b50a71b49c7d624584a for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:45.063297 30890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4326b71a8ff545259df55b4ab0564f48" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:45.054615 31496 raft_consensus.cc:2749] T 0b6381e285f94a7ca02f638d09d0b3c2 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:45.066334 31527 consensus_queue.cc:1059] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:45.068410 31411 raft_consensus.cc:3055] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:45.069028 31411 raft_consensus.cc:740] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:45.070299 31411 consensus_queue.cc:260] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:45.071311 30744 raft_consensus.cc:2468] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 2.
I20260709 12:21:45.071893 31411 raft_consensus.cc:3060] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:45.072932 30857 leader_election.cc:304] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:45.074314 31527 raft_consensus.cc:2804] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:45.075188 31527 raft_consensus.cc:697] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [term 2 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:45.076246 31527 consensus_queue.cc:237] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:45.077052 31547 consensus_queue.cc:1059] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:45.078747 31545 raft_consensus.cc:3055] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:45.079229 31545 raft_consensus.cc:740] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:45.078332 31506 consensus_queue.cc:1059] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:45.080009 30783 leader_election.cc:304] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:45.080971 30887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006658e1213f4f8da089a9570e0a76b9" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:45.081164 31545 consensus_queue.cc:260] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:45.086794 31545 raft_consensus.cc:3060] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:45.098683 30859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.099835 31506 raft_consensus.cc:3055] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:45.102788 31495 raft_consensus.cc:2749] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:45.104291 30712 leader_election.cc:304] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:45.105479 30712 leader_election.cc:304] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:45.106251 31487 raft_consensus.cc:2749] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:45.106624 30712 leader_election.cc:304] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:45.107048 31487 raft_consensus.cc:2804] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:45.107460 30890 raft_consensus.cc:1275] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:45.108721 30737 raft_consensus.cc:1275] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Refusing update from remote peer 20c7a0cd21c3449587fdeeff565557d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:45.111622 31448 raft_consensus.cc:2804] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:45.112246 31448 raft_consensus.cc:697] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [term 2 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:45.112615 30667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ccb8b23d8455a990ef1cb50271887" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:45.113268 31448 consensus_queue.cc:237] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:45.114240 31487 raft_consensus.cc:697] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 3 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:45.115634 31487 consensus_queue.cc:237] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:45.116776 30887 raft_consensus.cc:1275] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Refusing update from remote peer 20c7a0cd21c3449587fdeeff565557d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:45.120007 31495 consensus_queue.cc:1048] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:45.123754 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4326b71a8ff545259df55b4ab0564f48" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:45.100963 31539 raft_consensus.cc:2749] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:45.100431 31506 raft_consensus.cc:740] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:45.127022 30783 leader_election.cc:304] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:45.145233 30783 leader_election.cc:304] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:45.152392 30891 raft_consensus.cc:1275] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Refusing update from remote peer 4a9042c4154c442297159d1c9f1186b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:45.150413 31539 raft_consensus.cc:2749] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:21:45.150315 31495 raft_consensus.cc:2749] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:45.165627 30860 leader_election.cc:304] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:45.165565 30636 leader_election.cc:304] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:45.171507 30860 leader_election.cc:304] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:45.166193 31506 consensus_queue.cc:260] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:45.175633 31515 consensus_queue.cc:1048] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:45.175789 31506 raft_consensus.cc:3060] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:45.152853 31532 consensus_queue.cc:1048] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:21:45.178783 30816 raft_consensus.cc:1240] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Rejecting Update request from peer d3ab9d21f8864b50a71b49c7d624584a for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:45.182641 31547 raft_consensus.cc:2804] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:45.182979 30667 raft_consensus.cc:1275] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Refusing update from remote peer 4a9042c4154c442297159d1c9f1186b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:45.183219 31547 raft_consensus.cc:697] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 2 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:45.184235 31547 consensus_queue.cc:237] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:45.187027 30941 tablet_bootstrap.cc:492] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:45.187723 30941 ts_tablet_manager.cc:1403] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.305s	user 0.015s	sys 0.031s
I20260709 12:21:45.172950 31545 raft_consensus.cc:2749] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:45.196529 30860 leader_election.cc:304] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:45.177733 31481 raft_consensus.cc:2749] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:45.206279 31527 raft_consensus.cc:2749] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:45.208056 31548 consensus_queue.cc:1048] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:45.178604 31331 consensus_queue.cc:1059] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:21:45.235837 30941 raft_consensus.cc:359] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:45.236730 30941 raft_consensus.cc:385] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.237021 30941 raft_consensus.cc:740] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.319134 31422 raft_consensus.cc:3055] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:45.250636 30815 raft_consensus.cc:1240] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Rejecting Update request from peer d3ab9d21f8864b50a71b49c7d624584a for earlier term 1. Current term is 2. Ops: []
W20260709 12:21:45.395790 30709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 123862us
I20260709 12:21:45.399492 30941 consensus_queue.cc:260] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:45.386278 31422 raft_consensus.cc:740] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
W20260709 12:21:45.388666 30711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 117890us
I20260709 12:21:45.446744 31422 consensus_queue.cc:260] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:45.453781 31331 consensus_queue.cc:1059] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:45.455056 31331 raft_consensus.cc:3055] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:45.455435 31331 raft_consensus.cc:740] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:45.456332 31331 consensus_queue.cc:260] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:45.440721 30711 leader_election.cc:304] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:45.457732 31331 raft_consensus.cc:3060] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:45.459007 30711 leader_election.cc:304] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:45.461256 31492 raft_consensus.cc:2804] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:45.461953 31492 raft_consensus.cc:697] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:45.463171 31492 consensus_queue.cc:237] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:45.465991 31490 raft_consensus.cc:2749] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:21:45.468233 30783 consensus_peers.cc:597] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:45.469619 31408 consensus_queue.cc:1048] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:45.446835 30941 ts_tablet_manager.cc:1434] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.259s	user 0.019s	sys 0.003s
I20260709 12:21:45.478456 31490 consensus_queue.cc:1048] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:45.547483 30819 raft_consensus.cc:1275] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Refusing update from remote peer 4a9042c4154c442297159d1c9f1186b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:45.546060 31487 raft_consensus.cc:493] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.552332 31487 raft_consensus.cc:515] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:45.555140 31487 leader_election.cc:290] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:45.572609 30941 tablet_bootstrap.cc:492] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:21:45.587615 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f3fc82ff104135851cce7357eda3ec" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:45.588063 30941 tablet_bootstrap.cc:654] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.588428 30820 raft_consensus.cc:2468] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:45.578913 31422 raft_consensus.cc:3060] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:45.593149 30815 raft_consensus.cc:1275] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Refusing update from remote peer 4a9042c4154c442297159d1c9f1186b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:45.598069 31537 consensus_queue.cc:1048] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:45.630576 31408 raft_consensus.cc:493] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.631395 31408 raft_consensus.cc:515] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:45.634809 31408 leader_election.cc:290] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
W20260709 12:21:45.645731 30857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 45474.2us
I20260709 12:21:45.655810 30745 raft_consensus.cc:1275] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Refusing update from remote peer d3ab9d21f8864b50a71b49c7d624584a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:21:45.656945 30783 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 71127.5us
I20260709 12:21:45.659067 30712 leader_election.cc:304] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
I20260709 12:21:45.660339 31331 consensus_queue.cc:1048] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:45.664533 31537 raft_consensus.cc:2804] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:45.665167 31537 raft_consensus.cc:493] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.665588 31537 raft_consensus.cc:3060] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:45.670044 31570 consensus_queue.cc:1048] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:45.644189 30566 catalog_manager.cc:5697] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:45.676016 31478 consensus_queue.cc:1048] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:45.676882 30566 catalog_manager.cc:5697] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 1 to 2, leader changed from 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193) to 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194). New cstate: current_term: 2 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:45.678396 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faf21b4ff034e548c19569963419851" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
W20260709 12:21:45.692201 30636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 263067us
I20260709 12:21:45.707897 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faf21b4ff034e548c19569963419851" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:45.709560 30892 raft_consensus.cc:2393] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in current term 1: Already voted for candidate 4a9042c4154c442297159d1c9f1186b9 in this term.
I20260709 12:21:45.733713 30666 raft_consensus.cc:3060] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:45.777436 31492 raft_consensus.cc:493] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.778223 31492 raft_consensus.cc:515] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:45.783506 31492 leader_election.cc:290] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:45.755061 31537 raft_consensus.cc:515] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:45.786299 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bb30237ea045c79aa6eb181bc3e692" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:45.786991 30817 raft_consensus.cc:2468] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 2.
I20260709 12:21:45.788259 30712 leader_election.cc:304] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
I20260709 12:21:45.793552 30941 tablet_bootstrap.cc:492] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4: No bootstrap required, opened a new log
I20260709 12:21:45.795291 30941 ts_tablet_manager.cc:1403] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.223s	user 0.017s	sys 0.005s
W20260709 12:21:45.808831 31578 log.cc:927] Time spent T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:21:45.793417 31548 raft_consensus.cc:2804] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:45.816884 31548 raft_consensus.cc:493] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.817523 31548 raft_consensus.cc:3060] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:45.818239 30817 raft_consensus.cc:1275] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Refusing update from remote peer d3ab9d21f8864b50a71b49c7d624584a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:45.819952 31422 raft_consensus.cc:493] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:45.820523 31422 raft_consensus.cc:515] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:45.824549 31331 consensus_queue.cc:1048] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:45.826885 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006658e1213f4f8da089a9570e0a76b9" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:45.827592 30820 raft_consensus.cc:2468] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 2.
I20260709 12:21:45.828593 31422 leader_election.cc:290] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:45.834208 30860 leader_election.cc:304] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:45.835336 31331 raft_consensus.cc:2804] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:45.835722 31331 raft_consensus.cc:493] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:45.836086 31331 raft_consensus.cc:3060] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:45.837133 31537 leader_election.cc:290] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:45.846093 30667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f3fc82ff104135851cce7357eda3ec" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:45.846251 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f3fc82ff104135851cce7357eda3ec" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:45.846974 30667 raft_consensus.cc:2468] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 2.
I20260709 12:21:45.847025 30819 raft_consensus.cc:3060] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:21:45.868940 30941 raft_consensus.cc:359] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:45.869900 30941 raft_consensus.cc:385] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.870208 30941 raft_consensus.cc:740] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.870915 30941 consensus_queue.cc:260] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:45.873884 30565 catalog_manager.cc:5697] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:45.854797 31331 raft_consensus.cc:515] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:45.881153 31537 raft_consensus.cc:493] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.881771 31331 leader_election.cc:290] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:45.881748 31537 raft_consensus.cc:515] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:45.883121 31548 raft_consensus.cc:515] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:45.885291 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006658e1213f4f8da089a9570e0a76b9" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:45.885824 30670 raft_consensus.cc:1275] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Refusing update from remote peer 4a9042c4154c442297159d1c9f1186b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:45.887247 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f3fc82ff104135851cce7357eda3ec" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:45.887944 30670 raft_consensus.cc:3060] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:45.887320 30667 raft_consensus.cc:1275] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Refusing update from remote peer 4a9042c4154c442297159d1c9f1186b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:45.889077 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bb30237ea045c79aa6eb181bc3e692" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:45.889758 30665 raft_consensus.cc:2468] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 2.
I20260709 12:21:45.890251 30666 raft_consensus.cc:1275] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Refusing update from remote peer d3ab9d21f8864b50a71b49c7d624584a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:45.898645 30817 raft_consensus.cc:2468] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 2.
I20260709 12:21:45.900596 30860 leader_election.cc:304] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:45.895816 30636 leader_election.cc:304] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:45.905579 31331 raft_consensus.cc:493] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.913008 31331 raft_consensus.cc:515] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:45.915207 31331 leader_election.cc:290] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:45.893362 30819 raft_consensus.cc:2468] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 3.
I20260709 12:21:45.916152 31537 leader_election.cc:290] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:45.908910 31408 raft_consensus.cc:3060] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.917331 30712 leader_election.cc:304] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
I20260709 12:21:45.917801 30670 raft_consensus.cc:2468] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 3.
I20260709 12:21:45.919085 31490 raft_consensus.cc:2804] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:45.919649 31490 raft_consensus.cc:697] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [term 3 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:45.920491 31490 consensus_queue.cc:237] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:45.906868 31422 raft_consensus.cc:2804] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:45.922536 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb65e812f06540bc9f1c2b1e3e13d41c" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:45.922962 31422 raft_consensus.cc:697] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a [term 2 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:45.925161 31422 consensus_queue.cc:237] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:45.929054 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e243e0f019f54586877c9a61b2fc83ac" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:45.929742 30817 raft_consensus.cc:2468] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:45.931226 31547 consensus_queue.cc:1048] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:45.933436 30712 leader_election.cc:304] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
I20260709 12:21:45.935063 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bb30237ea045c79aa6eb181bc3e692" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:45.935465 30941 ts_tablet_manager.cc:1434] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.139s	user 0.004s	sys 0.004s
I20260709 12:21:45.935983 30817 raft_consensus.cc:3060] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:45.938126 31492 raft_consensus.cc:2804] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:45.938566 31492 raft_consensus.cc:493] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.938899 31492 raft_consensus.cc:3060] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:45.931223 31548 leader_election.cc:290] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:45.939126 31501 raft_consensus.cc:493] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.939926 31501 raft_consensus.cc:515] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:45.943565 31408 raft_consensus.cc:2749] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:45.949283 31501 leader_election.cc:290] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:45.955677 31501 raft_consensus.cc:493] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.956332 31501 raft_consensus.cc:515] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:45.959225 31501 leader_election.cc:290] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:45.964347 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de462b3788724f21b93b5cbb295c085a" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:45.986048 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a0a060aca4bdf912b9291106aaa74" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:45.970834 30670 raft_consensus.cc:1275] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Refusing update from remote peer d3ab9d21f8864b50a71b49c7d624584a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:45.979600 30817 raft_consensus.cc:2468] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 3.
I20260709 12:21:46.003088 30667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006658e1213f4f8da089a9570e0a76b9" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:46.009135 30667 raft_consensus.cc:2393] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d3ab9d21f8864b50a71b49c7d624584a in current term 2: Already voted for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in this term.
I20260709 12:21:46.000140 30567 catalog_manager.cc:5697] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:46.019632 30712 leader_election.cc:304] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
I20260709 12:21:46.013497 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006658e1213f4f8da089a9570e0a76b9" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:46.025784 30665 raft_consensus.cc:2393] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3ab9d21f8864b50a71b49c7d624584a in current term 2: Already voted for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in this term.
I20260709 12:21:46.027458 31298 raft_consensus.cc:493] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.028249 31298 raft_consensus.cc:515] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:46.030889 31298 leader_election.cc:290] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:46.031533 31298 raft_consensus.cc:2804] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:46.032119 31298 raft_consensus.cc:697] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [term 3 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:46.027895 31487 consensus_queue.cc:1048] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:21:46.035216 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de462b3788724f21b93b5cbb295c085a" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:46.035331 30667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bb30237ea045c79aa6eb181bc3e692" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:46.036000 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a0a060aca4bdf912b9291106aaa74" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:46.019490 31448 consensus_queue.cc:1048] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:21:46.033864 31298 consensus_queue.cc:237] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:46.040220 30665 raft_consensus.cc:3060] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.994067 31422 consensus_queue.cc:1048] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:21:46.046416 31492 raft_consensus.cc:515] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:46.048501 31537 consensus_queue.cc:1048] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:46.036113 30667 raft_consensus.cc:3060] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:46.052696 30617 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:46.055233 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb65e812f06540bc9f1c2b1e3e13d41c" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:46.056027 30671 raft_consensus.cc:2468] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 2.
I20260709 12:21:46.062006 30667 raft_consensus.cc:2468] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 3.
I20260709 12:21:46.065227 30857 leader_election.cc:304] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3
I20260709 12:21:46.066453 31498 raft_consensus.cc:493] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.066995 31527 raft_consensus.cc:2804] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:46.067381 31501 raft_consensus.cc:493] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.067716 31527 raft_consensus.cc:493] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.068136 31527 raft_consensus.cc:3060] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:46.068046 31501 raft_consensus.cc:515] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:46.066769 30663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e243e0f019f54586877c9a61b2fc83ac" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:46.070001 30663 raft_consensus.cc:2468] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 2.
I20260709 12:21:46.066900 30634 leader_election.cc:304] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:46.018728 30567 catalog_manager.cc:5697] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 1 to 2, leader changed from 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194) to 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195). New cstate: current_term: 2 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } }
I20260709 12:21:46.074486 30567 catalog_manager.cc:5697] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 1 to 2, leader changed from 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195) to 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194). New cstate: current_term: 2 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:46.078521 31492 leader_election.cc:290] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:46.075807 30567 catalog_manager.cc:5697] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 2 to 3, leader changed from 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195) to 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194). New cstate: current_term: 3 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:46.081828 30567 catalog_manager.cc:5697] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 1 to 2, leader changed from 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194) to d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196). New cstate: current_term: 2 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } }
I20260709 12:21:46.067179 31498 raft_consensus.cc:515] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:46.072949 31501 leader_election.cc:290] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:46.086714 31478 raft_consensus.cc:2749] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:46.091403 30663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e243e0f019f54586877c9a61b2fc83ac" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:46.118515 31446 raft_consensus.cc:493] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.126456 30663 raft_consensus.cc:3060] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:46.134670 31446 raft_consensus.cc:515] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:46.137161 31446 leader_election.cc:290] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:46.138012 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b26f10a0fb7476098bdb142c864895e" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:46.138790 30737 raft_consensus.cc:2468] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 2.
I20260709 12:21:46.139156 31498 leader_election.cc:290] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:46.140089 30783 leader_election.cc:304] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
I20260709 12:21:46.142023 30887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b26f10a0fb7476098bdb142c864895e" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:46.160879 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:46.166105 30891 raft_consensus.cc:2468] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 2.
W20260709 12:21:46.173708 30712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 154218us
I20260709 12:21:46.176391 30815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61dc8e98f804681b0815e953b2d2ad1" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:46.179843 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e243e0f019f54586877c9a61b2fc83ac" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:46.180495 30817 raft_consensus.cc:3060] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:21:46.142753 30887 raft_consensus.cc:2468] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 2.
I20260709 12:21:46.145247 31446 raft_consensus.cc:2804] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:46.144538 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac2bacfc36f49459fc2b2b2d8afb01d" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:46.145265 30667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61dc8e98f804681b0815e953b2d2ad1" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
W20260709 12:21:46.191828 30634 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 125002us
I20260709 12:21:46.194028 30636 leader_election.cc:304] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:46.197814 30667 raft_consensus.cc:2468] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 2.
I20260709 12:21:46.193182 30819 raft_consensus.cc:2468] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:46.199937 30817 raft_consensus.cc:2468] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 3.
I20260709 12:21:46.198818 30634 leader_election.cc:304] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:46.201351 30709 leader_election.cc:304] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3
I20260709 12:21:46.197032 30663 raft_consensus.cc:2468] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 3.
I20260709 12:21:46.202672 30712 leader_election.cc:304] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
I20260709 12:21:46.203413 31448 raft_consensus.cc:2804] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:46.203624 31502 raft_consensus.cc:2804] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:46.203994 31448 raft_consensus.cc:493] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.204329 31502 raft_consensus.cc:697] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 3 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:46.204581 31448 raft_consensus.cc:3060] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:46.205457 31502 consensus_queue.cc:237] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:46.213994 31478 raft_consensus.cc:2804] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:46.214581 31478 raft_consensus.cc:493] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.214635 31501 raft_consensus.cc:2749] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:46.215130 31478 raft_consensus.cc:3060] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:46.218165 30637 leader_election.cc:304] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:46.188128 31446 raft_consensus.cc:493] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.190160 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:46.222023 31446 raft_consensus.cc:3060] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:46.218169 31548 raft_consensus.cc:493] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.287860 31595 raft_consensus.cc:493] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:46.288817 31595 raft_consensus.cc:515] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:46.292284 31595 leader_election.cc:290] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:46.230014 31482 raft_consensus.cc:493] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
W20260709 12:21:46.283375 31513 log.cc:927] Time spent T 00000000000000000000000000000000 P 17a4fc443d4545efb5ffae32542ddab5: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:21:46.229813 31498 raft_consensus.cc:2804] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:46.257237 30820 raft_consensus.cc:2468] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 2.
I20260709 12:21:46.259573 31506 raft_consensus.cc:493] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.228067 31537 consensus_queue.cc:1048] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.076s
I20260709 12:21:46.308804 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d372d3fc5dd43d1880a4a932c83d7da" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:46.329277 30891 raft_consensus.cc:2468] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 2.
W20260709 12:21:46.299433 30634 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 97571.6us
I20260709 12:21:46.314117 30565 catalog_manager.cc:5697] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a reported cstate change: term changed from 1 to 2, leader changed from 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195) to d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196). New cstate: current_term: 2 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:46.307425 31498 raft_consensus.cc:493] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.297837 31548 raft_consensus.cc:515] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:46.306633 31482 raft_consensus.cc:515] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:46.341547 31498 raft_consensus.cc:3060] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:46.361047 31573 raft_consensus.cc:493] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
W20260709 12:21:46.361444 31594 log.cc:927] Time spent T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:21:46.361755 31573 raft_consensus.cc:515] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
W20260709 12:21:46.361112 31598 log.cc:927] Time spent T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 12:21:46.365919 31587 log.cc:927] Time spent T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 12:21:46.332851 31506 raft_consensus.cc:515] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:46.401932 31548 leader_election.cc:290] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:46.421535 30636 leader_election.cc:304] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:46.427608 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d372d3fc5dd43d1880a4a932c83d7da" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:46.428678 30740 raft_consensus.cc:2393] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in current term 2: Already voted for candidate 4a9042c4154c442297159d1c9f1186b9 in this term.
I20260709 12:21:46.429293 30662 raft_consensus.cc:1275] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Refusing update from remote peer 4a9042c4154c442297159d1c9f1186b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:46.430295 31608 raft_consensus.cc:2804] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:46.430814 31608 raft_consensus.cc:493] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:46.431173 31608 raft_consensus.cc:3060] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:46.431660 30663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac2bacfc36f49459fc2b2b2d8afb01d" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
W20260709 12:21:46.437665 30783 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 58639.8us
I20260709 12:21:46.443742 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac2bacfc36f49459fc2b2b2d8afb01d" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:46.444566 30817 raft_consensus.cc:2468] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
W20260709 12:21:46.471465 31596 log.cc:927] Time spent T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:21:46.486900 30817 raft_consensus.cc:1275] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Refusing update from remote peer d3ab9d21f8864b50a71b49c7d624584a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:46.475273 31446 raft_consensus.cc:515] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:46.524027 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e24a3b2b9d4270a8b8466d3c6313ab" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
W20260709 12:21:46.526633 30712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 55815.2us
I20260709 12:21:46.527680 30712 leader_election.cc:304] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
I20260709 12:21:46.533493 30664 raft_consensus.cc:1275] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Refusing update from remote peer 4a9042c4154c442297159d1c9f1186b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:46.452102 31298 consensus_queue.cc:1048] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
W20260709 12:21:46.535182 30709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 57803.4us
I20260709 12:21:46.448825 31448 raft_consensus.cc:515] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:46.482070 31602 raft_consensus.cc:493] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.540333 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2f4d39a39493b8404958a5aaaa7af" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:46.566041 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e24a3b2b9d4270a8b8466d3c6313ab" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:46.582162 31613 raft_consensus.cc:493] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.582834 31613 raft_consensus.cc:515] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:46.583410 31573 leader_election.cc:290] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
W20260709 12:21:46.585160 31597 log.cc:927] Time spent T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 12:21:46.602278 30637 leader_election.cc:304] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:46.561928 31492 raft_consensus.cc:2804] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:21:46.574457 31601 log.cc:927] Time spent T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
W20260709 12:21:46.609910 30785 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 214105us
I20260709 12:21:46.626852 30665 raft_consensus.cc:1275] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Refusing update from remote peer d3ab9d21f8864b50a71b49c7d624584a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:46.600225 31506 leader_election.cc:290] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:46.607012 31331 raft_consensus.cc:493] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.612875 31492 raft_consensus.cc:493] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.609071 31612 raft_consensus.cc:2749] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:46.609262 31614 raft_consensus.cc:493] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.619588 31490 raft_consensus.cc:493] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:46.651142 31492 raft_consensus.cc:3060] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:46.564857 31602 raft_consensus.cc:515] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:46.609858 31547 consensus_queue.cc:1048] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:21:46.649271 31331 raft_consensus.cc:515] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:46.676853 31625 raft_consensus.cc:493] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:46.683806 30637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 65135.8us
I20260709 12:21:46.641760 31613 leader_election.cc:290] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:46.691835 30817 raft_consensus.cc:2468] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 2.
I20260709 12:21:46.651628 31616 raft_consensus.cc:493] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:46.653275 31615 raft_consensus.cc:493] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.643114 31498 raft_consensus.cc:515] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:46.689074 31611 raft_consensus.cc:493] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:46.692505 31573 raft_consensus.cc:493] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.677904 31490 raft_consensus.cc:515] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:46.709494 31622 raft_consensus.cc:493] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:46.669816 31614 raft_consensus.cc:515] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
W20260709 12:21:46.749194 30857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 96096.6us
W20260709 12:21:46.856083 30860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 105786us
I20260709 12:21:46.739169 31446 leader_election.cc:290] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:46.694514 31625 raft_consensus.cc:515] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:46.752873 31506 raft_consensus.cc:493] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:46.715826 31624 consensus_queue.cc:1048] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.143s
I20260709 12:21:46.745779 31620 raft_consensus.cc:493] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:46.712443 31616 raft_consensus.cc:515] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:46.736683 31573 raft_consensus.cc:515] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:46.890437 30663 raft_consensus.cc:2393] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 in current term 3: Already voted for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in this term.
I20260709 12:21:46.724443 31615 raft_consensus.cc:515] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:46.887583 31448 leader_election.cc:290] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
W20260709 12:21:46.940389 31527 consensus_meta.cc:287] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a: Time spent flushing consensus metadata: real 0.861s	user 0.012s	sys 0.002s
I20260709 12:21:46.734040 31611 raft_consensus.cc:515] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:46.939049 31629 raft_consensus.cc:493] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.000746 30819 raft_consensus.cc:1275] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Refusing update from remote peer 4a9042c4154c442297159d1c9f1186b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:47.005292 30662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61dc8e98f804681b0815e953b2d2ad1" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
W20260709 12:21:46.984920 30634 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 241066us
W20260709 12:21:47.041122 30857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 253669us
I20260709 12:21:46.972028 31612 raft_consensus.cc:493] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.933007 31506 raft_consensus.cc:515] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:46.861897 31622 raft_consensus.cc:515] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:47.040357 30885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b26f10a0fb7476098bdb142c864895e" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:47.046118 31632 raft_consensus.cc:493] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:47.049057 31537 raft_consensus.cc:493] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:47.055851 31547 raft_consensus.cc:493] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.052553 30662 raft_consensus.cc:3060] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.081018 30885 raft_consensus.cc:3060] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.083916 31602 leader_election.cc:290] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
W20260709 12:21:47.084547 31628 log.cc:927] Time spent T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:21:47.085552 31635 raft_consensus.cc:493] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.943336 31620 raft_consensus.cc:515] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:47.086097 31635 raft_consensus.cc:515] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:47.087874 31620 leader_election.cc:290] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:47.088094 31635 leader_election.cc:290] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:47.033401 31527 raft_consensus.cc:515] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:47.089748 31615 leader_election.cc:290] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:47.090492 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b26f10a0fb7476098bdb142c864895e" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:47.091221 30744 raft_consensus.cc:3060] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.091511 31527 leader_election.cc:290] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:47.092240 31527 raft_consensus.cc:493] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.093814 31611 leader_election.cc:290] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:47.094110 31616 leader_election.cc:290] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:47.094810 31616 raft_consensus.cc:493] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.095644 31622 leader_election.cc:290] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:47.097311 31614 leader_election.cc:290] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:47.098074 31490 leader_election.cc:290] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:47.098374 31331 leader_election.cc:290] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:47.100092 31506 leader_election.cc:290] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:47.100759 31632 raft_consensus.cc:515] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:47.053440 31612 raft_consensus.cc:515] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:47.103276 31632 leader_election.cc:290] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:47.103628 31612 leader_election.cc:290] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:47.103950 31547 raft_consensus.cc:515] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:47.103641 31527 raft_consensus.cc:515] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:47.106274 31547 leader_election.cc:290] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
W20260709 12:21:47.107354 31608 consensus_meta.cc:287] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent flushing consensus metadata: real 0.676s	user 0.010s	sys 0.004s
I20260709 12:21:47.084609 31634 raft_consensus.cc:493] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.059278 31481 raft_consensus.cc:493] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.095340 31616 raft_consensus.cc:515] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:47.106444 31527 leader_election.cc:290] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
W20260709 12:21:47.117475 31478 consensus_meta.cc:287] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent flushing consensus metadata: real 0.902s	user 0.010s	sys 0.005s
I20260709 12:21:47.117949 31408 raft_consensus.cc:493] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:47.071448 31631 raft_consensus.cc:493] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.107959 31608 raft_consensus.cc:515] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
W20260709 12:21:47.129274 30857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 84364.6us
I20260709 12:21:47.119630 31602 raft_consensus.cc:493] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.123481 30668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac7c8095aaa457494024d09dfaaf1bb" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:47.107427 30887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda0258f575243bd910da13e828fb6f6" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:47.118716 31408 raft_consensus.cc:515] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:47.057442 31633 consensus_queue.cc:1048] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 12:21:47.043596 31629 raft_consensus.cc:515] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:47.108335 31634 raft_consensus.cc:515] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:47.123973 31498 leader_election.cc:290] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:47.120035 31537 raft_consensus.cc:515] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:47.129113 31631 raft_consensus.cc:515] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:47.147291 31634 leader_election.cc:290] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:47.147712 31537 leader_election.cc:290] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:47.148347 31631 leader_election.cc:290] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:47.152289 31616 leader_election.cc:290] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:47.152999 30887 raft_consensus.cc:2468] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 2.
I20260709 12:21:47.154402 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f2ae9f62734cf59b3d5477d92760cb" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:47.155196 30671 raft_consensus.cc:2468] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 2.
I20260709 12:21:47.157111 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2f4d39a39493b8404958a5aaaa7af" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:47.158129 30669 raft_consensus.cc:2468] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:47.165016 30667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb65e812f06540bc9f1c2b1e3e13d41c" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:47.165865 30667 raft_consensus.cc:3060] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.166666 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda0258f575243bd910da13e828fb6f6" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:47.167632 30742 raft_consensus.cc:2468] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:47.170049 31608 leader_election.cc:290] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:47.171828 31625 leader_election.cc:290] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:47.171969 30637 leader_election.cc:304] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:47.141461 30666 raft_consensus.cc:1275] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Refusing update from remote peer 4a9042c4154c442297159d1c9f1186b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:47.125752 30815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:47.182296 31638 raft_consensus.cc:2804] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:47.182462 30815 raft_consensus.cc:2468] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 1.
I20260709 12:21:47.182871 31638 raft_consensus.cc:493] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:47.183303 31638 raft_consensus.cc:3060] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:47.184474 30637 leader_election.cc:304] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:47.119367 31481 raft_consensus.cc:515] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:47.186975 31642 raft_consensus.cc:2804] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:47.187383 31642 raft_consensus.cc:493] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.187649 31481 leader_election.cc:290] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:47.189159 30811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac2bacfc36f49459fc2b2b2d8afb01d" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:47.190019 30811 raft_consensus.cc:3060] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.193452 30663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:47.194231 31629 leader_election.cc:290] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:47.196575 31638 raft_consensus.cc:515] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:47.140563 31602 raft_consensus.cc:515] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:47.199775 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2f4d39a39493b8404958a5aaaa7af" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:47.200850 30668 raft_consensus.cc:2393] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 in current term 2: Already voted for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in this term.
W20260709 12:21:47.142053 30712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 131065us
I20260709 12:21:47.117952 31478 raft_consensus.cc:515] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:47.223444 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a02078ac834032ac607943e7b3d175" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:47.224303 31502 raft_consensus.cc:493] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:47.224129 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac7c8095aaa457494024d09dfaaf1bb" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:47.224691 30740 raft_consensus.cc:2393] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3ab9d21f8864b50a71b49c7d624584a in current term 2: Already voted for candidate 4a9042c4154c442297159d1c9f1186b9 in this term.
I20260709 12:21:47.225107 30746 raft_consensus.cc:2468] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:47.224983 31502 raft_consensus.cc:515] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:47.226392 31638 leader_election.cc:290] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:47.227087 31502 leader_election.cc:290] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:47.228031 30817 raft_consensus.cc:2468] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 2.
I20260709 12:21:47.229480 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44af5a494fec45679774bc9eb1007f9b" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:47.229665 30637 leader_election.cc:304] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:47.230165 30857 leader_election.cc:304] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:47.230521 31638 raft_consensus.cc:2804] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:47.231122 31638 raft_consensus.cc:697] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:21:47.231583 31544 raft_consensus.cc:2804] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:47.232133 31544 raft_consensus.cc:493] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.232824 31544 raft_consensus.cc:3060] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.232065 31638 consensus_queue.cc:237] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:47.233059 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb4b46162a04eeda49624c82070758e" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:47.230186 30738 raft_consensus.cc:2468] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:47.233771 30741 raft_consensus.cc:2468] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:47.240899 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac7c8095aaa457494024d09dfaaf1bb" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:47.241703 30665 raft_consensus.cc:2468] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 2.
I20260709 12:21:47.242079 31544 raft_consensus.cc:515] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:47.247685 30857 leader_election.cc:304] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:47.248862 31422 raft_consensus.cc:2804] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:47.249361 31422 raft_consensus.cc:493] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.249770 31422 raft_consensus.cc:3060] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.252034 31573 leader_election.cc:290] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:47.201772 31602 leader_election.cc:290] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:47.253221 30815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006658e1213f4f8da089a9570e0a76b9" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:47.187719 31642 raft_consensus.cc:3060] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.156520 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ccb8b23d8455a990ef1cb50271887" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
W20260709 12:21:47.232098 31492 consensus_meta.cc:287] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9: Time spent flushing consensus metadata: real 0.544s	user 0.012s	sys 0.000s
I20260709 12:21:47.260432 31422 raft_consensus.cc:515] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:47.277309 31637 raft_consensus.cc:493] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:47.272465 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac7c8095aaa457494024d09dfaaf1bb" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:47.278265 30812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb65e812f06540bc9f1c2b1e3e13d41c" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:47.279009 30815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:47.278271 31602 raft_consensus.cc:493] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.281831 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a02078ac834032ac607943e7b3d175" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:47.282369 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f2ae9f62734cf59b3d5477d92760cb" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:47.283517 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4326b71a8ff545259df55b4ab0564f48" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:47.286258 30814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44af5a494fec45679774bc9eb1007f9b" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:47.295979 30565 catalog_manager.cc:5697] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a reported cstate change: term changed from 1 to 2, leader changed from 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195) to d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196). New cstate: current_term: 2 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:47.313865 30816 raft_consensus.cc:2468] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:47.316478 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ccb8b23d8455a990ef1cb50271887" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:47.319377 30860 leader_election.cc:304] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:47.319612 30818 raft_consensus.cc:2468] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 2.
W20260709 12:21:47.320045 30711 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.015s	sys 0.025s
W20260709 12:21:47.320354 30711 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.015s	sys 0.025s
I20260709 12:21:47.294411 30567 catalog_manager.cc:5697] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:47.320652 30711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 692370us
I20260709 12:21:47.321427 30567 catalog_manager.cc:5697] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:47.269879 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4326b71a8ff545259df55b4ab0564f48" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:47.300612 30817 raft_consensus.cc:2468] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 2.
I20260709 12:21:47.276497 30671 raft_consensus.cc:2468] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:47.330317 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2f4d39a39493b8404958a5aaaa7af" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:47.331182 30816 raft_consensus.cc:2468] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 2.
I20260709 12:21:47.298858 31637 raft_consensus.cc:515] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:47.334868 31487 raft_consensus.cc:493] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.335125 31637 leader_election.cc:290] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:47.337901 30567 catalog_manager.cc:5697] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:47.300781 30665 raft_consensus.cc:3060] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.335427 31487 raft_consensus.cc:515] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:47.314867 30812 raft_consensus.cc:3060] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.357314 31482 leader_election.cc:290] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:47.358539 30889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda0258f575243bd910da13e828fb6f6" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:47.359440 30889 raft_consensus.cc:2393] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 in current term 2: Already voted for candidate d3ab9d21f8864b50a71b49c7d624584a in this term.
I20260709 12:21:47.356981 31621 raft_consensus.cc:493] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.360870 31621 raft_consensus.cc:515] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:47.361128 30888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44af5a494fec45679774bc9eb1007f9b" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:47.362244 30888 raft_consensus.cc:2368] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 for earlier term 2. Current term is 3.
I20260709 12:21:47.363281 31621 leader_election.cc:290] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:47.318499 30815 raft_consensus.cc:2468] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:47.329072 31616 raft_consensus.cc:2804] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:47.368486 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99734494b57424691503918c73f294e" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:47.369167 31616 raft_consensus.cc:493] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.369815 31616 raft_consensus.cc:3060] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.370980 31478 leader_election.cc:290] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:47.371810 30815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:47.372545 30815 raft_consensus.cc:3060] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.291913 31492 raft_consensus.cc:515] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:47.356765 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99734494b57424691503918c73f294e" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:47.356823 30890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a02078ac834032ac607943e7b3d175" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:47.339469 31624 raft_consensus.cc:493] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:47.375061 30890 raft_consensus.cc:2468] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:47.356878 30569 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36728 (request call id 88) took 2057 ms. Trace:
I20260709 12:21:47.357276 30885 raft_consensus.cc:2468] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 3.
I20260709 12:21:47.376013 30569 rpcz_store.cc:276] 0709 12:21:45.245271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.268613 (+ 23342us) service_pool.cc:224] Handling call
0709 12:21:47.299221 (+2030608us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72499,"reported_tablets":6}
I20260709 12:21:47.375584 31624 raft_consensus.cc:515] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:47.375607 30739 raft_consensus.cc:2468] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 2.
I20260709 12:21:47.318104 30820 raft_consensus.cc:2468] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 2.
I20260709 12:21:47.318065 31602 raft_consensus.cc:515] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:47.393147 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac7c8095aaa457494024d09dfaaf1bb" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:47.395251 30891 raft_consensus.cc:2368] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 for earlier term 2. Current term is 3.
I20260709 12:21:47.400792 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb4b46162a04eeda49624c82070758e" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:47.401513 30892 raft_consensus.cc:2468] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 2.
I20260709 12:21:47.396294 31492 leader_election.cc:290] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:47.419541 30860 leader_election.cc:304] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:47.340497 31642 raft_consensus.cc:515] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:47.440444 31487 leader_election.cc:290] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:47.442688 31642 leader_election.cc:290] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:47.443161 30663 raft_consensus.cc:2393] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3ab9d21f8864b50a71b49c7d624584a in current term 3: Already voted for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in this term.
I20260709 12:21:47.445303 31624 leader_election.cc:290] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:47.447392 31602 leader_election.cc:290] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:47.449146 30889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f2ae9f62734cf59b3d5477d92760cb" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:47.449859 30889 raft_consensus.cc:2468] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 2.
I20260709 12:21:47.450415 30662 raft_consensus.cc:2468] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 3.
I20260709 12:21:47.424484 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac7c8095aaa457494024d09dfaaf1bb" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:47.450871 30889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb65e812f06540bc9f1c2b1e3e13d41c" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:47.451428 30741 raft_consensus.cc:3060] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.451890 30889 raft_consensus.cc:2393] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c7a0cd21c3449587fdeeff565557d3 in current term 3: Already voted for candidate d3ab9d21f8864b50a71b49c7d624584a in this term.
I20260709 12:21:47.456915 30857 leader_election.cc:304] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:47.457875 30857 leader_election.cc:304] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:47.458247 31629 raft_consensus.cc:2804] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:47.458725 31629 raft_consensus.cc:493] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.458914 31607 raft_consensus.cc:2804] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:47.459229 31629 raft_consensus.cc:3060] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.459532 31607 raft_consensus.cc:493] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.423048 30814 raft_consensus.cc:2468] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 2.
I20260709 12:21:47.397015 30890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2f4d39a39493b8404958a5aaaa7af" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:47.430999 30888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb4b46162a04eeda49624c82070758e" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:47.464092 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4326b71a8ff545259df55b4ab0564f48" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:47.464376 30888 raft_consensus.cc:2393] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 in current term 2: Already voted for candidate d3ab9d21f8864b50a71b49c7d624584a in this term.
I20260709 12:21:47.465457 30888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ccb8b23d8455a990ef1cb50271887" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:47.398910 31544 leader_election.cc:290] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:47.466076 30888 raft_consensus.cc:2468] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 2.
I20260709 12:21:47.467061 30888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:47.427191 30711 leader_election.cc:400] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441) with higher term. Message: Invalid argument: T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 for earlier term 2. Current term is 3.
I20260709 12:21:47.474565 30711 leader_election.cc:403] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:47.427831 30667 raft_consensus.cc:2468] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 3.
I20260709 12:21:47.409711 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ccb8b23d8455a990ef1cb50271887" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:47.433620 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a02078ac834032ac607943e7b3d175" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:47.479426 31544 raft_consensus.cc:2804] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:47.480697 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac2bacfc36f49459fc2b2b2d8afb01d" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:47.481041 31544 raft_consensus.cc:493] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.481393 31544 raft_consensus.cc:3060] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.481539 30746 raft_consensus.cc:2393] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in current term 3: Already voted for candidate 4a9042c4154c442297159d1c9f1186b9 in this term.
I20260709 12:21:47.483639 31422 leader_election.cc:290] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:47.479794 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2f4d39a39493b8404958a5aaaa7af" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:47.485587 30886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 228) took 1006 ms. Trace:
I20260709 12:21:47.485935 30886 rpcz_store.cc:276] 0709 12:21:46.478996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.482475 (+  3479us) service_pool.cc:224] Handling call
0709 12:21:47.479626 (+997151us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b5800134d98. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c3120a0 00007f4a9c311984 00007f4a9588c6d4 00007f4a9588c662
0709 12:21:47.485465 (+  5839us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27458304}
I20260709 12:21:47.460076 31607 raft_consensus.cc:3060] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.469678 31648 raft_consensus.cc:493] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:47.487308 31648 raft_consensus.cc:515] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:47.489552 31648 leader_election.cc:290] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:47.479859 30819 raft_consensus.cc:2393] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in current term 2: Already voted for candidate 20c7a0cd21c3449587fdeeff565557d3 in this term.
I20260709 12:21:47.480135 30892 raft_consensus.cc:2468] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:47.492734 30744 raft_consensus.cc:2468] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 3.
I20260709 12:21:47.479362 30889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4326b71a8ff545259df55b4ab0564f48" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:47.496330 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac2bacfc36f49459fc2b2b2d8afb01d" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:47.425519 30785 leader_election.cc:304] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:47.497588 30737 raft_consensus.cc:2393] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in current term 3: Already voted for candidate 4a9042c4154c442297159d1c9f1186b9 in this term.
I20260709 12:21:47.498418 30737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46508 (request call id 212) took 1166 ms. Trace:
I20260709 12:21:47.498468 31446 raft_consensus.cc:2804] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:47.499075 31446 raft_consensus.cc:493] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.499213 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac7c8095aaa457494024d09dfaaf1bb" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:47.499683 31446 raft_consensus.cc:3060] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.477682 31537 consensus_queue.cc:1048] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:21:47.423656 31408 leader_election.cc:290] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:47.501075 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d372d3fc5dd43d1880a4a932c83d7da" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:47.472124 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:47.501935 30745 raft_consensus.cc:2393] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in current term 2: Already voted for candidate 4a9042c4154c442297159d1c9f1186b9 in this term.
I20260709 12:21:47.502137 30820 raft_consensus.cc:3060] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.444255 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffb9d78e773452ab44ae35b5d65fdb2" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:47.458777 30811 raft_consensus.cc:2468] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 3.
I20260709 12:21:47.505307 30857 leader_election.cc:304] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:47.499745 30665 raft_consensus.cc:2468] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 3.
I20260709 12:21:47.506664 30857 leader_election.cc:304] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:47.507566 31616 raft_consensus.cc:515] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
W20260709 12:21:47.497691 30785 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 72251.1us
I20260709 12:21:47.444350 30812 raft_consensus.cc:2468] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 3.
I20260709 12:21:47.470643 31647 raft_consensus.cc:493] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:47.509229 30893 raft_consensus.cc:2393] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 in current term 3: Already voted for candidate d3ab9d21f8864b50a71b49c7d624584a in this term.
I20260709 12:21:47.510360 31647 raft_consensus.cc:515] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:47.509737 31623 raft_consensus.cc:3060] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:21:47.508962 30711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 89574.1us
I20260709 12:21:47.512995 30711 leader_election.cc:304] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:47.513881 30711 leader_election.cc:400] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441) with higher term. Message: Invalid argument: T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 for earlier term 2. Current term is 3.
I20260709 12:21:47.514153 30711 leader_election.cc:403] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:47.515805 31298 raft_consensus.cc:2804] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:47.516172 31298 raft_consensus.cc:493] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.516486 31298 raft_consensus.cc:3060] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.517318 31647 leader_election.cc:290] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:47.509837 30785 leader_election.cc:304] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:47.497929 30888 raft_consensus.cc:2468] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 2.
I20260709 12:21:47.519392 31605 raft_consensus.cc:2804] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:47.519946 31605 raft_consensus.cc:697] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [term 3 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:47.520982 30637 leader_election.cc:304] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:47.520807 31605 consensus_queue.cc:237] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:47.518357 30815 raft_consensus.cc:2468] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 3.
I20260709 12:21:47.522629 31630 raft_consensus.cc:2804] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:47.522835 31629 raft_consensus.cc:515] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:47.519402 30785 leader_election.cc:304] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:47.524839 31648 raft_consensus.cc:2804] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:47.525058 31629 leader_election.cc:290] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:47.525242 31648 raft_consensus.cc:493] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.526990 30637 leader_election.cc:304] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
W20260709 12:21:47.475605 30860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 56159.1us
I20260709 12:21:47.535238 30860 leader_election.cc:304] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:47.525739 31648 raft_consensus.cc:3060] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.537539 30709 leader_election.cc:304] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:47.533069 30785 leader_election.cc:304] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
W20260709 12:21:47.420179 30783 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 393839us
I20260709 12:21:47.542109 31633 raft_consensus.cc:2749] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:47.547616 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:47.548166 30857 leader_election.cc:304] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:47.498931 30737 rpcz_store.cc:276] 0709 12:21:46.332491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.333905 (+  1414us) service_pool.cc:224] Handling call
0709 12:21:47.268543 (+934638us) spinlock_profiling.cc:243] Waited 5.87 ms on lock 0x7b5800103898. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227e9c 00007f4a94227a5b 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c3120a0 00007f4a9c311984 00007f4a9588c6d4 00007f4a9588c662
0709 12:21:47.496205 (+227662us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b5800103898. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227eee 000000000036eb39 00007f4a9c29b1e0 00007f4a9c3640c4 00007f4a9c364131 00007f4a9c3120a0 00007f4a9c311984 00007f4a9588c6d4 00007f4a9588c662
0709 12:21:47.498336 (+  2131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22273280}
I20260709 12:21:47.544386 31629 raft_consensus.cc:493] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:47.509863 31616 leader_election.cc:290] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:47.577216 31629 raft_consensus.cc:515] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:47.577986 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d372d3fc5dd43d1880a4a932c83d7da" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:47.578755 30671 raft_consensus.cc:2468] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 2.
I20260709 12:21:47.579196 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4326b71a8ff545259df55b4ab0564f48" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:47.579653 31629 leader_election.cc:290] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:47.579790 30671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61dc8e98f804681b0815e953b2d2ad1" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:47.525111 31544 raft_consensus.cc:515] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:47.557204 30785 leader_election.cc:304] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:47.550148 31537 raft_consensus.cc:2804] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:47.582445 31544 leader_election.cc:290] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:47.584779 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44af5a494fec45679774bc9eb1007f9b" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:47.555739 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f2ae9f62734cf59b3d5477d92760cb" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:47.585762 30670 raft_consensus.cc:3060] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.538506 31630 raft_consensus.cc:697] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:21:47.587426 30663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac2bacfc36f49459fc2b2b2d8afb01d" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:47.588033 31630 consensus_queue.cc:237] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:47.588954 30663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb65e812f06540bc9f1c2b1e3e13d41c" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:47.544756 31647 raft_consensus.cc:493] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:47.590411 31647 raft_consensus.cc:515] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:47.544942 31422 raft_consensus.cc:2804] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:47.591557 31422 raft_consensus.cc:697] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [term 3 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:47.592458 31422 consensus_queue.cc:237] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:47.593020 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4326b71a8ff545259df55b4ab0564f48" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:47.580708 31602 raft_consensus.cc:2804] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:47.562107 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a02078ac834032ac607943e7b3d175" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:47.594249 31602 raft_consensus.cc:493] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.577517 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5d808cf6da46a0894e888635591cc8" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:47.594659 31602 raft_consensus.cc:3060] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.589690 31639 raft_consensus.cc:2804] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:47.595518 31639 raft_consensus.cc:697] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [term 3 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:47.596022 31634 raft_consensus.cc:493] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:47.580366 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5d808cf6da46a0894e888635591cc8" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:47.596680 31634 raft_consensus.cc:515] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
W20260709 12:21:47.598790 30860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 63662.9us
I20260709 12:21:47.599797 30709 leader_election.cc:304] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:47.568555 30743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44af5a494fec45679774bc9eb1007f9b" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:47.599749 30860 leader_election.cc:304] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:47.545332 31573 raft_consensus.cc:2804] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:21:47.602470 30857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 45646.2us
I20260709 12:21:47.538826 31624 raft_consensus.cc:493] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:47.597564 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2f4d39a39493b8404958a5aaaa7af" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:47.589759 30663 raft_consensus.cc:2393] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c7a0cd21c3449587fdeeff565557d3 in current term 3: Already voted for candidate d3ab9d21f8864b50a71b49c7d624584a in this term.
W20260709 12:21:47.610857 30785 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 53711.2us
I20260709 12:21:47.613397 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7695652594064f568b2df572cb76e12a" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:47.613459 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e946ad6dd9cb42ad93987cebde13ba9a" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:47.618238 30785 leader_election.cc:304] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:47.592397 31647 leader_election.cc:290] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:47.613965 31650 raft_consensus.cc:2804] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:47.618660 31624 raft_consensus.cc:515] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:47.621269 30669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ccb8b23d8455a990ef1cb50271887" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:47.646242 30669 raft_consensus.cc:3060] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.623045 30663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7695652594064f568b2df572cb76e12a" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:47.619611 30670 raft_consensus.cc:2468] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 3.
I20260709 12:21:47.622709 30785 leader_election.cc:304] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:47.601751 31627 raft_consensus.cc:493] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:47.624329 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61dc8e98f804681b0815e953b2d2ad1" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:47.624778 31443 raft_consensus.cc:2804] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:47.603542 31570 consensus_queue.cc:1048] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:21:47.604064 31537 raft_consensus.cc:697] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 3 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:47.737680 31537 consensus_queue.cc:237] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:47.608809 31629 raft_consensus.cc:2804] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:47.579810 30739 raft_consensus.cc:3060] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.634752 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f2ae9f62734cf59b3d5477d92760cb" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:47.635874 30741 raft_consensus.cc:2468] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 3.
I20260709 12:21:47.617484 30671 raft_consensus.cc:2368] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c7a0cd21c3449587fdeeff565557d3 for earlier term 2. Current term is 3.
I20260709 12:21:47.608906 31298 raft_consensus.cc:515] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:47.617525 31573 raft_consensus.cc:697] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:21:47.657088 30666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ccb8b23d8455a990ef1cb50271887" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:47.659547 30670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
W20260709 12:21:47.661736 30860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 61683.3us
W20260709 12:21:47.726742 30783 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 121146us
I20260709 12:21:47.741078 31652 raft_consensus.cc:493] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.757202 30670 raft_consensus.cc:2368] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c7a0cd21c3449587fdeeff565557d3 for earlier term 2. Current term is 3.
W20260709 12:21:47.736312 30709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 79069.5us
I20260709 12:21:47.658597 31650 raft_consensus.cc:493] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.742796 31629 raft_consensus.cc:493] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:47.686690 31443 raft_consensus.cc:493] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.628378 31607 raft_consensus.cc:515] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:47.720531 31331 raft_consensus.cc:2804] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:47.727062 31638 raft_consensus.cc:493] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
W20260709 12:21:47.730410 30785 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 107766us
I20260709 12:21:47.596493 31639 consensus_queue.cc:237] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:47.761656 30783 leader_election.cc:304] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:47.735337 30857 leader_election.cc:304] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:47.660651 31615 raft_consensus.cc:2804] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:47.768735 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44af5a494fec45679774bc9eb1007f9b" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:47.685806 31446 raft_consensus.cc:515] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:47.772032 30742 raft_consensus.cc:2393] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c7a0cd21c3449587fdeeff565557d3 in current term 3: Already voted for candidate 4a9042c4154c442297159d1c9f1186b9 in this term.
I20260709 12:21:47.754396 31548 raft_consensus.cc:2749] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441) with higher term. Message: Invalid argument: T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 for earlier term 2. Current term is 3.
W20260709 12:21:47.823911 30783 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 62327.3us
I20260709 12:21:47.824095 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:47.794595 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac7c8095aaa457494024d09dfaaf1bb" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:47.804155 30816 raft_consensus.cc:3060] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.767110 31634 leader_election.cc:290] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:47.747318 31627 raft_consensus.cc:515] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:47.766919 30820 raft_consensus.cc:2468] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 3.
I20260709 12:21:47.776501 30665 raft_consensus.cc:2393] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c7a0cd21c3449587fdeeff565557d3 in current term 3: Already voted for candidate d3ab9d21f8864b50a71b49c7d624584a in this term.
I20260709 12:21:47.834149 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:47.773340 31443 raft_consensus.cc:3060] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.833449 30885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d372d3fc5dd43d1880a4a932c83d7da" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:47.884387 30816 raft_consensus.cc:2468] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 3.
W20260709 12:21:47.836534 30857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 101282us
I20260709 12:21:47.775924 31331 raft_consensus.cc:493] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.841794 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d372d3fc5dd43d1880a4a932c83d7da" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:47.827378 31539 raft_consensus.cc:2749] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:47.836599 30783 leader_election.cc:400] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953) with higher term. Message: Invalid argument: T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c7a0cd21c3449587fdeeff565557d3 for earlier term 2. Current term is 3.
W20260709 12:21:47.899309 30783 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 73937.5us
I20260709 12:21:47.901300 30783 leader_election.cc:400] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953) with higher term. Message: Invalid argument: T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c7a0cd21c3449587fdeeff565557d3 for earlier term 2. Current term is 3.
I20260709 12:21:47.901681 30783 leader_election.cc:403] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:47.896086 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be8d04f2ad34fd5b7c66aa68c8fa47a" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:47.846998 31647 raft_consensus.cc:2804] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:47.771687 31650 raft_consensus.cc:3060] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.841233 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f2ae9f62734cf59b3d5477d92760cb" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
W20260709 12:21:47.861410 31658 log.cc:927] Time spent T 00000000000000000000000000000000 P 17a4fc443d4545efb5ffae32542ddab5: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 12:21:47.838362 31631 raft_consensus.cc:2764] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:21:47.867061 31573 consensus_queue.cc:237] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:47.868010 30814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ccb8b23d8455a990ef1cb50271887" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:47.873235 31607 leader_election.cc:290] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:47.873839 30890 raft_consensus.cc:2393] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c7a0cd21c3449587fdeeff565557d3 in current term 3: Already voted for candidate d3ab9d21f8864b50a71b49c7d624584a in this term.
I20260709 12:21:47.873538 30663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be8d04f2ad34fd5b7c66aa68c8fa47a" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" is_pre_election: true
I20260709 12:21:47.805480 31638 raft_consensus.cc:515] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:47.876006 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4326b71a8ff545259df55b4ab0564f48" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:47.904595 30888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439d52649ecc46e58d714b9351576dd5" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:47.878445 31627 leader_election.cc:290] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:47.879801 23151 tablet_server.cc:179] TabletServer@127.22.155.193:0 shutting down...
I20260709 12:21:47.770496 31652 raft_consensus.cc:515] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:47.825623 31615 raft_consensus.cc:493] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.772791 31629 raft_consensus.cc:3060] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:47.890385 30637 leader_election.cc:304] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:21:47.893685 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcceeadce924e3493e4e91cb49e2f2e" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:47.915531 30667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2f4d39a39493b8404958a5aaaa7af" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
I20260709 12:21:47.897153 31331 raft_consensus.cc:3060] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:47.920449 30709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 142061us
I20260709 12:21:47.929702 30817 raft_consensus.cc:3060] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.877439 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44af5a494fec45679774bc9eb1007f9b" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:47.945562 30893 raft_consensus.cc:2393] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c7a0cd21c3449587fdeeff565557d3 in current term 3: Already voted for candidate d3ab9d21f8864b50a71b49c7d624584a in this term.
I20260709 12:21:47.945506 30783 leader_election.cc:304] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:47.931813 30892 raft_consensus.cc:2468] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 2.
I20260709 12:21:47.909924 30815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e946ad6dd9cb42ad93987cebde13ba9a" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:47.939071 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac2bacfc36f49459fc2b2b2d8afb01d" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:47.951139 30816 raft_consensus.cc:2393] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 in current term 3: Already voted for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in this term.
I20260709 12:21:47.918926 31539 raft_consensus.cc:3060] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:21:47.943368 30637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 53042.3us
I20260709 12:21:47.954663 30860 leader_election.cc:304] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:47.907007 31648 raft_consensus.cc:515] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:47.961374 30817 raft_consensus.cc:2468] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 3.
I20260709 12:21:47.961656 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:47.953838 30636 leader_election.cc:304] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:47.927376 30887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006658e1213f4f8da089a9570e0a76b9" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
W20260709 12:21:47.966662 30857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 75882.9us
I20260709 12:21:47.967401 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcceeadce924e3493e4e91cb49e2f2e" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:47.983402 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ccb8b23d8455a990ef1cb50271887" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:47.983549 30857 leader_election.cc:304] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:47.984175 30892 raft_consensus.cc:2368] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 for earlier term 2. Current term is 3.
I20260709 12:21:47.967594 30783 leader_election.cc:304] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:47.967763 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda0258f575243bd910da13e828fb6f6" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:47.969046 31446 leader_election.cc:290] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:47.969558 30885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:47.989451 30669 raft_consensus.cc:2468] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 3.
I20260709 12:21:47.971565 31443 raft_consensus.cc:515] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:47.943363 31615 raft_consensus.cc:3060] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.974222 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439d52649ecc46e58d714b9351576dd5" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:47.944607 31610 raft_consensus.cc:493] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:47.937170 31624 leader_election.cc:290] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:47.963157 31602 raft_consensus.cc:515] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:47.977177 31605 raft_consensus.cc:2749] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:47.977200 30813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48396 (request call id 224) took 1226 ms. Trace:
I20260709 12:21:48.013257 30813 rpcz_store.cc:276] 0709 12:21:46.750519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.004452 (+253933us) service_pool.cc:224] Handling call
0709 12:21:47.004921 (+   469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:47.389381 (+384460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:47.389413 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:47.418507 (+ 29094us) log.cc:844] Serialized 26 byte log entry
0709 12:21:47.742860 (+324353us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:47.746032 (+  3172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:47.753183 (+  7151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:47.976967 (+223784us) raft_consensus.cc:1685] finished
0709 12:21:47.976993 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:47.977132 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20314,"raft.queue_time_us":40506,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":9200,"thread_start_us":605785,"threads_started":2,"wal-append.queue_time_us":469842}
I20260709 12:21:48.015578 30813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44af5a494fec45679774bc9eb1007f9b" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:48.016433 30813 raft_consensus.cc:2368] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 for earlier term 2. Current term is 3.
I20260709 12:21:47.977924 30811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffb9d78e773452ab44ae35b5d65fdb2" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:48.017601 30811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c148832de74745608d983f2184cbf23f" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:48.018745 30811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2f4d39a39493b8404958a5aaaa7af" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:48.018847 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4326b71a8ff545259df55b4ab0564f48" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:48.019650 30820 raft_consensus.cc:2393] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 in current term 3: Already voted for candidate d3ab9d21f8864b50a71b49c7d624584a in this term.
I20260709 12:21:48.019908 30811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb4b46162a04eeda49624c82070758e" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:47.966136 30889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2f4d39a39493b8404958a5aaaa7af" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:47.941792 31647 raft_consensus.cc:697] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [term 3 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:47.986481 30817 raft_consensus.cc:2368] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 for earlier term 2. Current term is 3.
I20260709 12:21:47.986482 30783 leader_election.cc:304] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:47.970266 31638 leader_election.cc:290] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:47.992929 30888 raft_consensus.cc:1240] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Rejecting Update request from peer 4e9c812ece8a42efa063dc7bd5ea25e4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:47.993448 30885 raft_consensus.cc:3060] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.994082 30739 raft_consensus.cc:2468] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 3.
I20260709 12:21:47.980898 30812 raft_consensus.cc:1275] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:48.022858 30811 raft_consensus.cc:2368] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 for earlier term 2. Current term is 3.
I20260709 12:21:48.034029 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a02078ac834032ac607943e7b3d175" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:47.998742 30636 leader_election.cc:304] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:47.950270 31627 raft_consensus.cc:2804] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:21:47.987207 30709 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
I20260709 12:21:48.000845 31544 raft_consensus.cc:2749] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:48.002036 31547 raft_consensus.cc:2749] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:48.003165 30857 leader_election.cc:304] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:47.995587 31626 raft_consensus.cc:2749] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:21:48.004742 30860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 50004us
I20260709 12:21:48.007546 31652 leader_election.cc:290] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:47.978778 31623 raft_consensus.cc:2749] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441) with higher term. Message: Invalid argument: T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 for earlier term 2. Current term is 3.
I20260709 12:21:48.020424 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a02078ac834032ac607943e7b3d175" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:48.047855 30857 leader_election.cc:304] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:47.988855 31595 raft_consensus.cc:2749] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:48.029228 31446 raft_consensus.cc:2749] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:48.028467 30815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:48.036067 30712 leader_election.cc:304] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:48.049512 30819 raft_consensus.cc:2393] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3ab9d21f8864b50a71b49c7d624584a in current term 3: Already voted for candidate 20c7a0cd21c3449587fdeeff565557d3 in this term.
I20260709 12:21:48.066708 30636 leader_election.cc:400] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Vote denied by peer d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441) with higher term. Message: Invalid argument: T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 for earlier term 2. Current term is 3.
I20260709 12:21:48.067322 30636 leader_election.cc:403] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:48.040998 31498 raft_consensus.cc:2804] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:48.023321 31610 raft_consensus.cc:515] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:48.049640 31607 raft_consensus.cc:2749] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:48.061729 31625 raft_consensus.cc:493] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.052762 31627 raft_consensus.cc:697] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:21:48.065266 31422 raft_consensus.cc:2804] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:48.065521 31492 raft_consensus.cc:2749] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:48.062350 31602 leader_election.cc:290] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:48.066891 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f3fc82ff104135851cce7357eda3ec" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:48.078703 31625 raft_consensus.cc:515] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:48.084990 30815 raft_consensus.cc:1275] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Refusing update from remote peer 4a9042c4154c442297159d1c9f1186b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:48.085970 31422 raft_consensus.cc:697] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 3 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:48.041880 31647 consensus_queue.cc:237] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:48.074018 31595 raft_consensus.cc:2749] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441) with higher term. Message: Invalid argument: T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 for earlier term 2. Current term is 3.
I20260709 12:21:48.087514 31627 consensus_queue.cc:237] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:48.102020 31648 leader_election.cc:290] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:48.102440 31422 consensus_queue.cc:237] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:48.075590 31498 raft_consensus.cc:697] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
W20260709 12:21:48.120193 31659 log.cc:927] Time spent T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a: Append to log took a long time: real 0.146s	user 0.003s	sys 0.000s
I20260709 12:21:48.056201 30860 leader_election.cc:304] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:48.128334 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda0258f575243bd910da13e828fb6f6" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:48.129364 30893 raft_consensus.cc:3060] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:48.128343 30860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 72278.9us
I20260709 12:21:48.138823 31547 raft_consensus.cc:493] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:48.144515 30860 leader_election.cc:304] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:48.148855 31547 raft_consensus.cc:515] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:48.152169 31607 raft_consensus.cc:2804] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:48.152822 31607 raft_consensus.cc:697] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [term 3 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:48.153429 30887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:48.154019 31607 consensus_queue.cc:237] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:48.157923 30860 leader_election.cc:304] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
W20260709 12:21:48.165118 31657 log.cc:927] Time spent T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 12:21:48.174289 31298 leader_election.cc:290] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:48.166893 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda0258f575243bd910da13e828fb6f6" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:48.195760 30785 leader_election.cc:304] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
W20260709 12:21:48.195632 30712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 159677us
W20260709 12:21:48.194654 30636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 129137us
I20260709 12:21:48.201995 30636 leader_election.cc:304] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:48.202991 30636 leader_election.cc:304] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:48.208304 30860 leader_election.cc:304] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:48.142357 31640 raft_consensus.cc:2804] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:48.214608 30712 leader_election.cc:304] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:48.206576 30746 raft_consensus.cc:3060] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:21:48.216805 31298 raft_consensus.cc:2749] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:48.215114 31527 raft_consensus.cc:2749] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:48.219581 31615 raft_consensus.cc:515] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:48.220878 30816 raft_consensus.cc:2393] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 in current term 3: Already voted for candidate 20c7a0cd21c3449587fdeeff565557d3 in this term.
I20260709 12:21:48.210120 31638 raft_consensus.cc:2749] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:48.210834 31652 raft_consensus.cc:3060] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:48.221827 31625 leader_election.cc:290] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:48.142515 31498 consensus_queue.cc:237] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:48.226598 30712 leader_election.cc:304] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:48.209448 31639 raft_consensus.cc:2749] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:48.207446 31501 raft_consensus.cc:2749] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:48.231127 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb4b46162a04eeda49624c82070758e" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:48.231878 31443 leader_election.cc:290] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:48.233228 31547 leader_election.cc:290] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:48.234786 31615 leader_election.cc:290] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:48.215377 31619 raft_consensus.cc:493] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:48.246517 31638 raft_consensus.cc:493] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:48.213112 31631 raft_consensus.cc:493] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:48.261509 30893 raft_consensus.cc:2468] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 3.
I20260709 12:21:48.265008 30637 leader_election.cc:304] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:48.295051 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c148832de74745608d983f2184cbf23f" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
W20260709 12:21:48.262990 30857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 207780us
I20260709 12:21:48.270546 30711 leader_election.cc:304] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
W20260709 12:21:48.271111 30712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 44577.3us
I20260709 12:21:48.275951 31298 raft_consensus.cc:2749] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:48.280562 30820 raft_consensus.cc:1275] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Refusing update from remote peer 4a9042c4154c442297159d1c9f1186b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:48.281381 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61dc8e98f804681b0815e953b2d2ad1" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:48.282804 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d372d3fc5dd43d1880a4a932c83d7da" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:48.285339 31652 raft_consensus.cc:2749] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:48.285010 30892 raft_consensus.cc:1275] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Refusing update from remote peer 20c7a0cd21c3449587fdeeff565557d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:48.286684 30886 raft_consensus.cc:3060] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:48.319218 30712 leader_election.cc:400] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287) with higher term. Message: Invalid argument: T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 for earlier term 2. Current term is 3.
I20260709 12:21:48.319698 30712 leader_election.cc:403] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:48.250525 31665 consensus_queue.cc:1059] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:21:48.288523 30888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a02078ac834032ac607943e7b3d175" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:48.248543 30819 raft_consensus.cc:1275] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Refusing update from remote peer d3ab9d21f8864b50a71b49c7d624584a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:48.250741 30887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f2ae9f62734cf59b3d5477d92760cb" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:48.292531 30890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a02078ac834032ac607943e7b3d175" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:48.296084 30785 leader_election.cc:304] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:48.292876 31619 raft_consensus.cc:515] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:48.259912 31610 leader_election.cc:290] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:48.313122 30711 leader_election.cc:304] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
W20260709 12:21:48.332515 30709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 345303us
I20260709 12:21:48.310787 31487 raft_consensus.cc:2749] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:48.286212 31331 raft_consensus.cc:515] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:48.311226 31600 raft_consensus.cc:2749] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:48.324898 30894 raft_consensus.cc:3060] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:48.358945 30783 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 88449.1us
I20260709 12:21:48.333797 30889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a8098230e4404c9d5743dcac2c5aaa" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:48.339637 31625 raft_consensus.cc:2804] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:48.363279 30712 leader_election.cc:400] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287) with higher term. Message: Invalid argument: T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 for earlier term 2. Current term is 3.
I20260709 12:21:48.310781 31638 raft_consensus.cc:515] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:48.339176 31663 raft_consensus.cc:2749] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:48.366441 30745 raft_consensus.cc:1275] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Refusing update from remote peer 20c7a0cd21c3449587fdeeff565557d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:48.364249 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb4b46162a04eeda49624c82070758e" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:48.371542 30712 leader_election.cc:400] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287) with higher term. Message: Invalid argument: T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 for earlier term 2. Current term is 3.
I20260709 12:21:48.374369 30891 raft_consensus.cc:2393] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in current term 3: Already voted for candidate d3ab9d21f8864b50a71b49c7d624584a in this term.
I20260709 12:21:48.377238 30742 raft_consensus.cc:3060] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:21:48.377235 30712 leader_election.cc:403] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:48.311187 31631 raft_consensus.cc:515] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:48.342836 31602 consensus_queue.cc:1048] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:21:48.360366 31640 raft_consensus.cc:697] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 3 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:48.388747 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a8098230e4404c9d5743dcac2c5aaa" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:48.355958 31595 consensus_queue.cc:1048] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:21:48.393008 31625 raft_consensus.cc:697] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:48.402036 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bb30237ea045c79aa6eb181bc3e692" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:48.385494 30746 raft_consensus.cc:2468] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 3.
I20260709 12:21:48.404094 30885 raft_consensus.cc:2468] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 3.
I20260709 12:21:48.406545 30744 raft_consensus.cc:2468] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 3.
I20260709 12:21:48.408109 30746 raft_consensus.cc:1275] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:48.408524 31621 raft_consensus.cc:2749] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287) with higher term. Message: Invalid argument: T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 for earlier term 2. Current term is 3.
I20260709 12:21:48.390177 31619 leader_election.cc:290] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:48.375628 31544 consensus_queue.cc:1048] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:21:48.443642 31331 leader_election.cc:290] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:48.448132 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:48.453068 30817 raft_consensus.cc:2393] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3ab9d21f8864b50a71b49c7d624584a in current term 3: Already voted for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in this term.
I20260709 12:21:48.402195 31638 leader_election.cc:290] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:48.462862 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1ba3aa111d4c5e8558a89abec0aa64" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
W20260709 12:21:48.476071 30712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 94359.7us
I20260709 12:21:48.427335 31650 raft_consensus.cc:515] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
W20260709 12:21:48.461892 30709 consensus_peers.cc:597] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:48.496205 30742 raft_consensus.cc:2468] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 3.
I20260709 12:21:48.402062 31625 consensus_queue.cc:237] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
W20260709 12:21:48.514050 30857 consensus_peers.cc:597] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:48.516374 30815 raft_consensus.cc:1275] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:48.484889 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a02078ac834032ac607943e7b3d175" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
W20260709 12:21:48.525960 30709 consensus_peers.cc:597] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:48.534039 30857 consensus_peers.cc:597] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:48.498677 31490 raft_consensus.cc:2749] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287) with higher term. Message: Invalid argument: T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a9042c4154c442297159d1c9f1186b9 for earlier term 2. Current term is 3.
W20260709 12:21:48.539671 30857 consensus_peers.cc:597] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:48.541337 30857 consensus_peers.cc:597] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:48.488821 31640 consensus_queue.cc:237] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
W20260709 12:21:48.547477 30857 leader_election.cc:336] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:21:48.549494 30857 consensus_peers.cc:597] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:48.503444 31631 leader_election.cc:290] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
W20260709 12:21:48.526911 30709 consensus_peers.cc:597] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:48.553357 30709 consensus_peers.cc:597] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:48.551723 30857 leader_election.cc:336] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:21:48.559783 30857 leader_election.cc:304] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:48.563594 30783 leader_election.cc:304] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
I20260709 12:21:48.558493 30814 raft_consensus.cc:2393] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3ab9d21f8864b50a71b49c7d624584a in current term 3: Already voted for candidate 20c7a0cd21c3449587fdeeff565557d3 in this term.
W20260709 12:21:48.565562 30709 consensus_peers.cc:597] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:48.573196 30738 raft_consensus.cc:2393] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c7a0cd21c3449587fdeeff565557d3 in current term 3: Already voted for candidate 4a9042c4154c442297159d1c9f1186b9 in this term.
W20260709 12:21:48.580049 30709 consensus_peers.cc:597] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:48.591519 30709 consensus_peers.cc:597] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:48.592254 30709 consensus_peers.cc:597] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:48.577262 31615 raft_consensus.cc:2804] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:21:48.598780 30634 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 135255us
I20260709 12:21:48.578861 31647 raft_consensus.cc:2749] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:48.599325 30742 raft_consensus.cc:1275] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Refusing update from remote peer d3ab9d21f8864b50a71b49c7d624584a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:48.602778 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7695652594064f568b2df572cb76e12a" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
W20260709 12:21:48.597671 31539 consensus_meta.cc:287] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3: Time spent flushing consensus metadata: real 0.645s	user 0.017s	sys 0.005s
I20260709 12:21:48.590227 31608 raft_consensus.cc:493] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:48.590023 31498 raft_consensus.cc:493] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:48.615746 31650 leader_election.cc:290] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:48.600342 30886 raft_consensus.cc:2468] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 3.
I20260709 12:21:48.602028 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9361d602cd814a70acf6a5867a109d74" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:48.625470 30817 raft_consensus.cc:1275] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:48.609046 31615 raft_consensus.cc:697] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [term 3 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:48.514775 31644 consensus_queue.cc:1048] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:21:48.632328 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ccb8b23d8455a990ef1cb50271887" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:48.544884 31646 consensus_queue.cc:1048] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:21:48.612560 31539 raft_consensus.cc:2749] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953) with higher term. Message: Invalid argument: T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c7a0cd21c3449587fdeeff565557d3 for earlier term 2. Current term is 3.
I20260709 12:21:48.573542 31631 consensus_queue.cc:1048] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:21:48.587946 31618 consensus_queue.cc:1048] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:48.610244 31422 consensus_queue.cc:1048] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:21:48.617899 31608 raft_consensus.cc:515] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:48.620450 31498 raft_consensus.cc:515] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:48.658704 30893 raft_consensus.cc:1275] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:48.637256 31642 raft_consensus.cc:493] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:48.671335 30893 raft_consensus.cc:1240] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Rejecting Update request from peer 4e9c812ece8a42efa063dc7bd5ea25e4 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:21:48.673269 31678 log.cc:927] Time spent T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:21:48.662586 31408 raft_consensus.cc:493] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:48.675410 31408 raft_consensus.cc:515] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
W20260709 12:21:48.681555 31629 consensus_meta.cc:287] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a: Time spent flushing consensus metadata: real 0.731s	user 0.021s	sys 0.001s
I20260709 12:21:48.681918 31492 raft_consensus.cc:493] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
W20260709 12:21:48.682994 31688 log.cc:927] Time spent T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:21:48.683115 31408 leader_election.cc:290] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:48.681663 30894 raft_consensus.cc:2468] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 3.
I20260709 12:21:48.687866 30744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46510 (request call id 159) took 1184 ms. Trace:
I20260709 12:21:48.698163 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e24a3b2b9d4270a8b8466d3c6313ab" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:48.692390 31615 consensus_queue.cc:237] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:48.699441 31608 leader_election.cc:290] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:48.700562 31501 consensus_queue.cc:1048] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:48.701246 30785 leader_election.cc:304] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:48.664666 31627 consensus_queue.cc:1048] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:21:48.704270 31631 raft_consensus.cc:2749] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:48.696375 31492 raft_consensus.cc:515] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:48.664259 31691 consensus_queue.cc:1048] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:21:48.666847 31642 raft_consensus.cc:515] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:48.695907 31629 raft_consensus.cc:515] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:48.745450 30817 raft_consensus.cc:1275] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:48.746376 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de462b3788724f21b93b5cbb295c085a" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:48.696432 30744 rpcz_store.cc:276] 0709 12:21:47.503234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.542863 (+ 39629us) service_pool.cc:224] Handling call
0709 12:21:48.687617 (+1144754us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b5400425c54. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:21:48.687783 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1104147712}
I20260709 12:21:48.759249 30814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e24a3b2b9d4270a8b8466d3c6313ab" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:48.775138 31642 leader_election.cc:290] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:48.763757 31408 raft_consensus.cc:493] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:48.753780 31665 raft_consensus.cc:493] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:48.753419 31630 raft_consensus.cc:493] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:48.778254 31498 leader_election.cc:290] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:48.785177 31492 leader_election.cc:290] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:48.759070 30888 raft_consensus.cc:3060] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:48.808888 30812 raft_consensus.cc:1275] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Refusing update from remote peer d3ab9d21f8864b50a71b49c7d624584a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:48.809832 31408 raft_consensus.cc:515] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:48.810864 30818 raft_consensus.cc:2468] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 3.
I20260709 12:21:48.812776 30891 raft_consensus.cc:1240] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Rejecting Update request from peer 4e9c812ece8a42efa063dc7bd5ea25e4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:48.815047 30820 raft_consensus.cc:1275] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Refusing update from remote peer d3ab9d21f8864b50a71b49c7d624584a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:21:48.825841 30783 consensus_peers.cc:597] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:48.827214 30783 leader_election.cc:336] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:21:48.827646 30783 leader_election.cc:304] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
W20260709 12:21:48.828765 30783 consensus_peers.cc:597] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:48.829316 30783 leader_election.cc:336] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:21:48.829658 30783 leader_election.cc:304] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
W20260709 12:21:48.835121 30636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 45286.8us
I20260709 12:21:48.817591 31630 raft_consensus.cc:515] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:48.815665 31665 raft_consensus.cc:515] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
W20260709 12:21:48.840618 30783 leader_election.cc:336] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:21:48.834884 31693 log.cc:927] Time spent T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:21:48.830628 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ea2bd624354824ada8b141b94ab5f0" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:48.834861 31648 raft_consensus.cc:2749] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:48.830680 31615 raft_consensus.cc:2749] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:48.844900 30783 leader_election.cc:304] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:48.828001 31647 consensus_queue.cc:1048] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
W20260709 12:21:48.896139 30783 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 59719.7us
W20260709 12:21:48.898518 30783 consensus_peers.cc:597] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:48.899466 30783 leader_election.cc:336] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:21:48.857292 30738 raft_consensus.cc:1275] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Refusing update from remote peer d3ab9d21f8864b50a71b49c7d624584a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:48.857709 30812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5d808cf6da46a0894e888635591cc8" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:48.905334 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d63226f015480c84967f90ac595cc0" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:48.836050 31639 consensus_queue.cc:1048] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 12:21:48.845489 31618 consensus_queue.cc:1059] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
W20260709 12:21:48.931169 30636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 86274us
I20260709 12:21:48.943586 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca6811dc9854dfaa1295db38c91c0fd" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
W20260709 12:21:48.946739 31704 log.cc:927] Time spent T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
W20260709 12:21:48.948773 31702 log.cc:927] Time spent T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:21:48.950989 30885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1ba3aa111d4c5e8558a89abec0aa64" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:48.956357 31665 leader_election.cc:290] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:48.945739 31618 consensus_queue.cc:1059] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:21:48.965646 31408 leader_election.cc:290] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:48.965764 31618 raft_consensus.cc:3055] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:48.966602 31618 raft_consensus.cc:740] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:21:48.978929 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9361d602cd814a70acf6a5867a109d74" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:48.956776 31630 leader_election.cc:290] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:48.967818 31618 consensus_queue.cc:260] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:48.993285 30888 raft_consensus.cc:2468] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 3.
I20260709 12:21:48.995390 31618 raft_consensus.cc:3060] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:49.001125 31625 raft_consensus.cc:2749] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:49.003834 31612 raft_consensus.cc:3055] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:49.009202 31647 raft_consensus.cc:493] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:49.011898 31647 raft_consensus.cc:515] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:49.010546 31612 raft_consensus.cc:740] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:21:49.020463 31612 consensus_queue.cc:260] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:49.027021 30815 raft_consensus.cc:1240] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Rejecting Update request from peer 4e9c812ece8a42efa063dc7bd5ea25e4 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:21:49.024305 31612 raft_consensus.cc:3060] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:49.031361 30783 leader_election.cc:336] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:21:49.031903 30783 leader_election.cc:304] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:49.032754 31605 raft_consensus.cc:2749] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:49.035439 30711 leader_election.cc:304] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:49.036989 31647 leader_election.cc:290] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:49.037488 31502 raft_consensus.cc:2804] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:49.038103 31502 raft_consensus.cc:697] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [term 3 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:49.039085 31502 consensus_queue.cc:237] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
W20260709 12:21:49.040059 30709 consensus_peers.cc:597] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:49.040477 30709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 447127us
I20260709 12:21:49.050066 30637 leader_election.cc:304] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:49.050783 31501 consensus_queue.cc:1048] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:49.052186 31595 raft_consensus.cc:2749] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.053092 31630 raft_consensus.cc:493] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:49.053820 31630 raft_consensus.cc:515] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:49.056455 31501 raft_consensus.cc:493] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:49.057430 31501 raft_consensus.cc:515] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:49.066641 31630 leader_election.cc:290] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:49.091483 31600 raft_consensus.cc:493] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
W20260709 12:21:49.091915 31712 log.cc:927] Time spent T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:21:49.092139 31600 raft_consensus.cc:515] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:49.094919 31600 leader_election.cc:290] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:49.095750 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ea2bd624354824ada8b141b94ab5f0" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:49.065824 31501 leader_election.cc:290] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:49.097443 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5d808cf6da46a0894e888635591cc8" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:49.119223 30857 leader_election.cc:304] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:49.123560 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9361d602cd814a70acf6a5867a109d74" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:49.125353 31684 raft_consensus.cc:2749] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:49.143675 31481 raft_consensus.cc:493] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:49.140478 30741 raft_consensus.cc:1240] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [term 3 LEADER]: Rejecting Update request from peer 4e9c812ece8a42efa063dc7bd5ea25e4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:49.146381 31691 raft_consensus.cc:493] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:49.147143 31691 raft_consensus.cc:515] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:49.120920 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de462b3788724f21b93b5cbb295c085a" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:49.128954 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a02078ac834032ac607943e7b3d175" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:49.152163 30739 raft_consensus.cc:2368] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3ab9d21f8864b50a71b49c7d624584a for earlier term 2. Current term is 3.
I20260709 12:21:49.158860 30813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61dc8e98f804681b0815e953b2d2ad1" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:49.160979 31707 raft_consensus.cc:493] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:49.161684 31707 raft_consensus.cc:515] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:49.162415 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ea2bd624354824ada8b141b94ab5f0" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:49.144508 31481 raft_consensus.cc:515] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:49.115742 31630 raft_consensus.cc:493] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:49.173269 30743 raft_consensus.cc:1275] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Refusing update from remote peer d3ab9d21f8864b50a71b49c7d624584a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:49.173985 31691 leader_election.cc:290] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:49.174800 30815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bb30237ea045c79aa6eb181bc3e692" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:49.131791 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd8dacaad53349ebb29c67fe11853fab" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:49.189759 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a0a060aca4bdf912b9291106aaa74" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:49.122606 31544 consensus_queue.cc:1048] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:21:49.164510 31707 leader_election.cc:290] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:49.226431 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f3fc82ff104135851cce7357eda3ec" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
W20260709 12:21:49.226719 30709 consensus_peers.cc:597] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:49.229514 30709 leader_election.cc:336] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:21:49.230969 30709 consensus_peers.cc:597] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:49.231642 30709 leader_election.cc:336] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:21:49.232159 30709 leader_election.cc:304] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
W20260709 12:21:49.234648 30709 consensus_peers.cc:597] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:49.212541 30813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e243e0f019f54586877c9a61b2fc83ac" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:49.218396 31481 leader_election.cc:290] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
W20260709 12:21:49.235476 30709 consensus_peers.cc:597] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:49.215353 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faf21b4ff034e548c19569963419851" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:49.249886 30783 leader_election.cc:304] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:49.251338 30783 leader_election.cc:304] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
W20260709 12:21:49.251101 30857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 129516us
W20260709 12:21:49.244850 30709 consensus_peers.cc:597] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:49.246270 30634 leader_election.cc:304] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:49.246853 31408 raft_consensus.cc:493] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:49.233451 31621 raft_consensus.cc:2749] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.188011 31630 raft_consensus.cc:515] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:49.260876 30634 leader_election.cc:304] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
W20260709 12:21:49.259821 30857 consensus_peers.cc:597] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:49.262797 30634 leader_election.cc:304] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:49.242451 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bb30237ea045c79aa6eb181bc3e692" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:49.251266 30743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e243e0f019f54586877c9a61b2fc83ac" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
W20260709 12:21:49.259754 30635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.256001 31648 raft_consensus.cc:2749] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:49.268877 31481 raft_consensus.cc:2749] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.271943 31618 raft_consensus.cc:2749] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:49.255921 31631 raft_consensus.cc:2749] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.260753 31600 raft_consensus.cc:2749] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.289477 31630 leader_election.cc:290] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:49.290242 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f3fc82ff104135851cce7357eda3ec" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:49.291009 31573 raft_consensus.cc:493] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:49.287662 30857 leader_election.cc:400] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 election: Vote denied by peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363) with higher term. Message: Invalid argument: T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3ab9d21f8864b50a71b49c7d624584a for earlier term 2. Current term is 3.
I20260709 12:21:49.257074 31408 raft_consensus.cc:515] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:49.301079 30634 leader_election.cc:304] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
W20260709 12:21:49.307525 31714 log.cc:927] Time spent T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:21:49.310115 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc72ff638c0425f9c75bb21e2b99dd3" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
W20260709 12:21:49.306670 30709 consensus_peers.cc:597] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:49.321607 30634 leader_election.cc:304] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:49.302757 30857 leader_election.cc:403] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:21:49.322999 30634 leader_election.cc:304] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:49.326436 31691 raft_consensus.cc:2749] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:49.318445 30709 consensus_peers.cc:597] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:49.329558 30709 consensus_peers.cc:597] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:49.337471 30709 leader_election.cc:336] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:21:49.304090 31697 raft_consensus.cc:493] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:49.317700 31481 raft_consensus.cc:2749] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:49.324337 31600 raft_consensus.cc:2749] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:49.328303 30815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc72ff638c0425f9c75bb21e2b99dd3" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:49.354382 30816 raft_consensus.cc:1275] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Refusing update from remote peer d3ab9d21f8864b50a71b49c7d624584a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:49.306391 31573 raft_consensus.cc:515] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:49.342792 31672 raft_consensus.cc:493] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:49.343948 31697 raft_consensus.cc:515] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:49.362957 30816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87d449e2aa442ec87cb2b55b61d4496" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:49.346127 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87d449e2aa442ec87cb2b55b61d4496" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:49.373361 30818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48376 (request call id 219) took 1457 ms. Trace:
I20260709 12:21:49.374173 30818 rpcz_store.cc:276] 0709 12:21:47.912928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.915014 (+  2086us) service_pool.cc:224] Handling call
0709 12:21:48.281214 (+366200us) spinlock_profiling.cc:243] Waited 5.11 ms on lock 0x7b58005d0698. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a940e7db1 00007f4a94227b71 00007f4a94227a22 00007f4a9d1408d9 00007f4a9c29aee0 00007f4a9c3640ab 00007f4a9c364131 00007f4a9c3120a0 00007f4a9c311984 00007f4a9588c6d4 00007f4a9588c662
0709 12:21:49.369900 (+1088686us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b5400656154. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a973502fa 00007f4a9c311b17 00007f4a9588c6d4 00007f4a9588c662 00007f4a9588c591 00007f4a9588c50c 00007f4a9588b7c2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:21:49.369993 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1103941248}
I20260709 12:21:49.361735 31408 leader_election.cc:290] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:49.382009 30819 raft_consensus.cc:1275] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Refusing update from remote peer 4a9042c4154c442297159d1c9f1186b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:49.385253 30637 leader_election.cc:304] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:49.367471 31630 raft_consensus.cc:493] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:49.389803 31408 raft_consensus.cc:2749] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.377373 30885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38606820b9b349d3ad9f9fae03de5e86" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:49.405669 30815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b6381e285f94a7ca02f638d09d0b3c2" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:49.365980 31672 raft_consensus.cc:515] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:49.409849 31642 raft_consensus.cc:493] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:49.409962 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93f0e0819f8466fad08603e540dc22e" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:49.410629 31672 leader_election.cc:290] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:49.410537 31642 raft_consensus.cc:515] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
W20260709 12:21:49.399022 30783 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 64437us
I20260709 12:21:49.400758 30711 leader_election.cc:304] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3
I20260709 12:21:49.402456 31481 raft_consensus.cc:493] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.413372 31630 raft_consensus.cc:515] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:49.413897 30743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b6381e285f94a7ca02f638d09d0b3c2" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:49.414285 31621 raft_consensus.cc:2804] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:49.414896 31621 raft_consensus.cc:697] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 3 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:49.415613 30889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca6811dc9854dfaa1295db38c91c0fd" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:49.415825 31621 consensus_queue.cc:237] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:49.403688 31573 leader_election.cc:290] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:49.404390 31697 leader_election.cc:290] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:49.413445 30888 raft_consensus.cc:1275] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:49.413934 31481 raft_consensus.cc:515] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:49.425396 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d63226f015480c84967f90ac595cc0" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:49.433418 30634 leader_election.cc:304] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
W20260709 12:21:49.484007 30634 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 50691.9us
I20260709 12:21:49.485208 30634 leader_election.cc:304] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:49.415633 31630 leader_election.cc:290] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:49.496728 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99734494b57424691503918c73f294e" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:49.481101 31443 raft_consensus.cc:493] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.496582 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a0a060aca4bdf912b9291106aaa74" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:49.482587 30885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd8dacaad53349ebb29c67fe11853fab" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:49.485628 31408 raft_consensus.cc:2749] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:49.498958 31699 raft_consensus.cc:2749] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.488214 30889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faf21b4ff034e548c19569963419851" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:49.487751 31642 leader_election.cc:290] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:49.503171 31443 raft_consensus.cc:515] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:21:49.523180 30813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f2ae9f62734cf59b3d5477d92760cb" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:49.527650 31544 consensus_queue.cc:1048] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:49.528249 31443 leader_election.cc:290] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:49.510002 30890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48114d81f8f4cf08f9665b697bc5560" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:49.530094 30711 leader_election.cc:304] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:49.531086 31481 leader_election.cc:290] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:49.532766 31624 raft_consensus.cc:2749] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.559480 30817 raft_consensus.cc:1275] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Refusing update from remote peer d3ab9d21f8864b50a71b49c7d624584a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:49.561653 31640 consensus_queue.cc:1048] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:49.567050 30885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b26f10a0fb7476098bdb142c864895e" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:49.570266 31629 leader_election.cc:290] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:49.575359 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b26f10a0fb7476098bdb142c864895e" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:49.578697 30743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffb9d78e773452ab44ae35b5d65fdb2" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:49.585161 31638 raft_consensus.cc:493] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.590310 30742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48114d81f8f4cf08f9665b697bc5560" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
W20260709 12:21:49.593021 30857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 305515us
I20260709 12:21:49.593148 31629 raft_consensus.cc:2749] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363) with higher term. Message: Invalid argument: T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3ab9d21f8864b50a71b49c7d624584a for earlier term 2. Current term is 3.
I20260709 12:21:49.599843 31720 consensus_queue.cc:1048] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:49.605429 30742 raft_consensus.cc:1275] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Refusing update from remote peer 20c7a0cd21c3449587fdeeff565557d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:49.609162 30712 leader_election.cc:304] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:49.613296 30815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a02078ac834032ac607943e7b3d175" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:49.614183 30815 raft_consensus.cc:2368] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3ab9d21f8864b50a71b49c7d624584a for earlier term 2. Current term is 3.
I20260709 12:21:49.619244 30860 leader_election.cc:400] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 election: Vote denied by peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287) with higher term. Message: Invalid argument: T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3ab9d21f8864b50a71b49c7d624584a for earlier term 2. Current term is 3.
I20260709 12:21:49.610852 31631 consensus_queue.cc:1048] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:21:49.622498 31642 raft_consensus.cc:493] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.624606 31642 raft_consensus.cc:515] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:49.609947 31638 raft_consensus.cc:515] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:49.627118 31642 leader_election.cc:290] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:49.627566 30745 raft_consensus.cc:1275] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Refusing update from remote peer 20c7a0cd21c3449587fdeeff565557d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:49.630110 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb65e812f06540bc9f1c2b1e3e13d41c" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:49.631615 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61dc8e98f804681b0815e953b2d2ad1" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:49.633453 31631 consensus_queue.cc:1048] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:21:49.627739 31638 leader_election.cc:290] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:49.644402 30636 leader_election.cc:304] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:49.646694 30636 leader_election.cc:304] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:49.649246 30636 leader_election.cc:304] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:49.642729 30815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61dc8e98f804681b0815e953b2d2ad1" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:49.649070 31707 raft_consensus.cc:2749] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.687498 30565 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36736 (request call id 79) took 3578 ms. Trace:
I20260709 12:21:49.649672 31642 raft_consensus.cc:2749] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:21:49.707326 30636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 58150.9us
I20260709 12:21:49.726816 30636 leader_election.cc:304] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:49.732561 31697 consensus_queue.cc:1048] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:49.735710 30636 leader_election.cc:304] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:49.737455 31408 raft_consensus.cc:2749] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.739054 30567 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36714 (request call id 89) took 3343 ms. Trace:
I20260709 12:21:49.743296 30636 leader_election.cc:304] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:49.744387 31707 raft_consensus.cc:2749] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.745903 30636 leader_election.cc:304] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:49.756124 30892 raft_consensus.cc:1275] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Refusing update from remote peer 20c7a0cd21c3449587fdeeff565557d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:49.756753 31612 raft_consensus.cc:2749] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.751623 30819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48376 (request call id 238) took 1372 ms. Trace:
I20260709 12:21:49.735935 31691 raft_consensus.cc:2749] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:49.693804 31624 raft_consensus.cc:2749] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:49.711436 31701 raft_consensus.cc:2749] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.727746 30815 raft_consensus.cc:2468] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 3.
I20260709 12:21:49.769019 30891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffb9d78e773452ab44ae35b5d65fdb2" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:49.771189 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93f0e0819f8466fad08603e540dc22e" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:49.717545 30565 rpcz_store.cc:276] 0709 12:21:46.109700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.118307 (+  8607us) service_pool.cc:224] Handling call
0709 12:21:49.687433 (+3569126us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:47.563786 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:47.564700 (+   914us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:47.564769 (+    69us) write_op.cc:435] Acquired schema lock
0709 12:21:47.564797 (+    28us) tablet.cc:662] Decoding operations
0709 12:21:47.565415 (+   618us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:47.565529 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:47.565572 (+    43us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:21:47.566025 (+   453us) tablet.cc:701] Row locks acquired
0709 12:21:47.566052 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:21:47.566256 (+   204us) write_op.cc:270] Start()
0709 12:21:47.566420 (+   164us) write_op.cc:276] Timestamp: P: 1783599707566199 usec, L: 0
0709 12:21:47.566450 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:21:47.567461 (+  1011us) log.cc:844] Serialized 934 byte log entry
0709 12:21:48.091975 (+524514us) op_driver.cc:464] REPLICATION: finished
0709 12:21:48.388980 (+297005us) write_op.cc:301] APPLY: starting
0709 12:21:48.389068 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:48.389188 (+   120us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:48.389321 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:48.389710 (+   389us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:48.389876 (+   166us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:21:48.389924 (+    48us) write_op.cc:312] APPLY: finished
0709 12:21:48.390111 (+   187us) log.cc:844] Serialized 28 byte log entry
0709 12:21:48.390284 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:48.390395 (+   111us) write_op.cc:454] Released schema lock
0709 12:21:48.390442 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:48.447431 (+ 56989us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:48.461635 (+ 14204us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":989182,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":296720,"apply.run_cpu_time_us":1965,"apply.run_wall_time_us":29694,"num_ops":2,"prepare.queue_time_us":217009,"prepare.run_cpu_time_us":8296,"prepare.run_wall_time_us":9272,"raft.queue_time_us":353226,"raft.run_cpu_time_us":133281,"raft.run_wall_time_us":472152,"replication_time_us":525367,"thread_start_us":502468,"threads_started":4,"wal-append.queue_time_us":9217,"wal-append.run_cpu_time_us":25747,"wal-append.run_wall_time_us":2059696}]]}
I20260709 12:21:49.769328 30637 leader_election.cc:304] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:49.784062 30892 raft_consensus.cc:1275] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Refusing update from remote peer 20c7a0cd21c3449587fdeeff565557d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:49.785068 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f2ae9f62734cf59b3d5477d92760cb" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:49.785363 30888 raft_consensus.cc:1275] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Refusing update from remote peer 4a9042c4154c442297159d1c9f1186b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:49.785648 30890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d63226f015480c84967f90ac595cc0" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:49.786329 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb65e812f06540bc9f1c2b1e3e13d41c" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:49.788277 31701 raft_consensus.cc:2804] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:49.829941 31701 raft_consensus.cc:493] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.830473 31701 raft_consensus.cc:3060] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:49.797683 30889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99734494b57424691503918c73f294e" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:49.798511 31539 consensus_queue.cc:1048] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:49.800710 30568 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36704 (request call id 88) took 2486 ms. Trace:
I20260709 12:21:49.814674 30569 catalog_manager.cc:5697] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:49.772734 30819 rpcz_store.cc:276] 0709 12:21:48.378910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.380476 (+  1566us) service_pool.cc:224] Handling call
0709 12:21:49.371409 (+990933us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:49.382691 (+ 11282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:49.751359 (+368668us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b5400656150. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b5571 00007f4a9734b8ad 00007f4a9c310419 00007f4a95887bd4 00007f4a95887b62 00007f4a95887a91 00007f4a95887a0c 00007f4a95886cc2 00007f4a9568748c 00007f4a956868c6 00007f4a9568626f
0709 12:21:49.751529 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2219627264}
I20260709 12:21:49.857769 30785 leader_election.cc:304] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:49.739511 30567 rpcz_store.cc:276] 0709 12:21:46.427117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.429786 (+  2669us) service_pool.cc:224] Handling call
0709 12:21:49.738982 (+3309196us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:47.573271 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:47.574127 (+   856us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:47.574175 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:21:47.574203 (+    28us) tablet.cc:662] Decoding operations
0709 12:21:47.575125 (+   922us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:47.575195 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:47.575238 (+    43us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:21:47.575688 (+   450us) tablet.cc:701] Row locks acquired
0709 12:21:47.575723 (+    35us) write_op.cc:260] PREPARE: finished
0709 12:21:47.575939 (+   216us) write_op.cc:270] Start()
0709 12:21:47.576094 (+   155us) write_op.cc:276] Timestamp: P: 1783599707575865 usec, L: 0
0709 12:21:47.576125 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:21:47.743314 (+167189us) log.cc:844] Serialized 1325 byte log entry
0709 12:21:48.379932 (+636618us) op_driver.cc:464] REPLICATION: finished
0709 12:21:48.481722 (+101790us) write_op.cc:301] APPLY: starting
0709 12:21:48.484704 (+  2982us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:48.498459 (+ 13755us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:48.505085 (+  6626us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:48.579211 (+ 74126us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:48.601356 (+ 22145us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:21:48.606461 (+  5105us) write_op.cc:312] APPLY: finished
0709 12:21:48.622650 (+ 16189us) log.cc:844] Serialized 34 byte log entry
0709 12:21:48.637403 (+ 14753us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:48.646496 (+  9093us) write_op.cc:454] Released schema lock
0709 12:21:48.649784 (+  3288us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:48.666972 (+ 17188us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:48.668008 (+  1036us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1090486,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":94454,"apply.run_cpu_time_us":3626,"apply.run_wall_time_us":186081,"num_ops":3,"prepare.queue_time_us":175131,"prepare.run_cpu_time_us":4510,"prepare.run_wall_time_us":177646,"replication_time_us":801537,"thread_start_us":166435,"threads_started":1}]]}
I20260709 12:21:49.852869 30568 rpcz_store.cc:276] 0709 12:21:47.313918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.314158 (+   240us) service_pool.cc:224] Handling call
0709 12:21:49.800623 (+2486465us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":625489,"reported_tablets":8}
W20260709 12:21:49.872849 30857 consensus_peers.cc:597] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:49.873515 30857 leader_election.cc:336] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:21:49.877219 30857 leader_election.cc:304] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:49.880318 30636 leader_election.cc:304] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
W20260709 12:21:49.881246 30857 consensus_peers.cc:597] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:49.886561 30636 leader_election.cc:304] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:49.894105 30636 leader_election.cc:304] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:49.877614 31631 raft_consensus.cc:2749] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.897477 30636 leader_election.cc:304] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:49.900058 30636 leader_election.cc:304] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:49.894477 31691 raft_consensus.cc:2749] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:49.885251 31639 raft_consensus.cc:2749] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.886960 31697 raft_consensus.cc:2749] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.884984 31624 consensus_queue.cc:1048] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:21:49.885370 31650 consensus_queue.cc:1048] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:21:49.890990 31492 consensus_queue.cc:1048] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:21:49.903560 31595 raft_consensus.cc:2749] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:49.907232 31600 raft_consensus.cc:2749] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:49.909293 31638 raft_consensus.cc:2749] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.896692 31701 raft_consensus.cc:515] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:49.962674 30818 raft_consensus.cc:1275] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Refusing update from remote peer 4a9042c4154c442297159d1c9f1186b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:49.983503 31595 raft_consensus.cc:493] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:49.967110 31537 consensus_queue.cc:1048] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:21:50.034127 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61dc8e98f804681b0815e953b2d2ad1" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:50.037746 31701 leader_election.cc:290] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
W20260709 12:21:50.041565 31740 log.cc:927] Time spent T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:21:50.049000 31741 log.cc:927] Time spent T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:21:50.051409 30813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61dc8e98f804681b0815e953b2d2ad1" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:50.054915 31701 raft_consensus.cc:493] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:50.055207 30813 raft_consensus.cc:3060] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:50.055619 31701 raft_consensus.cc:515] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:50.026463 31595 raft_consensus.cc:515] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:50.061184 30890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006658e1213f4f8da089a9570e0a76b9" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:50.063406 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006658e1213f4f8da089a9570e0a76b9" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:50.071089 30636 leader_election.cc:304] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:50.084177 31595 leader_election.cc:290] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:50.060581 31701 leader_election.cc:290] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:50.087182 30813 raft_consensus.cc:2468] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 4.
I20260709 12:21:50.089654 30818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcceeadce924e3493e4e91cb49e2f2e" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:50.098960 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcceeadce924e3493e4e91cb49e2f2e" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:50.102735 30819 raft_consensus.cc:1240] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Rejecting Update request from peer 4a9042c4154c442297159d1c9f1186b9 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:21:50.109452 30637 leader_election.cc:304] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:50.115607 30636 leader_election.cc:304] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:50.105497 31701 raft_consensus.cc:2749] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:50.113603 31638 raft_consensus.cc:2804] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:50.133798 31638 raft_consensus.cc:697] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:21:50.135152 31638 consensus_queue.cc:237] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:50.115325 31631 raft_consensus.cc:493] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.118974 31501 raft_consensus.cc:2749] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:50.141336 31631 raft_consensus.cc:515] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:50.194985 31618 raft_consensus.cc:493] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:50.209496 31618 raft_consensus.cc:515] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:50.211632 31618 leader_election.cc:290] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:50.197574 31701 raft_consensus.cc:493] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.213953 31701 raft_consensus.cc:515] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:50.215477 31492 consensus_queue.cc:1059] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:50.215639 30813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:50.216780 31492 raft_consensus.cc:3055] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:50.216037 31701 leader_election.cc:290] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:50.217156 31492 raft_consensus.cc:740] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:50.221803 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ccb8b23d8455a990ef1cb50271887" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:50.226320 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ccb8b23d8455a990ef1cb50271887" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:50.229877 30889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:50.235234 30887 raft_consensus.cc:1275] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Refusing update from remote peer 4a9042c4154c442297159d1c9f1186b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:21:50.239048 31745 log.cc:927] Time spent T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a: Append to log took a long time: real 0.250s	user 0.003s	sys 0.000s
I20260709 12:21:50.218326 31492 consensus_queue.cc:260] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:50.244424 31492 raft_consensus.cc:3060] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:50.245838 30709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 120018us
W20260709 12:21:50.262514 30709 consensus_peers.cc:597] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:50.274019 30636 leader_election.cc:304] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:50.287266 30636 leader_election.cc:304] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:50.288280 31697 raft_consensus.cc:2749] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:50.293143 31612 raft_consensus.cc:2749] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:50.284550 31631 leader_election.cc:290] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
W20260709 12:21:50.315168 30783 leader_election.cc:336] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:21:50.321671 30785 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 202008us
W20260709 12:21:50.363799 30711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 81879.6us
W20260709 12:21:50.367178 30712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 83394us
I20260709 12:21:50.387082 31757 consensus_queue.cc:1048] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
W20260709 12:21:50.444905 30712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 76373.3us
W20260709 12:21:50.563467 31731 log.cc:927] Time spent T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:21:50.563158 31600 raft_consensus.cc:493] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:50.773250 30857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 258499us
W20260709 12:21:50.789063 30860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 261989us
W20260709 12:21:50.794745 30711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 417917us
I20260709 12:21:50.798913 31600 raft_consensus.cc:515] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:50.856113 31638 raft_consensus.cc:493] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.856911 31638 raft_consensus.cc:515] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:50.860797 31638 leader_election.cc:290] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:50.868748 31638 raft_consensus.cc:493] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:50.869814 31638 raft_consensus.cc:515] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:50.873566 31638 leader_election.cc:290] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:50.885044 31600 leader_election.cc:290] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:50.902148 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d372d3fc5dd43d1880a4a932c83d7da" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:50.903450 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e24a3b2b9d4270a8b8466d3c6313ab" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:50.904187 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2f4d39a39493b8404958a5aaaa7af" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:50.906606 30894 raft_consensus.cc:2468] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 3.
W20260709 12:21:50.982852 23151 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 30696)
I20260709 12:21:51.005867 30818 raft_consensus.cc:1275] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:21:51.011881 30817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e24a3b2b9d4270a8b8466d3c6313ab" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:51.026937 30885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2f4d39a39493b8404958a5aaaa7af" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:51.037309 31699 raft_consensus.cc:493] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.038697 31699 raft_consensus.cc:515] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:51.028403 30885 raft_consensus.cc:2468] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 3.
I20260709 12:21:51.043468 30636 leader_election.cc:304] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
W20260709 12:21:51.069211 30636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.196:33441, user_credentials={real_user=slave}} blocked reactor thread for 53904.4us
I20260709 12:21:51.069860 31501 raft_consensus.cc:2804] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:51.070433 31501 raft_consensus.cc:493] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.070847 31501 raft_consensus.cc:3060] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:51.072685 31701 raft_consensus.cc:493] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:51.075333 31774 raft_consensus.cc:493] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:51.076406 31701 raft_consensus.cc:515] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:51.077298 31774 raft_consensus.cc:515] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:51.080030 31701 leader_election.cc:290] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
W20260709 12:21:51.067250 30709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 551432us
I20260709 12:21:51.102886 31699 leader_election.cc:290] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:51.103919 31699 raft_consensus.cc:493] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:21:51.080407 31774 leader_election.cc:290] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:51.120498 30565 catalog_manager.cc:5697] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } }
I20260709 12:21:51.112413 30569 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36728 (request call id 89) took 2729 ms. Trace:
I20260709 12:21:51.128991 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e243e0f019f54586877c9a61b2fc83ac" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:51.111868 31699 raft_consensus.cc:515] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:51.134105 30811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de462b3788724f21b93b5cbb295c085a" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:51.137769 31699 leader_election.cc:290] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:51.139843 30637 leader_election.cc:304] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:51.140805 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2f4d39a39493b8404958a5aaaa7af" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:51.141158 31691 raft_consensus.cc:2749] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:51.141804 30820 raft_consensus.cc:2468] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 3.
I20260709 12:21:51.145133 31691 consensus_queue.cc:1048] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:51.123839 30565 catalog_manager.cc:5697] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 1 to 3, leader changed from d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196) to 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194). New cstate: current_term: 3 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:51.163146 30565 catalog_manager.cc:5697] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } }
I20260709 12:21:51.163841 30785 leader_election.cc:304] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:51.165649 31720 raft_consensus.cc:493] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:51.170918 31720 raft_consensus.cc:515] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:51.174383 31720 leader_election.cc:290] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:51.178047 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faf21b4ff034e548c19569963419851" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:51.182900 31763 raft_consensus.cc:2804] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:51.183426 31763 raft_consensus.cc:493] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.183871 31763 raft_consensus.cc:3060] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:51.124646 30569 rpcz_store.cc:276] 0709 12:21:48.382617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.390655 (+  8038us) service_pool.cc:224] Handling call
0709 12:21:48.679884 (+289229us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b540078bed4. stack: 00007f4a9422d343 00007f4a9422d240 00007f4a93bbc1d4 00007f4a9d8fa304 00007f4a9d8fa299 00007f4a972b6090 00007f4a97354f3a 00007f4a9d10ae9c 00007f4a9d20904e 00007f4a9b6ca2a4 00007f4a9b6ca232 00007f4a9b6ca161 00007f4a9b6ca0dc 00007f4a9b6c9392 00007f4a9568748c 00007f4a956868c6
0709 12:21:51.112118 (+2432234us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:50.022629 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:50.023189 (+   560us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:50.023223 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:21:50.023240 (+    17us) tablet.cc:662] Decoding operations
0709 12:21:50.023579 (+   339us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:50.023636 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:50.023668 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:21:50.023860 (+   192us) tablet.cc:701] Row locks acquired
0709 12:21:50.023881 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:21:50.024035 (+   154us) write_op.cc:270] Start()
0709 12:21:50.025458 (+  1423us) write_op.cc:276] Timestamp: P: 1783599710023988 usec, L: 0
0709 12:21:50.027291 (+  1833us) op_driver.cc:348] REPLICATION: starting
0709 12:21:50.102553 (+ 75262us) log.cc:844] Serialized 543 byte log entry
0709 12:21:50.430446 (+327893us) op_driver.cc:464] REPLICATION: finished
0709 12:21:50.821313 (+390867us) write_op.cc:301] APPLY: starting
0709 12:21:50.824696 (+  3383us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:50.832350 (+  7654us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:50.914248 (+ 81898us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:50.927220 (+ 12972us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:50.932512 (+  5292us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:21:50.932791 (+   279us) write_op.cc:312] APPLY: finished
0709 12:21:50.933174 (+   383us) log.cc:844] Serialized 22 byte log entry
0709 12:21:50.933362 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:50.933467 (+   105us) write_op.cc:454] Released schema lock
0709 12:21:50.933504 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:50.933960 (+   456us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:50.933986 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1004901,"reported_tablets":9,"spinlock_wait_cycles":372338048,"child_traces":[["op",{"apply.queue_time_us":372218,"apply.run_cpu_time_us":2515,"apply.run_wall_time_us":124362,"num_ops":1,"prepare.queue_time_us":116818,"prepare.run_cpu_time_us":4756,"prepare.run_wall_time_us":135753,"raft.queue_time_us":131235,"raft.run_cpu_time_us":65512,"raft.run_wall_time_us":342435,"replication_time_us":402928,"thread_start_us":227403,"threads_started":4,"wal-append.queue_time_us":184369}]]}
W20260709 12:21:51.217731 30637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 68519.4us
I20260709 12:21:51.228404 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc72ff638c0425f9c75bb21e2b99dd3" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:51.194795 30565 catalog_manager.cc:5697] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 1 to 3, leader changed from 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194) to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 3 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } }
I20260709 12:21:51.236531 31699 raft_consensus.cc:493] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:51.239997 31699 raft_consensus.cc:515] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:51.248241 31763 raft_consensus.cc:515] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:51.254642 31763 leader_election.cc:290] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:51.256600 30744 raft_consensus.cc:1275] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 4 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:21:51.257164 30744 pending_rounds.cc:85] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9: Aborting all ops after (but not including) 1
I20260709 12:21:51.257481 30744 pending_rounds.cc:107] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:21:51.257864 30744 raft_consensus.cc:2889] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:51.260601 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2f4d39a39493b8404958a5aaaa7af" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:51.262133 30886 raft_consensus.cc:3060] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:51.262892 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d372d3fc5dd43d1880a4a932c83d7da" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:51.241567 31501 raft_consensus.cc:515] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:51.266906 31699 leader_election.cc:290] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:51.272145 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de462b3788724f21b93b5cbb295c085a" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:51.272833 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc72ff638c0425f9c75bb21e2b99dd3" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:51.274101 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f3fc82ff104135851cce7357eda3ec" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:51.273110 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e243e0f019f54586877c9a61b2fc83ac" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:51.272970 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac7c8095aaa457494024d09dfaaf1bb" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:51.279011 31501 leader_election.cc:290] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:51.282545 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f3fc82ff104135851cce7357eda3ec" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:51.283444 31691 consensus_queue.cc:1048] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:21:51.285015 30857 leader_election.cc:336] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:21:51.285514 30857 leader_election.cc:304] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:51.285691 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2f4d39a39493b8404958a5aaaa7af" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:51.286798 30819 raft_consensus.cc:2393] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in current term 4: Already voted for candidate 20c7a0cd21c3449587fdeeff565557d3 in this term.
I20260709 12:21:51.286449 30565 catalog_manager.cc:5697] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } }
I20260709 12:21:51.287988 31777 raft_consensus.cc:2749] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:51.289565 30565 catalog_manager.cc:5697] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } }
I20260709 12:21:51.291370 30634 leader_election.cc:304] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:51.291272 30565 catalog_manager.cc:5697] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 1 to 3, leader changed from 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195) to 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194). New cstate: current_term: 3 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:51.293105 31691 raft_consensus.cc:2749] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:51.302444 30886 raft_consensus.cc:2468] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 4.
I20260709 12:21:51.308346 30785 leader_election.cc:304] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
W20260709 12:21:51.310745 30783 consensus_peers.cc:597] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:51.311095 31501 raft_consensus.cc:493] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
W20260709 12:21:51.311568 30783 leader_election.cc:336] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:21:51.311851 31501 raft_consensus.cc:515] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:51.314909 31501 leader_election.cc:290] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:51.316723 30634 leader_election.cc:304] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:51.327114 31699 raft_consensus.cc:2749] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:51.330296 30634 leader_election.cc:304] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:51.331108 31699 raft_consensus.cc:2749] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:51.332434 30634 leader_election.cc:304] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:51.334501 31699 raft_consensus.cc:2749] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:51.325675 31501 raft_consensus.cc:493] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:51.335801 30634 leader_election.cc:304] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:51.336611 31699 raft_consensus.cc:2749] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:51.338837 30889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac7c8095aaa457494024d09dfaaf1bb" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:51.319006 31763 raft_consensus.cc:2804] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:51.342202 30890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a0a060aca4bdf912b9291106aaa74" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:51.343986 30565 catalog_manager.cc:5697] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } }
I20260709 12:21:51.343430 30889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2f4d39a39493b8404958a5aaaa7af" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:51.346315 30889 raft_consensus.cc:2393] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in current term 4: Already voted for candidate 20c7a0cd21c3449587fdeeff565557d3 in this term.
I20260709 12:21:51.347421 31763 raft_consensus.cc:697] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 4 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:51.335668 31501 raft_consensus.cc:515] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
W20260709 12:21:51.365531 30709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 44274.6us
I20260709 12:21:51.371410 31699 raft_consensus.cc:493] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:51.372167 31699 raft_consensus.cc:515] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:51.348623 31763 consensus_queue.cc:237] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:51.374538 31699 leader_election.cc:290] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
W20260709 12:21:51.378283 30783 consensus_peers.cc:597] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:51.385555 30636 leader_election.cc:304] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:51.389540 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48114d81f8f4cf08f9665b697bc5560" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:51.389874 31691 raft_consensus.cc:493] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:51.390578 31691 raft_consensus.cc:515] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:51.391000 31595 raft_consensus.cc:2749] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:21:51.396500 30857 consensus_peers.cc:597] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:51.402288 30634 leader_election.cc:304] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:51.405287 31699 raft_consensus.cc:2749] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:51.406428 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a0a060aca4bdf912b9291106aaa74" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:51.412570 30634 leader_election.cc:304] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:51.413242 30746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87d449e2aa442ec87cb2b55b61d4496" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:51.415766 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48114d81f8f4cf08f9665b697bc5560" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:51.416025 31774 raft_consensus.cc:493] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:51.417968 31774 raft_consensus.cc:515] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:51.403630 31691 leader_election.cc:290] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:51.421273 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87d449e2aa442ec87cb2b55b61d4496" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:51.423971 31600 raft_consensus.cc:2749] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:51.426676 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5d808cf6da46a0894e888635591cc8" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:51.427021 30637 leader_election.cc:304] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:51.436618 30634 leader_election.cc:304] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:51.438216 31595 raft_consensus.cc:2749] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:51.420410 31774 leader_election.cc:290] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:51.450562 31770 raft_consensus.cc:2749] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:51.454432 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5d808cf6da46a0894e888635591cc8" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:51.454784 31697 raft_consensus.cc:493] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:51.478744 31600 raft_consensus.cc:493] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3ab9d21f8864b50a71b49c7d624584a)
I20260709 12:21:51.472680 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9361d602cd814a70acf6a5867a109d74" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:51.479516 31600 raft_consensus.cc:515] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:51.485656 31697 raft_consensus.cc:515] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:51.485641 31501 leader_election.cc:290] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:51.497166 31699 raft_consensus.cc:493] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:51.516989 31699 raft_consensus.cc:515] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:51.520011 31699 leader_election.cc:290] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:51.511742 31600 leader_election.cc:290] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:51.520126 30885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d63226f015480c84967f90ac595cc0" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:51.514567 30889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca6811dc9854dfaa1295db38c91c0fd" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:51.516242 31697 leader_election.cc:290] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:51.514605 30813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca6811dc9854dfaa1295db38c91c0fd" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:51.506927 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9361d602cd814a70acf6a5867a109d74" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:51.528173 30634 leader_election.cc:304] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:51.543947 31501 raft_consensus.cc:2749] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:51.547941 30637 leader_election.cc:304] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:51.548822 31501 raft_consensus.cc:2749] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:51.533414 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d63226f015480c84967f90ac595cc0" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:51.535933 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b6381e285f94a7ca02f638d09d0b3c2" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
W20260709 12:21:51.537370 31783 log.cc:927] Time spent T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:21:51.538215 30811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b6381e285f94a7ca02f638d09d0b3c2" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:51.557650 30634 leader_election.cc:304] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:51.558615 31699 raft_consensus.cc:2749] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:51.570652 30636 leader_election.cc:304] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:51.574962 30636 leader_election.cc:304] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:51.575846 31501 raft_consensus.cc:2749] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:51.585831 31600 raft_consensus.cc:2749] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:51.587559 31501 raft_consensus.cc:493] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:51.588160 31501 raft_consensus.cc:515] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:51.590363 31501 leader_election.cc:290] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:51.592293 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99734494b57424691503918c73f294e" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:51.597033 30888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99734494b57424691503918c73f294e" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:51.597983 31699 raft_consensus.cc:493] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:51.598783 31699 raft_consensus.cc:515] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:51.601716 31699 leader_election.cc:290] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:51.603032 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1ba3aa111d4c5e8558a89abec0aa64" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:51.607005 31600 raft_consensus.cc:493] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:51.607631 31600 raft_consensus.cc:515] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:51.609248 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1ba3aa111d4c5e8558a89abec0aa64" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:51.609911 31600 leader_election.cc:290] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:51.610471 30636 leader_election.cc:304] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:51.612123 31600 raft_consensus.cc:2749] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:51.613013 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bb30237ea045c79aa6eb181bc3e692" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:51.613495 30811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bb30237ea045c79aa6eb181bc3e692" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:51.616770 30637 leader_election.cc:304] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:21:51.617884 31697 raft_consensus.cc:2749] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:51.628023 30636 leader_election.cc:304] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:51.628942 31697 raft_consensus.cc:2749] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:51.645740 31697 raft_consensus.cc:493] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:51.646803 31697 raft_consensus.cc:515] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:51.655750 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ea2bd624354824ada8b141b94ab5f0" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:51.657055 31697 leader_election.cc:290] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:51.659334 30567 catalog_manager.cc:5697] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 1 to 3, leader changed from d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196) to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 3 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:51.662173 30567 catalog_manager.cc:5697] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 1 to 3, leader changed from d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196) to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 3 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:51.674945 30565 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36714 (request call id 90) took 1277 ms. Trace:
I20260709 12:21:51.683125 30568 catalog_manager.cc:5697] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:51.694895 30567 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36704 (request call id 89) took 1334 ms. Trace:
I20260709 12:21:51.697084 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ea2bd624354824ada8b141b94ab5f0" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:51.698107 30568 catalog_manager.cc:5697] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:51.706405 30634 leader_election.cc:304] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:51.707792 31697 raft_consensus.cc:2749] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:51.708943 30568 catalog_manager.cc:5697] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:51.689482 30565 rpcz_store.cc:276] 0709 12:21:50.397854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:50.400159 (+  2305us) service_pool.cc:224] Handling call
0709 12:21:51.674857 (+1274698us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:51.457994 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:51.488248 (+ 30254us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:51.490373 (+  2125us) write_op.cc:435] Acquired schema lock
0709 12:21:51.490889 (+   516us) tablet.cc:662] Decoding operations
0709 12:21:51.534761 (+ 43872us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:51.534920 (+   159us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:51.534946 (+    26us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:21:51.535481 (+   535us) tablet.cc:701] Row locks acquired
0709 12:21:51.535524 (+    43us) write_op.cc:260] PREPARE: finished
0709 12:21:51.535677 (+   153us) write_op.cc:270] Start()
0709 12:21:51.535792 (+   115us) write_op.cc:276] Timestamp: P: 1783599711535632 usec, L: 0
0709 12:21:51.535830 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:21:51.536511 (+   681us) log.cc:844] Serialized 3281 byte log entry
0709 12:21:51.614866 (+ 78355us) op_driver.cc:464] REPLICATION: finished
0709 12:21:51.621402 (+  6536us) write_op.cc:301] APPLY: starting
0709 12:21:51.621525 (+   123us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:51.621754 (+   229us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:51.621896 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:51.623216 (+  1320us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:51.623594 (+   378us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:21:51.623671 (+    77us) write_op.cc:312] APPLY: finished
0709 12:21:51.624063 (+   392us) log.cc:844] Serialized 64 byte log entry
0709 12:21:51.634539 (+ 10476us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:51.634686 (+   147us) write_op.cc:454] Released schema lock
0709 12:21:51.634756 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:51.640025 (+  5269us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:51.640072 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17468,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":6241,"apply.run_cpu_time_us":3601,"apply.run_wall_time_us":18550,"num_ops":8,"prepare.queue_time_us":78404,"prepare.run_cpu_time_us":4654,"prepare.run_wall_time_us":83387,"replication_time_us":70114,"thread_start_us":44062,"threads_started":2}]]}
W20260709 12:21:51.718154 30709 consensus_peers.cc:597] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:51.703264 30567 rpcz_store.cc:276] 0709 12:21:50.360995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:50.361231 (+   236us) service_pool.cc:224] Handling call
0709 12:21:51.694806 (+1333575us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:51.666192 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:51.666743 (+   551us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:51.666780 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:21:51.666804 (+    24us) tablet.cc:662] Decoding operations
0709 12:21:51.667226 (+   422us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:51.667284 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:51.667313 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:21:51.667635 (+   322us) tablet.cc:701] Row locks acquired
0709 12:21:51.667654 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:21:51.667798 (+   144us) write_op.cc:270] Start()
0709 12:21:51.667916 (+   118us) write_op.cc:276] Timestamp: P: 1783599711667751 usec, L: 0
0709 12:21:51.667937 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:21:51.668553 (+   616us) log.cc:844] Serialized 934 byte log entry
0709 12:21:51.670312 (+  1759us) op_driver.cc:464] REPLICATION: finished
0709 12:21:51.670732 (+   420us) write_op.cc:301] APPLY: starting
0709 12:21:51.670806 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:51.670920 (+   114us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:51.671012 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:51.671307 (+   295us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:51.671469 (+   162us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:21:51.671528 (+    59us) write_op.cc:312] APPLY: finished
0709 12:21:51.671713 (+   185us) log.cc:844] Serialized 28 byte log entry
0709 12:21:51.671860 (+   147us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:51.671948 (+    88us) write_op.cc:454] Released schema lock
0709 12:21:51.671987 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:51.672338 (+   351us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:51.672366 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":14483,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":229,"apply.run_cpu_time_us":1563,"apply.run_wall_time_us":1563,"num_ops":2,"prepare.queue_time_us":106,"prepare.run_cpu_time_us":2697,"prepare.run_wall_time_us":2697,"replication_time_us":2254}]]}
I20260709 12:21:51.742254 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:51.744930 30569 catalog_manager.cc:5697] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 1 to 4, leader changed from 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194) to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 4 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } }
I20260709 12:21:51.751160 30568 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36736 (request call id 80) took 1376 ms. Trace:
W20260709 12:21:51.751344 30857 consensus_peers.cc:597] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:51.752805 23151 tablet_replica.cc:333] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.755369 23151 raft_consensus.cc:2243] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.756400 23151 raft_consensus.cc:2272] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.751642 30568 rpcz_store.cc:276] 0709 12:21:50.374484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:50.374713 (+   229us) service_pool.cc:224] Handling call
0709 12:21:51.751077 (+1376364us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:51.713482 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:51.714081 (+   599us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:51.714115 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:21:51.714137 (+    22us) tablet.cc:662] Decoding operations
0709 12:21:51.714706 (+   569us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:51.714760 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:51.714785 (+    25us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:21:51.715090 (+   305us) tablet.cc:701] Row locks acquired
0709 12:21:51.715102 (+    12us) write_op.cc:260] PREPARE: finished
0709 12:21:51.715255 (+   153us) write_op.cc:270] Start()
0709 12:21:51.715372 (+   117us) write_op.cc:276] Timestamp: P: 1783599711715210 usec, L: 0
0709 12:21:51.715389 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:21:51.715967 (+   578us) log.cc:844] Serialized 1325 byte log entry
0709 12:21:51.717903 (+  1936us) op_driver.cc:464] REPLICATION: finished
0709 12:21:51.718321 (+   418us) write_op.cc:301] APPLY: starting
0709 12:21:51.718404 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:51.718559 (+   155us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:51.718646 (+    87us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:51.719895 (+  1249us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:51.720087 (+   192us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:21:51.720137 (+    50us) write_op.cc:312] APPLY: finished
0709 12:21:51.720346 (+   209us) log.cc:844] Serialized 34 byte log entry
0709 12:21:51.720510 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:51.720608 (+    98us) write_op.cc:454] Released schema lock
0709 12:21:51.720691 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:51.721043 (+   352us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:51.721081 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3661,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":216,"apply.run_cpu_time_us":2673,"apply.run_wall_time_us":2673,"num_ops":3,"prepare.queue_time_us":117,"prepare.run_cpu_time_us":2773,"prepare.run_wall_time_us":2773,"replication_time_us":2381}]]}
I20260709 12:21:51.777158 23151 tablet_replica.cc:333] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.779470 23151 raft_consensus.cc:2243] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.780210 23151 raft_consensus.cc:2272] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.784605 23151 tablet_replica.cc:333] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.788303 23151 raft_consensus.cc:2243] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.790319 23151 pending_rounds.cc:70] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4: Trying to abort 1 pending ops.
I20260709 12:21:51.791090 31600 raft_consensus.cc:493] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:51.791880 31600 raft_consensus.cc:515] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:51.790606 23151 pending_rounds.cc:77] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305624400836632576 op_type: NO_OP noop_request { }
I20260709 12:21:51.793676 23151 raft_consensus.cc:2889] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:21:51.794082 23151 raft_consensus.cc:2272] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.794214 31600 leader_election.cc:290] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:51.794806 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faf21b4ff034e548c19569963419851" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:51.797469 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faf21b4ff034e548c19569963419851" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:51.799878 30634 leader_election.cc:304] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:51.801126 31699 raft_consensus.cc:2749] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:51.806746 23151 tablet_replica.cc:333] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.808611 23151 raft_consensus.cc:2243] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.809307 23151 raft_consensus.cc:2272] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.813314 23151 tablet_replica.cc:333] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.815438 23151 raft_consensus.cc:2243] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:51.817970 23151 raft_consensus.cc:2272] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.821017 23151 tablet_replica.cc:333] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.820259 30569 catalog_manager.cc:5697] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:51.822252 23151 raft_consensus.cc:2243] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.831453 23151 raft_consensus.cc:2272] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.834895 31600 raft_consensus.cc:493] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:21:51.835686 31600 raft_consensus.cc:515] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:51.838817 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93f0e0819f8466fad08603e540dc22e" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:51.844985 31600 leader_election.cc:290] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:51.849210 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93f0e0819f8466fad08603e540dc22e" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:51.835704 23151 tablet_replica.cc:333] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.850929 30634 leader_election.cc:304] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:51.852001 31600 raft_consensus.cc:2749] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:51.852032 23151 raft_consensus.cc:2243] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:51.860567 23151 raft_consensus.cc:2272] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.864466 23151 tablet_replica.cc:333] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.865351 23151 raft_consensus.cc:2243] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.865808 23151 pending_rounds.cc:70] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4: Trying to abort 1 pending ops.
I20260709 12:21:51.866008 23151 pending_rounds.cc:77] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4: Aborting op as it isn't in flight: id { term: 3 index: 2 } timestamp: 7305624396627275776 op_type: NO_OP noop_request { }
I20260709 12:21:51.866384 23151 raft_consensus.cc:2889] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:21:51.866770 23151 raft_consensus.cc:2272] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.870536 23151 tablet_replica.cc:333] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.871506 23151 raft_consensus.cc:2243] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:21:51.871816 30709 consensus_peers.cc:597] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:51.872148 23151 raft_consensus.cc:2272] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.877010 23151 tablet_replica.cc:333] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.878038 23151 raft_consensus.cc:2243] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:21:51.879098 23151 raft_consensus.cc:2272] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.883240 23151 tablet_replica.cc:333] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.884552 23151 raft_consensus.cc:2243] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.885140 23151 raft_consensus.cc:2272] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.888801 23151 tablet_replica.cc:333] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.889780 23151 raft_consensus.cc:2243] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.890385 23151 raft_consensus.cc:2272] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.893826 23151 tablet_replica.cc:333] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.894727 23151 raft_consensus.cc:2243] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:51.895645 23151 raft_consensus.cc:2272] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.896293 30886 raft_consensus.cc:1275] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Refusing update from remote peer 20c7a0cd21c3449587fdeeff565557d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:21:51.898949 23151 tablet_replica.cc:333] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.899509 31631 consensus_queue.cc:1048] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:51.900252 23151 raft_consensus.cc:2243] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.900978 23151 raft_consensus.cc:2272] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.904457 23151 tablet_replica.cc:333] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.905403 23151 raft_consensus.cc:2243] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.905908 23151 pending_rounds.cc:70] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4: Trying to abort 1 pending ops.
I20260709 12:21:51.906148 23151 pending_rounds.cc:77] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4: Aborting op as it isn't in flight: id { term: 3 index: 2 } timestamp: 7305624395944284160 op_type: NO_OP noop_request { }
I20260709 12:21:51.906504 23151 raft_consensus.cc:2889] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:21:51.906822 23151 raft_consensus.cc:2272] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.910251 31697 raft_consensus.cc:493] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.910300 23151 tablet_replica.cc:333] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.911063 31697 raft_consensus.cc:515] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:51.912441 23151 raft_consensus.cc:2243] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:51.913791 23151 raft_consensus.cc:2272] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.914497 31697 leader_election.cc:290] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:21:51.918016 23151 tablet_replica.cc:333] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.919219 23151 raft_consensus.cc:2243] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.919876 23151 raft_consensus.cc:2272] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.925282 23151 tablet_replica.cc:333] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.926191 23151 raft_consensus.cc:2243] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.926783 23151 raft_consensus.cc:2272] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.930316 23151 tablet_replica.cc:333] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.931599 23151 raft_consensus.cc:2243] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:51.931852 30885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb65e812f06540bc9f1c2b1e3e13d41c" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:51.932744 23151 raft_consensus.cc:2272] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:51.935130 30857 consensus_peers.cc:597] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:51.936445 23151 tablet_replica.cc:333] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.938436 23151 raft_consensus.cc:2243] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.939286 23151 pending_rounds.cc:70] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4: Trying to abort 1 pending ops.
I20260709 12:21:51.939680 23151 pending_rounds.cc:77] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305624405031772160 op_type: NO_OP noop_request { }
I20260709 12:21:51.940114 23151 raft_consensus.cc:2889] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:21:51.940505 23151 raft_consensus.cc:2272] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.944238 23151 tablet_replica.cc:333] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.945264 23151 raft_consensus.cc:2243] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:51.946622 23151 raft_consensus.cc:2272] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.950054 23151 tablet_replica.cc:333] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.951038 23151 raft_consensus.cc:2243] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.951566 23151 pending_rounds.cc:70] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4: Trying to abort 1 pending ops.
I20260709 12:21:51.951802 23151 pending_rounds.cc:77] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4: Aborting op as it isn't in flight: id { term: 3 index: 2 } timestamp: 7305624395462713344 op_type: NO_OP noop_request { }
I20260709 12:21:51.952173 23151 raft_consensus.cc:2889] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:21:51.952536 23151 raft_consensus.cc:2272] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.957528 23151 tablet_replica.cc:333] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.958469 23151 raft_consensus.cc:2243] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.959250 23151 raft_consensus.cc:2272] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:51.959882 30857 consensus_peers.cc:597] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:51.963246 23151 tablet_replica.cc:333] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.964517 23151 raft_consensus.cc:2243] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.965232 23151 raft_consensus.cc:2272] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.970098 23151 tablet_replica.cc:333] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.970997 23151 raft_consensus.cc:2243] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.971722 23151 raft_consensus.cc:2272] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.975382 23151 tablet_replica.cc:333] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.976457 23151 raft_consensus.cc:2243] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:51.978189 23151 raft_consensus.cc:2272] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.979110 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb65e812f06540bc9f1c2b1e3e13d41c" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:51.981914 23151 tablet_replica.cc:333] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.982961 23151 raft_consensus.cc:2243] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:51.984333 23151 raft_consensus.cc:2272] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.989738 23151 tablet_replica.cc:333] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.990795 23151 raft_consensus.cc:2243] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:51.992136 23151 raft_consensus.cc:2272] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.997123 23151 tablet_replica.cc:333] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:51.998045 23151 raft_consensus.cc:2243] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.998673 23151 raft_consensus.cc:2272] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:52.012210 23151 tablet_replica.cc:333] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:52.021850 23151 raft_consensus.cc:2243] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:52.022676 23151 raft_consensus.cc:2272] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:52.029659 30637 leader_election.cc:304] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a
W20260709 12:21:52.034633 30783 consensus_peers.cc:597] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:52.032935 31699 raft_consensus.cc:2749] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:52.055464 23151 tablet_replica.cc:333] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:52.070577 23151 raft_consensus.cc:2243] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:52.072883 23151 raft_consensus.cc:2272] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:52.074369 30709 consensus_peers.cc:597] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:52.091578 30857 consensus_peers.cc:597] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:52.097617 23151 tablet_replica.cc:333] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:52.098572 23151 raft_consensus.cc:2243] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:52.099979 23151 raft_consensus.cc:2272] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:52.103689 23151 tablet_replica.cc:333] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:52.104808 23151 raft_consensus.cc:2243] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:52.105541 23151 raft_consensus.cc:2272] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:52.108803 23151 tablet_replica.cc:333] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:52.109810 23151 raft_consensus.cc:2243] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:52.110419 23151 raft_consensus.cc:2272] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:52.113807 23151 tablet_replica.cc:333] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:52.114775 23151 raft_consensus.cc:2243] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:52.115455 23151 raft_consensus.cc:2272] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:52.118985 23151 tablet_replica.cc:333] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:52.120110 23151 raft_consensus.cc:2243] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:52.120864 23151 raft_consensus.cc:2272] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:52.124270 23151 tablet_replica.cc:333] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:52.125417 23151 raft_consensus.cc:2243] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:52.126742 23151 raft_consensus.cc:2272] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:52.132987 23151 tablet_replica.cc:333] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:52.133992 23151 raft_consensus.cc:2243] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:52.135404 23151 raft_consensus.cc:2272] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:52.139238 23151 tablet_replica.cc:333] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:52.140216 23151 raft_consensus.cc:2243] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:52.140949 23151 raft_consensus.cc:2272] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:52.144501 23151 tablet_replica.cc:333] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:52.146101 23151 raft_consensus.cc:2243] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:52.146773 23151 raft_consensus.cc:2272] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:52.150055 23151 tablet_replica.cc:333] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:52.151085 23151 raft_consensus.cc:2243] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:52.153026 23151 raft_consensus.cc:2272] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:52.156157 23151 tablet_replica.cc:333] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:52.157784 23151 raft_consensus.cc:2243] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:52.161547 23151 raft_consensus.cc:2272] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:52.166297 23151 tablet_replica.cc:333] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:52.167140 23151 raft_consensus.cc:2243] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:52.174964 23151 raft_consensus.cc:2272] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:52.178702 23151 tablet_replica.cc:333] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:52.179610 23151 raft_consensus.cc:2243] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:52.180866 23151 raft_consensus.cc:2272] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:52.184121 23151 tablet_replica.cc:333] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4: stopping tablet replica
I20260709 12:21:52.184978 23151 raft_consensus.cc:2243] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:52.185702 23151 raft_consensus.cc:2272] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:52.199445 30857 consensus_peers.cc:597] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:52.204599 30709 consensus_peers.cc:597] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:52.233100 30783 consensus_peers.cc:597] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:52.292734 30709 consensus_peers.cc:597] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:52.296682 30709 consensus_peers.cc:597] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:52.359696 30709 consensus_peers.cc:597] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:52.416318 30709 consensus_peers.cc:597] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:52.430343 30709 consensus_peers.cc:597] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:52.437112 30857 consensus_peers.cc:597] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:52.542299 30709 consensus_peers.cc:597] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:52.567308 30857 consensus_peers.cc:597] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:52.582582 30709 consensus_peers.cc:597] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:52.592482 30709 consensus_peers.cc:597] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:52.691699 30709 consensus_peers.cc:597] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:52.710880 30709 consensus_peers.cc:597] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:52.711402 30709 consensus_peers.cc:597] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:52.722832 30709 consensus_peers.cc:597] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:52.770977 30709 consensus_peers.cc:597] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:52.919165 31490 raft_consensus.cc:493] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:52.919950 31490 raft_consensus.cc:515] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:52.922623 31490 leader_election.cc:290] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:52.924716 30811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4682db2f801d4701a9c03cb1e4b32fd0" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:52.929688 31763 raft_consensus.cc:493] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
W20260709 12:21:52.930593 30709 leader_election.cc:336] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:52.930478 31763 raft_consensus.cc:515] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:52.931332 30709 leader_election.cc:304] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:52.932833 31490 raft_consensus.cc:2749] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:52.934093 31763 leader_election.cc:290] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:52.935881 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4682db2f801d4701a9c03cb1e4b32fd0" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:52.936777 30739 raft_consensus.cc:2468] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:52.939288 30783 leader_election.cc:304] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
W20260709 12:21:52.940335 30783 leader_election.cc:336] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:52.940873 31763 raft_consensus.cc:2804] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:52.941627 31763 raft_consensus.cc:493] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:52.942168 31763 raft_consensus.cc:3060] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:52.953979 31763 raft_consensus.cc:515] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:52.962078 31539 raft_consensus.cc:493] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:52.962852 31539 raft_consensus.cc:515] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:52.965277 31539 leader_election.cc:290] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:52.967182 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baad7ab904cc431381366c54397a57ef" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
W20260709 12:21:52.968461 30783 leader_election.cc:336] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:52.971079 31763 leader_election.cc:290] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:52.974488 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4682db2f801d4701a9c03cb1e4b32fd0" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:52.975304 30739 raft_consensus.cc:3060] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:52.984952 30783 leader_election.cc:336] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:52.985692 30783 leader_election.cc:304] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:52.987257 31763 raft_consensus.cc:2749] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:52.990418 30739 raft_consensus.cc:2468] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 2.
I20260709 12:21:53.000313 30783 leader_election.cc:304] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
W20260709 12:21:53.007091 30857 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111) [suppressed 218 similar messages]
I20260709 12:21:53.001730 31763 raft_consensus.cc:2804] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:53.011794 31763 raft_consensus.cc:697] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:53.013198 31763 consensus_queue.cc:237] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:53.032080 30569 catalog_manager.cc:5697] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 1 to 2, leader changed from 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193) to 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195). New cstate: current_term: 2 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:53.064677 31785 raft_consensus.cc:493] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.065408 31785 raft_consensus.cc:515] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:53.082247 31785 leader_election.cc:290] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:53.079064 31799 raft_consensus.cc:493] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.083382 31799 raft_consensus.cc:515] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:53.093102 30811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61dc8e98f804681b0815e953b2d2ad1" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:53.095971 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38606820b9b349d3ad9f9fae03de5e86" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:53.096498 31799 leader_election.cc:290] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
W20260709 12:21:53.100134 30857 leader_election.cc:336] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.100766 30857 leader_election.cc:304] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
W20260709 12:21:53.101096 30709 leader_election.cc:336] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.101266 31763 raft_consensus.cc:493] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.101944 31647 raft_consensus.cc:2749] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:53.101851 31763 raft_consensus.cc:515] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:53.101608 30709 leader_election.cc:304] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:53.104091 31763 leader_election.cc:290] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:53.105964 31799 raft_consensus.cc:2749] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:53.106463 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
W20260709 12:21:53.110091 30783 leader_election.cc:336] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.110603 30783 leader_election.cc:304] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:53.112198 31785 raft_consensus.cc:493] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.113999 31785 raft_consensus.cc:515] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:53.115862 31763 raft_consensus.cc:2749] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:53.116071 31647 raft_consensus.cc:493] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.119019 31647 raft_consensus.cc:515] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:53.121997 31647 leader_election.cc:290] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:53.123431 31785 leader_election.cc:290] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:53.126802 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78acfb4f1d649e4821c390039d2ede5" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
W20260709 12:21:53.130165 30860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 51657.3us
I20260709 12:21:53.131899 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:53.132177 31647 raft_consensus.cc:493] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.132845 31647 raft_consensus.cc:515] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:53.132862 30820 raft_consensus.cc:2468] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 3.
I20260709 12:21:53.136643 31647 leader_election.cc:290] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:53.140693 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e946ad6dd9cb42ad93987cebde13ba9a" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:53.142377 30860 leader_election.cc:304] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:53.143227 31647 raft_consensus.cc:2804] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:53.143680 31647 raft_consensus.cc:493] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.144124 31647 raft_consensus.cc:3060] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:53.146495 30857 leader_election.cc:336] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.147002 31799 raft_consensus.cc:493] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.147912 31799 raft_consensus.cc:515] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
W20260709 12:21:53.147114 30857 leader_election.cc:336] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.150669 30857 leader_election.cc:304] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:53.151494 31785 raft_consensus.cc:2749] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:53.154168 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7695652594064f568b2df572cb76e12a" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:53.154541 31799 leader_election.cc:290] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
W20260709 12:21:53.156986 30857 leader_election.cc:336] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.157460 30857 leader_election.cc:304] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:53.159886 31763 raft_consensus.cc:493] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.160604 31763 raft_consensus.cc:515] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
W20260709 12:21:53.165182 30709 leader_election.cc:336] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.167675 30890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e946ad6dd9cb42ad93987cebde13ba9a" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:53.168432 30890 raft_consensus.cc:2468] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:53.168900 31763 leader_election.cc:290] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:53.171295 30785 leader_election.cc:304] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:53.171465 30711 leader_election.cc:304] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:53.172803 31539 raft_consensus.cc:2804] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:53.173270 31539 raft_consensus.cc:493] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.173568 31785 raft_consensus.cc:2749] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:53.173647 31539 raft_consensus.cc:3060] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.177251 31647 raft_consensus.cc:515] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
W20260709 12:21:53.177780 30783 leader_election.cc:336] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.180826 31647 leader_election.cc:290] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:53.172817 31799 raft_consensus.cc:2749] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:21:53.184962 30857 leader_election.cc:336] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.185369 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c645f524d71421eb842b8b854f95597" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:53.185930 30820 raft_consensus.cc:3060] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:53.215452 30820 raft_consensus.cc:2468] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 4.
I20260709 12:21:53.218761 31539 raft_consensus.cc:515] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:53.221459 31767 raft_consensus.cc:493] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.229192 30860 leader_election.cc:304] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:53.229394 31767 raft_consensus.cc:515] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:53.230870 31785 raft_consensus.cc:2804] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:53.231556 31785 raft_consensus.cc:697] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 4 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:53.231778 31767 leader_election.cc:290] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:53.222749 31799 raft_consensus.cc:493] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.232613 31799 raft_consensus.cc:515] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:53.232870 31785 consensus_queue.cc:237] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:53.234894 31799 leader_election.cc:290] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:53.236240 30890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78acfb4f1d649e4821c390039d2ede5" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:53.237006 30890 raft_consensus.cc:2468] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:53.238387 30711 leader_election.cc:304] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
W20260709 12:21:53.243237 30709 leader_election.cc:336] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:21:53.243854 30709 leader_election.cc:336] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.244999 31799 raft_consensus.cc:2804] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:53.245502 31799 raft_consensus.cc:493] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.245941 31799 raft_consensus.cc:3060] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.247066 31539 leader_election.cc:290] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:53.254156 30569 catalog_manager.cc:5697] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a reported cstate change: term changed from 3 to 4, leader changed from 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193) to d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196). New cstate: current_term: 4 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:53.255555 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac2bacfc36f49459fc2b2b2d8afb01d" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:53.258018 31767 raft_consensus.cc:493] T 81434413f4d7497a8ae5f95db857f819 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.258608 31767 raft_consensus.cc:515] T 81434413f4d7497a8ae5f95db857f819 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:53.261088 30890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e946ad6dd9cb42ad93987cebde13ba9a" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:53.261866 30890 raft_consensus.cc:3060] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.265483 31806 raft_consensus.cc:493] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.266119 31806 raft_consensus.cc:515] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:53.268425 31767 leader_election.cc:290] T 81434413f4d7497a8ae5f95db857f819 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:53.268831 31806 leader_election.cc:290] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
W20260709 12:21:53.269266 30709 leader_election.cc:336] T 81434413f4d7497a8ae5f95db857f819 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.274901 30712 leader_election.cc:304] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:53.276152 31767 raft_consensus.cc:2749] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:53.278075 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815af3bc37df4d158766ac2e615de683" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
W20260709 12:21:53.278887 30783 leader_election.cc:336] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.281956 31806 raft_consensus.cc:493] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.282536 31806 raft_consensus.cc:515] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:53.285066 31806 leader_election.cc:290] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:53.286036 31799 raft_consensus.cc:515] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:53.272177 30890 raft_consensus.cc:2468] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 2.
I20260709 12:21:53.289161 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78acfb4f1d649e4821c390039d2ede5" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:53.289491 30785 leader_election.cc:304] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:53.289901 30886 raft_consensus.cc:3060] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.290375 31806 raft_consensus.cc:2804] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:53.290910 31806 raft_consensus.cc:697] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [term 2 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:53.291854 31806 consensus_queue.cc:237] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:53.293392 31767 raft_consensus.cc:493] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.294083 31767 raft_consensus.cc:515] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:53.294652 31798 raft_consensus.cc:493] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.295233 31798 raft_consensus.cc:515] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:53.297247 31799 leader_election.cc:290] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:53.297335 31798 leader_election.cc:290] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:21:53.298239 31767 leader_election.cc:290] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:53.300119 30890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38606820b9b349d3ad9f9fae03de5e86" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:53.301373 30890 raft_consensus.cc:2468] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 1.
I20260709 12:21:53.302852 30711 leader_election.cc:304] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:53.304095 31799 raft_consensus.cc:2804] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:53.304945 31799 raft_consensus.cc:493] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.305421 31799 raft_consensus.cc:3060] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.311486 31490 raft_consensus.cc:493] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.312124 31490 raft_consensus.cc:515] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:53.313797 31799 raft_consensus.cc:515] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:53.314687 31490 leader_election.cc:290] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:53.311033 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81434413f4d7497a8ae5f95db857f819" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:53.320235 30886 raft_consensus.cc:2468] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 2.
I20260709 12:21:53.323614 30888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38606820b9b349d3ad9f9fae03de5e86" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:53.323814 31799 leader_election.cc:290] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:53.324784 30888 raft_consensus.cc:3060] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.325896 30711 leader_election.cc:304] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:53.327387 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61dc8e98f804681b0815e953b2d2ad1" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:53.328130 30739 raft_consensus.cc:2468] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 4.
I20260709 12:21:53.328311 31785 raft_consensus.cc:493] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.329018 31785 raft_consensus.cc:515] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
W20260709 12:21:53.329861 30783 leader_election.cc:336] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.330415 30783 leader_election.cc:304] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:53.331254 31806 raft_consensus.cc:2749] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:53.330494 31767 raft_consensus.cc:2804] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:53.332111 30811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec2e3f6d6be4c038a84a15ea8b61235" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:53.332526 31767 raft_consensus.cc:697] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [term 2 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:53.333372 30712 leader_election.cc:304] T 81434413f4d7497a8ae5f95db857f819 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:53.334074 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56cad4068d4388bf572777bcfb89b3" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:53.334928 30783 leader_election.cc:304] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
I20260709 12:21:53.336440 31799 raft_consensus.cc:2749] T 81434413f4d7497a8ae5f95db857f819 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:53.337564 30813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fee969f4c2a4579ab7911212a86bf67" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:53.338344 31806 raft_consensus.cc:2804] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:21:53.339140 30783 leader_election.cc:336] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.339272 31806 raft_consensus.cc:493] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.337599 31767 consensus_queue.cc:237] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:53.339700 31806 raft_consensus.cc:3060] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:53.341666 30569 catalog_manager.cc:5697] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 1 to 2, leader changed from 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193) to 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195). New cstate: current_term: 2 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:53.344848 23151 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 30692)
I20260709 12:21:53.348816 31539 raft_consensus.cc:493] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.349459 31539 raft_consensus.cc:515] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:53.351958 31539 leader_election.cc:290] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
W20260709 12:21:53.354919 30857 leader_election.cc:336] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.356971 30860 leader_election.cc:304] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:53.331342 31785 leader_election.cc:290] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:53.358125 31647 raft_consensus.cc:2749] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:53.360364 30888 raft_consensus.cc:2468] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 2.
I20260709 12:21:53.362126 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec2e3f6d6be4c038a84a15ea8b61235" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:53.364827 30739 raft_consensus.cc:2468] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:53.365067 30711 leader_election.cc:304] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:53.366784 31798 raft_consensus.cc:2804] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:53.367334 31798 raft_consensus.cc:697] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [term 2 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:21:53.368312 31798 consensus_queue.cc:237] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:53.369926 30783 leader_election.cc:304] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
I20260709 12:21:53.370811 31763 raft_consensus.cc:2804] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:53.371263 31763 raft_consensus.cc:493] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
W20260709 12:21:53.370986 30709 leader_election.cc:336] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.371660 31763 raft_consensus.cc:3060] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.372786 31806 raft_consensus.cc:515] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:53.373576 30709 leader_election.cc:304] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
W20260709 12:21:53.374619 30709 leader_election.cc:336] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:21:53.375907 30709 leader_election.cc:336] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.385840 31539 raft_consensus.cc:493] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.386281 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61dc8e98f804681b0815e953b2d2ad1" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:53.385700 30569 catalog_manager.cc:5697] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 1 to 2, leader changed from 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193) to 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194). New cstate: current_term: 2 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:53.386471 31539 raft_consensus.cc:515] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:53.386951 30739 raft_consensus.cc:3060] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:53.388820 31539 leader_election.cc:290] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:53.392259 31539 raft_consensus.cc:493] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.374878 31806 leader_election.cc:290] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 5 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:53.375110 31767 raft_consensus.cc:2749] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:53.394261 31539 raft_consensus.cc:515] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:53.396442 31539 leader_election.cc:290] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
W20260709 12:21:53.382711 30709 leader_election.cc:336] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.397894 30709 leader_election.cc:304] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:53.398908 31767 raft_consensus.cc:2749] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:21:53.399569 30709 leader_election.cc:336] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.380422 31763 raft_consensus.cc:515] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
W20260709 12:21:53.401168 30783 leader_election.cc:336] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:21:53.409797 30783 leader_election.cc:336] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.403631 30739 raft_consensus.cc:2468] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 5.
I20260709 12:21:53.405778 31763 leader_election.cc:290] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:53.412346 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56cad4068d4388bf572777bcfb89b3" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:53.410382 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81434413f4d7497a8ae5f95db857f819" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:53.413075 30744 raft_consensus.cc:2468] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:53.413441 30740 raft_consensus.cc:2468] T 81434413f4d7497a8ae5f95db857f819 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:53.414215 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec2e3f6d6be4c038a84a15ea8b61235" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:53.414750 30745 raft_consensus.cc:3060] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.419385 31806 raft_consensus.cc:493] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.420059 31806 raft_consensus.cc:515] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:53.422005 30783 leader_election.cc:304] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:53.422890 30745 raft_consensus.cc:2468] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 2.
I20260709 12:21:53.423585 31539 raft_consensus.cc:2804] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:53.424160 31539 raft_consensus.cc:697] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 5 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:53.424270 31806 leader_election.cc:290] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:53.426249 31785 raft_consensus.cc:493] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.425942 31539 consensus_queue.cc:237] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:53.426863 31785 raft_consensus.cc:515] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:53.430222 30783 leader_election.cc:304] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
I20260709 12:21:53.431953 31807 raft_consensus.cc:2804] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:53.432399 31807 raft_consensus.cc:493] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.432830 31807 raft_consensus.cc:3060] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.435215 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7695652594064f568b2df572cb76e12a" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:53.436432 30745 raft_consensus.cc:2468] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
W20260709 12:21:53.436429 30857 leader_election.cc:336] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.438464 30857 leader_election.cc:304] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:53.439303 31647 raft_consensus.cc:2804] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:53.439716 31647 raft_consensus.cc:493] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.440079 31647 raft_consensus.cc:3060] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.441999 31807 raft_consensus.cc:515] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:53.444235 31807 leader_election.cc:290] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:53.431298 30783 leader_election.cc:304] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
I20260709 12:21:53.445297 31763 raft_consensus.cc:2804] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:53.445644 30783 leader_election.cc:304] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
I20260709 12:21:53.445937 31763 raft_consensus.cc:493] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.446538 31763 raft_consensus.cc:3060] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.436533 31785 leader_election.cc:290] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
W20260709 12:21:53.448486 30783 leader_election.cc:336] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:21:53.449738 30783 leader_election.cc:336] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:21:53.450403 30783 leader_election.cc:336] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.455821 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56cad4068d4388bf572777bcfb89b3" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:53.456518 30744 raft_consensus.cc:3060] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.460930 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac2bacfc36f49459fc2b2b2d8afb01d" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:53.461541 30745 raft_consensus.cc:2468] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 3.
I20260709 12:21:53.469393 31806 raft_consensus.cc:493] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.470321 31806 raft_consensus.cc:515] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:53.471724 30744 raft_consensus.cc:2468] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 2.
I20260709 12:21:53.452745 31807 raft_consensus.cc:2804] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:53.474576 31807 raft_consensus.cc:697] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:53.474970 31647 raft_consensus.cc:515] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:53.475678 31807 consensus_queue.cc:237] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:53.473027 31763 raft_consensus.cc:515] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:53.471606 30569 catalog_manager.cc:5697] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 1 to 2, leader changed from 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193) to 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194). New cstate: current_term: 2 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:53.480914 31763 leader_election.cc:290] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:53.479847 30568 catalog_manager.cc:5697] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 4 to 5, leader changed from 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193) to 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195). New cstate: current_term: 5 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:53.485204 31812 raft_consensus.cc:493] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.485857 31812 raft_consensus.cc:515] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:53.502449 30783 leader_election.cc:304] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
W20260709 12:21:53.503654 30857 leader_election.cc:336] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.504052 31798 raft_consensus.cc:493] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.504940 31798 raft_consensus.cc:515] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:53.505800 31647 leader_election.cc:290] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:53.506681 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7695652594064f568b2df572cb76e12a" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:53.507447 30744 raft_consensus.cc:3060] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.510753 30783 leader_election.cc:304] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
I20260709 12:21:53.515432 30888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be8d04f2ad34fd5b7c66aa68c8fa47a" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:53.517527 31812 leader_election.cc:290] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:53.518761 31812 raft_consensus.cc:2804] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:53.519222 31812 raft_consensus.cc:697] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:53.511250 31539 raft_consensus.cc:2804] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:53.519677 31539 raft_consensus.cc:493] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.520090 31539 raft_consensus.cc:3060] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:53.525239 31798 leader_election.cc:290] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:53.530109 30744 raft_consensus.cc:2468] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 2.
I20260709 12:21:53.530467 31806 leader_election.cc:290] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
W20260709 12:21:53.531255 30709 leader_election.cc:336] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.531716 30709 leader_election.cc:304] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:53.532143 30857 leader_election.cc:304] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:53.532995 31798 raft_consensus.cc:2749] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:53.533804 31785 raft_consensus.cc:2804] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:53.534579 31785 raft_consensus.cc:697] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [term 2 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:53.536108 31804 raft_consensus.cc:493] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.537354 31804 raft_consensus.cc:515] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:53.540882 31647 raft_consensus.cc:493] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.541345 31804 leader_election.cc:290] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:53.541589 31647 raft_consensus.cc:515] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:53.542155 31793 raft_consensus.cc:493] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.542821 31793 raft_consensus.cc:515] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:53.520179 31812 consensus_queue.cc:237] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:53.545050 31793 leader_election.cc:290] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:53.545696 31793 raft_consensus.cc:493] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.549125 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baad7ab904cc431381366c54397a57ef" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:53.549621 30820 raft_consensus.cc:2468] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 2.
I20260709 12:21:53.546216 31793 raft_consensus.cc:515] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:53.550719 30860 leader_election.cc:304] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:53.544384 31647 leader_election.cc:290] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:53.539004 31785 consensus_queue.cc:237] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:53.554627 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be8d04f2ad34fd5b7c66aa68c8fa47a" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9" is_pre_election: true
I20260709 12:21:53.552435 30813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:53.555682 30813 raft_consensus.cc:2468] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 3.
I20260709 12:21:53.561035 30744 raft_consensus.cc:2468] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:53.560501 31647 raft_consensus.cc:2804] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:53.565007 31647 raft_consensus.cc:493] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.565439 31647 raft_consensus.cc:3060] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:53.565689 31793 leader_election.cc:290] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:53.568207 30857 leader_election.cc:304] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:53.570590 31793 raft_consensus.cc:2804] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:53.570988 31793 raft_consensus.cc:493] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.571339 31793 raft_consensus.cc:3060] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.573493 30888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:53.574293 30888 raft_consensus.cc:2468] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 3.
W20260709 12:21:53.575237 30857 leader_election.cc:336] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:21:53.575659 30783 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 65023.3us
W20260709 12:21:53.576234 30857 leader_election.cc:336] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:21:53.577085 30857 leader_election.cc:336] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:21:53.577652 30857 leader_election.cc:336] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.576911 30888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fee969f4c2a4579ab7911212a86bf67" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:53.580154 30785 leader_election.cc:304] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:53.578429 31539 raft_consensus.cc:515] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:53.583283 31815 raft_consensus.cc:2804] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:53.583809 31815 raft_consensus.cc:493] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.584280 31815 raft_consensus.cc:3060] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:53.579299 30888 raft_consensus.cc:2468] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 1.
I20260709 12:21:53.589313 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81434413f4d7497a8ae5f95db857f819" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:53.589962 30744 raft_consensus.cc:3060] T 81434413f4d7497a8ae5f95db857f819 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.594233 30785 leader_election.cc:304] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:53.597018 30813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815af3bc37df4d158766ac2e615de683" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:21:53.597398 31816 raft_consensus.cc:2804] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:53.597779 30813 raft_consensus.cc:2468] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 1.
I20260709 12:21:53.597800 31816 raft_consensus.cc:493] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.598803 31816 raft_consensus.cc:3060] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.600512 30860 leader_election.cc:304] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:53.605686 30744 raft_consensus.cc:2468] T 81434413f4d7497a8ae5f95db857f819 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 2.
I20260709 12:21:53.620883 30568 catalog_manager.cc:5697] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a reported cstate change: term changed from 1 to 2, leader changed from 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193) to d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196). New cstate: current_term: 2 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:53.622203 31816 raft_consensus.cc:515] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:53.606087 31647 raft_consensus.cc:515] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:53.606848 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac2bacfc36f49459fc2b2b2d8afb01d" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:53.641088 30740 raft_consensus.cc:3060] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:53.607535 31785 raft_consensus.cc:2804] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:53.610409 30783 leader_election.cc:336] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.644290 31785 raft_consensus.cc:493] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.611296 30860 leader_election.cc:304] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:53.584370 31539 leader_election.cc:290] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:53.627813 31815 raft_consensus.cc:515] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:53.631680 31793 raft_consensus.cc:515] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:53.644809 31785 raft_consensus.cc:3060] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:53.647212 31793 leader_election.cc:290] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 election: Requested vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:21:53.647205 31819 raft_consensus.cc:2804] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:53.649123 31819 raft_consensus.cc:493] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:21:53.649490 31819 raft_consensus.cc:3060] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:53.644840 30783 leader_election.cc:336] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.656131 30783 leader_election.cc:304] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
I20260709 12:21:53.658521 30744 raft_consensus.cc:1275] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Refusing update from remote peer 20c7a0cd21c3449587fdeeff565557d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:53.665138 31815 leader_election.cc:290] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:53.666757 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:53.670028 31819 raft_consensus.cc:515] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:53.671095 31647 leader_election.cc:290] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:53.671705 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baad7ab904cc431381366c54397a57ef" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
W20260709 12:21:53.672094 30783 leader_election.cc:336] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.672374 30820 raft_consensus.cc:3060] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:53.672511 31539 raft_consensus.cc:2804] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:21:53.673017 30783 leader_election.cc:336] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.673084 31539 raft_consensus.cc:697] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:53.674506 31539 consensus_queue.cc:237] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:53.680433 30820 raft_consensus.cc:2468] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 3.
I20260709 12:21:53.682030 30860 leader_election.cc:304] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:53.683597 31647 raft_consensus.cc:2804] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:53.684180 31647 raft_consensus.cc:697] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [term 3 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:53.684707 30740 raft_consensus.cc:2468] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 4.
I20260709 12:21:53.685134 31647 consensus_queue.cc:237] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:53.686215 30813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815af3bc37df4d158766ac2e615de683" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:53.686859 31816 leader_election.cc:290] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:53.686901 30813 raft_consensus.cc:3060] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.687628 30888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fee969f4c2a4579ab7911212a86bf67" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:53.688278 31819 leader_election.cc:290] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:53.688349 30888 raft_consensus.cc:3060] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.690932 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be8d04f2ad34fd5b7c66aa68c8fa47a" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:21:53.691857 30744 raft_consensus.cc:3060] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.699350 31785 raft_consensus.cc:515] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:53.700392 30568 catalog_manager.cc:5697] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 1 to 2, leader changed from 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193) to 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195). New cstate: current_term: 2 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:53.705305 30813 raft_consensus.cc:2468] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 2.
I20260709 12:21:53.711504 30888 raft_consensus.cc:2468] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 2.
I20260709 12:21:53.717991 30860 leader_election.cc:304] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:53.717715 30568 catalog_manager.cc:5697] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 1 to 2, leader changed from 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193) to 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195). New cstate: current_term: 2 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:53.718894 30785 leader_election.cc:304] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:53.719745 31819 raft_consensus.cc:2804] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:53.720006 31539 raft_consensus.cc:2804] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:53.720306 31819 raft_consensus.cc:697] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [term 2 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:53.720651 31539 raft_consensus.cc:697] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:53.721446 31819 consensus_queue.cc:237] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:53.721760 31539 consensus_queue.cc:237] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
W20260709 12:21:53.712360 30783 leader_election.cc:336] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:21:53.731426 30783 leader_election.cc:336] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.734721 30886 raft_consensus.cc:2393] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c7a0cd21c3449587fdeeff565557d3 in current term 4: Already voted for candidate d3ab9d21f8864b50a71b49c7d624584a in this term.
I20260709 12:21:53.740051 31785 leader_election.cc:290] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:53.740914 30813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:21:53.751216 30813 raft_consensus.cc:2393] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d3ab9d21f8864b50a71b49c7d624584a in current term 4: Already voted for candidate 20c7a0cd21c3449587fdeeff565557d3 in this term.
I20260709 12:21:53.741979 31539 consensus_queue.cc:1048] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:53.742849 30783 leader_election.cc:304] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:53.755362 31812 raft_consensus.cc:2804] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:53.755944 31812 raft_consensus.cc:697] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 4 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
W20260709 12:21:53.756784 30783 consensus_peers.cc:597] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:53.756886 31812 consensus_queue.cc:237] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:21:53.759900 30813 raft_consensus.cc:1275] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Refusing update from remote peer d3ab9d21f8864b50a71b49c7d624584a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:53.762020 31793 consensus_queue.cc:1048] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:21:53.770671 30709 consensus_peers.cc:597] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:53.778398 30886 raft_consensus.cc:1275] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Refusing update from remote peer 20c7a0cd21c3449587fdeeff565557d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:53.780431 31539 consensus_queue.cc:1048] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 12:21:53.793413 30783 leader_election.cc:336] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.808501 30744 raft_consensus.cc:2468] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 2.
I20260709 12:21:53.794701 30783 leader_election.cc:304] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:21:53.813185 31815 raft_consensus.cc:2749] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:21:53.814486 30783 consensus_peers.cc:597] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:53.815240 30783 leader_election.cc:336] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:21:53.832278 30857 leader_election.cc:336] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:21:53.833323 30857 leader_election.cc:336] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.873886 30857 leader_election.cc:304] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
W20260709 12:21:53.888468 30857 leader_election.cc:336] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:21:53.889642 30857 leader_election.cc:336] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:53.896385 30857 leader_election.cc:304] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:53.887677 31793 raft_consensus.cc:2804] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:53.908915 31793 raft_consensus.cc:697] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 2 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:21:53.909926 31793 consensus_queue.cc:237] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:21:53.913393 30739 raft_consensus.cc:1275] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 5 FOLLOWER]: Refusing update from remote peer 20c7a0cd21c3449587fdeeff565557d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:53.925076 31804 raft_consensus.cc:2749] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:53.949148 30888 raft_consensus.cc:1275] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Refusing update from remote peer 4a9042c4154c442297159d1c9f1186b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:53.952118 31490 consensus_queue.cc:1048] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:21:53.956568 30857 consensus_peers.cc:597] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:53.959458 31812 consensus_queue.cc:1048] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:21:53.963887 30709 consensus_peers.cc:597] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:53.966184 30857 consensus_peers.cc:597] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:53.974948 30783 consensus_peers.cc:597] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:53.985620 30886 raft_consensus.cc:1275] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Refusing update from remote peer 4a9042c4154c442297159d1c9f1186b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:53.988847 30569 catalog_manager.cc:5697] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 1 to 2, leader changed from 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193) to 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195). New cstate: current_term: 2 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:53.990763 31490 consensus_queue.cc:1048] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:53.993388 30569 catalog_manager.cc:5697] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 1 to 2, leader changed from 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193) to 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195). New cstate: current_term: 2 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:53.995172 30569 catalog_manager.cc:5697] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 3 to 4, leader changed from 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193) to 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195). New cstate: current_term: 4 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:54.005847 30783 consensus_peers.cc:597] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:54.000521 30568 catalog_manager.cc:5697] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a reported cstate change: term changed from 2 to 3, leader changed from 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193) to d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196). New cstate: current_term: 3 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:54.008678 30568 catalog_manager.cc:5697] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a reported cstate change: term changed from 1 to 2, leader changed from 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193) to d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196). New cstate: current_term: 2 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:54.044981 30783 consensus_peers.cc:597] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:54.045459 30783 consensus_peers.cc:597] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:54.075448 30783 consensus_peers.cc:597] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:54.075824 30740 raft_consensus.cc:1275] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Refusing update from remote peer d3ab9d21f8864b50a71b49c7d624584a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:54.078150 31785 consensus_queue.cc:1048] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:54.091567 30745 raft_consensus.cc:1275] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Refusing update from remote peer 20c7a0cd21c3449587fdeeff565557d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:54.097316 31817 consensus_queue.cc:1048] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:54.116900 30739 raft_consensus.cc:1275] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Refusing update from remote peer 20c7a0cd21c3449587fdeeff565557d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:54.127593 31817 consensus_queue.cc:1048] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:21:54.134333 30886 raft_consensus.cc:1275] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Refusing update from remote peer 20c7a0cd21c3449587fdeeff565557d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:54.139192 31763 consensus_queue.cc:1048] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:21:54.144008 30567 catalog_manager.cc:5697] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a reported cstate change: term changed from 1 to 2, leader changed from 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193) to d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196). New cstate: current_term: 2 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:54.150141 30739 raft_consensus.cc:1275] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 4 FOLLOWER]: Refusing update from remote peer 20c7a0cd21c3449587fdeeff565557d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:54.164304 31763 consensus_queue.cc:1048] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:54.168619 30740 raft_consensus.cc:1275] T 81434413f4d7497a8ae5f95db857f819 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Refusing update from remote peer 20c7a0cd21c3449587fdeeff565557d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:21:54.187407 30857 consensus_peers.cc:597] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:54.190555 31817 consensus_queue.cc:1048] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:21:54.191701 30857 consensus_peers.cc:597] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:54.225010 30857 consensus_peers.cc:597] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:54.247848 30783 consensus_peers.cc:597] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:54.255498 30783 consensus_peers.cc:597] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:54.265404 30783 consensus_peers.cc:597] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:54.277828 30783 consensus_peers.cc:597] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:54.290910 30813 raft_consensus.cc:1275] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Refusing update from remote peer d3ab9d21f8864b50a71b49c7d624584a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:54.292819 31647 consensus_queue.cc:1048] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:54.300956 30820 raft_consensus.cc:1275] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Refusing update from remote peer d3ab9d21f8864b50a71b49c7d624584a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:54.304105 31647 consensus_queue.cc:1048] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:21:54.340305 30857 consensus_peers.cc:597] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:54.345352 23151 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 30692)
I20260709 12:21:54.347342 30739 raft_consensus.cc:1275] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Refusing update from remote peer d3ab9d21f8864b50a71b49c7d624584a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:54.358145 31820 consensus_queue.cc:1048] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:21:54.433588 30709 consensus_peers.cc:597] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:54.451786 30857 consensus_peers.cc:597] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:54.454821 30857 consensus_peers.cc:597] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:54.517092 30709 consensus_peers.cc:597] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:54.527676 30709 consensus_peers.cc:597] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:54.577533 30709 consensus_peers.cc:597] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:54.714025 30857 consensus_peers.cc:597] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:54.742672 30857 consensus_peers.cc:597] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:54.787192 30709 consensus_peers.cc:597] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:54.809056 30709 consensus_peers.cc:597] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:54.846735 30857 consensus_peers.cc:597] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:54.871134 30709 consensus_peers.cc:597] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:54.874426 30709 consensus_peers.cc:597] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:54.909709 30709 consensus_peers.cc:597] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:54.935667 30709 consensus_peers.cc:597] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:54.996924 30783 consensus_peers.cc:597] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.031263 30709 consensus_peers.cc:597] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.052987 30709 consensus_peers.cc:597] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.073886 30857 consensus_peers.cc:597] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.178923 30709 consensus_peers.cc:597] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.179540 30709 consensus_peers.cc:597] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.186724 30857 consensus_peers.cc:597] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.201967 30709 consensus_peers.cc:597] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.345933 23151 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 30692)
W20260709 12:21:55.373430 30709 consensus_peers.cc:597] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:55.607930 31851 raft_consensus.cc:493] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.608592 31851 raft_consensus.cc:515] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:55.612007 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:21:55.612797 30886 raft_consensus.cc:2468] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 4.
I20260709 12:21:55.614367 30785 leader_election.cc:304] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:21:55.615301 31539 raft_consensus.cc:2804] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:55.615738 31539 raft_consensus.cc:493] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:55.616041 31539 raft_consensus.cc:3060] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:55.619513 31851 leader_election.cc:290] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:55.626955 31539 raft_consensus.cc:515] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:55.629065 31539 leader_election.cc:290] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 5 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:21:55.629817 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:21:55.630400 30886 raft_consensus.cc:3060] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:55.631780 30783 leader_election.cc:336] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:55.638741 30886 raft_consensus.cc:2468] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 5.
W20260709 12:21:55.641095 30783 leader_election.cc:336] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:21:55.643554 30785 leader_election.cc:304] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:21:55.644721 31539 raft_consensus.cc:2804] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:55.646211 31539 raft_consensus.cc:697] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 5 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:21:55.647089 31539 consensus_queue.cc:237] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:21:55.675944 30565 catalog_manager.cc:5697] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 3 to 5, leader changed from 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193) to 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195). New cstate: current_term: 5 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:55.887181 30783 consensus_peers.cc:597] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:56.087460 30890 raft_consensus.cc:1275] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 5 FOLLOWER]: Refusing update from remote peer 20c7a0cd21c3449587fdeeff565557d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:56.102878 31539 consensus_queue.cc:1048] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:21:56.147346 30783 consensus_peers.cc:597] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:56.190246 30783 consensus_peers.cc:597] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:56.232218 30783 consensus_peers.cc:597] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:56.264503 30783 consensus_peers.cc:597] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:56.280813 30857 consensus_peers.cc:597] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:56.346668 23151 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 30692)
W20260709 12:21:56.361440 30783 consensus_peers.cc:597] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:56.420214 30709 consensus_peers.cc:597] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:56.447880 30857 consensus_peers.cc:597] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:56.543047 30783 consensus_peers.cc:597] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:56.581998 30783 consensus_peers.cc:597] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:56.643118 30783 consensus_peers.cc:597] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:56.810313 30783 consensus_peers.cc:597] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:56.877820 30709 consensus_peers.cc:597] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:56.903505 30857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 202689us
W20260709 12:21:56.930298 30857 consensus_peers.cc:597] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:56.933175 30857 consensus_peers.cc:597] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:56.933822 30857 consensus_peers.cc:597] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:56.942777 30857 consensus_peers.cc:597] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:56.957665 30857 consensus_peers.cc:597] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:57.003887 30857 consensus_peers.cc:597] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:57.007316 30783 consensus_peers.cc:597] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:57.072574 30783 consensus_peers.cc:597] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:57.347296 23151 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 30692)
W20260709 12:21:57.371486 30709 consensus_peers.cc:597] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:57.389417 30709 consensus_peers.cc:597] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:57.413903 30857 consensus_peers.cc:597] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:57.435896 30857 consensus_peers.cc:597] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:57.436426 30857 consensus_peers.cc:597] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:57.531704 30783 consensus_peers.cc:597] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:57.532644 30709 consensus_peers.cc:597] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:57.574646 30857 consensus_peers.cc:597] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:57.618616 30709 consensus_peers.cc:597] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:57.674224 30857 consensus_peers.cc:597] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:57.775301 30709 consensus_peers.cc:597] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:57.791708 30709 consensus_peers.cc:597] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:57.794608 30709 consensus_peers.cc:597] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:57.837147 30709 consensus_peers.cc:597] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:57.955681 30709 consensus_peers.cc:597] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:57.999460 30709 consensus_peers.cc:597] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:58.021389 30709 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111) [suppressed 443 similar messages]
W20260709 12:21:58.027827 30709 consensus_peers.cc:597] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:58.192922 30709 consensus_peers.cc:597] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:58.266466 30783 consensus_peers.cc:597] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:58.300906 30709 consensus_peers.cc:597] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:58.348259 23151 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 30692)
W20260709 12:21:58.371786 30709 consensus_peers.cc:597] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:58.439299 30709 consensus_peers.cc:597] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:58.565670 30709 consensus_peers.cc:597] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:58.587224 30709 consensus_peers.cc:597] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:58.687606 30783 consensus_peers.cc:597] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:58.810910 30783 consensus_peers.cc:597] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:58.814528 30709 consensus_peers.cc:597] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:58.836036 30783 consensus_peers.cc:597] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:58.904138 30857 consensus_peers.cc:597] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:58.910900 30857 consensus_peers.cc:597] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:58.952396 30783 consensus_peers.cc:597] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:58.976711 30783 consensus_peers.cc:597] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:58.986918 30783 consensus_peers.cc:597] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:59.079368 30783 consensus_peers.cc:597] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:59.106523 30783 consensus_peers.cc:597] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:59.246109 30857 consensus_peers.cc:597] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:59.261945 30857 consensus_peers.cc:597] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:59.265359 30857 consensus_peers.cc:597] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:59.349812 23151 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 30692)
W20260709 12:21:59.355051 30857 consensus_peers.cc:597] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:59.367457 30857 consensus_peers.cc:597] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:59.397529 30709 consensus_peers.cc:597] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:59.445365 30783 consensus_peers.cc:597] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:59.557992 30857 consensus_peers.cc:597] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:59.600833 30783 consensus_peers.cc:597] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:59.642728 30783 consensus_peers.cc:597] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:59.740252 30857 consensus_peers.cc:597] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:59.776810 30709 consensus_peers.cc:597] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:59.789256 30857 consensus_peers.cc:597] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:59.937012 30857 consensus_peers.cc:597] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:59.976603 30709 consensus_peers.cc:597] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:59.998653 30857 consensus_peers.cc:597] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:00.163416 30709 consensus_peers.cc:597] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:00.213066 30857 consensus_peers.cc:597] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:00.250082 30709 consensus_peers.cc:597] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:00.287874 30709 consensus_peers.cc:597] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:00.299929 30709 consensus_peers.cc:597] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:00.344475 30709 consensus_peers.cc:597] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:00.350427 23151 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 30692)
W20260709 12:22:00.443099 30709 consensus_peers.cc:597] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:00.450361 30709 consensus_peers.cc:597] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:00.463901 30783 consensus_peers.cc:597] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:00.471446 30709 consensus_peers.cc:597] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:00.549453 30709 consensus_peers.cc:597] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:00.808161 30709 consensus_peers.cc:597] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:00.828428 30709 consensus_peers.cc:597] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:00.857164 30783 consensus_peers.cc:597] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:00.987100 30709 consensus_peers.cc:597] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:01.027248 30709 consensus_peers.cc:597] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:01.182781 30709 consensus_peers.cc:597] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:01.203155 30709 consensus_peers.cc:597] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:01.266714 30783 consensus_peers.cc:597] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:01.271149 30709 consensus_peers.cc:597] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:01.277155 30783 consensus_peers.cc:597] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:01.278030 30783 consensus_peers.cc:597] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:01.282990 30783 consensus_peers.cc:597] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:01.342556 30783 consensus_peers.cc:597] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:01.351286 23151 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 30692)
W20260709 12:22:01.377300 30857 consensus_peers.cc:597] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:01.416759 30783 consensus_peers.cc:597] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:01.546744 30857 consensus_peers.cc:597] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:01.682363 30783 consensus_peers.cc:597] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:01.692322 30857 consensus_peers.cc:597] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:01.770756 30857 consensus_peers.cc:597] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:01.857630 30857 consensus_peers.cc:597] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:01.925015 30857 consensus_peers.cc:597] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:01.933669 30783 consensus_peers.cc:597] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:02.020746 30709 consensus_peers.cc:597] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:02.045884 30857 consensus_peers.cc:597] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:02.127633 30783 consensus_peers.cc:597] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:02.180876 30709 consensus_peers.cc:597] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:02.352082 23151 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 30692)
W20260709 12:22:02.360141 30857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 59864.2us
W20260709 12:22:02.405846 30857 consensus_peers.cc:597] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:02.406472 30857 consensus_peers.cc:597] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:02.411197 30783 consensus_peers.cc:597] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:02.424239 30857 consensus_peers.cc:597] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:02.427903 30783 consensus_peers.cc:597] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:02.431277 30709 consensus_peers.cc:597] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:02.440363 30857 consensus_peers.cc:597] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:02.583004 30709 consensus_peers.cc:597] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:02.675004 30709 consensus_peers.cc:597] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:02.689914 30709 consensus_peers.cc:597] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:02.740788 30709 consensus_peers.cc:597] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:02.767203 30857 consensus_peers.cc:597] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:02.849774 30857 consensus_peers.cc:597] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:02.898800 30783 consensus_peers.cc:597] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:02.872298 30709 consensus_peers.cc:597] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:02.915705 30709 consensus_peers.cc:597] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:02.994041 30709 consensus_peers.cc:597] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:03.035135 30857 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111) [suppressed 443 similar messages]
W20260709 12:22:03.061048 30709 consensus_peers.cc:597] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:03.242837 30709 consensus_peers.cc:597] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:03.247923 30783 consensus_peers.cc:597] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:03.251457 30709 consensus_peers.cc:597] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:03.352711 23151 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 30692)
W20260709 12:22:03.360986 30709 consensus_peers.cc:597] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:03.417968 30709 consensus_peers.cc:597] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:03.564528 30857 consensus_peers.cc:597] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:03.612768 30709 consensus_peers.cc:597] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:03.720084 30709 consensus_peers.cc:597] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:03.783617 30709 consensus_peers.cc:597] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:03.784490 30783 consensus_peers.cc:597] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:03.867260 30857 consensus_peers.cc:597] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:03.875816 30783 consensus_peers.cc:597] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:03.885251 30783 consensus_peers.cc:597] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:03.904518 30783 consensus_peers.cc:597] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:03.918586 30783 consensus_peers.cc:597] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:22:03.929711 23151 tablet_server.cc:196] TabletServer@127.22.155.193:0 shutdown complete.
W20260709 12:22:04.013480 30783 consensus_peers.cc:597] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:04.022410 30709 consensus_peers.cc:597] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:04.022706 30783 consensus_peers.cc:597] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:22:04.117422 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:04.139801 31892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:04.161849 30857 consensus_peers.cc:597] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:04.211871 30857 consensus_peers.cc:597] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:04.222064 31893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:04.229583 31897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:04.230393 23151 server_base.cc:1061] running on GCE node
I20260709 12:22:04.234211 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:04.234560 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:04.234810 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599724234766 us; error 0 us; skew 500 ppm
I20260709 12:22:04.235612 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:04.239663 23151 webserver.cc:533] Webserver started at http://127.22.155.193:33521/ using document root <none> and password file <none>
I20260709 12:22:04.240360 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:04.240612 23151 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:22:04.246162 23151 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:22:04.257010 31901 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:04.257988 23151 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:22:04.258365 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/ts-0-root
uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
format_stamp: "Formatted at 2026-07-09 12:21:28 on dist-test-slave-p7fg"
I20260709 12:22:04.258960 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599400258298-23151-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:22:04.272526 30857 consensus_peers.cc:597] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:22:04.300313 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:04.302425 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:04.307565 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:04.314941 31908 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:22:04.371440 30709 consensus_peers.cc:597] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:04.390632 30857 consensus_peers.cc:597] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:04.486241 30709 consensus_peers.cc:597] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:04.528074 30857 consensus_peers.cc:597] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:22:04.594722 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:22:04.595183 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.282s	user 0.010s	sys 0.001s
I20260709 12:22:04.595636 23151 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:22:04.603356 31908 tablet_bootstrap.cc:492] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
W20260709 12:22:04.620169 30783 consensus_peers.cc:597] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:04.623298 31908 tablet_bootstrap.cc:492] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:04.624339 31908 tablet_bootstrap.cc:492] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:04.625031 31908 ts_tablet_manager.cc:1403] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 12:22:04.633049 31908 raft_consensus.cc:359] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:04.634056 31908 raft_consensus.cc:740] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:04.634922 31908 consensus_queue.cc:260] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:04.637599 31908 ts_tablet_manager.cc:1434] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:22:04.638863 31908 tablet_bootstrap.cc:492] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:04.664585 31908 tablet_bootstrap.cc:492] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:04.665699 31908 tablet_bootstrap.cc:492] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:04.669265 31908 ts_tablet_manager.cc:1403] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.008s
I20260709 12:22:04.671793 31908 raft_consensus.cc:359] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:04.672401 31908 raft_consensus.cc:740] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:04.673152 31908 consensus_queue.cc:260] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:04.675010 31908 ts_tablet_manager.cc:1434] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:22:04.675697 31908 tablet_bootstrap.cc:492] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:04.690093 31908 tablet_bootstrap.cc:492] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:04.691197 31908 tablet_bootstrap.cc:492] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:04.691881 31908 ts_tablet_manager.cc:1403] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 12:22:04.694651 31908 raft_consensus.cc:359] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:04.695379 31908 raft_consensus.cc:740] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:04.696172 31908 consensus_queue.cc:260] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:04.698197 31908 ts_tablet_manager.cc:1434] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:22:04.699025 31908 tablet_bootstrap.cc:492] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:04.716850 31908 tablet_bootstrap.cc:492] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:22:04.718163 31908 tablet_bootstrap.cc:492] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:04.718829 31908 ts_tablet_manager.cc:1403] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 12:22:04.722657 31908 raft_consensus.cc:359] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:04.723609 31908 raft_consensus.cc:740] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:04.724264 31908 consensus_queue.cc:260] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:04.727415 31908 ts_tablet_manager.cc:1434] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:22:04.729321 31908 tablet_bootstrap.cc:492] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:04.745527 31908 tablet_bootstrap.cc:492] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:04.746449 31908 tablet_bootstrap.cc:492] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:04.747171 31908 ts_tablet_manager.cc:1403] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.007s
I20260709 12:22:04.749409 31908 raft_consensus.cc:359] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:04.750072 31908 raft_consensus.cc:740] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:04.750833 31908 consensus_queue.cc:260] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:04.752907 31908 ts_tablet_manager.cc:1434] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.001s
I20260709 12:22:04.753788 31908 tablet_bootstrap.cc:492] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
W20260709 12:22:04.773747 30857 consensus_peers.cc:597] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:04.776194 31908 tablet_bootstrap.cc:492] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:22:04.777434 31908 tablet_bootstrap.cc:492] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:04.778296 31908 ts_tablet_manager.cc:1403] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.000s
I20260709 12:22:04.782012 31908 raft_consensus.cc:359] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:04.782927 31908 raft_consensus.cc:740] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:04.783707 31908 consensus_queue.cc:260] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:04.785816 31908 ts_tablet_manager.cc:1434] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:22:04.786671 31908 tablet_bootstrap.cc:492] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:04.804728 31908 tablet_bootstrap.cc:492] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:04.805719 31908 tablet_bootstrap.cc:492] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:04.806344 31908 ts_tablet_manager.cc:1403] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 12:22:04.808475 31908 raft_consensus.cc:359] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:04.809082 31908 raft_consensus.cc:740] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:04.809784 31908 consensus_queue.cc:260] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:04.811609 31908 ts_tablet_manager.cc:1434] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:22:04.812413 31908 tablet_bootstrap.cc:492] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:04.827469 31908 tablet_bootstrap.cc:492] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:04.828223 31908 tablet_bootstrap.cc:492] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:04.828831 31908 ts_tablet_manager.cc:1403] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 12:22:04.830637 31908 raft_consensus.cc:359] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:04.831140 31908 raft_consensus.cc:740] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:04.831805 31908 consensus_queue.cc:260] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:04.833747 31908 ts_tablet_manager.cc:1434] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:22:04.834584 31908 tablet_bootstrap.cc:492] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:04.855201 31908 tablet_bootstrap.cc:492] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:04.856189 31908 tablet_bootstrap.cc:492] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:04.856843 31908 ts_tablet_manager.cc:1403] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.004s
I20260709 12:22:04.859313 31908 raft_consensus.cc:359] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:04.860016 31908 raft_consensus.cc:740] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
W20260709 12:22:04.859952 30783 consensus_peers.cc:597] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:22:04.861176 31908 consensus_queue.cc:260] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:04.863286 31908 ts_tablet_manager.cc:1434] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:22:04.864055 31908 tablet_bootstrap.cc:492] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:04.865173 23151 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:22:04.865532 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.270s	user 0.254s	sys 0.003s
I20260709 12:22:04.881189 31908 tablet_bootstrap.cc:492] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:04.882200 31908 tablet_bootstrap.cc:492] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:04.882839 31908 ts_tablet_manager.cc:1403] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 12:22:04.885465 31908 raft_consensus.cc:359] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:04.886123 31908 raft_consensus.cc:740] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:04.887537 31908 consensus_queue.cc:260] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:04.890204 31908 ts_tablet_manager.cc:1434] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:04.890995 31908 tablet_bootstrap.cc:492] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
W20260709 12:22:04.901829 30709 consensus_peers.cc:597] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:04.917119 31908 tablet_bootstrap.cc:492] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:04.918560 31908 tablet_bootstrap.cc:492] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:04.919243 31908 ts_tablet_manager.cc:1403] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.028s	user 0.024s	sys 0.000s
I20260709 12:22:04.921926 31908 raft_consensus.cc:359] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:04.922609 31908 raft_consensus.cc:740] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:04.923377 31908 consensus_queue.cc:260] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:04.925778 31908 ts_tablet_manager.cc:1434] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:22:04.926612 31908 tablet_bootstrap.cc:492] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:04.946372 31908 tablet_bootstrap.cc:492] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:22:04.947320 31908 tablet_bootstrap.cc:492] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:04.947952 31908 ts_tablet_manager.cc:1403] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.003s
I20260709 12:22:04.950584 31908 raft_consensus.cc:359] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:04.952322 31908 raft_consensus.cc:740] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
W20260709 12:22:04.952473 30857 consensus_peers.cc:597] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:04.953181 31908 consensus_queue.cc:260] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:04.955294 31908 ts_tablet_manager.cc:1434] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:22:04.956064 31908 tablet_bootstrap.cc:492] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:04.974560 31908 tablet_bootstrap.cc:492] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:04.975579 31908 tablet_bootstrap.cc:492] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:04.976241 31908 ts_tablet_manager.cc:1403] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.000s
W20260709 12:22:04.977660 30783 consensus_peers.cc:597] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:04.978415 30709 consensus_peers.cc:597] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:04.978791 31908 raft_consensus.cc:359] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:04.979559 31908 raft_consensus.cc:740] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.017369 31908 consensus_queue.cc:260] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:05.019851 31908 ts_tablet_manager.cc:1434] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.043s	user 0.013s	sys 0.032s
I20260709 12:22:05.020758 31908 tablet_bootstrap.cc:492] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
W20260709 12:22:05.026647 30709 consensus_peers.cc:597] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:05.042232 31908 tablet_bootstrap.cc:492] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:22:05.042706 30857 consensus_peers.cc:597] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:05.043298 31908 tablet_bootstrap.cc:492] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:05.044060 31908 ts_tablet_manager.cc:1403] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.011s
I20260709 12:22:05.047019 31908 raft_consensus.cc:359] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:05.047693 31908 raft_consensus.cc:740] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.053553 31908 consensus_queue.cc:260] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:05.057623 31908 ts_tablet_manager.cc:1434] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:22:05.058476 31908 tablet_bootstrap.cc:492] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
W20260709 12:22:05.064111 30857 consensus_peers.cc:597] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:05.072252 30783 consensus_peers.cc:597] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:22:05.091697 31908 tablet_bootstrap.cc:492] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:05.093221 31908 tablet_bootstrap.cc:492] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:05.094187 31908 ts_tablet_manager.cc:1403] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.007s
W20260709 12:22:05.098999 30857 consensus_peers.cc:597] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:05.103302 31908 raft_consensus.cc:359] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:05.106798 31908 raft_consensus.cc:740] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.107864 31908 consensus_queue.cc:260] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:05.110508 31908 ts_tablet_manager.cc:1434] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:22:05.111452 31908 tablet_bootstrap.cc:492] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:05.137089 31908 tablet_bootstrap.cc:492] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:05.138713 31908 tablet_bootstrap.cc:492] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:05.139446 31908 ts_tablet_manager.cc:1403] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.004s
I20260709 12:22:05.142323 31908 raft_consensus.cc:359] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:05.143041 31908 raft_consensus.cc:740] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.143905 31908 consensus_queue.cc:260] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:05.145857 31908 ts_tablet_manager.cc:1434] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:22:05.146018 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.193:34953
I20260709 12:22:05.146289 31985 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.193:34953 every 8 connection(s)
I20260709 12:22:05.146723 31908 tablet_bootstrap.cc:492] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:05.175120 31908 tablet_bootstrap.cc:492] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:05.176057 31908 tablet_bootstrap.cc:492] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:05.176674 31908 ts_tablet_manager.cc:1403] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.007s
I20260709 12:22:05.179591 31908 raft_consensus.cc:359] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:05.180362 31908 raft_consensus.cc:740] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.181175 31908 consensus_queue.cc:260] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:05.183149 31908 ts_tablet_manager.cc:1434] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:22:05.183949 31908 tablet_bootstrap.cc:492] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:05.188864 31986 heartbeater.cc:344] Connected to a master server at 127.22.155.254:37753
I20260709 12:22:05.189435 31986 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:05.190495 31986 heartbeater.cc:507] Master 127.22.155.254:37753 requested a full tablet report, sending...
I20260709 12:22:05.219470 30569 ts_manager.cc:194] Re-registered known tserver with Master: 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:22:05.223824 31908 tablet_bootstrap.cc:492] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:05.224902 31908 tablet_bootstrap.cc:492] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:05.225785 31908 ts_tablet_manager.cc:1403] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.022s
I20260709 12:22:05.228696 31908 raft_consensus.cc:359] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:05.229359 31908 raft_consensus.cc:740] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.230053 31908 consensus_queue.cc:260] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:05.231994 31908 ts_tablet_manager.cc:1434] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.002s
I20260709 12:22:05.232895 31908 tablet_bootstrap.cc:492] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
W20260709 12:22:05.237409 30709 consensus_peers.cc:597] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:05.259205 30857 consensus_peers.cc:597] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:05.263981 31959 raft_consensus.cc:3060] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.274933 31908 tablet_bootstrap.cc:492] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:05.276254 31908 tablet_bootstrap.cc:492] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:05.277516 31908 ts_tablet_manager.cc:1403] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.020s
I20260709 12:22:05.282311 31908 raft_consensus.cc:359] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:05.283144 31908 raft_consensus.cc:740] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.283964 31908 consensus_queue.cc:260] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:05.286911 31908 ts_tablet_manager.cc:1434] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 12:22:05.287895 31908 tablet_bootstrap.cc:492] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:05.309471 30569 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54634
I20260709 12:22:05.319236 31908 tablet_bootstrap.cc:492] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:05.320160 31986 heartbeater.cc:499] Master 127.22.155.254:37753 was elected leader, sending a full tablet report...
I20260709 12:22:05.320438 31908 tablet_bootstrap.cc:492] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:05.321450 31908 ts_tablet_manager.cc:1403] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.008s
I20260709 12:22:05.320294 31959 raft_consensus.cc:3060] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.324363 31908 raft_consensus.cc:359] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:05.333235 31908 raft_consensus.cc:740] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.335337 31908 consensus_queue.cc:260] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:05.336454 31958 raft_consensus.cc:3060] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.338191 31908 ts_tablet_manager.cc:1434] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:22:05.339295 31908 tablet_bootstrap.cc:492] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:05.347786 31960 raft_consensus.cc:3060] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:05.400154 31908 tablet_bootstrap.cc:492] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:05.401362 31908 tablet_bootstrap.cc:492] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:05.402513 31908 ts_tablet_manager.cc:1403] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.063s	user 0.028s	sys 0.024s
I20260709 12:22:05.406401 31908 raft_consensus.cc:359] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:05.407240 31908 raft_consensus.cc:740] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.408197 31908 consensus_queue.cc:260] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:05.411244 31908 ts_tablet_manager.cc:1434] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.004s
I20260709 12:22:05.412447 31908 tablet_bootstrap.cc:492] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
W20260709 12:22:05.432293 30709 consensus_peers.cc:597] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:05.432868 31959 raft_consensus.cc:3060] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.436774 31908 tablet_bootstrap.cc:492] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:05.437853 31908 tablet_bootstrap.cc:492] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:05.438531 31908 ts_tablet_manager.cc:1403] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.005s
I20260709 12:22:05.441602 31908 raft_consensus.cc:359] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:05.448676 31908 raft_consensus.cc:740] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.449478 31908 consensus_queue.cc:260] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:05.452184 31908 ts_tablet_manager.cc:1434] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:22:05.455785 31959 raft_consensus.cc:3060] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:05.460018 30709 consensus_peers.cc:597] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:05.466451 31908 tablet_bootstrap.cc:492] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:05.514428 31908 tablet_bootstrap.cc:492] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:05.514745 31960 raft_consensus.cc:3060] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:05.515272 31908 tablet_bootstrap.cc:492] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:05.516075 31908 ts_tablet_manager.cc:1403] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.050s	user 0.026s	sys 0.012s
I20260709 12:22:05.518720 31908 raft_consensus.cc:359] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:05.519407 31908 raft_consensus.cc:740] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.520082 31908 consensus_queue.cc:260] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:05.521808 31908 ts_tablet_manager.cc:1434] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.008s
I20260709 12:22:05.522707 31908 tablet_bootstrap.cc:492] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:05.535333 31959 pending_rounds.cc:85] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4: Aborting all ops after (but not including) 1
I20260709 12:22:05.535701 31959 pending_rounds.cc:107] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:22:05.536005 31959 raft_consensus.cc:2889] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:05.540086 31908 tablet_bootstrap.cc:492] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:05.541183 31908 tablet_bootstrap.cc:492] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
W20260709 12:22:05.542405 30709 consensus_peers.cc:597] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:05.545047 31908 ts_tablet_manager.cc:1403] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.002s
I20260709 12:22:05.549326 31960 raft_consensus.cc:3060] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.549043 31908 raft_consensus.cc:359] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:05.549912 31908 raft_consensus.cc:740] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.550700 31908 consensus_queue.cc:260] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:05.554219 31908 ts_tablet_manager.cc:1434] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.006s
W20260709 12:22:05.554606 30709 consensus_peers.cc:597] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:05.555325 31908 tablet_bootstrap.cc:492] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:05.576570 31908 tablet_bootstrap.cc:492] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:05.577704 31908 tablet_bootstrap.cc:492] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:05.578910 31908 ts_tablet_manager.cc:1403] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.003s
W20260709 12:22:05.580163 30709 consensus_peers.cc:597] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:05.581346 31908 raft_consensus.cc:359] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:05.581954 31908 raft_consensus.cc:740] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.582629 31908 consensus_queue.cc:260] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:05.600557 31908 ts_tablet_manager.cc:1434] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:22:05.601502 31908 tablet_bootstrap.cc:492] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:05.616576 31908 tablet_bootstrap.cc:492] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:22:05.617434 31908 tablet_bootstrap.cc:492] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:05.618043 31908 ts_tablet_manager.cc:1403] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.001s
I20260709 12:22:05.620537 31908 raft_consensus.cc:359] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:05.621418 31908 raft_consensus.cc:740] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.622154 31908 consensus_queue.cc:260] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:05.624095 31908 ts_tablet_manager.cc:1434] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:22:05.625262 31908 tablet_bootstrap.cc:492] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:05.640007 31908 tablet_bootstrap.cc:492] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:05.641014 31908 tablet_bootstrap.cc:492] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:05.641716 31908 ts_tablet_manager.cc:1403] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 12:22:05.644601 31908 raft_consensus.cc:359] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:05.645391 31908 raft_consensus.cc:740] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.646054 31908 consensus_queue.cc:260] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:05.648156 31908 ts_tablet_manager.cc:1434] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
I20260709 12:22:05.649010 31908 tablet_bootstrap.cc:492] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:05.685984 31908 tablet_bootstrap.cc:492] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:05.687067 31908 tablet_bootstrap.cc:492] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:05.687776 31908 ts_tablet_manager.cc:1403] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.013s
I20260709 12:22:05.690510 31908 raft_consensus.cc:359] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:05.691242 31908 raft_consensus.cc:740] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.692111 31908 consensus_queue.cc:260] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:05.693830 31908 ts_tablet_manager.cc:1434] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:22:05.695434 31908 tablet_bootstrap.cc:492] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:05.717722 31908 tablet_bootstrap.cc:492] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:05.718779 31908 tablet_bootstrap.cc:492] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:05.719394 31908 ts_tablet_manager.cc:1403] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.010s
I20260709 12:22:05.722586 31908 raft_consensus.cc:359] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:05.723234 31908 raft_consensus.cc:740] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.723937 31908 consensus_queue.cc:260] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:05.726189 31908 ts_tablet_manager.cc:1434] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 12:22:05.727052 31908 tablet_bootstrap.cc:492] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:05.743760 31908 tablet_bootstrap.cc:492] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:05.744619 31908 tablet_bootstrap.cc:492] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:05.745467 31908 ts_tablet_manager.cc:1403] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:22:05.747767 31908 raft_consensus.cc:359] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:05.748349 31908 raft_consensus.cc:740] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.749039 31908 consensus_queue.cc:260] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:05.750998 31908 ts_tablet_manager.cc:1434] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:22:05.752409 31908 tablet_bootstrap.cc:492] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:05.767287 31908 tablet_bootstrap.cc:492] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:05.768429 31908 tablet_bootstrap.cc:492] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:05.769210 31908 ts_tablet_manager.cc:1403] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 12:22:05.771901 31908 raft_consensus.cc:359] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:05.772635 31908 raft_consensus.cc:740] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.773330 31908 consensus_queue.cc:260] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:05.775158 31908 ts_tablet_manager.cc:1434] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:22:05.776810 31908 tablet_bootstrap.cc:492] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:05.798156 31908 tablet_bootstrap.cc:492] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:05.799026 31908 tablet_bootstrap.cc:492] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:05.799769 31908 ts_tablet_manager.cc:1403] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.007s
I20260709 12:22:05.802835 31908 raft_consensus.cc:359] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:05.803575 31908 raft_consensus.cc:740] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.804406 31908 consensus_queue.cc:260] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:05.806005 31908 ts_tablet_manager.cc:1434] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:22:05.807027 31908 tablet_bootstrap.cc:492] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:05.825618 31908 tablet_bootstrap.cc:492] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:05.826723 31908 tablet_bootstrap.cc:492] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:05.827461 31908 ts_tablet_manager.cc:1403] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260709 12:22:05.830071 31908 raft_consensus.cc:359] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:05.830760 31908 raft_consensus.cc:740] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.831426 31908 consensus_queue.cc:260] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:05.833983 31908 ts_tablet_manager.cc:1434] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:22:05.835413 31908 tablet_bootstrap.cc:492] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:05.849665 31908 tablet_bootstrap.cc:492] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:05.850659 31908 tablet_bootstrap.cc:492] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:05.851351 31908 ts_tablet_manager.cc:1403] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 12:22:05.853863 31908 raft_consensus.cc:359] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:05.854540 31908 raft_consensus.cc:740] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.855218 31908 consensus_queue.cc:260] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:05.857213 31908 ts_tablet_manager.cc:1434] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:22:05.859819 31908 tablet_bootstrap.cc:492] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:05.876433 31908 tablet_bootstrap.cc:492] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:22:05.877537 31908 tablet_bootstrap.cc:492] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:05.878340 31908 ts_tablet_manager.cc:1403] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 12:22:05.881124 31908 raft_consensus.cc:359] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:05.882021 31908 raft_consensus.cc:740] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.882790 31908 consensus_queue.cc:260] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:05.886750 31908 ts_tablet_manager.cc:1434] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:22:05.887776 31908 tablet_bootstrap.cc:492] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:05.893591 31959 raft_consensus.cc:3060] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.910473 31908 tablet_bootstrap.cc:492] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:05.911576 31908 tablet_bootstrap.cc:492] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:05.912345 31908 ts_tablet_manager.cc:1403] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.004s
I20260709 12:22:05.926623 31908 raft_consensus.cc:359] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:05.927284 31908 raft_consensus.cc:740] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.928023 31908 consensus_queue.cc:260] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:05.929754 31908 ts_tablet_manager.cc:1434] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:22:05.930410 31908 tablet_bootstrap.cc:492] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:05.956502 31959 pending_rounds.cc:85] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4: Aborting all ops after (but not including) 1
I20260709 12:22:05.956935 31959 pending_rounds.cc:107] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:22:05.957230 31959 raft_consensus.cc:2889] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:05.973145 31908 tablet_bootstrap.cc:492] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:05.974128 31908 tablet_bootstrap.cc:492] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:05.974761 31908 ts_tablet_manager.cc:1403] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.044s	user 0.018s	sys 0.020s
W20260709 12:22:05.981038 30709 consensus_peers.cc:597] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:05.977208 31960 raft_consensus.cc:3060] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.987775 31908 raft_consensus.cc:359] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:05.988545 31908 raft_consensus.cc:740] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.990113 31908 consensus_queue.cc:260] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:05.992151 31908 ts_tablet_manager.cc:1434] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:22:05.992959 31908 tablet_bootstrap.cc:492] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:06.043036 31956 raft_consensus.cc:3060] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.046671 31908 tablet_bootstrap.cc:492] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:06.047649 31908 tablet_bootstrap.cc:492] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:06.048442 31908 ts_tablet_manager.cc:1403] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.056s	user 0.031s	sys 0.021s
I20260709 12:22:06.051564 31908 raft_consensus.cc:359] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:06.052367 31908 raft_consensus.cc:740] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:06.053181 31908 consensus_queue.cc:260] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:06.055508 31908 ts_tablet_manager.cc:1434] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:22:06.056484 31908 tablet_bootstrap.cc:492] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:06.082243 31908 tablet_bootstrap.cc:492] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:06.083305 31908 tablet_bootstrap.cc:492] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:06.089612 31908 ts_tablet_manager.cc:1403] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.004s
I20260709 12:22:06.091893 31960 raft_consensus.cc:3060] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.092147 31908 raft_consensus.cc:359] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:06.123282 31908 raft_consensus.cc:740] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:06.124135 31908 consensus_queue.cc:260] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:06.127257 31908 ts_tablet_manager.cc:1434] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.037s	user 0.016s	sys 0.020s
I20260709 12:22:06.161410 31908 tablet_bootstrap.cc:492] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:06.203230 31958 raft_consensus.cc:3060] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:06.255918 31954 raft_consensus.cc:3060] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:22:06.263454 31908 tablet_bootstrap.cc:492] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:22:06.272389 30860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:45287, user_credentials={real_user=slave}} blocked reactor thread for 61321.1us
I20260709 12:22:06.291539 31908 tablet_bootstrap.cc:492] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:06.293263 31908 ts_tablet_manager.cc:1403] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.132s	user 0.019s	sys 0.025s
I20260709 12:22:06.296759 31908 raft_consensus.cc:359] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:06.297760 31908 raft_consensus.cc:740] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:06.298868 31908 consensus_queue.cc:260] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:06.301460 31908 ts_tablet_manager.cc:1434] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:22:06.302711 31908 tablet_bootstrap.cc:492] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
W20260709 12:22:06.364914 30783 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 135957us
I20260709 12:22:06.383136 31958 raft_consensus.cc:3060] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:06.440361 30783 consensus_peers.cc:597] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 26: this message will repeat every 5th retry.
I20260709 12:22:06.449111 31908 tablet_bootstrap.cc:492] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:06.450245 31908 tablet_bootstrap.cc:492] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:06.450984 31908 ts_tablet_manager.cc:1403] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.149s	user 0.021s	sys 0.020s
I20260709 12:22:06.455833 31908 raft_consensus.cc:359] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:06.456676 31908 raft_consensus.cc:740] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:06.457568 31908 consensus_queue.cc:260] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:06.459992 31908 ts_tablet_manager.cc:1434] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:22:06.460855 31908 tablet_bootstrap.cc:492] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:06.501533 31908 tablet_bootstrap.cc:492] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:06.502707 31908 tablet_bootstrap.cc:492] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:06.503378 31908 ts_tablet_manager.cc:1403] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.018s
I20260709 12:22:06.506302 31908 raft_consensus.cc:359] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:06.507041 31908 raft_consensus.cc:740] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:06.509951 31908 consensus_queue.cc:260] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:06.517534 31908 ts_tablet_manager.cc:1434] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:22:06.569644 31908 tablet_bootstrap.cc:492] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:06.615267 31908 tablet_bootstrap.cc:492] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:06.616258 31908 tablet_bootstrap.cc:492] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:06.617988 31908 ts_tablet_manager.cc:1403] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.100s	user 0.022s	sys 0.012s
I20260709 12:22:06.620548 31908 raft_consensus.cc:359] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:06.621264 31908 raft_consensus.cc:740] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:06.621932 31908 consensus_queue.cc:260] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:06.624051 31908 ts_tablet_manager.cc:1434] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:22:06.624887 31908 tablet_bootstrap.cc:492] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:06.643007 31908 tablet_bootstrap.cc:492] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:06.644008 31908 tablet_bootstrap.cc:492] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:06.644722 31908 ts_tablet_manager.cc:1403] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.001s
I20260709 12:22:06.646704 31908 raft_consensus.cc:359] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:06.647290 31908 raft_consensus.cc:740] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:06.647850 31908 consensus_queue.cc:260] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:06.649680 31908 ts_tablet_manager.cc:1434] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:22:06.650880 31908 tablet_bootstrap.cc:492] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap starting.
I20260709 12:22:06.675963 31908 tablet_bootstrap.cc:492] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:06.677067 31908 tablet_bootstrap.cc:492] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Bootstrap complete.
I20260709 12:22:06.677909 31908 ts_tablet_manager.cc:1403] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.008s
I20260709 12:22:06.680420 31908 raft_consensus.cc:359] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:06.681098 31908 raft_consensus.cc:740] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Initialized, Role: FOLLOWER
I20260709 12:22:06.681979 31908 consensus_queue.cc:260] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:06.684337 31908 ts_tablet_manager.cc:1434] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:22:06.781500 31954 raft_consensus.cc:3060] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:11.344291 30857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 72573us
I20260709 12:22:15.154544 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:15.210393 30811 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fee969f4c2a4579ab7911212a86bf67"
dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
mode: GRACEFUL
new_leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:43084
I20260709 12:22:15.211454 30811 raft_consensus.cc:606] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 LEADER]: Received request to transfer leadership to TS 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:15.216121 30811 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "439d52649ecc46e58d714b9351576dd5"
dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
mode: GRACEFUL
new_leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
 from {username='slave'} at 127.0.0.1:43084
I20260709 12:22:15.216900 30811 raft_consensus.cc:606] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Received request to transfer leadership to TS d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:22:15.229770 30739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f5d808cf6da46a0894e888635591cc8"
dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
mode: GRACEFUL
new_leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:43256
I20260709 12:22:15.230319 30739 raft_consensus.cc:606] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Received request to transfer leadership to TS 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:15.233042 30811 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8"
dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
mode: GRACEFUL
new_leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:43084
I20260709 12:22:15.233525 30811 raft_consensus.cc:606] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 5 LEADER]: Received request to transfer leadership to TS 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:15.236012 30811 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024"
dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
mode: GRACEFUL
new_leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:43084
I20260709 12:22:15.236701 30811 raft_consensus.cc:606] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 LEADER]: Received request to transfer leadership to TS 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:15.239530 30811 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f61dc8e98f804681b0815e953b2d2ad1"
dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
mode: GRACEFUL
new_leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:43084
I20260709 12:22:15.240203 30811 raft_consensus.cc:606] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 5 LEADER]: Received request to transfer leadership to TS 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:15.250104 32069 raft_consensus.cc:993] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3: : Instructing follower 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:15.250905 32071 raft_consensus.cc:1081] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 LEADER]: Signalling peer 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:15.253147 31958 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024"
dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:41598
I20260709 12:22:15.253964 31958 raft_consensus.cc:493] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:15.254352 31958 raft_consensus.cc:3060] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.258323 30885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fffb9d78e773452ab44ae35b5d65fdb2"
dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
mode: GRACEFUL
new_leader_uuid: "20c7a0cd21c3449587fdeeff565557d3"
 from {username='slave'} at 127.0.0.1:56054
I20260709 12:22:15.259088 30885 raft_consensus.cc:606] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Received request to transfer leadership to TS 20c7a0cd21c3449587fdeeff565557d3
I20260709 12:22:15.260828 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:22:15.262962 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:15.264076 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:15.265394 31958 raft_consensus.cc:515] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:15.273818 32071 raft_consensus.cc:993] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3: : Instructing follower 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:15.274521 32069 raft_consensus.cc:1081] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 5 LEADER]: Signalling peer 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:15.277370 31956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8"
dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:41598
I20260709 12:22:15.278165 31956 raft_consensus.cc:493] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:15.278606 31956 raft_consensus.cc:3060] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:15.281957 31958 leader_election.cc:290] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:22:15.299082 31956 raft_consensus.cc:515] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:15.300129 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:22:15.301093 30820 raft_consensus.cc:3055] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:15.301404 30820 raft_consensus.cc:740] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:22:15.302330 30820 consensus_queue.cc:260] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:15.303984 31956 leader_election.cc:290] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 6 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:22:15.305323 30811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:22:15.305999 30811 raft_consensus.cc:3055] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:15.306284 30811 raft_consensus.cc:740] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:22:15.307054 30811 consensus_queue.cc:260] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:15.313292 30820 raft_consensus.cc:3060] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.308578 30811 raft_consensus.cc:3060] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:15.319764 30820 raft_consensus.cc:2468] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 4.
I20260709 12:22:15.321707 31905 leader_election.cc:304] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:22:15.324376 30811 raft_consensus.cc:2468] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 6.
I20260709 12:22:15.325009 32084 raft_consensus.cc:2804] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:15.325639 31905 leader_election.cc:304] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:22:15.329142 32085 raft_consensus.cc:2804] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:15.329840 32085 raft_consensus.cc:697] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 6 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:22:15.330960 32085 consensus_queue.cc:237] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:15.332448 30885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:22:15.332690 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:22:15.333238 30885 raft_consensus.cc:3060] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:15.333384 30886 raft_consensus.cc:3060] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.326648 32084 raft_consensus.cc:697] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:22:15.345527 30885 raft_consensus.cc:2468] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 6.
I20260709 12:22:15.345469 32084 consensus_queue.cc:237] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:15.355818 30886 raft_consensus.cc:2468] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 4.
I20260709 12:22:15.367594 32070 raft_consensus.cc:993] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3: : Instructing follower 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:15.368095 32070 raft_consensus.cc:1081] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 LEADER]: Signalling peer 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:15.370376 31958 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2fee969f4c2a4579ab7911212a86bf67"
dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:41598
I20260709 12:22:15.370972 31958 raft_consensus.cc:493] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:15.371356 31958 raft_consensus.cc:3060] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.373522 30568 catalog_manager.cc:5697] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 3 to 4, leader changed from 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195) to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 4 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:15.388818 31958 raft_consensus.cc:515] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:15.392014 30811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fee969f4c2a4579ab7911212a86bf67" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:22:15.392874 30811 raft_consensus.cc:3055] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:15.393194 30811 raft_consensus.cc:740] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:22:15.393292 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fee969f4c2a4579ab7911212a86bf67" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:22:15.393953 30886 raft_consensus.cc:3060] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.394181 30811 consensus_queue.cc:260] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:15.395377 30811 raft_consensus.cc:3060] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.398432 31958 leader_election.cc:290] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:22:15.403563 30811 raft_consensus.cc:2468] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 3.
I20260709 12:22:15.404870 31905 leader_election.cc:304] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:22:15.406018 32084 raft_consensus.cc:2804] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:15.406541 32084 raft_consensus.cc:697] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:22:15.407624 32084 consensus_queue.cc:237] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:15.408746 30886 raft_consensus.cc:2468] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 3.
I20260709 12:22:15.415889 32070 raft_consensus.cc:993] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3: : Instructing follower 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:15.416416 32070 raft_consensus.cc:1081] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 5 LEADER]: Signalling peer 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:15.421151 31956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f61dc8e98f804681b0815e953b2d2ad1"
dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:41598
I20260709 12:22:15.421801 31956 raft_consensus.cc:493] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:15.422227 31956 raft_consensus.cc:3060] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:15.430996 30568 catalog_manager.cc:5697] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 5 to 6, leader changed from 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195) to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 6 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:15.433848 32094 raft_consensus.cc:993] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3: : Instructing follower d3ab9d21f8864b50a71b49c7d624584a to start an election
I20260709 12:22:15.434463 32094 raft_consensus.cc:1081] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Signalling peer d3ab9d21f8864b50a71b49c7d624584a to start an election
I20260709 12:22:15.433724 30568 catalog_manager.cc:5697] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 2 to 3, leader changed from 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195) to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 3 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:15.437356 31956 raft_consensus.cc:515] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:15.439857 30886 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "439d52649ecc46e58d714b9351576dd5"
dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
 from {username='slave'} at 127.0.0.1:51180
I20260709 12:22:15.440474 30886 raft_consensus.cc:493] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:15.441421 30886 raft_consensus.cc:3060] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.447126 30811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61dc8e98f804681b0815e953b2d2ad1" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:22:15.451725 30886 raft_consensus.cc:515] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:15.451851 30811 raft_consensus.cc:3055] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:15.440474 31956 leader_election.cc:290] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 6 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:22:15.452823 30811 raft_consensus.cc:740] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:22:15.453765 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61dc8e98f804681b0815e953b2d2ad1" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:22:15.454465 30739 raft_consensus.cc:3060] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:15.454051 30811 consensus_queue.cc:260] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:15.455458 30811 raft_consensus.cc:3060] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:15.458367 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439d52649ecc46e58d714b9351576dd5" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:22:15.459172 30744 raft_consensus.cc:3060] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.472074 30811 raft_consensus.cc:2468] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 6.
I20260709 12:22:15.474627 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439d52649ecc46e58d714b9351576dd5" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:22:15.475368 30820 raft_consensus.cc:3055] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:15.475677 30820 raft_consensus.cc:740] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:22:15.475914 31905 leader_election.cc:304] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:22:15.476516 30820 consensus_queue.cc:260] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:15.477125 32084 raft_consensus.cc:2804] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:15.477766 32084 raft_consensus.cc:697] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 6 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:22:15.477944 30820 raft_consensus.cc:3060] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.478827 32084 consensus_queue.cc:237] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:15.481949 30739 raft_consensus.cc:2468] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 6.
I20260709 12:22:15.485644 30886 leader_election.cc:290] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:22:15.488420 30744 raft_consensus.cc:2468] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 2.
I20260709 12:22:15.490020 30857 leader_election.cc:304] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:22:15.491080 32079 raft_consensus.cc:2804] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:15.491638 32079 raft_consensus.cc:697] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a [term 2 LEADER]: Becoming Leader. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:22:15.492607 30820 raft_consensus.cc:2468] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3ab9d21f8864b50a71b49c7d624584a in term 2.
I20260709 12:22:15.493710 32079 consensus_queue.cc:237] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:15.506158 30568 catalog_manager.cc:5697] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 5 to 6, leader changed from 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195) to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 6 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:15.508502 30567 catalog_manager.cc:5697] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a reported cstate change: term changed from 1 to 2, leader changed from 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195) to d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196). New cstate: current_term: 2 leader_uuid: "d3ab9d21f8864b50a71b49c7d624584a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:15.541352 32074 raft_consensus.cc:993] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9: : Instructing follower 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:15.542016 32068 raft_consensus.cc:1081] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Signalling peer 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:15.543879 31958 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f5d808cf6da46a0894e888635591cc8"
dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:41588
I20260709 12:22:15.544523 31958 raft_consensus.cc:493] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:15.544914 31958 raft_consensus.cc:3060] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.556887 31958 raft_consensus.cc:515] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:15.559986 31958 leader_election.cc:290] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:22:15.560102 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5d808cf6da46a0894e888635591cc8" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:22:15.561089 30739 raft_consensus.cc:3055] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:15.561187 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5d808cf6da46a0894e888635591cc8" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:22:15.561460 30739 raft_consensus.cc:740] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:22:15.561849 30820 raft_consensus.cc:3060] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.562374 30739 consensus_queue.cc:260] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:15.563982 30739 raft_consensus.cc:3060] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.571004 30739 raft_consensus.cc:2468] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 2.
I20260709 12:22:15.571978 30820 raft_consensus.cc:2468] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 2.
I20260709 12:22:15.572353 31902 leader_election.cc:304] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:22:15.573630 32084 raft_consensus.cc:2804] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:15.574213 32084 raft_consensus.cc:697] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:22:15.575205 32084 consensus_queue.cc:237] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:15.587790 30567 catalog_manager.cc:5697] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 1 to 2, leader changed from 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194) to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:15.710307 32079 raft_consensus.cc:993] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a: : Instructing follower 20c7a0cd21c3449587fdeeff565557d3 to start an election
I20260709 12:22:15.711014 32017 raft_consensus.cc:1081] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Signalling peer 20c7a0cd21c3449587fdeeff565557d3 to start an election
I20260709 12:22:15.712741 30820 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fffb9d78e773452ab44ae35b5d65fdb2"
dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
 from {username='slave'} at 127.0.0.1:48396
I20260709 12:22:15.713387 30820 raft_consensus.cc:493] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:15.713752 30820 raft_consensus.cc:3060] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.721087 30820 raft_consensus.cc:515] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:15.723011 30820 leader_election.cc:290] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:22:15.724071 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffb9d78e773452ab44ae35b5d65fdb2" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:22:15.724071 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffb9d78e773452ab44ae35b5d65fdb2" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:22:15.725224 30739 raft_consensus.cc:3060] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.725386 30886 raft_consensus.cc:3055] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:15.725889 30886 raft_consensus.cc:740] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:22:15.726679 30886 consensus_queue.cc:260] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:15.727881 30886 raft_consensus.cc:3060] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.731237 30739 raft_consensus.cc:2468] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 2.
I20260709 12:22:15.734057 30783 leader_election.cc:304] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
I20260709 12:22:15.734110 30886 raft_consensus.cc:2468] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 2.
I20260709 12:22:15.735886 32094 raft_consensus.cc:2804] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:15.736559 32094 raft_consensus.cc:697] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:22:15.737717 32094 consensus_queue.cc:237] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:15.739809 30820 raft_consensus.cc:1275] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:15.741813 32084 consensus_queue.cc:1048] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:15.766785 30885 raft_consensus.cc:1275] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:15.767277 30567 catalog_manager.cc:5697] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 1 to 2, leader changed from d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196) to 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195). New cstate: current_term: 2 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:15.768396 32086 consensus_queue.cc:1048] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:15.773178 30820 raft_consensus.cc:1275] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 6 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:15.775105 32084 consensus_queue.cc:1048] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:22:15.798121 30886 raft_consensus.cc:1275] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 6 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:15.802968 32085 consensus_queue.cc:1048] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:15.892079 30886 raft_consensus.cc:1275] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:15.893607 32085 consensus_queue.cc:1048] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:15.905884 30811 raft_consensus.cc:1275] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 6 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:15.909905 32084 consensus_queue.cc:1048] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:15.916205 30811 raft_consensus.cc:1275] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:15.918181 32084 consensus_queue.cc:1048] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:15.948395 30739 raft_consensus.cc:1275] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 6 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:15.950914 32085 consensus_queue.cc:1048] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:15.976423 30744 raft_consensus.cc:1275] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Refusing update from remote peer d3ab9d21f8864b50a71b49c7d624584a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:15.982182 32106 consensus_queue.cc:1048] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:15.998818 30820 raft_consensus.cc:1275] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Refusing update from remote peer d3ab9d21f8864b50a71b49c7d624584a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:16.000448 32106 consensus_queue.cc:1048] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:16.130257 30885 raft_consensus.cc:1275] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Refusing update from remote peer 20c7a0cd21c3449587fdeeff565557d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:16.131932 32113 consensus_queue.cc:1048] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:16.143306 30744 raft_consensus.cc:1275] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Refusing update from remote peer 20c7a0cd21c3449587fdeeff565557d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:16.148411 32094 consensus_queue.cc:1048] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:16.179322 30820 raft_consensus.cc:1275] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:16.181740 32086 consensus_queue.cc:1048] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:16.195155 30744 raft_consensus.cc:1275] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:16.197384 32085 consensus_queue.cc:1048] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:16.318832 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:16.361855 30886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c179d47d7f146ed83b56ea632997aa7"
dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
mode: GRACEFUL
new_leader_uuid: "20c7a0cd21c3449587fdeeff565557d3"
 from {username='slave'} at 127.0.0.1:56054
I20260709 12:22:16.362370 30886 raft_consensus.cc:606] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Received request to transfer leadership to TS 20c7a0cd21c3449587fdeeff565557d3
I20260709 12:22:16.365113 30739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a1ba3aa111d4c5e8558a89abec0aa64"
dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
mode: GRACEFUL
new_leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:43256
I20260709 12:22:16.365684 30739 raft_consensus.cc:606] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Received request to transfer leadership to TS 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:16.368350 30739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9361d602cd814a70acf6a5867a109d74"
dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
mode: GRACEFUL
new_leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:43256
I20260709 12:22:16.368844 30739 raft_consensus.cc:606] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Received request to transfer leadership to TS 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:16.372332 30739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c48114d81f8f4cf08f9665b697bc5560"
dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
mode: GRACEFUL
new_leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:43256
I20260709 12:22:16.372891 30739 raft_consensus.cc:606] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Received request to transfer leadership to TS 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:16.376744 30739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d99734494b57424691503918c73f294e"
dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
mode: GRACEFUL
new_leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:43256
I20260709 12:22:16.377381 30739 raft_consensus.cc:606] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Received request to transfer leadership to TS 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:16.380831 30820 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7e24a3b2b9d4270a8b8466d3c6313ab"
dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
mode: GRACEFUL
new_leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:43084
I20260709 12:22:16.381393 30820 raft_consensus.cc:606] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Received request to transfer leadership to TS 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:16.382899 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:22:16.384886 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:16.385761 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:16.551963 32068 raft_consensus.cc:993] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9: : Instructing follower 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:16.552681 32074 raft_consensus.cc:1081] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Signalling peer 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:16.553103 32079 raft_consensus.cc:993] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a: : Instructing follower 20c7a0cd21c3449587fdeeff565557d3 to start an election
I20260709 12:22:16.553640 32079 raft_consensus.cc:1081] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Signalling peer 20c7a0cd21c3449587fdeeff565557d3 to start an election
I20260709 12:22:16.554479 31958 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9361d602cd814a70acf6a5867a109d74"
dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:41588
I20260709 12:22:16.555122 31958 raft_consensus.cc:493] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:16.555438 31958 raft_consensus.cc:3060] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.560135 30811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c179d47d7f146ed83b56ea632997aa7"
dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
 from {username='slave'} at 127.0.0.1:48396
I20260709 12:22:16.560896 30811 raft_consensus.cc:493] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:16.561317 30811 raft_consensus.cc:3060] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.563452 31958 raft_consensus.cc:515] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:16.565012 32069 raft_consensus.cc:993] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3: : Instructing follower 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:16.565588 32094 raft_consensus.cc:1081] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Signalling peer 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:16.566330 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9361d602cd814a70acf6a5867a109d74" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:22:16.566597 31958 leader_election.cc:290] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:22:16.566954 30744 raft_consensus.cc:3055] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:16.567168 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9361d602cd814a70acf6a5867a109d74" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:22:16.567330 30744 raft_consensus.cc:740] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:22:16.567737 30820 raft_consensus.cc:3060] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.568300 30744 consensus_queue.cc:260] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:16.569625 30744 raft_consensus.cc:3060] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.569628 30811 raft_consensus.cc:515] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:16.573745 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c179d47d7f146ed83b56ea632997aa7" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:22:16.574366 30886 raft_consensus.cc:3055] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:16.574647 30886 raft_consensus.cc:740] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:22:16.575240 30820 raft_consensus.cc:2468] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 2.
I20260709 12:22:16.575403 30886 consensus_queue.cc:260] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:16.576576 30886 raft_consensus.cc:3060] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.576890 31905 leader_election.cc:304] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:22:16.577292 30811 leader_election.cc:290] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:22:16.577926 32085 raft_consensus.cc:2804] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:16.577872 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c179d47d7f146ed83b56ea632997aa7" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:22:16.578608 32085 raft_consensus.cc:697] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:22:16.577230 30744 raft_consensus.cc:2468] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 2.
I20260709 12:22:16.578778 30739 raft_consensus.cc:3060] T 5c179d47d7f146ed83b56ea632997aa7 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.579650 32085 consensus_queue.cc:237] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:16.584774 30739 raft_consensus.cc:2468] T 5c179d47d7f146ed83b56ea632997aa7 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 2.
I20260709 12:22:16.585788 31958 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7e24a3b2b9d4270a8b8466d3c6313ab"
dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:41598
I20260709 12:22:16.586009 30783 leader_election.cc:304] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9; no voters: 
I20260709 12:22:16.586508 31958 raft_consensus.cc:493] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:16.586912 32094 raft_consensus.cc:2804] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:16.587080 30886 raft_consensus.cc:2468] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 2.
I20260709 12:22:16.586956 31958 raft_consensus.cc:3060] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.590027 32094 raft_consensus.cc:697] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:22:16.590902 32094 consensus_queue.cc:237] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:16.595165 31958 raft_consensus.cc:515] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:16.597676 31958 leader_election.cc:290] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:22:16.603112 30568 catalog_manager.cc:5697] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 1 to 2, leader changed from 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194) to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:16.605775 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e24a3b2b9d4270a8b8466d3c6313ab" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:22:16.606241 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e24a3b2b9d4270a8b8466d3c6313ab" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:22:16.606531 30886 raft_consensus.cc:3060] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.606832 30820 raft_consensus.cc:3055] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:16.607144 30820 raft_consensus.cc:740] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:22:16.608433 30820 consensus_queue.cc:260] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:16.609900 30820 raft_consensus.cc:3060] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.614696 30886 raft_consensus.cc:2468] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 2.
I20260709 12:22:16.616307 31904 leader_election.cc:304] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:22:16.617857 32085 raft_consensus.cc:2804] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:16.618464 32085 raft_consensus.cc:697] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:22:16.619279 32085 consensus_queue.cc:237] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:16.630796 30820 raft_consensus.cc:2468] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 2.
I20260709 12:22:16.631346 30569 catalog_manager.cc:5697] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3 reported cstate change: term changed from 1 to 2, leader changed from d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196) to 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195). New cstate: current_term: 2 leader_uuid: "20c7a0cd21c3449587fdeeff565557d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:16.646353 32068 raft_consensus.cc:993] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9: : Instructing follower 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:16.646950 32074 raft_consensus.cc:1081] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Signalling peer 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:16.648874 31956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d99734494b57424691503918c73f294e"
dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:41588
I20260709 12:22:16.649456 31956 raft_consensus.cc:493] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:16.649796 31956 raft_consensus.cc:3060] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.651443 30569 catalog_manager.cc:5697] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 1 to 2, leader changed from 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195) to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:16.656809 31956 raft_consensus.cc:515] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:16.659101 31956 leader_election.cc:290] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:22:16.659690 30885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99734494b57424691503918c73f294e" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:22:16.660449 30885 raft_consensus.cc:3060] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.660705 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99734494b57424691503918c73f294e" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:22:16.661473 30744 raft_consensus.cc:3055] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:16.661823 30744 raft_consensus.cc:740] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:22:16.662694 30744 consensus_queue.cc:260] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:16.663996 30744 raft_consensus.cc:3060] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.674854 32068 raft_consensus.cc:993] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9: : Instructing follower 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:16.672307 30744 raft_consensus.cc:2468] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 2.
I20260709 12:22:16.676463 31902 leader_election.cc:304] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:22:16.676688 32068 raft_consensus.cc:1081] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Signalling peer 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:16.677440 32085 raft_consensus.cc:2804] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:16.678018 32085 raft_consensus.cc:697] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:22:16.679160 31956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a1ba3aa111d4c5e8558a89abec0aa64"
dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:41588
I20260709 12:22:16.679000 32085 consensus_queue.cc:237] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:16.679770 31956 raft_consensus.cc:493] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:16.680470 31956 raft_consensus.cc:3060] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.685070 30885 raft_consensus.cc:2468] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 2.
I20260709 12:22:16.689992 31956 raft_consensus.cc:515] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:16.697233 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1ba3aa111d4c5e8558a89abec0aa64" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:22:16.698195 30886 raft_consensus.cc:3060] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.699326 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1ba3aa111d4c5e8558a89abec0aa64" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:22:16.700101 30744 raft_consensus.cc:3055] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:16.700439 30744 raft_consensus.cc:740] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:22:16.701409 30744 consensus_queue.cc:260] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:16.709168 30744 raft_consensus.cc:3060] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.727293 30744 raft_consensus.cc:2468] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 2.
I20260709 12:22:16.728096 31956 leader_election.cc:290] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:22:16.727510 30569 catalog_manager.cc:5697] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 1 to 2, leader changed from 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194) to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:16.728619 30886 raft_consensus.cc:2468] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 2.
I20260709 12:22:16.728417 31902 leader_election.cc:304] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:22:16.729509 30888 raft_consensus.cc:1240] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Rejecting Update request from peer 4a9042c4154c442297159d1c9f1186b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:16.732906 32085 raft_consensus.cc:2804] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:16.733587 32085 raft_consensus.cc:697] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:22:16.734663 32085 consensus_queue.cc:237] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:16.749536 30569 catalog_manager.cc:5697] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 1 to 2, leader changed from 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194) to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:16.762765 32074 raft_consensus.cc:993] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9: : Instructing follower 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:16.763281 32074 raft_consensus.cc:1081] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Signalling peer 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:16.765081 31954 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c48114d81f8f4cf08f9665b697bc5560"
dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:41588
I20260709 12:22:16.766237 31954 raft_consensus.cc:493] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:16.766692 31954 raft_consensus.cc:3060] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.776703 31954 raft_consensus.cc:515] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:16.781560 30888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48114d81f8f4cf08f9665b697bc5560" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:22:16.782194 30888 raft_consensus.cc:3060] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.795171 30744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48114d81f8f4cf08f9665b697bc5560" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:22:16.795903 30744 raft_consensus.cc:3055] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:16.796205 30744 raft_consensus.cc:740] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:22:16.796732 31954 leader_election.cc:290] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:22:16.797168 30744 consensus_queue.cc:260] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:16.798488 30744 raft_consensus.cc:3060] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.798604 30888 raft_consensus.cc:2468] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 2.
I20260709 12:22:16.799731 31904 leader_election.cc:304] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:22:16.800608 32085 raft_consensus.cc:2804] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:16.801172 32085 raft_consensus.cc:697] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:22:16.802158 32085 consensus_queue.cc:237] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:16.805352 30744 raft_consensus.cc:2468] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 2.
I20260709 12:22:16.814867 30569 catalog_manager.cc:5697] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 1 to 2, leader changed from 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194) to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:16.974421 30744 raft_consensus.cc:1275] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:16.975786 32086 consensus_queue.cc:1048] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:16.978950 30820 raft_consensus.cc:1275] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:16.980850 32085 consensus_queue.cc:1048] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:17.041044 30888 raft_consensus.cc:1275] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Refusing update from remote peer 20c7a0cd21c3449587fdeeff565557d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:17.042410 32131 consensus_queue.cc:1048] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:17.057608 30744 raft_consensus.cc:1275] T 5c179d47d7f146ed83b56ea632997aa7 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Refusing update from remote peer 20c7a0cd21c3449587fdeeff565557d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:17.060051 32094 consensus_queue.cc:1048] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:17.084949 30739 raft_consensus.cc:1275] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:17.088518 32086 consensus_queue.cc:1048] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:17.085947 30888 raft_consensus.cc:1275] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:17.093286 30888 raft_consensus.cc:1275] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:17.094540 32086 consensus_queue.cc:1048] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:17.097148 32086 consensus_queue.cc:1048] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:17.135927 30811 raft_consensus.cc:1275] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:17.137844 32086 consensus_queue.cc:1048] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:17.162863 30739 raft_consensus.cc:1275] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:17.164947 32144 consensus_queue.cc:1048] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:17.182940 30886 raft_consensus.cc:1275] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:17.184599 32084 consensus_queue.cc:1048] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:17.269472 30886 raft_consensus.cc:1275] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:17.270954 32086 consensus_queue.cc:1048] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:17.283851 30744 raft_consensus.cc:1275] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:17.286847 32086 consensus_queue.cc:1048] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:17.433779 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:17.472857 30811 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f8edecc2bf945e2bf553a7708f0f2cb"
dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
mode: GRACEFUL
new_leader_uuid: "4a9042c4154c442297159d1c9f1186b9"
 from {username='slave'} at 127.0.0.1:43084
I20260709 12:22:17.473552 30811 raft_consensus.cc:606] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Received request to transfer leadership to TS 4a9042c4154c442297159d1c9f1186b9
I20260709 12:22:17.476388 30886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fcceeadce924e3493e4e91cb49e2f2e"
dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
mode: GRACEFUL
new_leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:56054
I20260709 12:22:17.476989 30886 raft_consensus.cc:606] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 2 LEADER]: Received request to transfer leadership to TS 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:17.479661 30886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9be8d04f2ad34fd5b7c66aa68c8fa47a"
dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
mode: GRACEFUL
new_leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:56054
I20260709 12:22:17.480214 30886 raft_consensus.cc:606] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 2 LEADER]: Received request to transfer leadership to TS 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:17.482721 30739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e243e0f019f54586877c9a61b2fc83ac"
dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
mode: GRACEFUL
new_leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:43256
I20260709 12:22:17.483345 30739 raft_consensus.cc:606] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 3 LEADER]: Received request to transfer leadership to TS 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:17.484717 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:22:17.486573 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:17.487360 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:17.492398 32068 raft_consensus.cc:993] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9: : Instructing follower 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:17.493058 32074 raft_consensus.cc:1081] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 3 LEADER]: Signalling peer 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:17.494982 31956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e243e0f019f54586877c9a61b2fc83ac"
dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:41588
I20260709 12:22:17.495692 31956 raft_consensus.cc:493] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:17.496012 31956 raft_consensus.cc:3060] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.502830 31956 raft_consensus.cc:515] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:17.504518 31956 leader_election.cc:290] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 election: Requested vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:22:17.505400 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e243e0f019f54586877c9a61b2fc83ac" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:22:17.505725 30811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e243e0f019f54586877c9a61b2fc83ac" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:22:17.506138 30739 raft_consensus.cc:3055] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:17.506420 30811 raft_consensus.cc:3060] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.506588 30739 raft_consensus.cc:740] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:22:17.512598 30739 consensus_queue.cc:260] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:17.514808 30739 raft_consensus.cc:3060] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.517786 30811 raft_consensus.cc:2468] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 4.
I20260709 12:22:17.519065 31905 leader_election.cc:304] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:22:17.519964 32086 raft_consensus.cc:2804] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:17.520452 32086 raft_consensus.cc:697] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:22:17.521380 32086 consensus_queue.cc:237] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:17.535874 32017 raft_consensus.cc:993] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a: : Instructing follower 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:17.536512 32079 raft_consensus.cc:1081] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 2 LEADER]: Signalling peer 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:17.538378 31956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9be8d04f2ad34fd5b7c66aa68c8fa47a"
dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:41592
I20260709 12:22:17.539052 31956 raft_consensus.cc:493] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:17.536428 30739 raft_consensus.cc:2468] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 4.
I20260709 12:22:17.539412 31956 raft_consensus.cc:3060] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:17.544051 30569 catalog_manager.cc:5697] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 3 to 4, leader changed from 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194) to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 4 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:17.557889 31956 raft_consensus.cc:515] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:17.560350 31956 leader_election.cc:290] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:22:17.560738 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be8d04f2ad34fd5b7c66aa68c8fa47a" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:22:17.561412 30886 raft_consensus.cc:3055] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:17.561728 30886 raft_consensus.cc:740] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:22:17.562656 32130 raft_consensus.cc:993] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3: : Instructing follower 4a9042c4154c442297159d1c9f1186b9 to start an election
I20260709 12:22:17.562503 30886 consensus_queue.cc:260] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:17.563771 30886 raft_consensus.cc:3060] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:17.564234 32094 raft_consensus.cc:1081] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Signalling peer 4a9042c4154c442297159d1c9f1186b9 to start an election
I20260709 12:22:17.566999 30745 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f8edecc2bf945e2bf553a7708f0f2cb"
dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
 from {username='slave'} at 127.0.0.1:46520
I20260709 12:22:17.567760 30745 raft_consensus.cc:493] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:17.568220 30745 raft_consensus.cc:3060] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.564870 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be8d04f2ad34fd5b7c66aa68c8fa47a" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:22:17.573640 30739 raft_consensus.cc:3060] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:17.599218 30739 raft_consensus.cc:2468] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 3.
I20260709 12:22:17.606282 30745 raft_consensus.cc:515] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:17.609896 31902 leader_election.cc:304] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4; no voters: 
I20260709 12:22:17.610303 30745 leader_election.cc:290] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:22:17.611292 30888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8edecc2bf945e2bf553a7708f0f2cb" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:22:17.612154 30888 raft_consensus.cc:3060] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.617945 32084 raft_consensus.cc:2804] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:17.618534 32084 raft_consensus.cc:697] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:22:17.618227 30820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8edecc2bf945e2bf553a7708f0f2cb" candidate_uuid: "4a9042c4154c442297159d1c9f1186b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:22:17.619556 30820 raft_consensus.cc:3055] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:17.619930 30820 raft_consensus.cc:740] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:22:17.619465 32084 consensus_queue.cc:237] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:17.620819 30820 consensus_queue.cc:260] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:17.622280 30820 raft_consensus.cc:3060] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.625833 30888 raft_consensus.cc:2468] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 2.
I20260709 12:22:17.627475 30711 leader_election.cc:304] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a9042c4154c442297159d1c9f1186b9, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:22:17.628396 32074 raft_consensus.cc:2804] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:17.628945 32074 raft_consensus.cc:697] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9 [term 2 LEADER]: Becoming Leader. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:22:17.629957 30886 raft_consensus.cc:2468] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 3.
I20260709 12:22:17.629849 32074 consensus_queue.cc:237] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:17.639410 30820 raft_consensus.cc:2468] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a9042c4154c442297159d1c9f1186b9 in term 2.
I20260709 12:22:17.645138 30569 catalog_manager.cc:5697] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9 reported cstate change: term changed from 1 to 2, leader changed from 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195) to 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194). New cstate: current_term: 2 leader_uuid: "4a9042c4154c442297159d1c9f1186b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:17.646463 30568 catalog_manager.cc:5697] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 2 to 3, leader changed from d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196) to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 3 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:17.694924 32079 raft_consensus.cc:993] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a: : Instructing follower 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:17.695506 32017 raft_consensus.cc:1081] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 2 LEADER]: Signalling peer 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:17.696990 31956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fcceeadce924e3493e4e91cb49e2f2e"
dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:41592
I20260709 12:22:17.697510 31956 raft_consensus.cc:493] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:17.697824 31956 raft_consensus.cc:3060] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:17.704727 31956 raft_consensus.cc:515] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:17.707140 31956 leader_election.cc:290] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 election: Requested vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441)
I20260709 12:22:17.707785 30813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcceeadce924e3493e4e91cb49e2f2e" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20c7a0cd21c3449587fdeeff565557d3"
I20260709 12:22:17.707896 30888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcceeadce924e3493e4e91cb49e2f2e" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:22:17.709084 30888 raft_consensus.cc:3055] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:17.709401 30888 raft_consensus.cc:740] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d3ab9d21f8864b50a71b49c7d624584a, State: Running, Role: LEADER
I20260709 12:22:17.710114 30888 consensus_queue.cc:260] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:17.708525 30813 raft_consensus.cc:3060] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:17.711444 30888 raft_consensus.cc:3060] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:17.718909 30888 raft_consensus.cc:2468] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 3.
I20260709 12:22:17.718612 30813 raft_consensus.cc:2468] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 3.
I20260709 12:22:17.720001 31904 leader_election.cc:304] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:22:17.721664 32084 raft_consensus.cc:2804] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:17.722973 32084 raft_consensus.cc:697] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:22:17.723824 32084 consensus_queue.cc:237] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:17.735110 30568 catalog_manager.cc:5697] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 2 to 3, leader changed from d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196) to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 3 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:17.958936 30820 raft_consensus.cc:1275] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:17.960517 32084 consensus_queue.cc:1048] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:17.969965 30745 raft_consensus.cc:1275] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 4 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:17.971742 32086 consensus_queue.cc:1048] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:18.033896 30886 raft_consensus.cc:1275] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Refusing update from remote peer 4a9042c4154c442297159d1c9f1186b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:18.035295 32126 consensus_queue.cc:1048] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:18.046121 30813 raft_consensus.cc:1275] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Refusing update from remote peer 4a9042c4154c442297159d1c9f1186b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:18.049769 32126 consensus_queue.cc:1048] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:18.057245 30745 raft_consensus.cc:1275] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:18.063045 30888 raft_consensus.cc:1275] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:18.067204 32086 consensus_queue.cc:1048] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:18.068054 32084 consensus_queue.cc:1048] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:18.290652 30813 raft_consensus.cc:1275] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:18.292502 32085 consensus_queue.cc:1048] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:22:18.307863 30888 raft_consensus.cc:1275] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:18.309998 32084 consensus_queue.cc:1048] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:18.535982 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:18.578100 30739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b78acfb4f1d649e4821c390039d2ede5"
dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
mode: GRACEFUL
new_leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:43256
I20260709 12:22:18.578735 30739 raft_consensus.cc:606] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [term 2 LEADER]: Received request to transfer leadership to TS 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:18.580050 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:22:18.581445 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:18.582104 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:19.010293 32126 raft_consensus.cc:993] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9: : Instructing follower 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:19.010912 32165 raft_consensus.cc:1081] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [term 2 LEADER]: Signalling peer 4e9c812ece8a42efa063dc7bd5ea25e4 to start an election
I20260709 12:22:19.012493 31956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b78acfb4f1d649e4821c390039d2ede5"
dest_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4"
 from {username='slave'} at 127.0.0.1:41588
I20260709 12:22:19.013105 31956 raft_consensus.cc:493] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:19.013440 31956 raft_consensus.cc:3060] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:19.019704 31956 raft_consensus.cc:515] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:19.021507 31956 leader_election.cc:290] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:22:19.022153 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78acfb4f1d649e4821c390039d2ede5" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:22:19.022859 30886 raft_consensus.cc:3060] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:19.022712 30745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b78acfb4f1d649e4821c390039d2ede5" candidate_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a9042c4154c442297159d1c9f1186b9"
I20260709 12:22:19.023475 30745 raft_consensus.cc:3055] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:19.023725 30745 raft_consensus.cc:740] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a9042c4154c442297159d1c9f1186b9, State: Running, Role: LEADER
I20260709 12:22:19.024586 30745 consensus_queue.cc:260] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:19.025745 30745 raft_consensus.cc:3060] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:19.029358 30886 raft_consensus.cc:2468] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 3.
I20260709 12:22:19.030709 31904 leader_election.cc:304] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:22:19.031610 32084 raft_consensus.cc:2804] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:19.032166 32084 raft_consensus.cc:697] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 LEADER]: Becoming Leader. State: Replica: 4e9c812ece8a42efa063dc7bd5ea25e4, State: Running, Role: LEADER
I20260709 12:22:19.033139 30745 raft_consensus.cc:2468] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9c812ece8a42efa063dc7bd5ea25e4 in term 3.
I20260709 12:22:19.033834 32084 consensus_queue.cc:237] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:19.059635 30569 catalog_manager.cc:5697] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 reported cstate change: term changed from 2 to 3, leader changed from 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194) to 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193). New cstate: current_term: 3 leader_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:19.829648 30860 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.008s	sys 0.005s
W20260709 12:22:19.830072 30860 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.008s	sys 0.005s
I20260709 12:22:19.858604 30741 raft_consensus.cc:1275] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:22:19.866926 30859 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.005s	sys 0.006s
W20260709 12:22:19.867339 30859 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.006s	sys 0.006s
I20260709 12:22:19.896762 30890 raft_consensus.cc:1275] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Refusing update from remote peer 4e9c812ece8a42efa063dc7bd5ea25e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:19.902941 32086 consensus_queue.cc:1048] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:19.920718 32181 consensus_queue.cc:1048] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:22:20.023201 31902 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 77698.1us
W20260709 12:22:20.033306 30857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 46360.9us
W20260709 12:22:20.036171 30709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:34953, user_credentials={real_user=slave}} blocked reactor thread for 53622.7us
I20260709 12:22:20.206557 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:20.248868 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:20.250991 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:20.251931 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:20.323141 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:20.374372 23151 tablet_server.cc:179] TabletServer@127.22.155.193:34953 shutting down...
W20260709 12:22:20.401209 30783 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 193 similar messages]
W20260709 12:22:20.408938 30783 consensus_peers.cc:597] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:20.422309 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:22:20.423207 30709 consensus_peers.cc:597] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:20.425092 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.426363 23151 raft_consensus.cc:2243] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.426960 23151 raft_consensus.cc:2272] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.429917 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.430785 23151 raft_consensus.cc:2243] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.431813 23151 raft_consensus.cc:2272] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.435276 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.436273 23151 raft_consensus.cc:2243] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.437175 23151 raft_consensus.cc:2272] T cabc74dfa2e44e0580c268f61d17e024 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.439210 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.439831 23151 raft_consensus.cc:2243] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.440625 23151 raft_consensus.cc:2272] T 4f5d808cf6da46a0894e888635591cc8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.443498 23151 tablet_replica.cc:333] stopping tablet replica
W20260709 12:22:20.443928 30783 consensus_peers.cc:597] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:20.444242 23151 raft_consensus.cc:2243] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.445245 23151 raft_consensus.cc:2272] T b7bda85e3c87401d84e81120f451dec8 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.447551 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.448235 23151 raft_consensus.cc:2243] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.448807 23151 raft_consensus.cc:2272] T eb65e812f06540bc9f1c2b1e3e13d41c P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.452206 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.453188 23151 raft_consensus.cc:2243] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:22:20.453280 30857 consensus_peers.cc:597] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:20.453819 23151 raft_consensus.cc:2272] T fd8dacaad53349ebb29c67fe11853fab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.457084 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.457863 23151 raft_consensus.cc:2243] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.458902 23151 raft_consensus.cc:2272] T e243e0f019f54586877c9a61b2fc83ac P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.461441 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.462136 23151 raft_consensus.cc:2243] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.462944 23151 raft_consensus.cc:2272] T 5fcceeadce924e3493e4e91cb49e2f2e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.465618 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.466499 23151 raft_consensus.cc:2243] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.467023 23151 raft_consensus.cc:2272] T 815af3bc37df4d158766ac2e615de683 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.470252 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.471024 23151 raft_consensus.cc:2243] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.471561 23151 raft_consensus.cc:2272] T 5c645f524d71421eb842b8b854f95597 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.474571 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.475471 23151 raft_consensus.cc:2243] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.476047 23151 raft_consensus.cc:2272] T baad7ab904cc431381366c54397a57ef P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.479255 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.480146 23151 raft_consensus.cc:2243] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.481159 23151 raft_consensus.cc:2272] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:20.481317 30857 consensus_peers.cc:597] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:20.484326 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.485328 23151 raft_consensus.cc:2243] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.485865 23151 raft_consensus.cc:2272] T e93f0e0819f8466fad08603e540dc22e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.489105 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.490041 23151 raft_consensus.cc:2243] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.490581 23151 raft_consensus.cc:2272] T 38606820b9b349d3ad9f9fae03de5e86 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.494199 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.495010 23151 raft_consensus.cc:2243] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.495498 23151 raft_consensus.cc:2272] T 006658e1213f4f8da089a9570e0a76b9 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.498541 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.499377 23151 raft_consensus.cc:2243] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.500335 23151 raft_consensus.cc:2272] T c48114d81f8f4cf08f9665b697bc5560 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:20.502737 30783 consensus_peers.cc:597] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:20.503201 23151 tablet_replica.cc:333] stopping tablet replica
W20260709 12:22:20.503609 30857 consensus_peers.cc:597] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:20.505201 23151 raft_consensus.cc:2243] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.505829 23151 raft_consensus.cc:2272] T bac2bacfc36f49459fc2b2b2d8afb01d P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.508428 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.509259 23151 raft_consensus.cc:2243] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.509709 23151 raft_consensus.cc:2272] T 9ac7c8095aaa457494024d09dfaaf1bb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.512072 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.512812 23151 raft_consensus.cc:2243] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.513237 23151 raft_consensus.cc:2272] T e87d449e2aa442ec87cb2b55b61d4496 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.515648 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.516232 23151 raft_consensus.cc:2243] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.516775 23151 raft_consensus.cc:2272] T b33ccb8b23d8455a990ef1cb50271887 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.519073 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.519824 23151 raft_consensus.cc:2243] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.520279 23151 raft_consensus.cc:2272] T 2f7a0a060aca4bdf912b9291106aaa74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.522899 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.523550 23151 raft_consensus.cc:2243] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.524323 23151 raft_consensus.cc:2272] T f61dc8e98f804681b0815e953b2d2ad1 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.526487 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.527088 23151 raft_consensus.cc:2243] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.527614 23151 raft_consensus.cc:2272] T b2f2ae9f62734cf59b3d5477d92760cb P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.530314 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.530900 23151 raft_consensus.cc:2243] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.531315 23151 raft_consensus.cc:2272] T 46ea2bd624354824ada8b141b94ab5f0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.533850 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.534490 23151 raft_consensus.cc:2243] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.534953 23151 raft_consensus.cc:2272] T 4faf21b4ff034e548c19569963419851 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.537360 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.537837 23151 raft_consensus.cc:2243] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.538228 23151 raft_consensus.cc:2272] T 7695652594064f568b2df572cb76e12a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.540100 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.540587 23151 raft_consensus.cc:2243] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.541323 23151 raft_consensus.cc:2272] T 9361d602cd814a70acf6a5867a109d74 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.543731 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.544229 23151 raft_consensus.cc:2243] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.545094 23151 raft_consensus.cc:2272] T f7e24a3b2b9d4270a8b8466d3c6313ab P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.547603 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.548437 23151 raft_consensus.cc:2243] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.549361 23151 raft_consensus.cc:2272] T d99734494b57424691503918c73f294e P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.551273 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.551780 23151 raft_consensus.cc:2243] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.552155 23151 raft_consensus.cc:2272] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.554409 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.554898 23151 raft_consensus.cc:2243] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.555276 23151 raft_consensus.cc:2272] T 82bb30237ea045c79aa6eb181bc3e692 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.557801 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.558585 23151 raft_consensus.cc:2243] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.559088 23151 raft_consensus.cc:2272] T e946ad6dd9cb42ad93987cebde13ba9a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.561897 23151 tablet_replica.cc:333] stopping tablet replica
W20260709 12:22:20.562022 30783 consensus_peers.cc:597] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:20.562644 23151 raft_consensus.cc:2243] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.563234 23151 raft_consensus.cc:2272] T 81434413f4d7497a8ae5f95db857f819 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.565745 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.566361 23151 raft_consensus.cc:2243] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.566790 23151 raft_consensus.cc:2272] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.569583 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.570325 23151 raft_consensus.cc:2243] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.571332 23151 raft_consensus.cc:2272] T b78acfb4f1d649e4821c390039d2ede5 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:20.574015 30709 consensus_peers.cc:597] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:20.576696 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.577462 23151 raft_consensus.cc:2243] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.577960 23151 raft_consensus.cc:2272] T f0d63226f015480c84967f90ac595cc0 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.580418 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.581179 23151 raft_consensus.cc:2243] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.581670 23151 raft_consensus.cc:2272] T 7ca6811dc9854dfaa1295db38c91c0fd P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.583860 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.584508 23151 raft_consensus.cc:2243] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.585018 23151 raft_consensus.cc:2272] T de462b3788724f21b93b5cbb295c085a P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.587307 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.587927 23151 raft_consensus.cc:2243] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.588462 23151 raft_consensus.cc:2272] T 2d372d3fc5dd43d1880a4a932c83d7da P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.590720 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.591317 23151 raft_consensus.cc:2243] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.592199 23151 raft_consensus.cc:2272] T 2fee969f4c2a4579ab7911212a86bf67 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.594548 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.595152 23151 raft_consensus.cc:2243] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.595760 23151 raft_consensus.cc:2272] T aec2e3f6d6be4c038a84a15ea8b61235 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.598131 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.598757 23151 raft_consensus.cc:2243] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.599234 23151 raft_consensus.cc:2272] T b7f3fc82ff104135851cce7357eda3ec P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.602187 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.602762 23151 raft_consensus.cc:2243] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.603240 23151 raft_consensus.cc:2272] T 7f56cad4068d4388bf572777bcfb89b3 P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.605321 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:20.605820 23151 raft_consensus.cc:2243] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.606263 23151 raft_consensus.cc:2272] T c4e2f4d39a39493b8404958a5aaaa7af P 4e9c812ece8a42efa063dc7bd5ea25e4 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:20.620815 30709 consensus_peers.cc:597] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:20.680959 23151 tablet_server.cc:196] TabletServer@127.22.155.193:34953 shutdown complete.
W20260709 12:22:20.682659 30709 consensus_peers.cc:597] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.683226 30709 consensus_peers.cc:597] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.685084 30709 consensus_peers.cc:597] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.700559 30857 consensus_peers.cc:597] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.711872 30841 debug-util.cc:398] Leaking SignalData structure 0x7b08001a0b60 after lost signal to thread 23154
W20260709 12:22:20.713163 30841 debug-util.cc:398] Leaking SignalData structure 0x7b08001c3f00 after lost signal to thread 30603
W20260709 12:22:20.714476 30841 debug-util.cc:398] Leaking SignalData structure 0x7b0800290140 after lost signal to thread 30770
W20260709 12:22:20.715812 30841 debug-util.cc:398] Leaking SignalData structure 0x7b080011e3a0 after lost signal to thread 30844
W20260709 12:22:20.717048 30841 debug-util.cc:398] Leaking SignalData structure 0x7b0800144340 after lost signal to thread 30918
W20260709 12:22:20.783456 30709 consensus_peers.cc:597] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.788440 30857 consensus_peers.cc:597] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.791944 30857 consensus_peers.cc:597] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.792106 30783 consensus_peers.cc:597] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:20.811980 23151 tablet_server.cc:179] TabletServer@127.22.155.194:0 shutting down...
W20260709 12:22:20.840479 30857 consensus_peers.cc:597] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.847185 30857 consensus_peers.cc:597] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.854521 30783 consensus_peers.cc:597] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.865343 30857 consensus_peers.cc:597] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.870103 30709 consensus_peers.cc:597] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.876888 30783 consensus_peers.cc:597] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.877471 30783 consensus_peers.cc:597] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.878346 30857 consensus_peers.cc:597] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.882483 30783 consensus_peers.cc:597] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.883924 30783 consensus_peers.cc:597] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.885221 30709 consensus_peers.cc:597] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.901459 30783 consensus_peers.cc:597] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.910276 30783 consensus_peers.cc:597] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.915934 30783 consensus_peers.cc:597] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.917929 30709 consensus_peers.cc:597] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.918088 30857 consensus_peers.cc:597] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.922765 30857 consensus_peers.cc:597] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.927901 30709 consensus_peers.cc:597] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.929322 30857 consensus_peers.cc:597] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.939129 30709 consensus_peers.cc:597] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.947901 30783 consensus_peers.cc:597] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:20.956944 30783 consensus_peers.cc:597] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:20.960105 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:20.961269 23151 tablet_replica.cc:333] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:20.962427 23151 raft_consensus.cc:2243] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.963073 23151 raft_consensus.cc:2272] T d99734494b57424691503918c73f294e P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.966271 23151 tablet_replica.cc:333] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:20.967310 23151 raft_consensus.cc:2243] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.967934 23151 raft_consensus.cc:2272] T 4682db2f801d4701a9c03cb1e4b32fd0 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.971027 23151 tablet_replica.cc:333] T 100eb209359a46d8b6c900d5a401586e P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:20.971805 23151 raft_consensus.cc:2243] T 100eb209359a46d8b6c900d5a401586e P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.972337 23151 raft_consensus.cc:2272] T 100eb209359a46d8b6c900d5a401586e P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.974969 23151 tablet_replica.cc:333] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:20.975582 23151 raft_consensus.cc:2243] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.976490 23151 raft_consensus.cc:2272] T 46ea2bd624354824ada8b141b94ab5f0 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.978705 23151 tablet_replica.cc:333] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:20.979444 23151 raft_consensus.cc:2243] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.980099 23151 raft_consensus.cc:2272] T fffb9d78e773452ab44ae35b5d65fdb2 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.982967 23151 tablet_replica.cc:333] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:20.983830 23151 raft_consensus.cc:2243] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:20.984354 23151 raft_consensus.cc:2272] T e243e0f019f54586877c9a61b2fc83ac P 4a9042c4154c442297159d1c9f1186b9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:20.987252 23151 tablet_replica.cc:333] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:20.988153 23151 raft_consensus.cc:2243] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:20.989378 23151 raft_consensus.cc:2272] T fd8dacaad53349ebb29c67fe11853fab P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:20.999523 30783 consensus_peers.cc:597] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:21.001114 23151 tablet_replica.cc:333] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.002172 23151 raft_consensus.cc:2243] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.002825 23151 raft_consensus.cc:2272] T f61dc8e98f804681b0815e953b2d2ad1 P 4a9042c4154c442297159d1c9f1186b9 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.006515 23151 tablet_replica.cc:333] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.007576 23151 raft_consensus.cc:2243] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.008381 23151 raft_consensus.cc:2272] T 6a1ba3aa111d4c5e8558a89abec0aa64 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.011950 23151 tablet_replica.cc:333] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
W20260709 12:22:21.012909 30857 consensus_peers.cc:597] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:21.013186 23151 raft_consensus.cc:2243] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.014015 23151 raft_consensus.cc:2272] T 7f56cad4068d4388bf572777bcfb89b3 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.017722 23151 tablet_replica.cc:333] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.018761 23151 raft_consensus.cc:2243] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.020123 23151 raft_consensus.cc:2272] T e93f0e0819f8466fad08603e540dc22e P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.023533 23151 tablet_replica.cc:333] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.024597 23151 raft_consensus.cc:2243] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.025316 23151 raft_consensus.cc:2272] T c48114d81f8f4cf08f9665b697bc5560 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.028584 23151 tablet_replica.cc:333] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.029686 23151 raft_consensus.cc:2243] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.031059 23151 raft_consensus.cc:2272] T 4f8edecc2bf945e2bf553a7708f0f2cb P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:21.031826 30783 consensus_peers.cc:597] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:21.034721 23151 tablet_replica.cc:333] T 5c179d47d7f146ed83b56ea632997aa7 P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.035887 23151 raft_consensus.cc:2243] T 5c179d47d7f146ed83b56ea632997aa7 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.036532 23151 raft_consensus.cc:2272] T 5c179d47d7f146ed83b56ea632997aa7 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.039832 23151 tablet_replica.cc:333] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.040913 23151 raft_consensus.cc:2243] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.041621 23151 raft_consensus.cc:2272] T 439d52649ecc46e58d714b9351576dd5 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.044924 23151 tablet_replica.cc:333] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.046029 23151 raft_consensus.cc:2243] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.046777 23151 raft_consensus.cc:2272] T 44af5a494fec45679774bc9eb1007f9b P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.050447 23151 tablet_replica.cc:333] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.051473 23151 raft_consensus.cc:2243] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.052796 23151 raft_consensus.cc:2272] T 38606820b9b349d3ad9f9fae03de5e86 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.056244 23151 tablet_replica.cc:333] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.057222 23151 raft_consensus.cc:2243] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.057950 23151 raft_consensus.cc:2272] T fda0258f575243bd910da13e828fb6f6 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.061573 23151 tablet_replica.cc:333] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.062706 23151 raft_consensus.cc:2243] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.063403 23151 raft_consensus.cc:2272] T b78acfb4f1d649e4821c390039d2ede5 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.068076 23151 tablet_replica.cc:333] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.069131 23151 raft_consensus.cc:2243] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.069871 23151 raft_consensus.cc:2272] T aec2e3f6d6be4c038a84a15ea8b61235 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.072893 23151 tablet_replica.cc:333] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.073686 23151 raft_consensus.cc:2243] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.074831 23151 raft_consensus.cc:2272] T b7f3fc82ff104135851cce7357eda3ec P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.079550 23151 tablet_replica.cc:333] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.081406 23151 raft_consensus.cc:2243] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.082057 23151 raft_consensus.cc:2272] T 4f5d808cf6da46a0894e888635591cc8 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.085112 23151 tablet_replica.cc:333] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.085915 23151 raft_consensus.cc:2243] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.087194 23151 raft_consensus.cc:2272] T de462b3788724f21b93b5cbb295c085a P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:21.087368 30783 consensus_peers.cc:597] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:21.089972 23151 tablet_replica.cc:333] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.090951 23151 raft_consensus.cc:2243] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.092080 23151 raft_consensus.cc:2272] T 2d372d3fc5dd43d1880a4a932c83d7da P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.095497 23151 tablet_replica.cc:333] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.096349 23151 raft_consensus.cc:2243] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.097059 23151 raft_consensus.cc:2272] T bac2bacfc36f49459fc2b2b2d8afb01d P 4a9042c4154c442297159d1c9f1186b9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.100044 23151 tablet_replica.cc:333] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.100879 23151 raft_consensus.cc:2243] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.101454 23151 raft_consensus.cc:2272] T 9ac7c8095aaa457494024d09dfaaf1bb P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:21.102366 30857 consensus_peers.cc:597] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:21.104599 23151 tablet_replica.cc:333] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.105786 23151 raft_consensus.cc:2243] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:22:21.105822 30857 consensus_peers.cc:597] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:21.106652 23151 raft_consensus.cc:2272] T 0fb4b46162a04eeda49624c82070758e P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.110965 23151 tablet_replica.cc:333] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.111969 23151 raft_consensus.cc:2243] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.112799 23151 raft_consensus.cc:2272] T 2f7a0a060aca4bdf912b9291106aaa74 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.116302 23151 tablet_replica.cc:333] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.117242 23151 raft_consensus.cc:2243] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.118520 23151 raft_consensus.cc:2272] T e87d449e2aa442ec87cb2b55b61d4496 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.121804 23151 tablet_replica.cc:333] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.122758 23151 raft_consensus.cc:2243] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.123976 23151 raft_consensus.cc:2272] T 4faf21b4ff034e548c19569963419851 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.127163 23151 tablet_replica.cc:333] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.128151 23151 raft_consensus.cc:2243] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.128901 23151 raft_consensus.cc:2272] T 9361d602cd814a70acf6a5867a109d74 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.134936 23151 tablet_replica.cc:333] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.135671 23151 raft_consensus.cc:2243] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.136293 23151 raft_consensus.cc:2272] T 7695652594064f568b2df572cb76e12a P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.139199 23151 tablet_replica.cc:333] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.140038 23151 raft_consensus.cc:2243] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.140664 23151 raft_consensus.cc:2272] T 4b26f10a0fb7476098bdb142c864895e P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.143090 23151 tablet_replica.cc:333] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.143698 23151 raft_consensus.cc:2243] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.144563 23151 raft_consensus.cc:2272] T 82bb30237ea045c79aa6eb181bc3e692 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.146811 23151 tablet_replica.cc:333] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.147367 23151 raft_consensus.cc:2243] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.147874 23151 raft_consensus.cc:2272] T 4326b71a8ff545259df55b4ab0564f48 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.150025 23151 tablet_replica.cc:333] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.150733 23151 raft_consensus.cc:2243] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.151597 23151 raft_consensus.cc:2272] T 77a02078ac834032ac607943e7b3d175 P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.155354 23151 tablet_replica.cc:333] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.156118 23151 raft_consensus.cc:2243] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.157173 23151 raft_consensus.cc:2272] T 18a8098230e4404c9d5743dcac2c5aaa P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.159801 23151 tablet_replica.cc:333] T 69a04a5cd9b143daba902d508029dcb5 P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.162393 23151 raft_consensus.cc:2243] T 69a04a5cd9b143daba902d508029dcb5 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.163010 23151 raft_consensus.cc:2272] T 69a04a5cd9b143daba902d508029dcb5 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.165853 23151 tablet_replica.cc:333] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.166445 23151 raft_consensus.cc:2243] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.166922 23151 raft_consensus.cc:2272] T c148832de74745608d983f2184cbf23f P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.169798 23151 tablet_replica.cc:333] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.170549 23151 raft_consensus.cc:2243] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.171082 23151 raft_consensus.cc:2272] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P 4a9042c4154c442297159d1c9f1186b9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.173687 23151 tablet_replica.cc:333] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.174458 23151 raft_consensus.cc:2243] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.175554 23151 raft_consensus.cc:2272] T f0d63226f015480c84967f90ac595cc0 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.177974 23151 tablet_replica.cc:333] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.178495 23151 raft_consensus.cc:2243] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.179250 23151 raft_consensus.cc:2272] T 0b6381e285f94a7ca02f638d09d0b3c2 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.181421 23151 tablet_replica.cc:333] T 81434413f4d7497a8ae5f95db857f819 P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.181907 23151 raft_consensus.cc:2243] T 81434413f4d7497a8ae5f95db857f819 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.182365 23151 raft_consensus.cc:2272] T 81434413f4d7497a8ae5f95db857f819 P 4a9042c4154c442297159d1c9f1186b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.184332 23151 tablet_replica.cc:333] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4a9042c4154c442297159d1c9f1186b9: stopping tablet replica
I20260709 12:22:21.184844 23151 raft_consensus.cc:2243] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.185257 23151 raft_consensus.cc:2272] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 4a9042c4154c442297159d1c9f1186b9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:21.260457 30783 consensus_peers.cc:597] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:21.420456 30783 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:44363, user_credentials={real_user=slave}} blocked reactor thread for 55023.8us
I20260709 12:22:21.464952 32217 raft_consensus.cc:493] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:21.466878 32217 raft_consensus.cc:515] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:21.470738 32217 leader_election.cc:290] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:22:21.480134 32213 raft_consensus.cc:493] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:21.481304 32213 raft_consensus.cc:515] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:21.485875 30819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcceeadce924e3493e4e91cb49e2f2e" candidate_uuid: "d3ab9d21f8864b50a71b49c7d624584a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20c7a0cd21c3449587fdeeff565557d3" is_pre_election: true
I20260709 12:22:21.486711 32213 leader_election.cc:290] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
W20260709 12:22:21.495888 30857 consensus_peers.cc:597] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:21.497048 30857 consensus_peers.cc:597] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:21.500806 30783 consensus_peers.cc:597] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:21.519255 30857 leader_election.cc:336] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:22:21.520140 30857 leader_election.cc:304] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:21.521157 32213 raft_consensus.cc:2749] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:21.526329 23151 tablet_server.cc:196] TabletServer@127.22.155.194:0 shutdown complete.
I20260709 12:22:21.530185 32213 raft_consensus.cc:493] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:21.531165 32213 raft_consensus.cc:515] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:21.534006 32213 leader_election.cc:290] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:22:21.542486 32210 raft_consensus.cc:493] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:21.543516 32210 raft_consensus.cc:515] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:21.548889 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7bda85e3c87401d84e81120f451dec8" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:22:21.552953 32210 leader_election.cc:290] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
W20260709 12:22:21.556067 30783 consensus_peers.cc:597] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:21.557017 30783 leader_election.cc:336] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
W20260709 12:22:21.558835 30783 leader_election.cc:336] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:22:21.559302 30783 leader_election.cc:304] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:21.560318 32216 raft_consensus.cc:2749] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:21.567812 32216 raft_consensus.cc:493] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:21.569144 32216 raft_consensus.cc:515] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:21.573055 32216 leader_election.cc:290] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:22:21.574457 32213 raft_consensus.cc:493] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:21.575225 32213 raft_consensus.cc:515] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:21.577584 32213 leader_election.cc:290] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
W20260709 12:22:21.579928 30857 leader_election.cc:336] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
W20260709 12:22:21.583904 30857 leader_election.cc:336] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:22:21.584379 30857 leader_election.cc:304] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:21.585127 32213 raft_consensus.cc:2749] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:21.588470 30857 leader_election.cc:336] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:22:21.590782 30857 leader_election.cc:336] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:21.591269 30857 leader_election.cc:304] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
W20260709 12:22:21.591527 30783 leader_election.cc:336] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:22:21.592083 32213 raft_consensus.cc:2749] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:21.594893 30783 leader_election.cc:304] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:22:21.606889 32216 raft_consensus.cc:2749] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:21.611469 30783 leader_election.cc:336] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:22:21.612730 30783 leader_election.cc:336] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:21.613235 30783 leader_election.cc:304] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:21.614085 32216 raft_consensus.cc:2749] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:21.689469 32210 raft_consensus.cc:493] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:21.690267 32210 raft_consensus.cc:515] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:21.693054 32210 leader_election.cc:290] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
W20260709 12:22:21.700124 30783 leader_election.cc:336] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:22:21.700793 30783 leader_election.cc:336] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:21.701171 30783 leader_election.cc:304] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:21.701923 32210 raft_consensus.cc:2749] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:21.766196 23151 tablet_server.cc:179] TabletServer@127.22.155.195:0 shutting down...
I20260709 12:22:21.767184 32210 raft_consensus.cc:493] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:21.767874 32210 raft_consensus.cc:515] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:21.771497 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabc74dfa2e44e0580c268f61d17e024" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:22:21.772593 32210 leader_election.cc:290] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:22:21.773568 32220 raft_consensus.cc:493] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:21.774256 32220 raft_consensus.cc:515] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
W20260709 12:22:21.780392 30860 leader_election.cc:336] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:22:21.782158 30783 leader_election.cc:336] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:22:21.782814 30783 leader_election.cc:304] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
I20260709 12:22:21.784165 32210 raft_consensus.cc:2749] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:21.784701 32213 raft_consensus.cc:493] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:21.785025 32220 leader_election.cc:290] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:22:21.785420 32213 raft_consensus.cc:515] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
W20260709 12:22:21.791267 30857 leader_election.cc:336] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:22:21.791611 30857 leader_election.cc:304] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:21.793952 32213 leader_election.cc:290] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:22:21.793244 32220 raft_consensus.cc:2749] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:21.798033 30857 leader_election.cc:336] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:22:21.800926 30857 leader_election.cc:336] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:21.801465 30857 leader_election.cc:304] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:21.803575 32220 raft_consensus.cc:2749] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:21.829552 32213 raft_consensus.cc:493] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:21.830296 32213 raft_consensus.cc:515] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:21.836227 32213 leader_election.cc:290] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:22:21.839156 32210 raft_consensus.cc:493] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:21.839926 32210 raft_consensus.cc:515] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:21.842326 32210 leader_election.cc:290] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:22:21.843806 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e24a3b2b9d4270a8b8466d3c6313ab" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
W20260709 12:22:21.848455 30860 leader_election.cc:336] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:22:21.853150 30783 leader_election.cc:336] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:22:21.853685 30783 leader_election.cc:304] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4, d3ab9d21f8864b50a71b49c7d624584a
W20260709 12:22:21.854242 30857 leader_election.cc:336] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:22:21.854442 32210 raft_consensus.cc:2749] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:21.859928 30857 leader_election.cc:304] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:21.860909 32213 raft_consensus.cc:2749] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:22:21.877082 30860 consensus_peers.cc:597] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Couldn't send request to peer 20c7a0cd21c3449587fdeeff565557d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:21.877198 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:21.878499 23151 tablet_replica.cc:333] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:21.879727 23151 raft_consensus.cc:2243] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.880503 23151 raft_consensus.cc:2272] T f7e24a3b2b9d4270a8b8466d3c6313ab P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.885679 23151 tablet_replica.cc:333] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:21.886876 23151 raft_consensus.cc:2243] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.887639 23151 raft_consensus.cc:2272] T 44af5a494fec45679774bc9eb1007f9b P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.891832 23151 tablet_replica.cc:333] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:21.892856 23151 raft_consensus.cc:2243] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.894474 23151 raft_consensus.cc:2272] T 4682db2f801d4701a9c03cb1e4b32fd0 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.898303 23151 tablet_replica.cc:333] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:21.899266 23151 raft_consensus.cc:2243] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.900321 23151 raft_consensus.cc:2272] T c4e2f4d39a39493b8404958a5aaaa7af P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.901687 32218 raft_consensus.cc:493] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:21.903115 23151 tablet_replica.cc:333] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:21.902583 32218 raft_consensus.cc:515] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } }
I20260709 12:22:21.903990 23151 raft_consensus.cc:2243] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.905243 23151 raft_consensus.cc:2272] T 100eb209359a46d8b6c900d5a401586e P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.905790 32218 leader_election.cc:290] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:22:21.909366 23151 tablet_replica.cc:333] T 7ca6811dc9854dfaa1295db38c91c0fd P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:21.910923 23151 raft_consensus.cc:2243] T 7ca6811dc9854dfaa1295db38c91c0fd P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.911898 23151 raft_consensus.cc:2272] T 7ca6811dc9854dfaa1295db38c91c0fd P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.914098 32213 raft_consensus.cc:493] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:21.915050 32213 raft_consensus.cc:515] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:21.915908 23151 tablet_replica.cc:333] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
W20260709 12:22:21.916122 30783 leader_election.cc:336] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:22:21.917281 23151 raft_consensus.cc:2243] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.917474 32190 raft_consensus.cc:493] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
W20260709 12:22:21.918206 30783 leader_election.cc:336] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:21.918370 23151 raft_consensus.cc:2272] T e243e0f019f54586877c9a61b2fc83ac P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.918984 30783 leader_election.cc:304] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:21.918334 32190 raft_consensus.cc:515] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:21.919989 32210 raft_consensus.cc:2749] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:21.923127 23151 tablet_replica.cc:333] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:21.924316 23151 raft_consensus.cc:2243] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.924327 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcceeadce924e3493e4e91cb49e2f2e" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:22:21.925213 30886 raft_consensus.cc:2468] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 3.
I20260709 12:22:21.925844 23151 raft_consensus.cc:2272] T fffb9d78e773452ab44ae35b5d65fdb2 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.929177 30785 leader_election.cc:304] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:22:21.929749 23151 tablet_replica.cc:333] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:21.930949 23151 raft_consensus.cc:2243] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.932420 23151 raft_consensus.cc:2272] T bac2bacfc36f49459fc2b2b2d8afb01d P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.937242 23151 tablet_replica.cc:333] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:21.937903 32221 raft_consensus.cc:493] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:21.938508 23151 raft_consensus.cc:2243] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.938685 32221 raft_consensus.cc:515] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:21.939723 23151 raft_consensus.cc:2272] T 5c645f524d71421eb842b8b854f95597 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.944264 32210 raft_consensus.cc:2804] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:21.944711 32210 raft_consensus.cc:493] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:21.945104 32210 raft_consensus.cc:3060] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:21.955024 23151 tablet_replica.cc:333] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:21.956219 23151 raft_consensus.cc:2243] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.956645 32212 raft_consensus.cc:493] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:21.957156 23151 raft_consensus.cc:2272] T f61dc8e98f804681b0815e953b2d2ad1 P 20c7a0cd21c3449587fdeeff565557d3 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.957502 32212 raft_consensus.cc:515] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:21.960580 32212 leader_election.cc:290] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:22:21.961184 32212 raft_consensus.cc:493] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:21.961855 23151 tablet_replica.cc:333] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:21.963271 23151 raft_consensus.cc:2243] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.964144 23151 raft_consensus.cc:2272] T b2f2ae9f62734cf59b3d5477d92760cb P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.964211 32190 leader_election.cc:290] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:22:21.961833 32212 raft_consensus.cc:515] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:21.967787 23151 tablet_replica.cc:333] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:21.968676 32212 leader_election.cc:290] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:22:21.968760 23151 raft_consensus.cc:2243] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.969595 32221 leader_election.cc:290] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
W20260709 12:22:21.969836 30783 leader_election.cc:336] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:22:21.970738 23151 raft_consensus.cc:2272] T 7f56cad4068d4388bf572777bcfb89b3 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:21.973654 30860 leader_election.cc:336] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:22:21.974506 30860 consensus_peers.cc:597] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a -> Peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Couldn't send request to peer 20c7a0cd21c3449587fdeeff565557d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:21.974795 23151 tablet_replica.cc:333] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:21.976385 23151 raft_consensus.cc:2243] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.976905 32213 leader_election.cc:290] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:22:21.978083 23151 raft_consensus.cc:2272] T e946ad6dd9cb42ad93987cebde13ba9a P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.982661 23151 tablet_replica.cc:333] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:21.984020 23151 raft_consensus.cc:2243] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.984942 23151 raft_consensus.cc:2272] T baad7ab904cc431381366c54397a57ef P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.988981 23151 tablet_replica.cc:333] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:21.990023 23151 raft_consensus.cc:2243] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.991672 23151 raft_consensus.cc:2272] T fda0258f575243bd910da13e828fb6f6 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:21.991986 30860 leader_election.cc:336] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:22:21.996860 30857 leader_election.cc:336] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:22:22.000483 30857 leader_election.cc:336] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:22.001766 23151 tablet_replica.cc:333] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:22.001775 30857 leader_election.cc:304] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:22.004338 32221 raft_consensus.cc:2749] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:22.003403 23151 raft_consensus.cc:2243] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:22.008224 23151 raft_consensus.cc:2272] T 5c179d47d7f146ed83b56ea632997aa7 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.991235 32210 raft_consensus.cc:515] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:22.011381 32210 leader_election.cc:290] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:22:22.011909 23151 tablet_replica.cc:333] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:22.012451 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcceeadce924e3493e4e91cb49e2f2e" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:22:22.013109 23151 raft_consensus.cc:2243] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:22.013166 30886 raft_consensus.cc:3060] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:22.014101 23151 raft_consensus.cc:2272] T 439d52649ecc46e58d714b9351576dd5 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:22.016750 30783 leader_election.cc:336] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:22:22.021395 30857 leader_election.cc:336] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:22:22.022071 30857 leader_election.cc:336] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:22:22.022493 30857 leader_election.cc:304] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:22.023418 32221 raft_consensus.cc:2749] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:22.023543 30857 leader_election.cc:336] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:22:22.024065 30857 leader_election.cc:304] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:22.025872 32221 raft_consensus.cc:2749] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:22.026748 30857 leader_election.cc:336] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:22.027247 30857 leader_election.cc:304] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
W20260709 12:22:22.028874 30860 consensus_peers.cc:597] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a -> Peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Couldn't send request to peer 20c7a0cd21c3449587fdeeff565557d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:22.030807 32221 raft_consensus.cc:2749] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:22.030447 30886 raft_consensus.cc:2468] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 4.
I20260709 12:22:22.033267 30785 leader_election.cc:304] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:22.033516 23151 tablet_replica.cc:333] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:22.034324 32210 raft_consensus.cc:2804] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:22.034665 23151 raft_consensus.cc:2243] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:22.035056 32210 raft_consensus.cc:697] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 4 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:22:22.035645 23151 raft_consensus.cc:2272] T 4f8edecc2bf945e2bf553a7708f0f2cb P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:22.036368 32210 consensus_queue.cc:237] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:22.039577 23151 tablet_replica.cc:333] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
W20260709 12:22:22.044003 30860 consensus_peers.cc:597] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a -> Peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Couldn't send request to peer 20c7a0cd21c3449587fdeeff565557d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:22.044893 23151 raft_consensus.cc:2243] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:22.045845 23151 raft_consensus.cc:2272] T b33ccb8b23d8455a990ef1cb50271887 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:22.049067 32218 raft_consensus.cc:493] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:22.049690 23151 tablet_replica.cc:333] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:22.049803 32218 raft_consensus.cc:515] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:22.050848 23151 raft_consensus.cc:2243] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:22.051741 23151 raft_consensus.cc:2272] T e87d449e2aa442ec87cb2b55b61d4496 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:22.053580 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fee969f4c2a4579ab7911212a86bf67" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a" is_pre_election: true
I20260709 12:22:22.054392 30886 raft_consensus.cc:2468] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 3.
I20260709 12:22:22.055457 23151 tablet_replica.cc:333] T 69a04a5cd9b143daba902d508029dcb5 P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:22.056429 23151 raft_consensus.cc:2243] T 69a04a5cd9b143daba902d508029dcb5 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:22.057194 23151 raft_consensus.cc:2272] T 69a04a5cd9b143daba902d508029dcb5 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:22.061017 23151 tablet_replica.cc:333] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:22.060503 30785 leader_election.cc:304] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:22:22.062688 23151 raft_consensus.cc:2243] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:22.062770 32190 raft_consensus.cc:2804] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:22.063306 32190 raft_consensus.cc:493] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:22.063709 32190 raft_consensus.cc:3060] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:22.064394 23151 raft_consensus.cc:2272] T c148832de74745608d983f2184cbf23f P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:22.065361 32218 leader_election.cc:290] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
W20260709 12:22:22.074254 30783 leader_election.cc:336] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:22:22.074229 32190 raft_consensus.cc:515] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:22.068601 23151 tablet_replica.cc:333] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:22.079164 30886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fee969f4c2a4579ab7911212a86bf67" candidate_uuid: "20c7a0cd21c3449587fdeeff565557d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3ab9d21f8864b50a71b49c7d624584a"
I20260709 12:22:22.079789 30886 raft_consensus.cc:3060] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:22.080111 23151 raft_consensus.cc:2243] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:22.081832 23151 raft_consensus.cc:2272] T aec2e3f6d6be4c038a84a15ea8b61235 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:22.083983 30860 consensus_peers.cc:597] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a -> Peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Couldn't send request to peer 20c7a0cd21c3449587fdeeff565557d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:22.085500 32190 leader_election.cc:290] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 election: Requested vote from peers d3ab9d21f8864b50a71b49c7d624584a (127.22.155.196:33441), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:22:22.088574 30886 raft_consensus.cc:2468] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c7a0cd21c3449587fdeeff565557d3 in term 4.
I20260709 12:22:22.089869 30785 leader_election.cc:304] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c7a0cd21c3449587fdeeff565557d3, d3ab9d21f8864b50a71b49c7d624584a; no voters: 
I20260709 12:22:22.091749 32190 raft_consensus.cc:2804] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:22.092576 32190 raft_consensus.cc:697] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 LEADER]: Becoming Leader. State: Replica: 20c7a0cd21c3449587fdeeff565557d3, State: Running, Role: LEADER
I20260709 12:22:22.085825 23151 tablet_replica.cc:333] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:22.093616 32190 consensus_queue.cc:237] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
W20260709 12:22:22.095271 30860 consensus_peers.cc:597] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Couldn't send request to peer 20c7a0cd21c3449587fdeeff565557d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:22.095301 23151 raft_consensus.cc:2243] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:22.096797 23151 raft_consensus.cc:2272] T b7f3fc82ff104135851cce7357eda3ec P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:22.097636 30783 leader_election.cc:336] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:22:22.101733 23151 tablet_replica.cc:333] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:22.103117 23151 raft_consensus.cc:2243] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:22.104001 23151 raft_consensus.cc:2272] T cabc74dfa2e44e0580c268f61d17e024 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:22.108414 23151 tablet_replica.cc:333] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:22.109668 23151 raft_consensus.cc:2243] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:22.110560 23151 raft_consensus.cc:2272] T 4f5d808cf6da46a0894e888635591cc8 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:22.110837 30860 consensus_peers.cc:597] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Couldn't send request to peer 20c7a0cd21c3449587fdeeff565557d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:22.113262 30860 consensus_peers.cc:597] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Couldn't send request to peer 20c7a0cd21c3449587fdeeff565557d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:22.114557 23151 tablet_replica.cc:333] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:22.115780 23151 raft_consensus.cc:2243] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:22.116497 23151 raft_consensus.cc:2272] T 006658e1213f4f8da089a9570e0a76b9 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:22.120350 23151 tablet_replica.cc:333] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:22.121462 23151 raft_consensus.cc:2243] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:22.122972 23151 raft_consensus.cc:2272] T 0fb4b46162a04eeda49624c82070758e P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:22.127362 23151 tablet_replica.cc:333] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:22.128470 23151 raft_consensus.cc:2243] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 LEADER]: Raft consensus shutting down.
W20260709 12:22:22.129009 30860 consensus_peers.cc:597] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Couldn't send request to peer 20c7a0cd21c3449587fdeeff565557d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:22.129577 23151 pending_rounds.cc:70] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3: Trying to abort 1 pending ops.
I20260709 12:22:22.129964 23151 pending_rounds.cc:77] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3: Aborting op as it isn't in flight: id { term: 4 index: 4 } timestamp: 7305624543628591104 op_type: NO_OP noop_request { }
I20260709 12:22:22.130404 23151 raft_consensus.cc:2889] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:22:22.130837 23151 raft_consensus.cc:2272] T 2fee969f4c2a4579ab7911212a86bf67 P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:22.134066 23151 tablet_replica.cc:333] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:22.134788 23151 raft_consensus.cc:2243] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:22.135423 23151 raft_consensus.cc:2272] T de462b3788724f21b93b5cbb295c085a P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:22.138211 23151 tablet_replica.cc:333] T 0b6381e285f94a7ca02f638d09d0b3c2 P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:22.138866 23151 raft_consensus.cc:2243] T 0b6381e285f94a7ca02f638d09d0b3c2 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:22.139506 23151 raft_consensus.cc:2272] T 0b6381e285f94a7ca02f638d09d0b3c2 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:22.142272 23151 tablet_replica.cc:333] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:22.142937 23151 raft_consensus.cc:2243] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:22.143549 23151 raft_consensus.cc:2272] T 77a02078ac834032ac607943e7b3d175 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:22.146201 23151 tablet_replica.cc:333] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:22.146870 23151 raft_consensus.cc:2243] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:22.147535 23151 raft_consensus.cc:2272] T 18a8098230e4404c9d5743dcac2c5aaa P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:22.150354 23151 tablet_replica.cc:333] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:22.151072 23151 raft_consensus.cc:2243] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:22.151671 23151 raft_consensus.cc:2272] T b7bda85e3c87401d84e81120f451dec8 P 20c7a0cd21c3449587fdeeff565557d3 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:22.154371 23151 tablet_replica.cc:333] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:22.155004 23151 raft_consensus.cc:2243] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:22.155769 23151 pending_rounds.cc:70] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3: Trying to abort 1 pending ops.
I20260709 12:22:22.155941 23151 pending_rounds.cc:77] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3: Aborting op as it isn't in flight: id { term: 4 index: 4 } timestamp: 7305624543395254272 op_type: NO_OP noop_request { }
I20260709 12:22:22.156297 23151 raft_consensus.cc:2889] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:22:22.156715 23151 raft_consensus.cc:2272] T 5fcceeadce924e3493e4e91cb49e2f2e P 20c7a0cd21c3449587fdeeff565557d3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:22.159991 23151 tablet_replica.cc:333] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:22.160755 23151 raft_consensus.cc:2243] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:22.161338 23151 raft_consensus.cc:2272] T 815af3bc37df4d158766ac2e615de683 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:22.163904 23151 tablet_replica.cc:333] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:22.164523 23151 raft_consensus.cc:2243] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:22.165652 23151 raft_consensus.cc:2272] T 81434413f4d7497a8ae5f95db857f819 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:22.168342 23151 tablet_replica.cc:333] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:22.169152 23151 raft_consensus.cc:2243] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:22.170778 23151 raft_consensus.cc:2272] T 0fc72ff638c0425f9c75bb21e2b99dd3 P 20c7a0cd21c3449587fdeeff565557d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:22.174556 23151 tablet_replica.cc:333] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:22.175444 23151 raft_consensus.cc:2243] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:22.176785 23151 raft_consensus.cc:2272] T 4b26f10a0fb7476098bdb142c864895e P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:22.179535 23151 tablet_replica.cc:333] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:22.180174 23151 raft_consensus.cc:2243] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:22.180783 23151 raft_consensus.cc:2272] T 82bb30237ea045c79aa6eb181bc3e692 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:22.183503 23151 tablet_replica.cc:333] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:22.184139 23151 raft_consensus.cc:2243] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:22.184796 23151 raft_consensus.cc:2272] T 4326b71a8ff545259df55b4ab0564f48 P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:22.187196 23151 tablet_replica.cc:333] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:22.187904 23151 raft_consensus.cc:2243] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:22.188560 23151 raft_consensus.cc:2272] T 9361d602cd814a70acf6a5867a109d74 P 20c7a0cd21c3449587fdeeff565557d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:22.191362 23151 tablet_replica.cc:333] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3: stopping tablet replica
I20260709 12:22:22.192111 23151 raft_consensus.cc:2243] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:22.192597 23151 raft_consensus.cc:2272] T eb65e812f06540bc9f1c2b1e3e13d41c P 20c7a0cd21c3449587fdeeff565557d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:22.203845 32213 raft_consensus.cc:493] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:22:22.204749 32213 raft_consensus.cc:515] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:22.207623 32213 leader_election.cc:290] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
W20260709 12:22:22.213608 30857 leader_election.cc:336] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:22:22.214480 30857 leader_election.cc:336] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:22.214919 30857 leader_election.cc:304] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:22.215749 32213 raft_consensus.cc:2749] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:22.232940 32221 raft_consensus.cc:493] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:22:22.233688 32221 raft_consensus.cc:515] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:22.236276 32221 leader_election.cc:290] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
W20260709 12:22:22.241142 30860 leader_election.cc:336] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:22:22.243883 30857 leader_election.cc:336] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:22.244516 30857 leader_election.cc:304] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:22:22.245723 32221 raft_consensus.cc:2749] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:22.249783 30860 consensus_peers.cc:597] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a -> Peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Couldn't send request to peer 20c7a0cd21c3449587fdeeff565557d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:22.287003 30860 consensus_peers.cc:597] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Couldn't send request to peer 20c7a0cd21c3449587fdeeff565557d3. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:22.340174 30860 consensus_peers.cc:597] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Couldn't send request to peer 20c7a0cd21c3449587fdeeff565557d3. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:22.353912 32221 raft_consensus.cc:493] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:22:22.354650 32221 raft_consensus.cc:515] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:22.356858 32221 leader_election.cc:290] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
W20260709 12:22:22.361243 30857 leader_election.cc:336] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
W20260709 12:22:22.361873 30860 leader_election.cc:336] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111)
I20260709 12:22:22.362270 30860 leader_election.cc:304] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:22:22.362915 32221 raft_consensus.cc:2749] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:22.392477 32221 raft_consensus.cc:493] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:22:22.393193 32221 raft_consensus.cc:515] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:22.393777 32212 raft_consensus.cc:493] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:22:22.394430 32212 raft_consensus.cc:515] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:22.395706 32221 leader_election.cc:290] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:22:22.396682 32212 leader_election.cc:290] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
W20260709 12:22:22.402406 30857 leader_election.cc:336] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:22:22.403051 30857 leader_election.cc:336] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:22:22.403707 30857 leader_election.cc:336] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:22.404031 30857 leader_election.cc:304] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:22.404713 32212 raft_consensus.cc:2749] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:22.404867 30857 leader_election.cc:336] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:22.405354 30857 leader_election.cc:304] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:22.405995 32212 raft_consensus.cc:2749] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:22.439811 32212 raft_consensus.cc:493] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:22:22.440547 32212 raft_consensus.cc:515] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:22.442981 32212 leader_election.cc:290] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
W20260709 12:22:22.446939 30857 leader_election.cc:336] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:22:22.447959 30857 leader_election.cc:336] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:22.448403 30857 leader_election.cc:304] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:22.449115 32212 raft_consensus.cc:2749] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:22.452656 32212 raft_consensus.cc:493] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:22:22.453269 32212 raft_consensus.cc:515] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:22.456615 32212 leader_election.cc:290] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
W20260709 12:22:22.460002 30857 leader_election.cc:336] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:22:22.464565 30857 leader_election.cc:336] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:22.465080 30857 leader_election.cc:304] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:22.465761 32221 raft_consensus.cc:2749] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:22.489504 32227 raft_consensus.cc:493] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:22:22.490126 32227 raft_consensus.cc:515] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:22.493703 32227 leader_election.cc:290] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
W20260709 12:22:22.499541 30857 leader_election.cc:336] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:22:22.500578 30857 leader_election.cc:336] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:22.501016 30857 leader_election.cc:304] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:22.501708 32227 raft_consensus.cc:2749] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:22.523103 32227 raft_consensus.cc:493] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:22:22.523813 32227 raft_consensus.cc:515] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:22.524947 32212 raft_consensus.cc:493] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:22:22.525684 32212 raft_consensus.cc:515] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:22.526530 32227 leader_election.cc:290] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:22:22.527927 32212 leader_election.cc:290] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
W20260709 12:22:22.542577 30857 leader_election.cc:336] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
W20260709 12:22:22.544135 30857 leader_election.cc:336] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
W20260709 12:22:22.545166 30857 leader_election.cc:336] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:22:22.545658 30857 leader_election.cc:304] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:22.547495 32212 raft_consensus.cc:2749] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:22.550693 30860 leader_election.cc:336] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111)
I20260709 12:22:22.551111 30860 leader_election.cc:304] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:22:22.551818 32212 raft_consensus.cc:2749] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:22.929319 32212 raft_consensus.cc:493] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:22:22.930042 32212 raft_consensus.cc:515] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:22.932716 32212 leader_election.cc:290] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
W20260709 12:22:22.937165 30857 leader_election.cc:336] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
W20260709 12:22:22.938928 30860 leader_election.cc:336] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111)
I20260709 12:22:22.939531 30860 leader_election.cc:304] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:22:22.940296 32212 raft_consensus.cc:2749] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:22.954270 32212 raft_consensus.cc:493] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:22:22.954965 32212 raft_consensus.cc:515] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:22.958390 32212 leader_election.cc:290] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
W20260709 12:22:22.961853 30860 leader_election.cc:336] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111)
W20260709 12:22:22.962481 30857 leader_election.cc:336] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:22.962889 30857 leader_election.cc:304] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:22:22.963497 32212 raft_consensus.cc:2749] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:22.984969 32212 raft_consensus.cc:493] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:22:22.985659 32212 raft_consensus.cc:515] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:22.991320 32212 leader_election.cc:290] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
W20260709 12:22:22.993491 30857 leader_election.cc:336] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
W20260709 12:22:22.994215 30860 leader_election.cc:336] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111)
I20260709 12:22:22.994707 30860 leader_election.cc:304] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:22:22.995597 32212 raft_consensus.cc:2749] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:23.068327 30857 consensus_peers.cc:597] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:23.074666 30857 consensus_peers.cc:597] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:23.096701 32212 raft_consensus.cc:493] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:22:23.097451 32212 raft_consensus.cc:515] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:23.100176 32212 leader_election.cc:290] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
W20260709 12:22:23.105934 30860 leader_election.cc:336] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111)
W20260709 12:22:23.109755 30857 leader_election.cc:336] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:22:23.110150 30857 leader_election.cc:304] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:23.110790 32212 raft_consensus.cc:2749] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:22:23.139180 30857 consensus_peers.cc:597] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:23.175067 30857 consensus_peers.cc:597] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:23.253067 30857 consensus_peers.cc:597] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:23.271323 30857 consensus_peers.cc:597] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:23.281471 30857 consensus_peers.cc:597] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:23.297698 32212 raft_consensus.cc:493] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:22:23.298668 32212 raft_consensus.cc:515] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
W20260709 12:22:23.299206 23151 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 30841)
I20260709 12:22:23.301316 32212 leader_election.cc:290] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
W20260709 12:22:23.305240 30860 leader_election.cc:336] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111)
W20260709 12:22:23.306340 30857 leader_election.cc:336] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:23.306732 30857 leader_election.cc:304] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:22:23.307416 32212 raft_consensus.cc:2749] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:23.346514 32212 raft_consensus.cc:493] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:23.347126 32212 raft_consensus.cc:515] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:23.349148 32212 leader_election.cc:290] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
W20260709 12:22:23.353694 30857 leader_election.cc:336] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:22:23.354487 30857 leader_election.cc:336] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:23.354899 30857 leader_election.cc:304] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:23.355715 32212 raft_consensus.cc:2749] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:23.358429 32212 raft_consensus.cc:493] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:22:23.358909 32212 raft_consensus.cc:515] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:23.360935 32212 leader_election.cc:290] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
W20260709 12:22:23.365520 30857 leader_election.cc:336] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
W20260709 12:22:23.367758 30860 leader_election.cc:336] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111)
I20260709 12:22:23.368547 32212 raft_consensus.cc:493] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:22:23.368865 30860 leader_election.cc:304] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:22:23.369340 32212 raft_consensus.cc:515] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:23.370337 32227 raft_consensus.cc:2749] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:23.372351 32212 leader_election.cc:290] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
W20260709 12:22:23.375064 30860 leader_election.cc:336] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111)
W20260709 12:22:23.376924 30857 leader_election.cc:336] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:22:23.377426 30857 leader_election.cc:304] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:23.378206 32212 raft_consensus.cc:2749] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:23.389079 30857 consensus_peers.cc:597] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:23.389748 32212 raft_consensus.cc:493] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:22:23.390368 32212 raft_consensus.cc:515] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:23.392535 32212 leader_election.cc:290] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
W20260709 12:22:23.397648 30857 leader_election.cc:336] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
W20260709 12:22:23.398196 30860 leader_election.cc:336] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111)
I20260709 12:22:23.398706 30860 leader_election.cc:304] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:22:23.399626 32212 raft_consensus.cc:2749] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:23.401551 30857 consensus_peers.cc:597] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:23.417404 30857 consensus_peers.cc:597] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:23.420423 30857 consensus_peers.cc:597] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:23.463477 30857 consensus_peers.cc:597] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:23.495697 30857 consensus_peers.cc:597] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:23.559264 30857 consensus_peers.cc:597] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Couldn't send request to peer 4e9c812ece8a42efa063dc7bd5ea25e4. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:23.563534 32212 raft_consensus.cc:493] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:22:23.564317 32212 raft_consensus.cc:515] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
W20260709 12:22:23.565117 30857 consensus_peers.cc:597] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:23.567755 32212 leader_election.cc:290] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:22:23.569430 32212 raft_consensus.cc:493] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:23.569998 32212 raft_consensus.cc:515] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
W20260709 12:22:23.571242 30857 leader_election.cc:336] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
W20260709 12:22:23.571970 30860 leader_election.cc:336] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111)
I20260709 12:22:23.572382 32212 leader_election.cc:290] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:22:23.572479 30860 leader_election.cc:304] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:22:23.574697 32212 raft_consensus.cc:2749] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:23.576715 30857 leader_election.cc:336] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:22:23.578673 30860 leader_election.cc:336] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111)
I20260709 12:22:23.579017 30860 leader_election.cc:304] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:23.579737 32212 raft_consensus.cc:2749] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:23.604589 30857 consensus_peers.cc:597] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:23.644693 32227 raft_consensus.cc:493] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:23.645335 32227 raft_consensus.cc:515] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:23.647411 32227 leader_election.cc:290] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
W20260709 12:22:23.651049 30857 leader_election.cc:336] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:22:23.652058 30857 leader_election.cc:336] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:23.652393 30857 leader_election.cc:304] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:23.653016 32227 raft_consensus.cc:2749] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:23.774897 32227 raft_consensus.cc:493] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:23.775528 32227 raft_consensus.cc:515] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:23.777815 32227 leader_election.cc:290] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
W20260709 12:22:23.783635 30857 leader_election.cc:336] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:22:23.784747 30857 leader_election.cc:336] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:23.785224 30857 leader_election.cc:304] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:23.785892 32227 raft_consensus.cc:2749] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:23.789978 32227 raft_consensus.cc:493] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:22:23.790410 32227 raft_consensus.cc:515] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:23.792333 32227 leader_election.cc:290] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
W20260709 12:22:23.798920 30857 leader_election.cc:336] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:22:23.801837 30857 leader_election.cc:336] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:23.802289 30857 leader_election.cc:304] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:23.803092 32227 raft_consensus.cc:2749] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:23.853515 32227 raft_consensus.cc:493] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:23.854285 32227 raft_consensus.cc:515] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:23.856336 32227 leader_election.cc:290] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
W20260709 12:22:23.861689 30857 leader_election.cc:336] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:22:23.864888 30857 leader_election.cc:336] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:23.865332 30857 leader_election.cc:304] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:23.866173 32212 raft_consensus.cc:2749] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:23.874428 30857 consensus_peers.cc:597] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:23.902609 32227 raft_consensus.cc:493] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:23.903326 32227 raft_consensus.cc:515] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:23.905731 32227 leader_election.cc:290] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
I20260709 12:22:23.908882 32227 raft_consensus.cc:493] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:22:23.909448 32227 raft_consensus.cc:515] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
W20260709 12:22:23.910305 30860 leader_election.cc:336] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111)
I20260709 12:22:23.911674 32227 leader_election.cc:290] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
W20260709 12:22:23.914016 30857 leader_election.cc:336] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:22:23.914577 30857 leader_election.cc:304] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:23.915416 32212 raft_consensus.cc:2749] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:23.917862 30860 leader_election.cc:336] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111)
W20260709 12:22:23.918540 30857 leader_election.cc:336] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:23.918969 30857 leader_election.cc:304] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:22:23.919752 32212 raft_consensus.cc:2749] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:24.030330 32212 raft_consensus.cc:493] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:22:24.030936 32212 raft_consensus.cc:515] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:24.033005 32212 leader_election.cc:290] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
W20260709 12:22:24.040607 30857 leader_election.cc:336] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:22:24.041217 30857 leader_election.cc:336] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:24.041525 30857 leader_election.cc:304] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:24.042201 32227 raft_consensus.cc:2749] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:24.049889 32227 raft_consensus.cc:493] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:24.050559 32227 raft_consensus.cc:515] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:24.053170 32227 leader_election.cc:290] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
W20260709 12:22:24.058113 30860 leader_election.cc:336] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111)
W20260709 12:22:24.058796 30857 leader_election.cc:336] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:22:24.059149 30857 leader_election.cc:304] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:24.059839 32227 raft_consensus.cc:2749] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:22:24.118165 30857 consensus_peers.cc:597] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a -> Peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Couldn't send request to peer 4a9042c4154c442297159d1c9f1186b9. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:24.135283 32227 raft_consensus.cc:493] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:24.136029 32227 raft_consensus.cc:515] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:24.138521 32227 leader_election.cc:290] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:22:24.145232 32227 raft_consensus.cc:493] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:22:24.145916 32227 raft_consensus.cc:515] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:24.148195 32227 leader_election.cc:290] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
W20260709 12:22:24.151016 30857 leader_election.cc:336] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:22:24.153276 30857 leader_election.cc:336] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:24.153716 30857 leader_election.cc:304] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:24.154548 32227 raft_consensus.cc:2749] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:24.154942 30857 leader_election.cc:336] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:22:24.157498 30857 leader_election.cc:336] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:24.157912 30857 leader_election.cc:304] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:24.158667 32227 raft_consensus.cc:2749] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:24.231935 30860 consensus_peers.cc:597] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Couldn't send request to peer 20c7a0cd21c3449587fdeeff565557d3. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:24.243358 32227 raft_consensus.cc:493] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:22:24.244071 32227 raft_consensus.cc:515] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:24.246474 32227 leader_election.cc:290] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
W20260709 12:22:24.254185 30857 leader_election.cc:336] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
W20260709 12:22:24.255239 30857 leader_election.cc:336] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:22:24.255703 30857 leader_election.cc:304] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:24.256511 32227 raft_consensus.cc:2749] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:24.271301 32227 raft_consensus.cc:493] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.272126 32227 raft_consensus.cc:515] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:24.274314 32227 leader_election.cc:290] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
W20260709 12:22:24.279407 30860 leader_election.cc:336] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111)
W20260709 12:22:24.281519 30857 leader_election.cc:336] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:22:24.282016 30857 leader_election.cc:304] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:24.282773 32227 raft_consensus.cc:2749] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:22:24.299734 23151 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 30841)
I20260709 12:22:24.313104 32227 raft_consensus.cc:493] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:22:24.313841 32227 raft_consensus.cc:515] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:24.316111 32227 leader_election.cc:290] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
W20260709 12:22:24.320133 30857 leader_election.cc:336] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:22:24.321200 30857 leader_election.cc:336] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:24.321566 30857 leader_election.cc:304] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:24.322274 32227 raft_consensus.cc:2749] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:24.360419 32212 raft_consensus.cc:493] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:22:24.361110 32212 raft_consensus.cc:515] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:24.363513 32212 leader_election.cc:290] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:22:24.364598 32212 raft_consensus.cc:493] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:22:24.365175 32212 raft_consensus.cc:515] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:24.367393 32212 leader_election.cc:290] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
W20260709 12:22:24.370139 30860 leader_election.cc:336] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111)
W20260709 12:22:24.371265 30857 leader_election.cc:336] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:24.371747 30857 leader_election.cc:304] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:22:24.372602 32212 raft_consensus.cc:2749] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:24.374572 30857 leader_election.cc:336] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:22:24.375393 30857 leader_election.cc:336] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:24.375804 30857 leader_election.cc:304] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:24.376564 32212 raft_consensus.cc:2749] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:24.463011 30860 consensus_peers.cc:597] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a -> Peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Couldn't send request to peer 20c7a0cd21c3449587fdeeff565557d3. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:24.490394 30860 consensus_peers.cc:597] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Couldn't send request to peer 20c7a0cd21c3449587fdeeff565557d3. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:24.511338 30860 consensus_peers.cc:597] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a -> Peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Couldn't send request to peer 20c7a0cd21c3449587fdeeff565557d3. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:24.528509 32212 raft_consensus.cc:493] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
W20260709 12:22:24.529455 30860 consensus_peers.cc:597] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a -> Peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Couldn't send request to peer 20c7a0cd21c3449587fdeeff565557d3. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:24.529153 32212 raft_consensus.cc:515] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:24.531546 32212 leader_election.cc:290] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
W20260709 12:22:24.535656 30860 leader_election.cc:336] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111)
W20260709 12:22:24.536175 30857 leader_election.cc:336] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:24.536566 30857 leader_election.cc:304] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:22:24.537477 32212 raft_consensus.cc:2749] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:24.560858 32212 raft_consensus.cc:493] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a9042c4154c442297159d1c9f1186b9)
I20260709 12:22:24.561408 32212 raft_consensus.cc:515] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:24.563347 32212 leader_election.cc:290] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
W20260709 12:22:24.567493 30857 leader_election.cc:336] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:22:24.568187 30857 leader_election.cc:336] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:24.568492 30857 leader_election.cc:304] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:24.569185 32212 raft_consensus.cc:2749] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:24.605511 30860 consensus_peers.cc:597] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a -> Peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Couldn't send request to peer 20c7a0cd21c3449587fdeeff565557d3. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:24.606032 30860 consensus_peers.cc:597] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Couldn't send request to peer 20c7a0cd21c3449587fdeeff565557d3. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:24.609136 32212 raft_consensus.cc:493] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:22:24.609719 32212 raft_consensus.cc:515] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:24.611583 32212 leader_election.cc:290] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
W20260709 12:22:24.617424 30857 leader_election.cc:336] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
W20260709 12:22:24.617916 30860 leader_election.cc:336] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111)
I20260709 12:22:24.618404 30860 leader_election.cc:304] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:22:24.619194 32227 raft_consensus.cc:2749] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:24.638070 30860 consensus_peers.cc:597] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Couldn't send request to peer 20c7a0cd21c3449587fdeeff565557d3. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:24.709409 32212 raft_consensus.cc:493] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:22:24.710062 32212 raft_consensus.cc:515] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:24.711884 32212 leader_election.cc:290] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
W20260709 12:22:24.716010 30860 leader_election.cc:336] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111)
W20260709 12:22:24.716579 30857 leader_election.cc:336] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:22:24.717049 30857 leader_election.cc:304] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:24.717748 32212 raft_consensus.cc:2749] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:22:24.726799 30860 consensus_peers.cc:597] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a -> Peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Couldn't send request to peer 20c7a0cd21c3449587fdeeff565557d3. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:24.773650 30860 consensus_peers.cc:597] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Couldn't send request to peer 20c7a0cd21c3449587fdeeff565557d3. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:24.840719 30860 consensus_peers.cc:597] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Couldn't send request to peer 20c7a0cd21c3449587fdeeff565557d3. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:24.932358 32227 raft_consensus.cc:493] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:22:24.933017 32227 raft_consensus.cc:515] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:24.935341 32227 leader_election.cc:290] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
W20260709 12:22:24.939236 30857 leader_election.cc:336] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
W20260709 12:22:24.940201 30860 leader_election.cc:336] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111)
I20260709 12:22:24.940790 30860 leader_election.cc:304] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:22:24.941633 32227 raft_consensus.cc:2749] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:24.950222 30860 consensus_peers.cc:597] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a -> Peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Couldn't send request to peer 20c7a0cd21c3449587fdeeff565557d3. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:24.982631 32227 raft_consensus.cc:493] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.983242 32227 raft_consensus.cc:515] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } }
I20260709 12:22:24.985688 32227 leader_election.cc:290] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287), 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953)
W20260709 12:22:24.989966 30857 leader_election.cc:336] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
W20260709 12:22:24.990581 30860 leader_election.cc:336] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111)
I20260709 12:22:24.991027 30860 leader_election.cc:304] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:24.991850 32227 raft_consensus.cc:2749] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:25.059852 32212 raft_consensus.cc:493] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:22:25.060460 32212 raft_consensus.cc:515] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:25.062268 32212 leader_election.cc:290] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
W20260709 12:22:25.066428 30857 leader_election.cc:336] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
W20260709 12:22:25.067327 30860 leader_election.cc:336] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111)
I20260709 12:22:25.067731 30860 leader_election.cc:304] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:22:25.068356 32212 raft_consensus.cc:2749] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:25.070515 32212 raft_consensus.cc:493] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:22:25.070976 32212 raft_consensus.cc:515] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:25.072799 32212 leader_election.cc:290] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
W20260709 12:22:25.076463 30857 leader_election.cc:336] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
W20260709 12:22:25.077032 30860 leader_election.cc:336] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111)
I20260709 12:22:25.077566 30860 leader_election.cc:304] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:22:25.078358 32212 raft_consensus.cc:2749] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:25.189425 32212 raft_consensus.cc:493] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:22:25.189936 32212 raft_consensus.cc:515] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:25.193543 32212 leader_election.cc:290] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
W20260709 12:22:25.196605 30860 leader_election.cc:336] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111)
W20260709 12:22:25.201563 30857 leader_election.cc:336] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:25.203866 30857 leader_election.cc:304] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:22:25.204716 32212 raft_consensus.cc:2749] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:25.212917 23151 tablet_server.cc:196] TabletServer@127.22.155.195:0 shutdown complete.
I20260709 12:22:25.295890 23151 tablet_server.cc:179] TabletServer@127.22.155.196:0 shutting down...
I20260709 12:22:25.353253 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:25.354244 23151 tablet_replica.cc:333] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.355296 23151 raft_consensus.cc:2243] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.356377 23151 raft_consensus.cc:2272] T 7ca6811dc9854dfaa1295db38c91c0fd P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.359354 23151 tablet_replica.cc:333] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.360129 23151 raft_consensus.cc:2243] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.360801 23151 raft_consensus.cc:2272] T c4e2f4d39a39493b8404958a5aaaa7af P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.360900 32212 raft_consensus.cc:493] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20c7a0cd21c3449587fdeeff565557d3)
I20260709 12:22:25.361704 32212 raft_consensus.cc:515] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } } peers { permanent_uuid: "20c7a0cd21c3449587fdeeff565557d3" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 45287 } } peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } }
I20260709 12:22:25.363969 32212 leader_election.cc:290] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363), 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287)
I20260709 12:22:25.364727 23151 tablet_replica.cc:333] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.365857 23151 raft_consensus.cc:2243] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.366597 23151 raft_consensus.cc:2272] T f7e24a3b2b9d4270a8b8466d3c6313ab P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:25.368134 30857 leader_election.cc:336] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
W20260709 12:22:25.369164 30860 leader_election.cc:336] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 20c7a0cd21c3449587fdeeff565557d3 (127.22.155.195:45287): Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111)
I20260709 12:22:25.369623 30860 leader_election.cc:304] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 20c7a0cd21c3449587fdeeff565557d3, 4a9042c4154c442297159d1c9f1186b9
I20260709 12:22:25.370386 23151 tablet_replica.cc:333] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.370399 32212 raft_consensus.cc:2749] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:25.371681 23151 raft_consensus.cc:2243] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.372452 23151 raft_consensus.cc:2272] T d99734494b57424691503918c73f294e P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.375514 23151 tablet_replica.cc:333] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.376217 23151 raft_consensus.cc:2243] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.376883 23151 raft_consensus.cc:2272] T fffb9d78e773452ab44ae35b5d65fdb2 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.379482 23151 tablet_replica.cc:333] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.380436 23151 raft_consensus.cc:2243] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.381119 23151 raft_consensus.cc:2272] T 100eb209359a46d8b6c900d5a401586e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.384575 23151 tablet_replica.cc:333] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.385317 23151 raft_consensus.cc:2243] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.385732 23151 raft_consensus.cc:2272] T 46ea2bd624354824ada8b141b94ab5f0 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.388140 23151 tablet_replica.cc:333] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.388885 23151 raft_consensus.cc:2243] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.389845 23151 raft_consensus.cc:2272] T 5c645f524d71421eb842b8b854f95597 P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.392287 23151 tablet_replica.cc:333] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.392935 23151 raft_consensus.cc:2243] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.393373 23151 raft_consensus.cc:2272] T fd8dacaad53349ebb29c67fe11853fab P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.395722 23151 tablet_replica.cc:333] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.396355 23151 raft_consensus.cc:2243] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.396872 23151 raft_consensus.cc:2272] T 6a1ba3aa111d4c5e8558a89abec0aa64 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.399258 23151 tablet_replica.cc:333] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.399947 23151 raft_consensus.cc:2243] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.400456 23151 raft_consensus.cc:2272] T e946ad6dd9cb42ad93987cebde13ba9a P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.402791 23151 tablet_replica.cc:333] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.403579 23151 raft_consensus.cc:2243] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.404564 23151 raft_consensus.cc:2272] T b2f2ae9f62734cf59b3d5477d92760cb P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.406962 23151 tablet_replica.cc:333] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.407585 23151 raft_consensus.cc:2243] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.408047 23151 raft_consensus.cc:2272] T e93f0e0819f8466fad08603e540dc22e P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.411087 23151 tablet_replica.cc:333] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
W20260709 12:22:25.411573 30860 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.155.195:45287: connect: Connection refused (error 111) [suppressed 453 similar messages]
I20260709 12:22:25.412086 23151 raft_consensus.cc:2243] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.413324 23151 raft_consensus.cc:2272] T baad7ab904cc431381366c54397a57ef P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.416052 23151 tablet_replica.cc:333] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.416828 23151 raft_consensus.cc:2243] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.417390 23151 raft_consensus.cc:2272] T 4f8edecc2bf945e2bf553a7708f0f2cb P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.420542 23151 tablet_replica.cc:333] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.421295 23151 raft_consensus.cc:2243] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.421866 23151 raft_consensus.cc:2272] T c48114d81f8f4cf08f9665b697bc5560 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.424362 23151 tablet_replica.cc:333] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.425097 23151 raft_consensus.cc:2243] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.425522 23151 raft_consensus.cc:2272] T 5c179d47d7f146ed83b56ea632997aa7 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.427663 23151 tablet_replica.cc:333] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.428203 32227 raft_consensus.cc:493] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4e9c812ece8a42efa063dc7bd5ea25e4)
I20260709 12:22:25.428308 23151 raft_consensus.cc:2243] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.428916 32227 raft_consensus.cc:515] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3ab9d21f8864b50a71b49c7d624584a" member_type: VOTER last_known_addr { host: "127.22.155.196" port: 33441 } } peers { permanent_uuid: "4e9c812ece8a42efa063dc7bd5ea25e4" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 34953 } } peers { permanent_uuid: "4a9042c4154c442297159d1c9f1186b9" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 44363 } }
I20260709 12:22:25.429632 23151 raft_consensus.cc:2272] T 439d52649ecc46e58d714b9351576dd5 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.430934 32227 leader_election.cc:290] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953), 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363)
I20260709 12:22:25.432469 23151 tablet_replica.cc:333] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.433454 23151 raft_consensus.cc:2243] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:22:25.434592 30857 leader_election.cc:336] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4e9c812ece8a42efa063dc7bd5ea25e4 (127.22.155.193:34953): Network error: Client connection negotiation failed: client connection to 127.22.155.193:34953: connect: Connection refused (error 111)
I20260709 12:22:25.434633 23151 raft_consensus.cc:2272] T 44af5a494fec45679774bc9eb1007f9b P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:25.435339 30857 leader_election.cc:336] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4a9042c4154c442297159d1c9f1186b9 (127.22.155.194:44363): Network error: Client connection negotiation failed: client connection to 127.22.155.194:44363: connect: Connection refused (error 111)
I20260709 12:22:25.435719 30857 leader_election.cc:304] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3ab9d21f8864b50a71b49c7d624584a; no voters: 4a9042c4154c442297159d1c9f1186b9, 4e9c812ece8a42efa063dc7bd5ea25e4
I20260709 12:22:25.436331 32227 raft_consensus.cc:2749] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:25.437599 23151 tablet_replica.cc:333] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.438380 23151 raft_consensus.cc:2243] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.438947 23151 raft_consensus.cc:2272] T 38606820b9b349d3ad9f9fae03de5e86 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.441254 23151 tablet_replica.cc:333] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.441887 23151 raft_consensus.cc:2243] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.442479 23151 raft_consensus.cc:2272] T fda0258f575243bd910da13e828fb6f6 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.444766 23151 tablet_replica.cc:333] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.445380 23151 raft_consensus.cc:2243] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.446002 23151 raft_consensus.cc:2272] T b78acfb4f1d649e4821c390039d2ede5 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.448287 23151 tablet_replica.cc:333] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.448928 23151 raft_consensus.cc:2243] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.449415 23151 raft_consensus.cc:2272] T 2fee969f4c2a4579ab7911212a86bf67 P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.451507 23151 tablet_replica.cc:333] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.452133 23151 raft_consensus.cc:2243] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.452602 23151 raft_consensus.cc:2272] T 2d372d3fc5dd43d1880a4a932c83d7da P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.454869 23151 tablet_replica.cc:333] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.455518 23151 raft_consensus.cc:2243] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.456610 23151 raft_consensus.cc:2272] T 2f7a0a060aca4bdf912b9291106aaa74 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.459236 23151 tablet_replica.cc:333] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.459952 23151 raft_consensus.cc:2243] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.461154 23151 raft_consensus.cc:2272] T b33ccb8b23d8455a990ef1cb50271887 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.464442 23151 tablet_replica.cc:333] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.465162 23151 raft_consensus.cc:2243] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.465662 23151 raft_consensus.cc:2272] T 4b26f10a0fb7476098bdb142c864895e P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.467887 23151 tablet_replica.cc:333] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.468446 23151 raft_consensus.cc:2243] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.469434 23151 raft_consensus.cc:2272] T 4326b71a8ff545259df55b4ab0564f48 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.471566 23151 tablet_replica.cc:333] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.472117 23151 raft_consensus.cc:2243] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.473008 23151 raft_consensus.cc:2272] T 006658e1213f4f8da089a9570e0a76b9 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.474969 23151 tablet_replica.cc:333] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.475490 23151 raft_consensus.cc:2243] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.475970 23151 raft_consensus.cc:2272] T f0d63226f015480c84967f90ac595cc0 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.478189 23151 tablet_replica.cc:333] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.478747 23151 raft_consensus.cc:2243] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.479522 23151 raft_consensus.cc:2272] T 69a04a5cd9b143daba902d508029dcb5 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.481725 23151 tablet_replica.cc:333] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.482254 23151 raft_consensus.cc:2243] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.482682 23151 raft_consensus.cc:2272] T 9be8d04f2ad34fd5b7c66aa68c8fa47a P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.484922 23151 tablet_replica.cc:333] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.485730 23151 raft_consensus.cc:2243] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.486253 23151 raft_consensus.cc:2272] T c148832de74745608d983f2184cbf23f P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.488350 23151 tablet_replica.cc:333] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.489147 23151 raft_consensus.cc:2243] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.489713 23151 raft_consensus.cc:2272] T 4faf21b4ff034e548c19569963419851 P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.492769 23151 tablet_replica.cc:333] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.493413 23151 raft_consensus.cc:2243] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.494356 23151 raft_consensus.cc:2272] T 7695652594064f568b2df572cb76e12a P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.496703 23151 tablet_replica.cc:333] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.497298 23151 raft_consensus.cc:2243] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.497756 23151 raft_consensus.cc:2272] T 0fb4b46162a04eeda49624c82070758e P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.499897 23151 tablet_replica.cc:333] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.500568 23151 raft_consensus.cc:2243] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.501587 23151 raft_consensus.cc:2272] T 9ac7c8095aaa457494024d09dfaaf1bb P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.503875 23151 tablet_replica.cc:333] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.504505 23151 raft_consensus.cc:2243] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.504979 23151 raft_consensus.cc:2272] T cabc74dfa2e44e0580c268f61d17e024 P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.507083 23151 tablet_replica.cc:333] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.507627 23151 raft_consensus.cc:2243] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.508522 23151 raft_consensus.cc:2272] T eb65e812f06540bc9f1c2b1e3e13d41c P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.510748 23151 tablet_replica.cc:333] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.511330 23151 raft_consensus.cc:2243] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.511811 23151 raft_consensus.cc:2272] T 77a02078ac834032ac607943e7b3d175 P d3ab9d21f8864b50a71b49c7d624584a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.513955 23151 tablet_replica.cc:333] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.514694 23151 raft_consensus.cc:2243] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.515161 23151 raft_consensus.cc:2272] T 18a8098230e4404c9d5743dcac2c5aaa P d3ab9d21f8864b50a71b49c7d624584a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.517139 23151 tablet_replica.cc:333] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.517669 23151 raft_consensus.cc:2243] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.518196 23151 raft_consensus.cc:2272] T b7bda85e3c87401d84e81120f451dec8 P d3ab9d21f8864b50a71b49c7d624584a [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.520133 23151 tablet_replica.cc:333] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.520670 23151 raft_consensus.cc:2243] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.521114 23151 raft_consensus.cc:2272] T 5fcceeadce924e3493e4e91cb49e2f2e P d3ab9d21f8864b50a71b49c7d624584a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.523149 23151 tablet_replica.cc:333] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a: stopping tablet replica
I20260709 12:22:25.523646 23151 raft_consensus.cc:2243] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.524516 23151 raft_consensus.cc:2272] T 815af3bc37df4d158766ac2e615de683 P d3ab9d21f8864b50a71b49c7d624584a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.606137 23151 tablet_server.cc:196] TabletServer@127.22.155.196:0 shutdown complete.
I20260709 12:22:25.678141 23151 master.cc:562] Master@127.22.155.254:37753 shutting down...
I20260709 12:22:25.712083 23151 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 17a4fc443d4545efb5ffae32542ddab5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.712880 23151 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 17a4fc443d4545efb5ffae32542ddab5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.713251 23151 tablet_replica.cc:333] T 00000000000000000000000000000000 P 17a4fc443d4545efb5ffae32542ddab5: stopping tablet replica
I20260709 12:22:25.737411 23151 master.cc:584] Master@127.22.155.254:37753 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (57486 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:22:25.834957 23151 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.155.254:45051
I20260709 12:22:25.836251 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:25.843067 32232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:25.843091 32231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:25.844439 23151 server_base.cc:1061] running on GCE node
W20260709 12:22:25.844779 32234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:25.849025 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:25.849244 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:25.849428 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599745849411 us; error 0 us; skew 500 ppm
I20260709 12:22:25.850047 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:25.853080 23151 webserver.cc:533] Webserver started at http://127.22.155.254:44169/ using document root <none> and password file <none>
I20260709 12:22:25.853621 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:25.853798 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:25.854132 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:25.855525 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599400258298-23151-0/minicluster-data/master-0-root/instance:
uuid: "a7832cbf71144f9db839bb669369d97b"
format_stamp: "Formatted at 2026-07-09 12:22:25 on dist-test-slave-p7fg"
I20260709 12:22:25.860621 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:22:25.864742 32239 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:25.865589 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:22:25.866031 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599400258298-23151-0/minicluster-data/master-0-root
uuid: "a7832cbf71144f9db839bb669369d97b"
format_stamp: "Formatted at 2026-07-09 12:22:25 on dist-test-slave-p7fg"
I20260709 12:22:25.866348 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599400258298-23151-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599400258298-23151-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599400258298-23151-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:25.888053 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:25.889576 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:25.935640 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.254:45051
I20260709 12:22:25.935758 32290 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.254:45051 every 8 connection(s)
I20260709 12:22:25.940027 32291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.951244 32291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7832cbf71144f9db839bb669369d97b: Bootstrap starting.
I20260709 12:22:25.956399 32291 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a7832cbf71144f9db839bb669369d97b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.961577 32291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7832cbf71144f9db839bb669369d97b: No bootstrap required, opened a new log
I20260709 12:22:25.963855 32291 raft_consensus.cc:359] T 00000000000000000000000000000000 P a7832cbf71144f9db839bb669369d97b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7832cbf71144f9db839bb669369d97b" member_type: VOTER }
I20260709 12:22:25.964251 32291 raft_consensus.cc:385] T 00000000000000000000000000000000 P a7832cbf71144f9db839bb669369d97b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.964454 32291 raft_consensus.cc:740] T 00000000000000000000000000000000 P a7832cbf71144f9db839bb669369d97b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7832cbf71144f9db839bb669369d97b, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.965095 32291 consensus_queue.cc:260] T 00000000000000000000000000000000 P a7832cbf71144f9db839bb669369d97b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7832cbf71144f9db839bb669369d97b" member_type: VOTER }
I20260709 12:22:25.965546 32291 raft_consensus.cc:399] T 00000000000000000000000000000000 P a7832cbf71144f9db839bb669369d97b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:25.965744 32291 raft_consensus.cc:493] T 00000000000000000000000000000000 P a7832cbf71144f9db839bb669369d97b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:25.965960 32291 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a7832cbf71144f9db839bb669369d97b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:25.971138 32291 raft_consensus.cc:515] T 00000000000000000000000000000000 P a7832cbf71144f9db839bb669369d97b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7832cbf71144f9db839bb669369d97b" member_type: VOTER }
I20260709 12:22:25.971660 32291 leader_election.cc:304] T 00000000000000000000000000000000 P a7832cbf71144f9db839bb669369d97b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a7832cbf71144f9db839bb669369d97b; no voters: 
I20260709 12:22:25.972940 32291 leader_election.cc:290] T 00000000000000000000000000000000 P a7832cbf71144f9db839bb669369d97b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:25.973407 32294 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a7832cbf71144f9db839bb669369d97b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:25.975116 32294 raft_consensus.cc:697] T 00000000000000000000000000000000 P a7832cbf71144f9db839bb669369d97b [term 1 LEADER]: Becoming Leader. State: Replica: a7832cbf71144f9db839bb669369d97b, State: Running, Role: LEADER
I20260709 12:22:25.975973 32294 consensus_queue.cc:237] T 00000000000000000000000000000000 P a7832cbf71144f9db839bb669369d97b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7832cbf71144f9db839bb669369d97b" member_type: VOTER }
I20260709 12:22:25.976120 32291 sys_catalog.cc:565] T 00000000000000000000000000000000 P a7832cbf71144f9db839bb669369d97b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:25.982321 32296 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7832cbf71144f9db839bb669369d97b [sys.catalog]: SysCatalogTable state changed. Reason: New leader a7832cbf71144f9db839bb669369d97b. Latest consensus state: current_term: 1 leader_uuid: "a7832cbf71144f9db839bb669369d97b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7832cbf71144f9db839bb669369d97b" member_type: VOTER } }
I20260709 12:22:25.982306 32295 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7832cbf71144f9db839bb669369d97b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a7832cbf71144f9db839bb669369d97b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7832cbf71144f9db839bb669369d97b" member_type: VOTER } }
I20260709 12:22:25.983726 32296 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7832cbf71144f9db839bb669369d97b [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:25.983827 32295 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7832cbf71144f9db839bb669369d97b [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:25.987982 32303 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:25.996017 32303 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:25.997143 23151 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:26.006929 32303 catalog_manager.cc:1383] Generated new cluster ID: c468a4605a054b809c5cd107e8e0fdd2
I20260709 12:22:26.007326 32303 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:26.035285 32303 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:26.036896 32303 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:26.049652 32303 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a7832cbf71144f9db839bb669369d97b: Generated new TSK 0
I20260709 12:22:26.050323 32303 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:26.064217 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:26.071236 32312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:26.072579 32313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:26.078085 23151 server_base.cc:1061] running on GCE node
W20260709 12:22:26.081025 32315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:26.082171 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:26.082442 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:26.082651 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599746082626 us; error 0 us; skew 500 ppm
I20260709 12:22:26.083271 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:26.085963 23151 webserver.cc:533] Webserver started at http://127.22.155.193:39539/ using document root <none> and password file <none>
I20260709 12:22:26.086508 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:26.086733 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:26.087018 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:26.088294 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599400258298-23151-0/minicluster-data/ts-0-root/instance:
uuid: "3be0070ae46940d98553de245ef14d4b"
format_stamp: "Formatted at 2026-07-09 12:22:26 on dist-test-slave-p7fg"
I20260709 12:22:26.093796 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:22:26.097887 32320 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:26.098922 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:22:26.099323 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599400258298-23151-0/minicluster-data/ts-0-root
uuid: "3be0070ae46940d98553de245ef14d4b"
format_stamp: "Formatted at 2026-07-09 12:22:26 on dist-test-slave-p7fg"
I20260709 12:22:26.099628 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599400258298-23151-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599400258298-23151-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599400258298-23151-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:26.120325 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:26.121654 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:26.123215 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:26.125741 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:26.125959 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:26.126241 23151 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:26.126431 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:26.174913 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.193:46069
I20260709 12:22:26.175064 32382 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.193:46069 every 8 connection(s)
I20260709 12:22:26.180094 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:26.188544 32387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:26.191082 32388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:26.193271 23151 server_base.cc:1061] running on GCE node
W20260709 12:22:26.193308 32390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:26.195201 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:26.195470 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:26.195660 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599746195643 us; error 0 us; skew 500 ppm
I20260709 12:22:26.196441 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:26.196756 32383 heartbeater.cc:344] Connected to a master server at 127.22.155.254:45051
I20260709 12:22:26.197232 32383 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:26.198143 32383 heartbeater.cc:507] Master 127.22.155.254:45051 requested a full tablet report, sending...
I20260709 12:22:26.199585 23151 webserver.cc:533] Webserver started at http://127.22.155.194:46583/ using document root <none> and password file <none>
I20260709 12:22:26.200260 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:26.200433 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:26.200726 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:26.201023 32256 ts_manager.cc:194] Registered new tserver with Master: 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069)
I20260709 12:22:26.201941 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599400258298-23151-0/minicluster-data/ts-1-root/instance:
uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
format_stamp: "Formatted at 2026-07-09 12:22:26 on dist-test-slave-p7fg"
I20260709 12:22:26.203289 32256 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47264
I20260709 12:22:26.207245 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:22:26.211619 32395 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:26.212738 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:22:26.213088 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599400258298-23151-0/minicluster-data/ts-1-root
uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
format_stamp: "Formatted at 2026-07-09 12:22:26 on dist-test-slave-p7fg"
I20260709 12:22:26.213413 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599400258298-23151-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599400258298-23151-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599400258298-23151-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:26.236902 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:26.238168 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:26.239761 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:26.242133 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:26.242383 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:26.242620 23151 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:26.242787 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:26.288785 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.194:33471
I20260709 12:22:26.289022 32457 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.194:33471 every 8 connection(s)
I20260709 12:22:26.293812 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:26.302461 32461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:26.305876 32462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:26.307045 32464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:26.309091 32458 heartbeater.cc:344] Connected to a master server at 127.22.155.254:45051
I20260709 12:22:26.309526 23151 server_base.cc:1061] running on GCE node
I20260709 12:22:26.309701 32458 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:26.310760 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:22:26.310815 32458 heartbeater.cc:507] Master 127.22.155.254:45051 requested a full tablet report, sending...
W20260709 12:22:26.311172 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:26.311414 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599746311391 us; error 0 us; skew 500 ppm
I20260709 12:22:26.312196 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:26.313486 32256 ts_manager.cc:194] Registered new tserver with Master: 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471)
I20260709 12:22:26.315215 32256 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47266
I20260709 12:22:26.315624 23151 webserver.cc:533] Webserver started at http://127.22.155.195:35565/ using document root <none> and password file <none>
I20260709 12:22:26.316437 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:26.316757 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:26.317068 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:26.318362 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599400258298-23151-0/minicluster-data/ts-2-root/instance:
uuid: "ba6fd2b98668427bb42cde3ad503803d"
format_stamp: "Formatted at 2026-07-09 12:22:26 on dist-test-slave-p7fg"
I20260709 12:22:26.323411 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:22:26.327157 32469 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:26.327972 23151 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:22:26.328325 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599400258298-23151-0/minicluster-data/ts-2-root
uuid: "ba6fd2b98668427bb42cde3ad503803d"
format_stamp: "Formatted at 2026-07-09 12:22:26 on dist-test-slave-p7fg"
I20260709 12:22:26.328686 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599400258298-23151-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599400258298-23151-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599400258298-23151-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:26.340772 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:26.342032 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:26.343597 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:26.346076 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:26.346314 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:26.346560 23151 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:26.346731 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:26.396512 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.195:34813
I20260709 12:22:26.396724 32531 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.195:34813 every 8 connection(s)
I20260709 12:22:26.412544 32532 heartbeater.cc:344] Connected to a master server at 127.22.155.254:45051
I20260709 12:22:26.413115 32532 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:26.413877 32532 heartbeater.cc:507] Master 127.22.155.254:45051 requested a full tablet report, sending...
I20260709 12:22:26.416002 32256 ts_manager.cc:194] Registered new tserver with Master: ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:26.416538 23151 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016207117s
I20260709 12:22:26.417874 32256 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47270
I20260709 12:22:26.445578 32256 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47286:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:26.448685 32256 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:26.533792 32348 tablet_service.cc:1511] Processing CreateTablet for tablet 20c26312d2694b5980a2f78bfdc472fe (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:26.535347 32348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c26312d2694b5980a2f78bfdc472fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.535041 32347 tablet_service.cc:1511] Processing CreateTablet for tablet 36a1129de5fd4878b018a89467544ecb (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:26.537727 32347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36a1129de5fd4878b018a89467544ecb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.542847 32346 tablet_service.cc:1511] Processing CreateTablet for tablet b279692d87ed403dbcb22f1d366edcba (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:26.543040 32345 tablet_service.cc:1511] Processing CreateTablet for tablet bd8f84fc897d4f01b94924403eaf8e64 (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:26.544472 32346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b279692d87ed403dbcb22f1d366edcba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.547755 32345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd8f84fc897d4f01b94924403eaf8e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.561096 32344 tablet_service.cc:1511] Processing CreateTablet for tablet 225cfe1201f64d04846232f5b22ec651 (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:26.562783 32344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 225cfe1201f64d04846232f5b22ec651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.566008 32343 tablet_service.cc:1511] Processing CreateTablet for tablet 1feae880171f4a4997bc3da8d9aa6460 (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:26.567601 32343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1feae880171f4a4997bc3da8d9aa6460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.584975 32497 tablet_service.cc:1511] Processing CreateTablet for tablet 20c26312d2694b5980a2f78bfdc472fe (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:26.586925 32497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c26312d2694b5980a2f78bfdc472fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.588138 32494 tablet_service.cc:1511] Processing CreateTablet for tablet bd8f84fc897d4f01b94924403eaf8e64 (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:26.589818 32494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd8f84fc897d4f01b94924403eaf8e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.593875 32423 tablet_service.cc:1511] Processing CreateTablet for tablet 20c26312d2694b5980a2f78bfdc472fe (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:26.600183 32496 tablet_service.cc:1511] Processing CreateTablet for tablet 36a1129de5fd4878b018a89467544ecb (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:26.600692 32495 tablet_service.cc:1511] Processing CreateTablet for tablet b279692d87ed403dbcb22f1d366edcba (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:26.602070 32496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36a1129de5fd4878b018a89467544ecb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.603080 32495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b279692d87ed403dbcb22f1d366edcba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.603539 32419 tablet_service.cc:1511] Processing CreateTablet for tablet 225cfe1201f64d04846232f5b22ec651 (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:26.605892 32420 tablet_service.cc:1511] Processing CreateTablet for tablet bd8f84fc897d4f01b94924403eaf8e64 (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:26.608354 32421 tablet_service.cc:1511] Processing CreateTablet for tablet b279692d87ed403dbcb22f1d366edcba (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:26.588147 32493 tablet_service.cc:1511] Processing CreateTablet for tablet 225cfe1201f64d04846232f5b22ec651 (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:26.615283 32493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 225cfe1201f64d04846232f5b22ec651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.596593 32422 tablet_service.cc:1511] Processing CreateTablet for tablet 36a1129de5fd4878b018a89467544ecb (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:26.619010 32547 tablet_bootstrap.cc:492] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b: Bootstrap starting.
I20260709 12:22:26.619134 32423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c26312d2694b5980a2f78bfdc472fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.621860 32421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b279692d87ed403dbcb22f1d366edcba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.625130 32422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36a1129de5fd4878b018a89467544ecb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.626245 32547 tablet_bootstrap.cc:654] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:26.626909 32419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 225cfe1201f64d04846232f5b22ec651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.631270 32420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd8f84fc897d4f01b94924403eaf8e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.639303 32418 tablet_service.cc:1511] Processing CreateTablet for tablet 1feae880171f4a4997bc3da8d9aa6460 (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:26.641141 32418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1feae880171f4a4997bc3da8d9aa6460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.640864 32492 tablet_service.cc:1511] Processing CreateTablet for tablet 1feae880171f4a4997bc3da8d9aa6460 (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:26.642385 32492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1feae880171f4a4997bc3da8d9aa6460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.672405 32547 tablet_bootstrap.cc:492] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b: No bootstrap required, opened a new log
I20260709 12:22:26.673580 32547 ts_tablet_manager.cc:1403] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b: Time spent bootstrapping tablet: real 0.055s	user 0.008s	sys 0.010s
I20260709 12:22:26.676242 32547 raft_consensus.cc:359] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:26.676957 32547 raft_consensus.cc:385] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:26.679481 32347 tablet_service.cc:1511] Processing CreateTablet for tablet e3ef7d12ba5a45cab61fdc87dbc39117 (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:26.677263 32547 raft_consensus.cc:740] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be0070ae46940d98553de245ef14d4b, State: Initialized, Role: FOLLOWER
I20260709 12:22:26.680979 32347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3ef7d12ba5a45cab61fdc87dbc39117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.681454 32547 consensus_queue.cc:260] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:26.685840 32417 tablet_service.cc:1511] Processing CreateTablet for tablet e3ef7d12ba5a45cab61fdc87dbc39117 (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:26.687322 32417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3ef7d12ba5a45cab61fdc87dbc39117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.690161 32497 tablet_service.cc:1511] Processing CreateTablet for tablet e3ef7d12ba5a45cab61fdc87dbc39117 (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:26.691556 32497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3ef7d12ba5a45cab61fdc87dbc39117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.708222 32550 tablet_bootstrap.cc:492] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d: Bootstrap starting.
I20260709 12:22:26.709841 32343 tablet_service.cc:1511] Processing CreateTablet for tablet 6454a4189fd24aabb3b216a8884e5422 (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:26.713562 32343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6454a4189fd24aabb3b216a8884e5422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.717227 32418 tablet_service.cc:1511] Processing CreateTablet for tablet 6454a4189fd24aabb3b216a8884e5422 (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:26.718837 32418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6454a4189fd24aabb3b216a8884e5422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.731408 32344 tablet_service.cc:1511] Processing CreateTablet for tablet 37c87edb5fa542a794c3eab947086653 (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:26.733014 32344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37c87edb5fa542a794c3eab947086653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.734618 32422 tablet_service.cc:1511] Processing CreateTablet for tablet 37c87edb5fa542a794c3eab947086653 (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:26.736469 32422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37c87edb5fa542a794c3eab947086653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.738855 32346 tablet_service.cc:1511] Processing CreateTablet for tablet bda1105bad6e4f8daffc1141ab247524 (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:26.739764 32549 tablet_bootstrap.cc:492] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92: Bootstrap starting.
I20260709 12:22:26.740485 32346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda1105bad6e4f8daffc1141ab247524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.741868 32496 tablet_service.cc:1511] Processing CreateTablet for tablet 37c87edb5fa542a794c3eab947086653 (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:26.743629 32496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37c87edb5fa542a794c3eab947086653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.730186 32497 tablet_service.cc:1511] Processing CreateTablet for tablet 6454a4189fd24aabb3b216a8884e5422 (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:26.761270 32497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6454a4189fd24aabb3b216a8884e5422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.767428 32547 ts_tablet_manager.cc:1434] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b: Time spent starting tablet: real 0.093s	user 0.011s	sys 0.000s
I20260709 12:22:26.768368 32383 heartbeater.cc:499] Master 127.22.155.254:45051 was elected leader, sending a full tablet report...
I20260709 12:22:26.770609 32549 tablet_bootstrap.cc:654] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:26.772182 32420 tablet_service.cc:1511] Processing CreateTablet for tablet bda1105bad6e4f8daffc1141ab247524 (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:26.773036 32547 tablet_bootstrap.cc:492] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b: Bootstrap starting.
I20260709 12:22:26.773643 32420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda1105bad6e4f8daffc1141ab247524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.781220 32547 tablet_bootstrap.cc:654] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:26.785681 32550 tablet_bootstrap.cc:654] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:26.815160 32549 tablet_bootstrap.cc:492] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92: No bootstrap required, opened a new log
I20260709 12:22:26.815886 32549 ts_tablet_manager.cc:1403] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92: Time spent bootstrapping tablet: real 0.077s	user 0.010s	sys 0.008s
I20260709 12:22:26.812351 32494 tablet_service.cc:1511] Processing CreateTablet for tablet bda1105bad6e4f8daffc1141ab247524 (DEFAULT_TABLE table=test-workload [id=a9e503d440bb4a40a753c63d4fe3e028]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:26.817055 32494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda1105bad6e4f8daffc1141ab247524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.817428 32547 tablet_bootstrap.cc:492] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b: No bootstrap required, opened a new log
I20260709 12:22:26.818096 32547 ts_tablet_manager.cc:1403] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.012s
I20260709 12:22:26.818876 32549 raft_consensus.cc:359] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } }
I20260709 12:22:26.819545 32549 raft_consensus.cc:385] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:26.819806 32549 raft_consensus.cc:740] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0201cedacd48c2abd9eb3e09ee0d92, State: Initialized, Role: FOLLOWER
I20260709 12:22:26.820537 32549 consensus_queue.cc:260] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } }
I20260709 12:22:26.821167 32547 raft_consensus.cc:359] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } }
I20260709 12:22:26.822834 32547 raft_consensus.cc:385] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:26.823140 32547 raft_consensus.cc:740] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be0070ae46940d98553de245ef14d4b, State: Initialized, Role: FOLLOWER
I20260709 12:22:26.823976 32547 consensus_queue.cc:260] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } }
I20260709 12:22:26.826301 32547 ts_tablet_manager.cc:1434] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:22:26.827859 32547 tablet_bootstrap.cc:492] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b: Bootstrap starting.
I20260709 12:22:26.830080 32550 tablet_bootstrap.cc:492] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d: No bootstrap required, opened a new log
I20260709 12:22:26.830763 32550 ts_tablet_manager.cc:1403] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d: Time spent bootstrapping tablet: real 0.123s	user 0.009s	sys 0.008s
I20260709 12:22:26.834134 32550 raft_consensus.cc:359] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:26.834784 32547 tablet_bootstrap.cc:654] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:26.834889 32550 raft_consensus.cc:385] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:26.835423 32550 raft_consensus.cc:740] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6fd2b98668427bb42cde3ad503803d, State: Initialized, Role: FOLLOWER
I20260709 12:22:26.842864 32550 consensus_queue.cc:260] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:26.843459 32458 heartbeater.cc:499] Master 127.22.155.254:45051 was elected leader, sending a full tablet report...
I20260709 12:22:26.843976 32549 ts_tablet_manager.cc:1434] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.003s
I20260709 12:22:26.845292 32549 tablet_bootstrap.cc:492] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92: Bootstrap starting.
I20260709 12:22:26.851536 32549 tablet_bootstrap.cc:654] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:26.855496 32547 tablet_bootstrap.cc:492] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b: No bootstrap required, opened a new log
I20260709 12:22:26.856081 32547 ts_tablet_manager.cc:1403] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.001s
I20260709 12:22:26.859141 32547 raft_consensus.cc:359] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:26.859737 32547 raft_consensus.cc:385] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:26.859998 32547 raft_consensus.cc:740] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be0070ae46940d98553de245ef14d4b, State: Initialized, Role: FOLLOWER
I20260709 12:22:26.860913 32532 heartbeater.cc:499] Master 127.22.155.254:45051 was elected leader, sending a full tablet report...
I20260709 12:22:26.863871 32547 consensus_queue.cc:260] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:26.869807 32547 ts_tablet_manager.cc:1434] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b: Time spent starting tablet: real 0.013s	user 0.000s	sys 0.006s
I20260709 12:22:26.870987 32547 tablet_bootstrap.cc:492] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b: Bootstrap starting.
I20260709 12:22:26.873965 32550 ts_tablet_manager.cc:1434] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d: Time spent starting tablet: real 0.043s	user 0.010s	sys 0.008s
I20260709 12:22:26.875280 32550 tablet_bootstrap.cc:492] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d: Bootstrap starting.
I20260709 12:22:26.878751 32549 tablet_bootstrap.cc:492] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92: No bootstrap required, opened a new log
I20260709 12:22:26.879436 32549 ts_tablet_manager.cc:1403] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.019s
I20260709 12:22:26.880615 32547 tablet_bootstrap.cc:654] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:26.882944 32549 raft_consensus.cc:359] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:26.883808 32549 raft_consensus.cc:385] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:26.883955 32550 tablet_bootstrap.cc:654] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:26.884174 32549 raft_consensus.cc:740] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0201cedacd48c2abd9eb3e09ee0d92, State: Initialized, Role: FOLLOWER
I20260709 12:22:26.885509 32549 consensus_queue.cc:260] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:26.887850 32549 ts_tablet_manager.cc:1434] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:22:26.888950 32549 tablet_bootstrap.cc:492] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92: Bootstrap starting.
I20260709 12:22:26.896092 32549 tablet_bootstrap.cc:654] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:26.898533 32551 raft_consensus.cc:493] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:26.901532 32533 tablet.cc:2406] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:22:26.900813 32550 tablet_bootstrap.cc:492] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d: No bootstrap required, opened a new log
I20260709 12:22:26.902590 32550 ts_tablet_manager.cc:1403] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.003s
I20260709 12:22:26.901528 32551 raft_consensus.cc:515] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } }
I20260709 12:22:26.905545 32547 tablet_bootstrap.cc:492] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b: No bootstrap required, opened a new log
I20260709 12:22:26.906167 32547 ts_tablet_manager.cc:1403] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.011s
I20260709 12:22:26.906119 32550 raft_consensus.cc:359] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } }
I20260709 12:22:26.906935 32550 raft_consensus.cc:385] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:26.907275 32550 raft_consensus.cc:740] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6fd2b98668427bb42cde3ad503803d, State: Initialized, Role: FOLLOWER
I20260709 12:22:26.908285 32550 consensus_queue.cc:260] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } }
I20260709 12:22:26.910066 32547 raft_consensus.cc:359] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:26.910953 32547 raft_consensus.cc:385] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:26.911285 32547 raft_consensus.cc:740] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be0070ae46940d98553de245ef14d4b, State: Initialized, Role: FOLLOWER
I20260709 12:22:26.912077 32547 consensus_queue.cc:260] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:26.913128 32550 ts_tablet_manager.cc:1434] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:22:26.914213 32551 leader_election.cc:290] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813), 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471)
I20260709 12:22:26.914264 32550 tablet_bootstrap.cc:492] T 225cfe1201f64d04846232f5b22ec651 P ba6fd2b98668427bb42cde3ad503803d: Bootstrap starting.
I20260709 12:22:26.920433 32547 ts_tablet_manager.cc:1434] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:22:26.921919 32547 tablet_bootstrap.cc:492] T 1feae880171f4a4997bc3da8d9aa6460 P 3be0070ae46940d98553de245ef14d4b: Bootstrap starting.
I20260709 12:22:26.925518 32549 tablet_bootstrap.cc:492] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92: No bootstrap required, opened a new log
I20260709 12:22:26.926205 32549 ts_tablet_manager.cc:1403] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.008s
I20260709 12:22:26.928326 32507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c26312d2694b5980a2f78bfdc472fe" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d" is_pre_election: true
I20260709 12:22:26.929141 32507 raft_consensus.cc:2468] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be0070ae46940d98553de245ef14d4b in term 0.
I20260709 12:22:26.929832 32547 tablet_bootstrap.cc:654] T 1feae880171f4a4997bc3da8d9aa6460 P 3be0070ae46940d98553de245ef14d4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:26.929768 32549 raft_consensus.cc:359] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:26.930891 32549 raft_consensus.cc:385] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:26.931321 32549 raft_consensus.cc:740] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0201cedacd48c2abd9eb3e09ee0d92, State: Initialized, Role: FOLLOWER
I20260709 12:22:26.930745 32323 leader_election.cc:304] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b, ba6fd2b98668427bb42cde3ad503803d; no voters: 
I20260709 12:22:26.932530 32550 tablet_bootstrap.cc:654] T 225cfe1201f64d04846232f5b22ec651 P ba6fd2b98668427bb42cde3ad503803d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:26.932243 32549 consensus_queue.cc:260] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:26.933226 32564 raft_consensus.cc:2804] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:26.933647 32564 raft_consensus.cc:493] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.933987 32564 raft_consensus.cc:3060] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:26.935264 32549 ts_tablet_manager.cc:1434] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:22:26.936525 32549 tablet_bootstrap.cc:492] T 36a1129de5fd4878b018a89467544ecb P 4a0201cedacd48c2abd9eb3e09ee0d92: Bootstrap starting.
I20260709 12:22:26.940343 32547 tablet_bootstrap.cc:492] T 1feae880171f4a4997bc3da8d9aa6460 P 3be0070ae46940d98553de245ef14d4b: No bootstrap required, opened a new log
I20260709 12:22:26.940498 32550 tablet_bootstrap.cc:492] T 225cfe1201f64d04846232f5b22ec651 P ba6fd2b98668427bb42cde3ad503803d: No bootstrap required, opened a new log
I20260709 12:22:26.941212 32550 ts_tablet_manager.cc:1403] T 225cfe1201f64d04846232f5b22ec651 P ba6fd2b98668427bb42cde3ad503803d: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.002s
I20260709 12:22:26.941604 32551 raft_consensus.cc:493] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.942196 32551 raft_consensus.cc:515] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:26.943442 32549 tablet_bootstrap.cc:654] T 36a1129de5fd4878b018a89467544ecb P 4a0201cedacd48c2abd9eb3e09ee0d92: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:26.944540 32551 leader_election.cc:290] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:26.944794 32550 raft_consensus.cc:359] T 225cfe1201f64d04846232f5b22ec651 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:26.941139 32547 ts_tablet_manager.cc:1403] T 1feae880171f4a4997bc3da8d9aa6460 P 3be0070ae46940d98553de245ef14d4b: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 12:22:26.945601 32550 raft_consensus.cc:385] T 225cfe1201f64d04846232f5b22ec651 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:26.945940 32550 raft_consensus.cc:740] T 225cfe1201f64d04846232f5b22ec651 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6fd2b98668427bb42cde3ad503803d, State: Initialized, Role: FOLLOWER
I20260709 12:22:26.946957 32550 consensus_queue.cc:260] T 225cfe1201f64d04846232f5b22ec651 P ba6fd2b98668427bb42cde3ad503803d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:26.948935 32547 raft_consensus.cc:359] T 1feae880171f4a4997bc3da8d9aa6460 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:26.949723 32547 raft_consensus.cc:385] T 1feae880171f4a4997bc3da8d9aa6460 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:26.950027 32547 raft_consensus.cc:740] T 1feae880171f4a4997bc3da8d9aa6460 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be0070ae46940d98553de245ef14d4b, State: Initialized, Role: FOLLOWER
I20260709 12:22:26.950845 32547 consensus_queue.cc:260] T 1feae880171f4a4997bc3da8d9aa6460 P 3be0070ae46940d98553de245ef14d4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:26.951447 32507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8f84fc897d4f01b94924403eaf8e64" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d" is_pre_election: true
I20260709 12:22:26.953640 32547 ts_tablet_manager.cc:1434] T 1feae880171f4a4997bc3da8d9aa6460 P 3be0070ae46940d98553de245ef14d4b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:22:26.954952 32547 tablet_bootstrap.cc:492] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b: Bootstrap starting.
I20260709 12:22:26.956096 32555 raft_consensus.cc:493] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.956777 32555 raft_consensus.cc:515] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:26.957546 32550 ts_tablet_manager.cc:1434] T 225cfe1201f64d04846232f5b22ec651 P ba6fd2b98668427bb42cde3ad503803d: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:22:26.962756 32547 tablet_bootstrap.cc:654] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:26.956146 32323 leader_election.cc:343] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:26.972167 32555 leader_election.cc:290] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:26.974027 32550 tablet_bootstrap.cc:492] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d: Bootstrap starting.
I20260709 12:22:26.977705 32549 tablet_bootstrap.cc:492] T 36a1129de5fd4878b018a89467544ecb P 4a0201cedacd48c2abd9eb3e09ee0d92: No bootstrap required, opened a new log
I20260709 12:22:26.981284 32549 ts_tablet_manager.cc:1403] T 36a1129de5fd4878b018a89467544ecb P 4a0201cedacd48c2abd9eb3e09ee0d92: Time spent bootstrapping tablet: real 0.045s	user 0.006s	sys 0.012s
I20260709 12:22:26.983837 32564 raft_consensus.cc:515] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } }
W20260709 12:22:26.989681 32304 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:26.990242 32550 tablet_bootstrap.cc:654] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:26.990643 32432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8f84fc897d4f01b94924403eaf8e64" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" is_pre_election: true
I20260709 12:22:26.992043 32507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c26312d2694b5980a2f78bfdc472fe" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d"
W20260709 12:22:26.992255 32322 leader_election.cc:343] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:26.992686 32507 raft_consensus.cc:3060] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:26.992746 32322 leader_election.cc:304] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b; no voters: 4a0201cedacd48c2abd9eb3e09ee0d92, ba6fd2b98668427bb42cde3ad503803d
I20260709 12:22:26.994019 32551 raft_consensus.cc:2749] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:26.987650 32433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c26312d2694b5980a2f78bfdc472fe" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" is_pre_election: true
I20260709 12:22:26.995955 32433 raft_consensus.cc:2468] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be0070ae46940d98553de245ef14d4b in term 0.
I20260709 12:22:26.986094 32549 raft_consensus.cc:359] T 36a1129de5fd4878b018a89467544ecb P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:26.998243 32551 raft_consensus.cc:493] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.999279 32551 raft_consensus.cc:515] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.001566 32551 leader_election.cc:290] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:27.003981 32506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b279692d87ed403dbcb22f1d366edcba" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d" is_pre_election: true
I20260709 12:22:27.004937 32507 raft_consensus.cc:2468] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be0070ae46940d98553de245ef14d4b in term 1.
W20260709 12:22:27.005888 32323 leader_election.cc:343] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:27.003218 32549 raft_consensus.cc:385] T 36a1129de5fd4878b018a89467544ecb P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.007601 32323 leader_election.cc:304] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b, ba6fd2b98668427bb42cde3ad503803d; no voters: 
I20260709 12:22:27.010461 32549 raft_consensus.cc:740] T 36a1129de5fd4878b018a89467544ecb P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0201cedacd48c2abd9eb3e09ee0d92, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.011076 32551 raft_consensus.cc:2804] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:27.011765 32549 consensus_queue.cc:260] T 36a1129de5fd4878b018a89467544ecb P 4a0201cedacd48c2abd9eb3e09ee0d92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.018862 32549 ts_tablet_manager.cc:1434] T 36a1129de5fd4878b018a89467544ecb P 4a0201cedacd48c2abd9eb3e09ee0d92: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 12:22:27.010212 32564 leader_election.cc:290] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 election: Requested vote from peers ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813), 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471)
I20260709 12:22:27.022085 32564 raft_consensus.cc:493] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.022693 32564 raft_consensus.cc:515] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.020479 32549 tablet_bootstrap.cc:492] T bd8f84fc897d4f01b94924403eaf8e64 P 4a0201cedacd48c2abd9eb3e09ee0d92: Bootstrap starting.
I20260709 12:22:27.028017 32433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b279692d87ed403dbcb22f1d366edcba" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" is_pre_election: true
I20260709 12:22:27.028970 32433 raft_consensus.cc:2468] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be0070ae46940d98553de245ef14d4b in term 0.
I20260709 12:22:27.031668 32550 tablet_bootstrap.cc:492] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d: No bootstrap required, opened a new log
I20260709 12:22:27.032375 32358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1feae880171f4a4997bc3da8d9aa6460" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be0070ae46940d98553de245ef14d4b" is_pre_election: true
I20260709 12:22:27.033156 32358 raft_consensus.cc:2468] T 1feae880171f4a4997bc3da8d9aa6460 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0201cedacd48c2abd9eb3e09ee0d92 in term 0.
I20260709 12:22:27.034212 32564 leader_election.cc:290] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:27.034993 32547 tablet_bootstrap.cc:492] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b: No bootstrap required, opened a new log
I20260709 12:22:27.034827 32507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225cfe1201f64d04846232f5b22ec651" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d" is_pre_election: true
I20260709 12:22:27.032400 32550 ts_tablet_manager.cc:1403] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.019s
I20260709 12:22:27.035650 32433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c26312d2694b5980a2f78bfdc472fe" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
I20260709 12:22:27.036196 32506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1feae880171f4a4997bc3da8d9aa6460" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d" is_pre_election: true
I20260709 12:22:27.037806 32547 ts_tablet_manager.cc:1403] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b: Time spent bootstrapping tablet: real 0.083s	user 0.028s	sys 0.042s
I20260709 12:22:27.039480 32433 raft_consensus.cc:3060] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.037788 32507 raft_consensus.cc:2468] T 225cfe1201f64d04846232f5b22ec651 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be0070ae46940d98553de245ef14d4b in term 0.
I20260709 12:22:27.042196 32323 leader_election.cc:304] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b, ba6fd2b98668427bb42cde3ad503803d; no voters: 
I20260709 12:22:27.043306 32550 raft_consensus.cc:359] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.044112 32550 raft_consensus.cc:385] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.044433 32550 raft_consensus.cc:740] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6fd2b98668427bb42cde3ad503803d, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.042249 32322 leader_election.cc:304] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b, 4a0201cedacd48c2abd9eb3e09ee0d92; no voters: ba6fd2b98668427bb42cde3ad503803d
I20260709 12:22:27.045722 32432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225cfe1201f64d04846232f5b22ec651" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" is_pre_election: true
I20260709 12:22:27.045325 32550 consensus_queue.cc:260] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.036854 32397 leader_election.cc:304] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b, 4a0201cedacd48c2abd9eb3e09ee0d92; no voters: 
I20260709 12:22:27.047015 32551 raft_consensus.cc:697] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [term 1 LEADER]: Becoming Leader. State: Replica: 3be0070ae46940d98553de245ef14d4b, State: Running, Role: LEADER
W20260709 12:22:27.047704 32398 leader_election.cc:343] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:27.048175 32551 consensus_queue.cc:237] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } }
I20260709 12:22:27.049364 32549 tablet_bootstrap.cc:654] T bd8f84fc897d4f01b94924403eaf8e64 P 4a0201cedacd48c2abd9eb3e09ee0d92: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:27.049783 32555 raft_consensus.cc:2804] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:27.050240 32555 raft_consensus.cc:493] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.050601 32555 raft_consensus.cc:3060] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.055423 32547 raft_consensus.cc:359] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.056290 32547 raft_consensus.cc:385] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.056592 32547 raft_consensus.cc:740] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be0070ae46940d98553de245ef14d4b, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.057228 32564 raft_consensus.cc:2804] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:27.058559 32564 raft_consensus.cc:493] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.059073 32564 raft_consensus.cc:3060] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.058787 32547 consensus_queue.cc:260] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.059798 32572 raft_consensus.cc:2804] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:27.060240 32572 raft_consensus.cc:493] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.061465 32547 ts_tablet_manager.cc:1434] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:22:27.062011 32550 ts_tablet_manager.cc:1434] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.003s
I20260709 12:22:27.060572 32572 raft_consensus.cc:3060] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.062686 32547 tablet_bootstrap.cc:492] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b: Bootstrap starting.
W20260709 12:22:27.057780 32322 leader_election.cc:343] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:27.067572 32433 raft_consensus.cc:2468] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be0070ae46940d98553de245ef14d4b in term 1.
I20260709 12:22:27.069283 32550 tablet_bootstrap.cc:492] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d: Bootstrap starting.
I20260709 12:22:27.071168 32564 raft_consensus.cc:515] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.059327 32555 raft_consensus.cc:515] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.076311 32432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225cfe1201f64d04846232f5b22ec651" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
I20260709 12:22:27.075568 32254 catalog_manager.cc:5697] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3be0070ae46940d98553de245ef14d4b (127.22.155.193). New cstate: current_term: 1 leader_uuid: "3be0070ae46940d98553de245ef14d4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:27.079713 32322 leader_election.cc:343] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:27.081699 32547 tablet_bootstrap.cc:654] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:27.081825 32358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1feae880171f4a4997bc3da8d9aa6460" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be0070ae46940d98553de245ef14d4b"
I20260709 12:22:27.082516 32358 raft_consensus.cc:3060] T 1feae880171f4a4997bc3da8d9aa6460 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.084939 32564 leader_election.cc:290] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 election: Requested vote from peers 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:27.085131 32507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225cfe1201f64d04846232f5b22ec651" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d"
I20260709 12:22:27.085772 32507 raft_consensus.cc:3060] T 225cfe1201f64d04846232f5b22ec651 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.093528 32358 raft_consensus.cc:2468] T 1feae880171f4a4997bc3da8d9aa6460 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0201cedacd48c2abd9eb3e09ee0d92 in term 1.
I20260709 12:22:27.094749 32547 tablet_bootstrap.cc:492] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b: No bootstrap required, opened a new log
I20260709 12:22:27.095371 32547 ts_tablet_manager.cc:1403] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.004s
I20260709 12:22:27.095202 32397 leader_election.cc:304] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b, 4a0201cedacd48c2abd9eb3e09ee0d92; no voters: 
I20260709 12:22:27.097690 32507 raft_consensus.cc:2468] T 225cfe1201f64d04846232f5b22ec651 P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be0070ae46940d98553de245ef14d4b in term 1.
I20260709 12:22:27.101557 32549 tablet_bootstrap.cc:492] T bd8f84fc897d4f01b94924403eaf8e64 P 4a0201cedacd48c2abd9eb3e09ee0d92: No bootstrap required, opened a new log
I20260709 12:22:27.103458 32549 ts_tablet_manager.cc:1403] T bd8f84fc897d4f01b94924403eaf8e64 P 4a0201cedacd48c2abd9eb3e09ee0d92: Time spent bootstrapping tablet: real 0.083s	user 0.008s	sys 0.015s
I20260709 12:22:27.103549 32506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1feae880171f4a4997bc3da8d9aa6460" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d"
I20260709 12:22:27.103729 32323 leader_election.cc:304] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b, ba6fd2b98668427bb42cde3ad503803d; no voters: 4a0201cedacd48c2abd9eb3e09ee0d92
I20260709 12:22:27.099948 32547 raft_consensus.cc:359] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.104894 32547 raft_consensus.cc:385] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.105226 32547 raft_consensus.cc:740] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be0070ae46940d98553de245ef14d4b, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.105386 32564 raft_consensus.cc:2804] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:22:27.105719 32398 leader_election.cc:343] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:27.106022 32564 raft_consensus.cc:697] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [term 1 LEADER]: Becoming Leader. State: Replica: 3be0070ae46940d98553de245ef14d4b, State: Running, Role: LEADER
I20260709 12:22:27.106731 32549 raft_consensus.cc:359] T bd8f84fc897d4f01b94924403eaf8e64 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.106958 32564 consensus_queue.cc:237] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.107570 32549 raft_consensus.cc:385] T bd8f84fc897d4f01b94924403eaf8e64 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.107287 32547 consensus_queue.cc:260] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.107892 32549 raft_consensus.cc:740] T bd8f84fc897d4f01b94924403eaf8e64 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0201cedacd48c2abd9eb3e09ee0d92, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.109022 32549 consensus_queue.cc:260] T bd8f84fc897d4f01b94924403eaf8e64 P 4a0201cedacd48c2abd9eb3e09ee0d92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.112776 32555 leader_election.cc:290] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 1 election: Requested vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:27.113628 32555 raft_consensus.cc:2804] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:27.114140 32555 raft_consensus.cc:697] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 LEADER]: Becoming Leader. State: Replica: 4a0201cedacd48c2abd9eb3e09ee0d92, State: Running, Role: LEADER
I20260709 12:22:27.115023 32555 consensus_queue.cc:237] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.118012 32572 raft_consensus.cc:515] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.120221 32547 ts_tablet_manager.cc:1434] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 12:22:27.123068 32549 ts_tablet_manager.cc:1434] T bd8f84fc897d4f01b94924403eaf8e64 P 4a0201cedacd48c2abd9eb3e09ee0d92: Time spent starting tablet: real 0.019s	user 0.001s	sys 0.009s
I20260709 12:22:27.124333 32549 tablet_bootstrap.cc:492] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92: Bootstrap starting.
I20260709 12:22:27.125101 32550 tablet_bootstrap.cc:654] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:27.128756 32547 tablet_bootstrap.cc:492] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b: Bootstrap starting.
I20260709 12:22:27.131100 32506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b279692d87ed403dbcb22f1d366edcba" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d"
I20260709 12:22:27.131119 32432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b279692d87ed403dbcb22f1d366edcba" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
I20260709 12:22:27.135136 32432 raft_consensus.cc:3060] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.139967 32549 tablet_bootstrap.cc:654] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:27.140544 32323 leader_election.cc:343] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:27.146097 32547 tablet_bootstrap.cc:654] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:27.149413 32557 raft_consensus.cc:493] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.150020 32557 raft_consensus.cc:515] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.153102 32549 tablet_bootstrap.cc:492] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92: No bootstrap required, opened a new log
I20260709 12:22:27.154121 32549 ts_tablet_manager.cc:1403] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92: Time spent bootstrapping tablet: real 0.030s	user 0.005s	sys 0.009s
I20260709 12:22:27.158727 32549 raft_consensus.cc:359] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.159809 32557 leader_election.cc:290] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471)
I20260709 12:22:27.160846 32557 raft_consensus.cc:493] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.161605 32557 raft_consensus.cc:515] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.162405 32432 raft_consensus.cc:2468] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be0070ae46940d98553de245ef14d4b in term 1.
I20260709 12:22:27.164433 32322 leader_election.cc:304] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b, 4a0201cedacd48c2abd9eb3e09ee0d92; no voters: ba6fd2b98668427bb42cde3ad503803d
I20260709 12:22:27.165566 32551 raft_consensus.cc:2804] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:27.165863 32572 leader_election.cc:290] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 election: Requested vote from peers 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:27.166375 32551 raft_consensus.cc:697] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [term 1 LEADER]: Becoming Leader. State: Replica: 3be0070ae46940d98553de245ef14d4b, State: Running, Role: LEADER
I20260709 12:22:27.167657 32551 consensus_queue.cc:237] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.174809 32557 leader_election.cc:290] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471)
I20260709 12:22:27.159942 32549 raft_consensus.cc:385] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.176100 32549 raft_consensus.cc:740] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0201cedacd48c2abd9eb3e09ee0d92, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.177349 32549 consensus_queue.cc:260] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.181180 32549 ts_tablet_manager.cc:1434] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.000s
I20260709 12:22:27.182407 32549 tablet_bootstrap.cc:492] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92: Bootstrap starting.
I20260709 12:22:27.187413 32550 tablet_bootstrap.cc:492] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d: No bootstrap required, opened a new log
I20260709 12:22:27.194496 32549 tablet_bootstrap.cc:654] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:27.193523 32255 catalog_manager.cc:5697] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:27.195123 32550 ts_tablet_manager.cc:1403] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d: Time spent bootstrapping tablet: real 0.126s	user 0.013s	sys 0.006s
I20260709 12:22:27.212067 32550 raft_consensus.cc:359] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.213088 32550 raft_consensus.cc:385] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.213469 32550 raft_consensus.cc:740] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6fd2b98668427bb42cde3ad503803d, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.214318 32547 tablet_bootstrap.cc:492] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b: No bootstrap required, opened a new log
I20260709 12:22:27.214377 32550 consensus_queue.cc:260] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.205503 32253 catalog_manager.cc:5697] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3be0070ae46940d98553de245ef14d4b (127.22.155.193). New cstate: current_term: 1 leader_uuid: "3be0070ae46940d98553de245ef14d4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:27.217818 32550 ts_tablet_manager.cc:1434] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:22:27.219244 32550 tablet_bootstrap.cc:492] T 1feae880171f4a4997bc3da8d9aa6460 P ba6fd2b98668427bb42cde3ad503803d: Bootstrap starting.
I20260709 12:22:27.228205 32550 tablet_bootstrap.cc:654] T 1feae880171f4a4997bc3da8d9aa6460 P ba6fd2b98668427bb42cde3ad503803d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:27.232309 32551 raft_consensus.cc:493] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.232154 32432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a1129de5fd4878b018a89467544ecb" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" is_pre_election: true
I20260709 12:22:27.233078 32551 raft_consensus.cc:515] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.233480 32432 raft_consensus.cc:2468] T 36a1129de5fd4878b018a89467544ecb P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba6fd2b98668427bb42cde3ad503803d in term 0.
I20260709 12:22:27.233969 32358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a1129de5fd4878b018a89467544ecb" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be0070ae46940d98553de245ef14d4b" is_pre_election: true
I20260709 12:22:27.232560 32433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef7d12ba5a45cab61fdc87dbc39117" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" is_pre_election: true
I20260709 12:22:27.234696 32358 raft_consensus.cc:2468] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba6fd2b98668427bb42cde3ad503803d in term 0.
I20260709 12:22:27.235463 32551 leader_election.cc:290] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:27.237819 32506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a1129de5fd4878b018a89467544ecb" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d" is_pre_election: true
I20260709 12:22:27.238492 32506 raft_consensus.cc:2468] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be0070ae46940d98553de245ef14d4b in term 0.
I20260709 12:22:27.239861 32433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a1129de5fd4878b018a89467544ecb" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" is_pre_election: true
I20260709 12:22:27.240504 32433 raft_consensus.cc:2468] T 36a1129de5fd4878b018a89467544ecb P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be0070ae46940d98553de245ef14d4b in term 0.
I20260709 12:22:27.241822 32322 leader_election.cc:304] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b, 4a0201cedacd48c2abd9eb3e09ee0d92; no voters: 
I20260709 12:22:27.244040 32358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef7d12ba5a45cab61fdc87dbc39117" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be0070ae46940d98553de245ef14d4b" is_pre_election: true
I20260709 12:22:27.245867 32471 leader_election.cc:304] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0201cedacd48c2abd9eb3e09ee0d92, ba6fd2b98668427bb42cde3ad503803d; no voters: 
I20260709 12:22:27.246851 32557 raft_consensus.cc:2804] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:27.247555 32557 raft_consensus.cc:493] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.247712 32547 ts_tablet_manager.cc:1403] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b: Time spent bootstrapping tablet: real 0.126s	user 0.010s	sys 0.021s
I20260709 12:22:27.248040 32557 raft_consensus.cc:3060] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.251156 32547 raft_consensus.cc:359] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.251946 32547 raft_consensus.cc:385] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.252250 32547 raft_consensus.cc:740] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be0070ae46940d98553de245ef14d4b, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.253842 32547 consensus_queue.cc:260] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.247026 32551 raft_consensus.cc:2804] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:27.255748 32256 catalog_manager.cc:5697] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3be0070ae46940d98553de245ef14d4b (127.22.155.193). New cstate: current_term: 1 leader_uuid: "3be0070ae46940d98553de245ef14d4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:27.257091 32551 raft_consensus.cc:493] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.257603 32551 raft_consensus.cc:3060] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.256431 32547 ts_tablet_manager.cc:1434] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:22:27.258908 32547 tablet_bootstrap.cc:492] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b: Bootstrap starting.
I20260709 12:22:27.259825 32550 tablet_bootstrap.cc:492] T 1feae880171f4a4997bc3da8d9aa6460 P ba6fd2b98668427bb42cde3ad503803d: No bootstrap required, opened a new log
I20260709 12:22:27.260514 32550 ts_tablet_manager.cc:1403] T 1feae880171f4a4997bc3da8d9aa6460 P ba6fd2b98668427bb42cde3ad503803d: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.028s
I20260709 12:22:27.263679 32550 raft_consensus.cc:359] T 1feae880171f4a4997bc3da8d9aa6460 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.263917 32557 raft_consensus.cc:515] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.264509 32550 raft_consensus.cc:385] T 1feae880171f4a4997bc3da8d9aa6460 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.264971 32550 raft_consensus.cc:740] T 1feae880171f4a4997bc3da8d9aa6460 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6fd2b98668427bb42cde3ad503803d, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.265255 32547 tablet_bootstrap.cc:654] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:27.266093 32557 leader_election.cc:290] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 1 election: Requested vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471)
I20260709 12:22:27.265934 32550 consensus_queue.cc:260] T 1feae880171f4a4997bc3da8d9aa6460 P ba6fd2b98668427bb42cde3ad503803d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
W20260709 12:22:27.246850 32471 leader_election.cc:343] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:27.267956 32471 leader_election.cc:343] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:27.268517 32550 ts_tablet_manager.cc:1434] T 1feae880171f4a4997bc3da8d9aa6460 P ba6fd2b98668427bb42cde3ad503803d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:22:27.269519 32550 tablet_bootstrap.cc:492] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d: Bootstrap starting.
I20260709 12:22:27.275854 32550 tablet_bootstrap.cc:654] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:27.268497 32471 leader_election.cc:304] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba6fd2b98668427bb42cde3ad503803d; no voters: 3be0070ae46940d98553de245ef14d4b, 4a0201cedacd48c2abd9eb3e09ee0d92
I20260709 12:22:27.279074 32549 tablet_bootstrap.cc:492] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92: No bootstrap required, opened a new log
I20260709 12:22:27.278996 32358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a1129de5fd4878b018a89467544ecb" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be0070ae46940d98553de245ef14d4b"
I20260709 12:22:27.279793 32433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a1129de5fd4878b018a89467544ecb" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
I20260709 12:22:27.279563 32557 raft_consensus.cc:2749] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:27.280470 32433 raft_consensus.cc:3060] T 36a1129de5fd4878b018a89467544ecb P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.285884 32551 raft_consensus.cc:515] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.287343 32358 raft_consensus.cc:2393] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ba6fd2b98668427bb42cde3ad503803d in current term 1: Already voted for candidate 3be0070ae46940d98553de245ef14d4b in this term.
I20260709 12:22:27.288339 32549 ts_tablet_manager.cc:1403] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92: Time spent bootstrapping tablet: real 0.106s	user 0.018s	sys 0.026s
I20260709 12:22:27.289312 32432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a1129de5fd4878b018a89467544ecb" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
I20260709 12:22:27.289600 32506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a1129de5fd4878b018a89467544ecb" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d"
I20260709 12:22:27.290499 32506 raft_consensus.cc:2393] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3be0070ae46940d98553de245ef14d4b in current term 1: Already voted for candidate ba6fd2b98668427bb42cde3ad503803d in this term.
I20260709 12:22:27.291779 32323 leader_election.cc:304] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b; no voters: 4a0201cedacd48c2abd9eb3e09ee0d92, ba6fd2b98668427bb42cde3ad503803d
I20260709 12:22:27.292234 32549 raft_consensus.cc:359] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.292652 32564 raft_consensus.cc:2749] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:27.293032 32549 raft_consensus.cc:385] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.293401 32549 raft_consensus.cc:740] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0201cedacd48c2abd9eb3e09ee0d92, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.294170 32433 raft_consensus.cc:2468] T 36a1129de5fd4878b018a89467544ecb P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6fd2b98668427bb42cde3ad503803d in term 1.
I20260709 12:22:27.294672 32549 consensus_queue.cc:260] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.295485 32550 tablet_bootstrap.cc:492] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d: No bootstrap required, opened a new log
I20260709 12:22:27.296087 32550 ts_tablet_manager.cc:1403] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d: Time spent bootstrapping tablet: real 0.027s	user 0.002s	sys 0.010s
I20260709 12:22:27.296576 32547 tablet_bootstrap.cc:492] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b: No bootstrap required, opened a new log
I20260709 12:22:27.297170 32547 ts_tablet_manager.cc:1403] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.009s
I20260709 12:22:27.297201 32549 ts_tablet_manager.cc:1434] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:27.298418 32549 tablet_bootstrap.cc:492] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92: Bootstrap starting.
I20260709 12:22:27.299297 32550 raft_consensus.cc:359] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.300122 32550 raft_consensus.cc:385] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.293215 32551 leader_election.cc:290] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 election: Requested vote from peers 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:27.295521 32471 leader_election.cc:304] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0201cedacd48c2abd9eb3e09ee0d92, ba6fd2b98668427bb42cde3ad503803d; no voters: 3be0070ae46940d98553de245ef14d4b
I20260709 12:22:27.300370 32547 raft_consensus.cc:359] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.305261 32547 raft_consensus.cc:385] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.305368 32557 raft_consensus.cc:2804] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:27.305610 32547 raft_consensus.cc:740] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be0070ae46940d98553de245ef14d4b, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.306021 32549 tablet_bootstrap.cc:654] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:27.306102 32557 raft_consensus.cc:697] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d [term 1 LEADER]: Becoming Leader. State: Replica: ba6fd2b98668427bb42cde3ad503803d, State: Running, Role: LEADER
I20260709 12:22:27.308095 32557 consensus_queue.cc:237] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.300400 32550 raft_consensus.cc:740] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6fd2b98668427bb42cde3ad503803d, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.306694 32547 consensus_queue.cc:260] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.314082 32550 consensus_queue.cc:260] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.316540 32550 ts_tablet_manager.cc:1434] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.003s
I20260709 12:22:27.318224 32550 tablet_bootstrap.cc:492] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d: Bootstrap starting.
I20260709 12:22:27.318291 32547 ts_tablet_manager.cc:1434] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.004s
I20260709 12:22:27.319588 32547 tablet_bootstrap.cc:492] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b: Bootstrap starting.
I20260709 12:22:27.321408 32549 tablet_bootstrap.cc:492] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92: No bootstrap required, opened a new log
I20260709 12:22:27.322057 32549 ts_tablet_manager.cc:1403] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.003s
I20260709 12:22:27.325110 32549 raft_consensus.cc:359] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.325798 32549 raft_consensus.cc:385] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.326042 32549 raft_consensus.cc:740] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0201cedacd48c2abd9eb3e09ee0d92, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.326778 32550 tablet_bootstrap.cc:654] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:27.326974 32549 consensus_queue.cc:260] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.326889 32547 tablet_bootstrap.cc:654] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:27.332180 32549 ts_tablet_manager.cc:1434] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:22:27.333336 32549 tablet_bootstrap.cc:492] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92: Bootstrap starting.
I20260709 12:22:27.342267 32547 tablet_bootstrap.cc:492] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b: No bootstrap required, opened a new log
I20260709 12:22:27.342935 32547 ts_tablet_manager.cc:1403] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.002s
I20260709 12:22:27.345319 32549 tablet_bootstrap.cc:654] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:27.346071 32547 raft_consensus.cc:359] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.346869 32547 raft_consensus.cc:385] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.347157 32547 raft_consensus.cc:740] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be0070ae46940d98553de245ef14d4b, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.348201 32547 consensus_queue.cc:260] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.353077 32547 ts_tablet_manager.cc:1434] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:22:27.347734 32253 catalog_manager.cc:5697] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d reported cstate change: term changed from 0 to 1, leader changed from <none> to ba6fd2b98668427bb42cde3ad503803d (127.22.155.195). New cstate: current_term: 1 leader_uuid: "ba6fd2b98668427bb42cde3ad503803d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:27.360895 32550 tablet_bootstrap.cc:492] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d: No bootstrap required, opened a new log
I20260709 12:22:27.360984 32549 tablet_bootstrap.cc:492] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92: No bootstrap required, opened a new log
I20260709 12:22:27.361697 32549 ts_tablet_manager.cc:1403] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.007s
I20260709 12:22:27.362236 32551 raft_consensus.cc:493] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.362807 32551 raft_consensus.cc:515] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.365036 32551 leader_election.cc:290] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:27.365156 32549 raft_consensus.cc:359] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.365931 32549 raft_consensus.cc:385] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.366226 32549 raft_consensus.cc:740] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0201cedacd48c2abd9eb3e09ee0d92, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.366863 32433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c87edb5fa542a794c3eab947086653" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" is_pre_election: true
I20260709 12:22:27.366955 32549 consensus_queue.cc:260] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.361646 32550 ts_tablet_manager.cc:1403] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d: Time spent bootstrapping tablet: real 0.044s	user 0.018s	sys 0.024s
I20260709 12:22:27.367669 32506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c87edb5fa542a794c3eab947086653" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d" is_pre_election: true
I20260709 12:22:27.368038 32433 raft_consensus.cc:2468] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be0070ae46940d98553de245ef14d4b in term 0.
I20260709 12:22:27.368710 32506 raft_consensus.cc:2468] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be0070ae46940d98553de245ef14d4b in term 0.
I20260709 12:22:27.369625 32549 ts_tablet_manager.cc:1434] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:22:27.369822 32322 leader_election.cc:304] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b, 4a0201cedacd48c2abd9eb3e09ee0d92; no voters: 
I20260709 12:22:27.370756 32549 tablet_bootstrap.cc:492] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92: Bootstrap starting.
I20260709 12:22:27.370993 32551 raft_consensus.cc:2804] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:27.371393 32551 raft_consensus.cc:493] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.371711 32551 raft_consensus.cc:3060] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.377911 32549 tablet_bootstrap.cc:654] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:27.380344 32550 raft_consensus.cc:359] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.381307 32550 raft_consensus.cc:385] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.381646 32550 raft_consensus.cc:740] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6fd2b98668427bb42cde3ad503803d, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.382586 32550 consensus_queue.cc:260] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.386899 32549 tablet_bootstrap.cc:492] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92: No bootstrap required, opened a new log
I20260709 12:22:27.387230 32550 ts_tablet_manager.cc:1434] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:22:27.387504 32549 ts_tablet_manager.cc:1403] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 12:22:27.388319 32550 tablet_bootstrap.cc:492] T 6454a4189fd24aabb3b216a8884e5422 P ba6fd2b98668427bb42cde3ad503803d: Bootstrap starting.
I20260709 12:22:27.390564 32549 raft_consensus.cc:359] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.390985 32551 raft_consensus.cc:515] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.391400 32549 raft_consensus.cc:385] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.391916 32549 raft_consensus.cc:740] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0201cedacd48c2abd9eb3e09ee0d92, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.392802 32549 consensus_queue.cc:260] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.394541 32549 ts_tablet_manager.cc:1434] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:27.395205 32433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c87edb5fa542a794c3eab947086653" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
I20260709 12:22:27.395586 32550 tablet_bootstrap.cc:654] T 6454a4189fd24aabb3b216a8884e5422 P ba6fd2b98668427bb42cde3ad503803d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:27.395851 32433 raft_consensus.cc:3060] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.400280 32557 raft_consensus.cc:493] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.400846 32557 raft_consensus.cc:515] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.401324 32550 tablet_bootstrap.cc:492] T 6454a4189fd24aabb3b216a8884e5422 P ba6fd2b98668427bb42cde3ad503803d: No bootstrap required, opened a new log
I20260709 12:22:27.401978 32550 ts_tablet_manager.cc:1403] T 6454a4189fd24aabb3b216a8884e5422 P ba6fd2b98668427bb42cde3ad503803d: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.001s
I20260709 12:22:27.403281 32557 leader_election.cc:290] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471)
I20260709 12:22:27.405097 32432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8f84fc897d4f01b94924403eaf8e64" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" is_pre_election: true
I20260709 12:22:27.405912 32358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8f84fc897d4f01b94924403eaf8e64" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be0070ae46940d98553de245ef14d4b" is_pre_election: true
I20260709 12:22:27.403982 32551 leader_election.cc:290] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 election: Requested vote from peers 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:27.406378 32506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c87edb5fa542a794c3eab947086653" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d"
I20260709 12:22:27.406688 32358 raft_consensus.cc:2468] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba6fd2b98668427bb42cde3ad503803d in term 0.
I20260709 12:22:27.407063 32506 raft_consensus.cc:3060] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.405963 32432 raft_consensus.cc:2468] T bd8f84fc897d4f01b94924403eaf8e64 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba6fd2b98668427bb42cde3ad503803d in term 0.
I20260709 12:22:27.408762 32471 leader_election.cc:304] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b, ba6fd2b98668427bb42cde3ad503803d; no voters: 
I20260709 12:22:27.409626 32557 raft_consensus.cc:2804] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:27.405213 32550 raft_consensus.cc:359] T 6454a4189fd24aabb3b216a8884e5422 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.410032 32557 raft_consensus.cc:493] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.410205 32550 raft_consensus.cc:385] T 6454a4189fd24aabb3b216a8884e5422 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.410535 32557 raft_consensus.cc:3060] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.410714 32550 raft_consensus.cc:740] T 6454a4189fd24aabb3b216a8884e5422 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6fd2b98668427bb42cde3ad503803d, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.412187 32555 raft_consensus.cc:493] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.411754 32550 consensus_queue.cc:260] T 6454a4189fd24aabb3b216a8884e5422 P ba6fd2b98668427bb42cde3ad503803d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.412772 32555 raft_consensus.cc:515] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.414589 32550 ts_tablet_manager.cc:1434] T 6454a4189fd24aabb3b216a8884e5422 P ba6fd2b98668427bb42cde3ad503803d: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:22:27.415848 32550 tablet_bootstrap.cc:492] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d: Bootstrap starting.
I20260709 12:22:27.416460 32506 raft_consensus.cc:2468] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be0070ae46940d98553de245ef14d4b in term 1.
I20260709 12:22:27.417327 32507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6454a4189fd24aabb3b216a8884e5422" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d" is_pre_election: true
I20260709 12:22:27.417968 32323 leader_election.cc:304] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b, ba6fd2b98668427bb42cde3ad503803d; no voters: 
I20260709 12:22:27.418133 32507 raft_consensus.cc:2468] T 6454a4189fd24aabb3b216a8884e5422 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0201cedacd48c2abd9eb3e09ee0d92 in term 0.
I20260709 12:22:27.419075 32551 raft_consensus.cc:2804] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:27.419693 32551 raft_consensus.cc:697] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [term 1 LEADER]: Becoming Leader. State: Replica: 3be0070ae46940d98553de245ef14d4b, State: Running, Role: LEADER
I20260709 12:22:27.420013 32433 raft_consensus.cc:2468] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be0070ae46940d98553de245ef14d4b in term 1.
I20260709 12:22:27.420734 32551 consensus_queue.cc:237] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.422721 32550 tablet_bootstrap.cc:654] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:27.422811 32358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6454a4189fd24aabb3b216a8884e5422" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be0070ae46940d98553de245ef14d4b" is_pre_election: true
I20260709 12:22:27.423736 32358 raft_consensus.cc:2468] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0201cedacd48c2abd9eb3e09ee0d92 in term 0.
I20260709 12:22:27.424717 32555 leader_election.cc:290] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:27.421494 32398 leader_election.cc:304] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0201cedacd48c2abd9eb3e09ee0d92, ba6fd2b98668427bb42cde3ad503803d; no voters: 
I20260709 12:22:27.426160 32555 raft_consensus.cc:2804] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:27.426620 32555 raft_consensus.cc:493] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.427013 32555 raft_consensus.cc:3060] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.432843 32550 tablet_bootstrap.cc:492] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d: No bootstrap required, opened a new log
I20260709 12:22:27.433459 32550 ts_tablet_manager.cc:1403] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.010s
I20260709 12:22:27.434006 32551 raft_consensus.cc:493] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.436749 32550 raft_consensus.cc:359] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.437831 32550 raft_consensus.cc:385] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.438477 32550 raft_consensus.cc:740] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6fd2b98668427bb42cde3ad503803d, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.437796 32555 raft_consensus.cc:515] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.439327 32550 consensus_queue.cc:260] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.441664 32550 ts_tablet_manager.cc:1434] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:27.442512 32358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6454a4189fd24aabb3b216a8884e5422" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be0070ae46940d98553de245ef14d4b"
I20260709 12:22:27.443176 32358 raft_consensus.cc:3060] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.437574 32253 catalog_manager.cc:5697] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3be0070ae46940d98553de245ef14d4b (127.22.155.193). New cstate: current_term: 1 leader_uuid: "3be0070ae46940d98553de245ef14d4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:27.434731 32551 raft_consensus.cc:515] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.443596 32557 raft_consensus.cc:515] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.447373 32433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef7d12ba5a45cab61fdc87dbc39117" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" is_pre_election: true
I20260709 12:22:27.449491 32433 raft_consensus.cc:2468] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be0070ae46940d98553de245ef14d4b in term 0.
I20260709 12:22:27.449743 32357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8f84fc897d4f01b94924403eaf8e64" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be0070ae46940d98553de245ef14d4b"
I20260709 12:22:27.450340 32432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8f84fc897d4f01b94924403eaf8e64" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
I20260709 12:22:27.450521 32357 raft_consensus.cc:3060] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.450975 32432 raft_consensus.cc:3060] T bd8f84fc897d4f01b94924403eaf8e64 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.453801 32322 leader_election.cc:304] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b, 4a0201cedacd48c2abd9eb3e09ee0d92; no voters: 
I20260709 12:22:27.454846 32564 raft_consensus.cc:2804] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:27.455284 32564 raft_consensus.cc:493] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.455696 32564 raft_consensus.cc:3060] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.443168 32555 leader_election.cc:290] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 1 election: Requested vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:27.457683 32506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6454a4189fd24aabb3b216a8884e5422" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d"
I20260709 12:22:27.458362 32506 raft_consensus.cc:3060] T 6454a4189fd24aabb3b216a8884e5422 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.461328 32432 raft_consensus.cc:2468] T bd8f84fc897d4f01b94924403eaf8e64 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6fd2b98668427bb42cde3ad503803d in term 1.
I20260709 12:22:27.462689 32471 leader_election.cc:304] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0201cedacd48c2abd9eb3e09ee0d92, ba6fd2b98668427bb42cde3ad503803d; no voters: 
I20260709 12:22:27.456255 32358 raft_consensus.cc:2468] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0201cedacd48c2abd9eb3e09ee0d92 in term 1.
I20260709 12:22:27.463819 32586 raft_consensus.cc:2804] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:27.463861 32573 raft_consensus.cc:493] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.464392 32357 raft_consensus.cc:2468] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6fd2b98668427bb42cde3ad503803d in term 1.
I20260709 12:22:27.464751 32573 raft_consensus.cc:515] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.465423 32397 leader_election.cc:304] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b, 4a0201cedacd48c2abd9eb3e09ee0d92; no voters: 
I20260709 12:22:27.467082 32564 raft_consensus.cc:515] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.468894 32507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda1105bad6e4f8daffc1141ab247524" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d" is_pre_election: true
I20260709 12:22:27.469894 32507 raft_consensus.cc:2468] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be0070ae46940d98553de245ef14d4b in term 0.
I20260709 12:22:27.469964 32505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef7d12ba5a45cab61fdc87dbc39117" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d" is_pre_election: true
I20260709 12:22:27.470395 32564 leader_election.cc:290] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 election: Requested vote from peers 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:27.448407 32557 leader_election.cc:290] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 1 election: Requested vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471)
I20260709 12:22:27.467391 32506 raft_consensus.cc:2468] T 6454a4189fd24aabb3b216a8884e5422 P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0201cedacd48c2abd9eb3e09ee0d92 in term 1.
I20260709 12:22:27.470956 32505 raft_consensus.cc:2468] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be0070ae46940d98553de245ef14d4b in term 0.
I20260709 12:22:27.468175 32551 leader_election.cc:290] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:27.471655 32586 raft_consensus.cc:697] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [term 1 LEADER]: Becoming Leader. State: Replica: ba6fd2b98668427bb42cde3ad503803d, State: Running, Role: LEADER
I20260709 12:22:27.475112 32573 leader_election.cc:290] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:27.472896 32504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef7d12ba5a45cab61fdc87dbc39117" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d"
I20260709 12:22:27.475250 32586 consensus_queue.cc:237] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.476140 32433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef7d12ba5a45cab61fdc87dbc39117" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
I20260709 12:22:27.476878 32433 raft_consensus.cc:3060] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.477273 32323 leader_election.cc:304] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b, ba6fd2b98668427bb42cde3ad503803d; no voters: 
I20260709 12:22:27.477809 32557 raft_consensus.cc:493] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.476087 32504 raft_consensus.cc:3060] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.478466 32557 raft_consensus.cc:515] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.482126 32357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b279692d87ed403dbcb22f1d366edcba" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be0070ae46940d98553de245ef14d4b" is_pre_election: true
I20260709 12:22:27.486096 32433 raft_consensus.cc:2468] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be0070ae46940d98553de245ef14d4b in term 1.
I20260709 12:22:27.486848 32551 raft_consensus.cc:2804] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:27.471216 32555 raft_consensus.cc:2804] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:27.487011 32557 leader_election.cc:290] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471)
I20260709 12:22:27.487368 32431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b279692d87ed403dbcb22f1d366edcba" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" is_pre_election: true
I20260709 12:22:27.488425 32431 raft_consensus.cc:2393] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba6fd2b98668427bb42cde3ad503803d in current term 1: Already voted for candidate 3be0070ae46940d98553de245ef14d4b in this term.
I20260709 12:22:27.489046 32555 raft_consensus.cc:697] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 LEADER]: Becoming Leader. State: Replica: 4a0201cedacd48c2abd9eb3e09ee0d92, State: Running, Role: LEADER
I20260709 12:22:27.489748 32322 leader_election.cc:304] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b, 4a0201cedacd48c2abd9eb3e09ee0d92; no voters: 
I20260709 12:22:27.489905 32471 leader_election.cc:304] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba6fd2b98668427bb42cde3ad503803d; no voters: 3be0070ae46940d98553de245ef14d4b, 4a0201cedacd48c2abd9eb3e09ee0d92
I20260709 12:22:27.490090 32555 consensus_queue.cc:237] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.490893 32573 raft_consensus.cc:2804] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:27.491204 32586 raft_consensus.cc:3060] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.491822 32573 raft_consensus.cc:697] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 1 LEADER]: Becoming Leader. State: Replica: 3be0070ae46940d98553de245ef14d4b, State: Running, Role: LEADER
I20260709 12:22:27.487397 32551 raft_consensus.cc:493] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.492900 32551 raft_consensus.cc:3060] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.492996 32573 consensus_queue.cc:237] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.494599 32256 catalog_manager.cc:5697] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d reported cstate change: term changed from 0 to 1, leader changed from <none> to ba6fd2b98668427bb42cde3ad503803d (127.22.155.195). New cstate: current_term: 1 leader_uuid: "ba6fd2b98668427bb42cde3ad503803d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:27.501179 32432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda1105bad6e4f8daffc1141ab247524" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" is_pre_election: true
I20260709 12:22:27.502205 32432 raft_consensus.cc:2468] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be0070ae46940d98553de245ef14d4b in term 0.
I20260709 12:22:27.503448 32504 raft_consensus.cc:2468] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be0070ae46940d98553de245ef14d4b in term 1.
I20260709 12:22:27.516446 32551 raft_consensus.cc:515] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.519212 32551 leader_election.cc:290] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 election: Requested vote from peers 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:27.519824 32551 consensus_queue.cc:1048] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:27.520231 32431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda1105bad6e4f8daffc1141ab247524" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
I20260709 12:22:27.523072 32431 raft_consensus.cc:3060] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.520852 32504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda1105bad6e4f8daffc1141ab247524" candidate_uuid: "3be0070ae46940d98553de245ef14d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d"
I20260709 12:22:27.522250 32586 raft_consensus.cc:2749] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:27.525874 32504 raft_consensus.cc:3060] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.533545 32256 catalog_manager.cc:5697] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:27.534677 32253 catalog_manager.cc:5697] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3be0070ae46940d98553de245ef14d4b (127.22.155.193). New cstate: current_term: 1 leader_uuid: "3be0070ae46940d98553de245ef14d4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:27.540854 32507 raft_consensus.cc:3060] T 1feae880171f4a4997bc3da8d9aa6460 P ba6fd2b98668427bb42cde3ad503803d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.544927 32504 raft_consensus.cc:2468] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be0070ae46940d98553de245ef14d4b in term 1.
I20260709 12:22:27.546981 32431 raft_consensus.cc:2468] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be0070ae46940d98553de245ef14d4b in term 1.
I20260709 12:22:27.549072 32322 leader_election.cc:304] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b, 4a0201cedacd48c2abd9eb3e09ee0d92; no voters: 
I20260709 12:22:27.551692 32573 raft_consensus.cc:2804] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:27.551820 32579 raft_consensus.cc:493] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.552356 32573 raft_consensus.cc:697] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [term 1 LEADER]: Becoming Leader. State: Replica: 3be0070ae46940d98553de245ef14d4b, State: Running, Role: LEADER
I20260709 12:22:27.552600 32579 raft_consensus.cc:515] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.553412 32573 consensus_queue.cc:237] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:27.556104 32555 consensus_queue.cc:1048] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:27.556803 32357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225cfe1201f64d04846232f5b22ec651" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be0070ae46940d98553de245ef14d4b" is_pre_election: true
I20260709 12:22:27.556310 32579 leader_election.cc:290] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:27.559058 32504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225cfe1201f64d04846232f5b22ec651" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d" is_pre_election: true
I20260709 12:22:27.560228 32504 raft_consensus.cc:2393] T 225cfe1201f64d04846232f5b22ec651 P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a0201cedacd48c2abd9eb3e09ee0d92 in current term 1: Already voted for candidate 3be0070ae46940d98553de245ef14d4b in this term.
I20260709 12:22:27.561729 32398 leader_election.cc:304] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0201cedacd48c2abd9eb3e09ee0d92; no voters: 3be0070ae46940d98553de245ef14d4b, ba6fd2b98668427bb42cde3ad503803d
I20260709 12:22:27.563128 32579 raft_consensus.cc:3060] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:27.566342 32555 consensus_queue.cc:1048] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:27.567147 32256 catalog_manager.cc:5697] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3be0070ae46940d98553de245ef14d4b (127.22.155.193). New cstate: current_term: 1 leader_uuid: "3be0070ae46940d98553de245ef14d4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:27.571763 32579 raft_consensus.cc:2749] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:27.595779 32573 consensus_queue.cc:1048] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:27.602020 32573 consensus_queue.cc:1048] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:22:27.628293 32573 consensus_queue.cc:1048] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:27.645382 32572 consensus_queue.cc:1048] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:27.662643 32573 consensus_queue.cc:1048] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:27.691546 32586 consensus_queue.cc:1048] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:27.696866 23151 ts_manager.cc:295] Set tserver state for 3be0070ae46940d98553de245ef14d4b to MAINTENANCE_MODE
I20260709 12:22:27.697901 23151 tablet_server.cc:179] TabletServer@127.22.155.193:0 shutting down...
I20260709 12:22:27.714614 32586 consensus_queue.cc:1048] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:22:27.720010 32471 consensus_peers.cc:597] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d -> Peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Couldn't send request to peer 3be0070ae46940d98553de245ef14d4b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:27.736541 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:27.737820 23151 tablet_replica.cc:333] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b: stopping tablet replica
I20260709 12:22:27.738880 23151 raft_consensus.cc:2243] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:27.739701 23151 pending_rounds.cc:70] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b: Trying to abort 1 pending ops.
I20260709 12:22:27.739979 23151 pending_rounds.cc:77] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305624565747281920 op_type: NO_OP noop_request { }
I20260709 12:22:27.740302 23151 raft_consensus.cc:2889] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:22:27.740593 23151 raft_consensus.cc:2272] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.743268 23151 tablet_replica.cc:333] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b: stopping tablet replica
I20260709 12:22:27.743901 23151 raft_consensus.cc:2243] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:27.744306 23151 pending_rounds.cc:70] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b: Trying to abort 1 pending ops.
I20260709 12:22:27.744490 23151 pending_rounds.cc:77] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305624564985577472 op_type: NO_OP noop_request { }
I20260709 12:22:27.744836 23151 raft_consensus.cc:2889] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:22:27.745142 23151 raft_consensus.cc:2272] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.747756 23151 tablet_replica.cc:333] T 1feae880171f4a4997bc3da8d9aa6460 P 3be0070ae46940d98553de245ef14d4b: stopping tablet replica
I20260709 12:22:27.748363 23151 raft_consensus.cc:2243] T 1feae880171f4a4997bc3da8d9aa6460 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:27.748883 23151 raft_consensus.cc:2272] T 1feae880171f4a4997bc3da8d9aa6460 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.751463 23151 tablet_replica.cc:333] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b: stopping tablet replica
I20260709 12:22:27.752067 23151 raft_consensus.cc:2243] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:27.753034 23151 raft_consensus.cc:2272] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.755462 23151 tablet_replica.cc:333] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b: stopping tablet replica
I20260709 12:22:27.756058 23151 raft_consensus.cc:2243] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:27.756460 23151 raft_consensus.cc:2272] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.758478 23151 tablet_replica.cc:333] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b: stopping tablet replica
I20260709 12:22:27.759017 23151 raft_consensus.cc:2243] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:27.759888 23151 raft_consensus.cc:2272] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.762245 23151 tablet_replica.cc:333] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b: stopping tablet replica
I20260709 12:22:27.762805 23151 raft_consensus.cc:2243] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:27.763191 23151 raft_consensus.cc:2272] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.765266 23151 tablet_replica.cc:333] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b: stopping tablet replica
I20260709 12:22:27.765798 23151 raft_consensus.cc:2243] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:27.766422 23151 pending_rounds.cc:70] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b: Trying to abort 1 pending ops.
I20260709 12:22:27.766623 23151 pending_rounds.cc:77] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305624565999058944 op_type: NO_OP noop_request { }
I20260709 12:22:27.766912 23151 raft_consensus.cc:2889] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:22:27.767186 23151 raft_consensus.cc:2272] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.769958 23151 tablet_replica.cc:333] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b: stopping tablet replica
I20260709 12:22:27.770674 23151 raft_consensus.cc:2243] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:27.771452 23151 pending_rounds.cc:70] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b: Trying to abort 1 pending ops.
I20260709 12:22:27.771667 23151 pending_rounds.cc:77] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305624565454462976 op_type: NO_OP noop_request { }
I20260709 12:22:27.771932 23151 raft_consensus.cc:2889] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:22:27.772183 23151 raft_consensus.cc:2272] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.774417 23151 tablet_replica.cc:333] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b: stopping tablet replica
I20260709 12:22:27.774894 23151 raft_consensus.cc:2243] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:27.775771 23151 raft_consensus.cc:2272] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.809470 23151 tablet_server.cc:196] TabletServer@127.22.155.193:0 shutdown complete.
W20260709 12:22:27.860347 32471 consensus_peers.cc:597] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d -> Peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Couldn't send request to peer 3be0070ae46940d98553de245ef14d4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:27.894119 32617 consensus_queue.cc:1048] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:22:27.912498 32397 consensus_peers.cc:597] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 -> Peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Couldn't send request to peer 3be0070ae46940d98553de245ef14d4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:27.963584 32397 consensus_peers.cc:597] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92 -> Peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Couldn't send request to peer 3be0070ae46940d98553de245ef14d4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:27.990806 32304 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:22:28.021812 32586 consensus_queue.cc:1048] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:22:28.991923 32304 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:22:29.078001 32634 raft_consensus.cc:493] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3be0070ae46940d98553de245ef14d4b)
I20260709 12:22:29.078737 32634 raft_consensus.cc:515] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } }
I20260709 12:22:29.080847 32634 leader_election.cc:290] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:29.082131 32507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c26312d2694b5980a2f78bfdc472fe" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d" is_pre_election: true
W20260709 12:22:29.085592 32397 leader_election.cc:336] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111)
I20260709 12:22:29.086038 32397 leader_election.cc:304] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0201cedacd48c2abd9eb3e09ee0d92; no voters: 3be0070ae46940d98553de245ef14d4b, ba6fd2b98668427bb42cde3ad503803d
I20260709 12:22:29.086782 32634 raft_consensus.cc:2749] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:29.107311 32557 raft_consensus.cc:493] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3be0070ae46940d98553de245ef14d4b)
I20260709 12:22:29.108022 32557 raft_consensus.cc:515] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } }
I20260709 12:22:29.110146 32557 leader_election.cc:290] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471)
I20260709 12:22:29.111867 32431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c26312d2694b5980a2f78bfdc472fe" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" is_pre_election: true
I20260709 12:22:29.112603 32431 raft_consensus.cc:2468] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba6fd2b98668427bb42cde3ad503803d in term 1.
I20260709 12:22:29.113806 32471 leader_election.cc:304] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0201cedacd48c2abd9eb3e09ee0d92, ba6fd2b98668427bb42cde3ad503803d; no voters: 
I20260709 12:22:29.114606 32557 raft_consensus.cc:2804] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:22:29.114604 32471 leader_election.cc:336] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111)
I20260709 12:22:29.115044 32557 raft_consensus.cc:493] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3be0070ae46940d98553de245ef14d4b)
I20260709 12:22:29.115463 32557 raft_consensus.cc:3060] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:29.121022 32557 raft_consensus.cc:515] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } }
I20260709 12:22:29.122941 32557 leader_election.cc:290] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 2 election: Requested vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471)
I20260709 12:22:29.124830 32431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c26312d2694b5980a2f78bfdc472fe" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
I20260709 12:22:29.125519 32431 raft_consensus.cc:3060] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:29.127048 32471 leader_election.cc:336] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111)
I20260709 12:22:29.129458 32634 raft_consensus.cc:493] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3be0070ae46940d98553de245ef14d4b)
I20260709 12:22:29.130005 32634 raft_consensus.cc:515] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:29.131078 32431 raft_consensus.cc:2468] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6fd2b98668427bb42cde3ad503803d in term 2.
I20260709 12:22:29.131978 32634 leader_election.cc:290] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:29.132720 32557 raft_consensus.cc:493] T 225cfe1201f64d04846232f5b22ec651 P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3be0070ae46940d98553de245ef14d4b)
I20260709 12:22:29.132928 32471 leader_election.cc:304] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0201cedacd48c2abd9eb3e09ee0d92, ba6fd2b98668427bb42cde3ad503803d; no voters: 3be0070ae46940d98553de245ef14d4b
I20260709 12:22:29.133366 32507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225cfe1201f64d04846232f5b22ec651" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d" is_pre_election: true
I20260709 12:22:29.133312 32557 raft_consensus.cc:515] T 225cfe1201f64d04846232f5b22ec651 P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:29.134692 32507 raft_consensus.cc:2468] T 225cfe1201f64d04846232f5b22ec651 P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0201cedacd48c2abd9eb3e09ee0d92 in term 1.
I20260709 12:22:29.134851 32635 raft_consensus.cc:2804] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:29.136139 32398 leader_election.cc:304] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0201cedacd48c2abd9eb3e09ee0d92, ba6fd2b98668427bb42cde3ad503803d; no voters: 
I20260709 12:22:29.137029 32634 raft_consensus.cc:2804] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:29.137462 32634 raft_consensus.cc:493] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3be0070ae46940d98553de245ef14d4b)
I20260709 12:22:29.137549 32635 raft_consensus.cc:697] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [term 2 LEADER]: Becoming Leader. State: Replica: ba6fd2b98668427bb42cde3ad503803d, State: Running, Role: LEADER
I20260709 12:22:29.137926 32634 raft_consensus.cc:3060] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:29.136952 32557 leader_election.cc:290] T 225cfe1201f64d04846232f5b22ec651 P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471)
I20260709 12:22:29.138677 32635 consensus_queue.cc:237] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } }
W20260709 12:22:29.139705 32397 leader_election.cc:336] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111)
I20260709 12:22:29.142144 32431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225cfe1201f64d04846232f5b22ec651" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" is_pre_election: true
W20260709 12:22:29.145206 32471 leader_election.cc:336] T 225cfe1201f64d04846232f5b22ec651 P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111)
I20260709 12:22:29.147527 32634 raft_consensus.cc:515] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:29.148909 32431 raft_consensus.cc:2393] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba6fd2b98668427bb42cde3ad503803d in current term 2: Already voted for candidate 4a0201cedacd48c2abd9eb3e09ee0d92 in this term.
I20260709 12:22:29.148535 32256 catalog_manager.cc:5697] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d reported cstate change: term changed from 1 to 2, leader changed from 3be0070ae46940d98553de245ef14d4b (127.22.155.193) to ba6fd2b98668427bb42cde3ad503803d (127.22.155.195). New cstate: current_term: 2 leader_uuid: "ba6fd2b98668427bb42cde3ad503803d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.149788 32634 leader_election.cc:290] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 2 election: Requested vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:29.150355 32634 raft_consensus.cc:493] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.150784 32634 raft_consensus.cc:515] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:29.151505 32471 leader_election.cc:304] T 225cfe1201f64d04846232f5b22ec651 P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba6fd2b98668427bb42cde3ad503803d; no voters: 3be0070ae46940d98553de245ef14d4b, 4a0201cedacd48c2abd9eb3e09ee0d92
I20260709 12:22:29.153231 32635 raft_consensus.cc:3060] T 225cfe1201f64d04846232f5b22ec651 P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:29.162060 32557 raft_consensus.cc:493] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3be0070ae46940d98553de245ef14d4b)
I20260709 12:22:29.162696 32557 raft_consensus.cc:515] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:29.163803 32635 raft_consensus.cc:2749] T 225cfe1201f64d04846232f5b22ec651 P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:29.164242 32397 leader_election.cc:336] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111)
I20260709 12:22:29.165241 32557 leader_election.cc:290] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471)
I20260709 12:22:29.166536 32634 leader_election.cc:290] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:29.168897 32431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b279692d87ed403dbcb22f1d366edcba" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" is_pre_election: true
I20260709 12:22:29.171658 32431 raft_consensus.cc:2468] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba6fd2b98668427bb42cde3ad503803d in term 1.
I20260709 12:22:29.172894 32638 raft_consensus.cc:493] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3be0070ae46940d98553de245ef14d4b)
I20260709 12:22:29.173434 32638 raft_consensus.cc:515] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
W20260709 12:22:29.173863 32471 leader_election.cc:336] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111)
I20260709 12:22:29.174901 32471 leader_election.cc:304] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0201cedacd48c2abd9eb3e09ee0d92, ba6fd2b98668427bb42cde3ad503803d; no voters: 3be0070ae46940d98553de245ef14d4b
W20260709 12:22:29.175690 32397 leader_election.cc:336] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111)
I20260709 12:22:29.175734 32638 leader_election.cc:290] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:29.178062 32504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b279692d87ed403dbcb22f1d366edcba" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d" is_pre_election: true
I20260709 12:22:29.178442 32507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225cfe1201f64d04846232f5b22ec651" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d"
I20260709 12:22:29.178088 32505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c87edb5fa542a794c3eab947086653" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d" is_pre_election: true
I20260709 12:22:29.180794 32505 raft_consensus.cc:2468] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0201cedacd48c2abd9eb3e09ee0d92 in term 1.
I20260709 12:22:29.175787 32557 raft_consensus.cc:2804] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:29.181797 32557 raft_consensus.cc:493] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3be0070ae46940d98553de245ef14d4b)
I20260709 12:22:29.182236 32557 raft_consensus.cc:3060] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:29.182286 32398 leader_election.cc:304] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0201cedacd48c2abd9eb3e09ee0d92, ba6fd2b98668427bb42cde3ad503803d; no voters: 3be0070ae46940d98553de245ef14d4b
I20260709 12:22:29.183673 32638 raft_consensus.cc:2804] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:29.184056 32638 raft_consensus.cc:493] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.184394 32638 raft_consensus.cc:3060] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:29.185580 32397 leader_election.cc:336] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111)
I20260709 12:22:29.188442 32507 raft_consensus.cc:2468] T 225cfe1201f64d04846232f5b22ec651 P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0201cedacd48c2abd9eb3e09ee0d92 in term 2.
I20260709 12:22:29.191545 32557 raft_consensus.cc:515] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:29.193341 32504 raft_consensus.cc:2393] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a0201cedacd48c2abd9eb3e09ee0d92 in current term 2: Already voted for candidate ba6fd2b98668427bb42cde3ad503803d in this term.
I20260709 12:22:29.193583 32398 leader_election.cc:304] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0201cedacd48c2abd9eb3e09ee0d92, ba6fd2b98668427bb42cde3ad503803d; no voters: 3be0070ae46940d98553de245ef14d4b
I20260709 12:22:29.194977 32634 raft_consensus.cc:2804] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:29.196651 32557 leader_election.cc:290] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 2 election: Requested vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471)
I20260709 12:22:29.196449 32398 leader_election.cc:304] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0201cedacd48c2abd9eb3e09ee0d92; no voters: 3be0070ae46940d98553de245ef14d4b, ba6fd2b98668427bb42cde3ad503803d
I20260709 12:22:29.201470 32431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b279692d87ed403dbcb22f1d366edcba" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
I20260709 12:22:29.202255 32431 raft_consensus.cc:3060] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:29.204447 32634 raft_consensus.cc:697] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 LEADER]: Becoming Leader. State: Replica: 4a0201cedacd48c2abd9eb3e09ee0d92, State: Running, Role: LEADER
W20260709 12:22:29.205881 32471 leader_election.cc:336] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111)
I20260709 12:22:29.205600 32634 consensus_queue.cc:237] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:29.200781 32638 raft_consensus.cc:515] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:29.209741 32504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c87edb5fa542a794c3eab947086653" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d"
I20260709 12:22:29.210423 32504 raft_consensus.cc:3060] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:29.213583 32638 leader_election.cc:290] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 2 election: Requested vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
W20260709 12:22:29.214572 32397 leader_election.cc:336] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111)
I20260709 12:22:29.216228 32431 raft_consensus.cc:2468] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6fd2b98668427bb42cde3ad503803d in term 2.
I20260709 12:22:29.217108 32643 raft_consensus.cc:2749] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:29.218730 32504 raft_consensus.cc:2468] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0201cedacd48c2abd9eb3e09ee0d92 in term 2.
I20260709 12:22:29.220170 32398 leader_election.cc:304] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0201cedacd48c2abd9eb3e09ee0d92, ba6fd2b98668427bb42cde3ad503803d; no voters: 3be0070ae46940d98553de245ef14d4b
I20260709 12:22:29.221103 32643 raft_consensus.cc:2804] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:29.221701 32643 raft_consensus.cc:697] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 LEADER]: Becoming Leader. State: Replica: 4a0201cedacd48c2abd9eb3e09ee0d92, State: Running, Role: LEADER
I20260709 12:22:29.222183 32255 catalog_manager.cc:5697] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 reported cstate change: term changed from 1 to 2, leader changed from 3be0070ae46940d98553de245ef14d4b (127.22.155.193) to 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194). New cstate: current_term: 2 leader_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.222616 32643 consensus_queue.cc:237] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:29.220877 32471 leader_election.cc:304] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0201cedacd48c2abd9eb3e09ee0d92, ba6fd2b98668427bb42cde3ad503803d; no voters: 3be0070ae46940d98553de245ef14d4b
I20260709 12:22:29.225936 32557 raft_consensus.cc:2804] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:29.226470 32557 raft_consensus.cc:697] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 2 LEADER]: Becoming Leader. State: Replica: ba6fd2b98668427bb42cde3ad503803d, State: Running, Role: LEADER
I20260709 12:22:29.227468 32557 consensus_queue.cc:237] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:29.236379 32255 catalog_manager.cc:5697] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d reported cstate change: term changed from 1 to 2, leader changed from 3be0070ae46940d98553de245ef14d4b (127.22.155.193) to ba6fd2b98668427bb42cde3ad503803d (127.22.155.195). New cstate: current_term: 2 leader_uuid: "ba6fd2b98668427bb42cde3ad503803d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:29.238303 32256 catalog_manager.cc:5697] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 reported cstate change: term changed from 1 to 2, leader changed from 3be0070ae46940d98553de245ef14d4b (127.22.155.193) to 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194). New cstate: current_term: 2 leader_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.278738 32643 raft_consensus.cc:493] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.279309 32643 raft_consensus.cc:515] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:29.281684 32643 leader_election.cc:290] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:29.282964 32504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef7d12ba5a45cab61fdc87dbc39117" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d" is_pre_election: true
I20260709 12:22:29.283862 32504 raft_consensus.cc:2468] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0201cedacd48c2abd9eb3e09ee0d92 in term 1.
W20260709 12:22:29.284839 32397 leader_election.cc:336] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111)
I20260709 12:22:29.285450 32398 leader_election.cc:304] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0201cedacd48c2abd9eb3e09ee0d92, ba6fd2b98668427bb42cde3ad503803d; no voters: 3be0070ae46940d98553de245ef14d4b
I20260709 12:22:29.286192 32643 raft_consensus.cc:2804] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:29.286528 32643 raft_consensus.cc:493] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.286851 32643 raft_consensus.cc:3060] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:29.293522 32643 raft_consensus.cc:515] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:29.295509 32643 leader_election.cc:290] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 2 election: Requested vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:29.296886 32504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef7d12ba5a45cab61fdc87dbc39117" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6fd2b98668427bb42cde3ad503803d"
I20260709 12:22:29.297516 32504 raft_consensus.cc:3060] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:29.299628 32397 leader_election.cc:336] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111)
I20260709 12:22:29.303925 32504 raft_consensus.cc:2468] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0201cedacd48c2abd9eb3e09ee0d92 in term 2.
I20260709 12:22:29.305418 32398 leader_election.cc:304] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0201cedacd48c2abd9eb3e09ee0d92, ba6fd2b98668427bb42cde3ad503803d; no voters: 3be0070ae46940d98553de245ef14d4b
I20260709 12:22:29.306375 32643 raft_consensus.cc:2804] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:29.306906 32643 raft_consensus.cc:697] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 LEADER]: Becoming Leader. State: Replica: 4a0201cedacd48c2abd9eb3e09ee0d92, State: Running, Role: LEADER
I20260709 12:22:29.307768 32643 consensus_queue.cc:237] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:29.316763 32256 catalog_manager.cc:5697] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 reported cstate change: term changed from 1 to 2, leader changed from 3be0070ae46940d98553de245ef14d4b (127.22.155.193) to 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194). New cstate: current_term: 2 leader_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.528548 32557 raft_consensus.cc:493] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.529280 32557 raft_consensus.cc:515] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:29.531339 32557 leader_election.cc:290] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471)
I20260709 12:22:29.533444 32431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda1105bad6e4f8daffc1141ab247524" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" is_pre_election: true
I20260709 12:22:29.534216 32431 raft_consensus.cc:2468] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba6fd2b98668427bb42cde3ad503803d in term 1.
I20260709 12:22:29.535296 32471 leader_election.cc:304] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0201cedacd48c2abd9eb3e09ee0d92, ba6fd2b98668427bb42cde3ad503803d; no voters: 
I20260709 12:22:29.535959 32557 raft_consensus.cc:2804] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:22:29.535960 32471 leader_election.cc:336] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111)
I20260709 12:22:29.536415 32557 raft_consensus.cc:493] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.536855 32557 raft_consensus.cc:3060] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:29.542884 32557 raft_consensus.cc:515] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:29.544764 32557 leader_election.cc:290] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 2 election: Requested vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471)
I20260709 12:22:29.546509 32431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda1105bad6e4f8daffc1141ab247524" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
I20260709 12:22:29.547202 32431 raft_consensus.cc:3060] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:29.548549 32471 leader_election.cc:336] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111)
I20260709 12:22:29.553025 32431 raft_consensus.cc:2468] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6fd2b98668427bb42cde3ad503803d in term 2.
I20260709 12:22:29.554114 32471 leader_election.cc:304] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0201cedacd48c2abd9eb3e09ee0d92, ba6fd2b98668427bb42cde3ad503803d; no voters: 3be0070ae46940d98553de245ef14d4b
I20260709 12:22:29.554883 32557 raft_consensus.cc:2804] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:29.555377 32557 raft_consensus.cc:697] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [term 2 LEADER]: Becoming Leader. State: Replica: ba6fd2b98668427bb42cde3ad503803d, State: Running, Role: LEADER
I20260709 12:22:29.556185 32557 consensus_queue.cc:237] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:29.564049 32256 catalog_manager.cc:5697] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d reported cstate change: term changed from 1 to 2, leader changed from 3be0070ae46940d98553de245ef14d4b (127.22.155.193) to ba6fd2b98668427bb42cde3ad503803d (127.22.155.195). New cstate: current_term: 2 leader_uuid: "ba6fd2b98668427bb42cde3ad503803d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:29.596375 32504 raft_consensus.cc:1275] T 225cfe1201f64d04846232f5b22ec651 P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Refusing update from remote peer 4a0201cedacd48c2abd9eb3e09ee0d92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:29.597832 32643 consensus_queue.cc:1048] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:29.612321 32397 consensus_peers.cc:597] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 -> Peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Couldn't send request to peer 3be0070ae46940d98553de245ef14d4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:29.617650 32471 consensus_peers.cc:597] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d -> Peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Couldn't send request to peer 3be0070ae46940d98553de245ef14d4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:29.675024 32504 raft_consensus.cc:1275] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Refusing update from remote peer 4a0201cedacd48c2abd9eb3e09ee0d92: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:22:29.676378 32634 consensus_queue.cc:1048] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:29.691573 32431 raft_consensus.cc:1275] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Refusing update from remote peer ba6fd2b98668427bb42cde3ad503803d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:29.693614 32557 consensus_queue.cc:1048] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:29.696373 32397 consensus_peers.cc:597] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 -> Peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Couldn't send request to peer 3be0070ae46940d98553de245ef14d4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:29.712935 32471 consensus_peers.cc:597] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d -> Peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Couldn't send request to peer 3be0070ae46940d98553de245ef14d4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:29.733068 32504 raft_consensus.cc:1275] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Refusing update from remote peer 4a0201cedacd48c2abd9eb3e09ee0d92: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:22:29.734565 32643 consensus_queue.cc:1048] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:22:29.749265 32397 consensus_peers.cc:597] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 -> Peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Couldn't send request to peer 3be0070ae46940d98553de245ef14d4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:29.823760 32431 raft_consensus.cc:1275] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Refusing update from remote peer ba6fd2b98668427bb42cde3ad503803d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:29.825325 32636 consensus_queue.cc:1048] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:29.945420 32471 consensus_peers.cc:597] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d -> Peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Couldn't send request to peer 3be0070ae46940d98553de245ef14d4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:29.993137 32304 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:22:29.994235 32431 raft_consensus.cc:1275] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Refusing update from remote peer ba6fd2b98668427bb42cde3ad503803d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:22:29.995553 32657 consensus_queue.cc:1048] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:22:30.056836 32471 consensus_peers.cc:597] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d -> Peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Couldn't send request to peer 3be0070ae46940d98553de245ef14d4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:30.208815 32471 consensus_peers.cc:597] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d -> Peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Couldn't send request to peer 3be0070ae46940d98553de245ef14d4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:30.354713 32397 consensus_peers.cc:597] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 -> Peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Couldn't send request to peer 3be0070ae46940d98553de245ef14d4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:30.452702 32471 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111) [suppressed 55 similar messages]
W20260709 12:22:30.558910 32397 consensus_peers.cc:597] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92 -> Peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Couldn't send request to peer 3be0070ae46940d98553de245ef14d4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:30.994333 32304 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:22:31.939356 32397 consensus_peers.cc:597] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 -> Peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Couldn't send request to peer 3be0070ae46940d98553de245ef14d4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:31.996001 32304 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:22:32.012667 32471 consensus_peers.cc:597] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d -> Peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Couldn't send request to peer 3be0070ae46940d98553de245ef14d4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:32.059475 32471 consensus_peers.cc:597] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d -> Peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Couldn't send request to peer 3be0070ae46940d98553de245ef14d4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:32.368960 32471 consensus_peers.cc:597] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d -> Peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Couldn't send request to peer 3be0070ae46940d98553de245ef14d4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:32.386940 32397 consensus_peers.cc:597] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 -> Peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Couldn't send request to peer 3be0070ae46940d98553de245ef14d4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:32.515407 32471 consensus_peers.cc:597] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d -> Peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Couldn't send request to peer 3be0070ae46940d98553de245ef14d4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:32.528860 32397 consensus_peers.cc:597] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 -> Peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Couldn't send request to peer 3be0070ae46940d98553de245ef14d4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:32.552371 32471 consensus_peers.cc:597] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d -> Peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Couldn't send request to peer 3be0070ae46940d98553de245ef14d4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:32.782682 32397 consensus_peers.cc:597] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 -> Peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Couldn't send request to peer 3be0070ae46940d98553de245ef14d4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:22:32.833413 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:32.843283 32664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:32.843344 32663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:32.846055 32666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:32.846395 23151 server_base.cc:1061] running on GCE node
I20260709 12:22:32.848266 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:32.848493 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:32.848711 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599752848689 us; error 0 us; skew 500 ppm
I20260709 12:22:32.849282 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:32.852521 23151 webserver.cc:533] Webserver started at http://127.22.155.193:39539/ using document root <none> and password file <none>
I20260709 12:22:32.853274 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:32.853446 23151 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:22:32.857810 23151 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.001s	sys 0.003s
I20260709 12:22:32.862452 32671 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:32.863508 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:22:32.863893 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599400258298-23151-0/minicluster-data/ts-0-root
uuid: "3be0070ae46940d98553de245ef14d4b"
format_stamp: "Formatted at 2026-07-09 12:22:26 on dist-test-slave-p7fg"
I20260709 12:22:32.864341 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599400258298-23151-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599400258298-23151-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599400258298-23151-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:32.879851 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:32.881275 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:32.882911 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:32.886984 32678 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:22:32.942586 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:22:32.942929 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.057s	user 0.001s	sys 0.002s
I20260709 12:22:32.943251 23151 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:22:32.949684 32678 tablet_bootstrap.cc:492] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b: Bootstrap starting.
I20260709 12:22:32.969219 32678 tablet_bootstrap.cc:492] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:32.970271 32678 tablet_bootstrap.cc:492] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b: Bootstrap complete.
I20260709 12:22:32.971000 32678 ts_tablet_manager.cc:1403] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.000s
I20260709 12:22:32.974501 32678 raft_consensus.cc:359] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:32.975618 32678 raft_consensus.cc:740] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be0070ae46940d98553de245ef14d4b, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.976470 32678 consensus_queue.cc:260] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:32.980019 32678 ts_tablet_manager.cc:1434] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:22:32.981037 32678 tablet_bootstrap.cc:492] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b: Bootstrap starting.
W20260709 12:22:32.997470 32304 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:22:33.000020 32678 tablet_bootstrap.cc:492] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:22:33.000934 32678 tablet_bootstrap.cc:492] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b: Bootstrap complete.
I20260709 12:22:33.001525 32678 ts_tablet_manager.cc:1403] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.012s
I20260709 12:22:33.003949 32678 raft_consensus.cc:359] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:33.004755 32678 raft_consensus.cc:740] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be0070ae46940d98553de245ef14d4b, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.005440 32678 consensus_queue.cc:260] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:33.007114 32678 ts_tablet_manager.cc:1434] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:22:33.007700 23151 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:22:33.007958 32678 tablet_bootstrap.cc:492] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b: Bootstrap starting.
I20260709 12:22:33.008008 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.065s	user 0.057s	sys 0.008s
I20260709 12:22:33.023893 32678 tablet_bootstrap.cc:492] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:33.024904 32678 tablet_bootstrap.cc:492] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b: Bootstrap complete.
I20260709 12:22:33.025478 32678 ts_tablet_manager.cc:1403] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 12:22:33.027729 32678 raft_consensus.cc:359] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } }
I20260709 12:22:33.028316 32678 raft_consensus.cc:740] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be0070ae46940d98553de245ef14d4b, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.029126 32678 consensus_queue.cc:260] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } }
I20260709 12:22:33.031243 32678 ts_tablet_manager.cc:1434] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:22:33.031965 32678 tablet_bootstrap.cc:492] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b: Bootstrap starting.
I20260709 12:22:33.043957 32678 tablet_bootstrap.cc:492] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:22:33.045112 32678 tablet_bootstrap.cc:492] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b: Bootstrap complete.
I20260709 12:22:33.045655 32678 ts_tablet_manager.cc:1403] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.007s
I20260709 12:22:33.047581 32678 raft_consensus.cc:359] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:33.049794 32678 raft_consensus.cc:740] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be0070ae46940d98553de245ef14d4b, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.050618 32678 consensus_queue.cc:260] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:33.052542 32678 ts_tablet_manager.cc:1434] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 12:22:33.053850 32678 tablet_bootstrap.cc:492] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b: Bootstrap starting.
I20260709 12:22:33.067211 32678 tablet_bootstrap.cc:492] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:33.068384 32678 tablet_bootstrap.cc:492] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b: Bootstrap complete.
I20260709 12:22:33.069181 32678 ts_tablet_manager.cc:1403] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 12:22:33.071866 32678 raft_consensus.cc:359] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:33.072472 32678 raft_consensus.cc:740] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be0070ae46940d98553de245ef14d4b, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.073160 32678 consensus_queue.cc:260] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:33.075294 32678 ts_tablet_manager.cc:1434] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:22:33.075990 32678 tablet_bootstrap.cc:492] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b: Bootstrap starting.
I20260709 12:22:33.087460 32678 tablet_bootstrap.cc:492] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:33.088158 32678 tablet_bootstrap.cc:492] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b: Bootstrap complete.
I20260709 12:22:33.088549 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.193:46069
I20260709 12:22:33.088708 32741 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.193:46069 every 8 connection(s)
I20260709 12:22:33.088867 32678 ts_tablet_manager.cc:1403] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.006s
I20260709 12:22:33.091444 32678 raft_consensus.cc:359] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:33.091965 32678 raft_consensus.cc:740] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be0070ae46940d98553de245ef14d4b, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.092731 32678 consensus_queue.cc:260] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:33.094679 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:33.094895 32678 ts_tablet_manager.cc:1434] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.001s
I20260709 12:22:33.096016 32678 tablet_bootstrap.cc:492] T 1feae880171f4a4997bc3da8d9aa6460 P 3be0070ae46940d98553de245ef14d4b: Bootstrap starting.
I20260709 12:22:33.121794 32678 tablet_bootstrap.cc:492] T 1feae880171f4a4997bc3da8d9aa6460 P 3be0070ae46940d98553de245ef14d4b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:33.122756 32678 tablet_bootstrap.cc:492] T 1feae880171f4a4997bc3da8d9aa6460 P 3be0070ae46940d98553de245ef14d4b: Bootstrap complete.
I20260709 12:22:33.123454 32678 ts_tablet_manager.cc:1403] T 1feae880171f4a4997bc3da8d9aa6460 P 3be0070ae46940d98553de245ef14d4b: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.012s
I20260709 12:22:33.125721 32678 raft_consensus.cc:359] T 1feae880171f4a4997bc3da8d9aa6460 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:33.126251 32678 raft_consensus.cc:740] T 1feae880171f4a4997bc3da8d9aa6460 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be0070ae46940d98553de245ef14d4b, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.127009 32678 consensus_queue.cc:260] T 1feae880171f4a4997bc3da8d9aa6460 P 3be0070ae46940d98553de245ef14d4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:33.129007 32678 ts_tablet_manager.cc:1434] T 1feae880171f4a4997bc3da8d9aa6460 P 3be0070ae46940d98553de245ef14d4b: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:22:33.129957 32678 tablet_bootstrap.cc:492] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b: Bootstrap starting.
I20260709 12:22:33.132104 32742 heartbeater.cc:344] Connected to a master server at 127.22.155.254:45051
I20260709 12:22:33.132745 32742 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:33.132534 32504 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bda1105bad6e4f8daffc1141ab247524"
dest_uuid: "ba6fd2b98668427bb42cde3ad503803d"
mode: GRACEFUL
new_leader_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
 from {username='slave'} at 127.0.0.1:35788
I20260709 12:22:33.133354 32504 raft_consensus.cc:606] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [term 2 LEADER]: Received request to transfer leadership to TS 4a0201cedacd48c2abd9eb3e09ee0d92
I20260709 12:22:33.133882 32742 heartbeater.cc:507] Master 127.22.155.254:45051 requested a full tablet report, sending...
I20260709 12:22:33.142159 32255 ts_manager.cc:194] Re-registered known tserver with Master: 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069)
I20260709 12:22:33.151122 32431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3ef7d12ba5a45cab61fdc87dbc39117"
dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
mode: GRACEFUL
new_leader_uuid: "ba6fd2b98668427bb42cde3ad503803d"
 from {username='slave'} at 127.0.0.1:55018
I20260709 12:22:33.151942 32431 raft_consensus.cc:606] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 LEADER]: Received request to transfer leadership to TS ba6fd2b98668427bb42cde3ad503803d
I20260709 12:22:33.154202 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:33.155012 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:33.155536 32255 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35876
I20260709 12:22:33.155961 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:33.161046 32742 heartbeater.cc:499] Master 127.22.155.254:45051 was elected leader, sending a full tablet report...
I20260709 12:22:33.162467 32678 tablet_bootstrap.cc:492] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:33.163437 32678 tablet_bootstrap.cc:492] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b: Bootstrap complete.
I20260709 12:22:33.164218 32678 ts_tablet_manager.cc:1403] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.008s
I20260709 12:22:33.169029 32678 raft_consensus.cc:359] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:33.169976 32678 raft_consensus.cc:740] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be0070ae46940d98553de245ef14d4b, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.171044 32678 consensus_queue.cc:260] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:33.175949 32678 ts_tablet_manager.cc:1434] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:22:33.176934 32678 tablet_bootstrap.cc:492] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b: Bootstrap starting.
I20260709 12:22:33.186049 32638 raft_consensus.cc:993] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92: : Instructing follower ba6fd2b98668427bb42cde3ad503803d to start an election
I20260709 12:22:33.186620 32638 raft_consensus.cc:1081] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 LEADER]: Signalling peer ba6fd2b98668427bb42cde3ad503803d to start an election
I20260709 12:22:33.188700 32504 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3ef7d12ba5a45cab61fdc87dbc39117"
dest_uuid: "ba6fd2b98668427bb42cde3ad503803d"
 from {username='slave'} at 127.0.0.1:54976
I20260709 12:22:33.189366 32504 raft_consensus.cc:493] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:33.189777 32504 raft_consensus.cc:3060] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.195596 32678 tablet_bootstrap.cc:492] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:22:33.196700 32678 tablet_bootstrap.cc:492] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b: Bootstrap complete.
I20260709 12:22:33.197451 32678 ts_tablet_manager.cc:1403] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.000s
I20260709 12:22:33.200088 32678 raft_consensus.cc:359] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:33.200980 32678 raft_consensus.cc:740] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be0070ae46940d98553de245ef14d4b, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.200664 32504 raft_consensus.cc:515] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:33.201785 32678 consensus_queue.cc:260] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:33.203078 32504 leader_election.cc:290] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 3 election: Requested vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471)
I20260709 12:22:33.204083 32678 ts_tablet_manager.cc:1434] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:22:33.204488 32431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef7d12ba5a45cab61fdc87dbc39117" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
I20260709 12:22:33.205132 32678 tablet_bootstrap.cc:492] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b: Bootstrap starting.
I20260709 12:22:33.205520 32431 raft_consensus.cc:3055] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:33.205885 32431 raft_consensus.cc:740] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a0201cedacd48c2abd9eb3e09ee0d92, State: Running, Role: LEADER
I20260709 12:22:33.206897 32431 consensus_queue.cc:260] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:33.208045 32431 raft_consensus.cc:3060] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.211256 32715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef7d12ba5a45cab61fdc87dbc39117" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "3be0070ae46940d98553de245ef14d4b"
I20260709 12:22:33.212073 32715 raft_consensus.cc:3060] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.218565 32431 raft_consensus.cc:2468] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6fd2b98668427bb42cde3ad503803d in term 3.
I20260709 12:22:33.220460 32471 leader_election.cc:304] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0201cedacd48c2abd9eb3e09ee0d92, ba6fd2b98668427bb42cde3ad503803d; no voters: 
I20260709 12:22:33.221727 32660 raft_consensus.cc:2804] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:33.222636 32715 raft_consensus.cc:2468] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6fd2b98668427bb42cde3ad503803d in term 3.
I20260709 12:22:33.223356 32660 raft_consensus.cc:697] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 3 LEADER]: Becoming Leader. State: Replica: ba6fd2b98668427bb42cde3ad503803d, State: Running, Role: LEADER
I20260709 12:22:33.224705 32660 consensus_queue.cc:237] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:33.225795 32678 tablet_bootstrap.cc:492] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:22:33.226734 32678 tablet_bootstrap.cc:492] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b: Bootstrap complete.
I20260709 12:22:33.227294 32678 ts_tablet_manager.cc:1403] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 12:22:33.229961 32678 raft_consensus.cc:359] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:33.230813 32678 raft_consensus.cc:740] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be0070ae46940d98553de245ef14d4b, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.231500 32678 consensus_queue.cc:260] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:33.233074 32678 ts_tablet_manager.cc:1434] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:22:33.234314 32255 catalog_manager.cc:5697] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d reported cstate change: term changed from 2 to 3, leader changed from 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194) to ba6fd2b98668427bb42cde3ad503803d (127.22.155.195). New cstate: current_term: 3 leader_uuid: "ba6fd2b98668427bb42cde3ad503803d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:33.239825 32660 raft_consensus.cc:993] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d: : Instructing follower 4a0201cedacd48c2abd9eb3e09ee0d92 to start an election
I20260709 12:22:33.240428 32660 raft_consensus.cc:1081] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [term 2 LEADER]: Signalling peer 4a0201cedacd48c2abd9eb3e09ee0d92 to start an election
I20260709 12:22:33.242632 32431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bda1105bad6e4f8daffc1141ab247524"
dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
 from {username='slave'} at 127.0.0.1:57474
I20260709 12:22:33.243461 32431 raft_consensus.cc:493] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:33.243945 32431 raft_consensus.cc:3060] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.253954 32431 raft_consensus.cc:515] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:33.255993 32431 leader_election.cc:290] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 3 election: Requested vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:33.257040 32715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda1105bad6e4f8daffc1141ab247524" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "3be0070ae46940d98553de245ef14d4b"
I20260709 12:22:33.257441 32504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda1105bad6e4f8daffc1141ab247524" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "ba6fd2b98668427bb42cde3ad503803d"
I20260709 12:22:33.257867 32715 raft_consensus.cc:3060] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.258116 32504 raft_consensus.cc:3055] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:33.258565 32504 raft_consensus.cc:740] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ba6fd2b98668427bb42cde3ad503803d, State: Running, Role: LEADER
I20260709 12:22:33.259516 32504 consensus_queue.cc:260] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:33.260712 32504 raft_consensus.cc:3060] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.264896 32715 raft_consensus.cc:2468] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0201cedacd48c2abd9eb3e09ee0d92 in term 3.
I20260709 12:22:33.266330 32397 leader_election.cc:304] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b, 4a0201cedacd48c2abd9eb3e09ee0d92; no voters: 
I20260709 12:22:33.267400 32662 raft_consensus.cc:2804] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:33.267724 32504 raft_consensus.cc:2468] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0201cedacd48c2abd9eb3e09ee0d92 in term 3.
I20260709 12:22:33.267999 32662 raft_consensus.cc:697] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 3 LEADER]: Becoming Leader. State: Replica: 4a0201cedacd48c2abd9eb3e09ee0d92, State: Running, Role: LEADER
I20260709 12:22:33.269685 32662 consensus_queue.cc:237] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:33.277649 32255 catalog_manager.cc:5697] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92 reported cstate change: term changed from 2 to 3, leader changed from ba6fd2b98668427bb42cde3ad503803d (127.22.155.195) to 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194). New cstate: current_term: 3 leader_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:33.373021 32715 raft_consensus.cc:3060] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.512068 32715 raft_consensus.cc:3060] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.555025 32715 raft_consensus.cc:3060] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.602967 32715 raft_consensus.cc:3060] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.609118 32715 pending_rounds.cc:85] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b: Aborting all ops after (but not including) 0
I20260709 12:22:33.609359 32715 pending_rounds.cc:107] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:22:33.609702 32715 raft_consensus.cc:2889] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:33.673286 32715 raft_consensus.cc:1275] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 3 FOLLOWER]: Refusing update from remote peer ba6fd2b98668427bb42cde3ad503803d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:33.674754 32660 consensus_queue.cc:1048] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:33.675318 32660 consensus_queue.cc:1243] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [LEADER]: Peer 3be0070ae46940d98553de245ef14d4b log is divergent from this leader: its last log entry 1.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:22:33.678140 32715 pending_rounds.cc:85] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b: Aborting all ops after (but not including) 0
I20260709 12:22:33.678481 32715 pending_rounds.cc:107] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:22:33.678719 32715 raft_consensus.cc:2889] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:33.688040 32431 raft_consensus.cc:1275] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 3 FOLLOWER]: Refusing update from remote peer ba6fd2b98668427bb42cde3ad503803d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:33.690181 32660 consensus_queue.cc:1048] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:33.745026 32715 raft_consensus.cc:1275] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [term 3 FOLLOWER]: Refusing update from remote peer 4a0201cedacd48c2abd9eb3e09ee0d92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:33.746572   302 consensus_queue.cc:1048] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:33.747108   302 consensus_queue.cc:1243] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92 [LEADER]: Peer 3be0070ae46940d98553de245ef14d4b log is divergent from this leader: its last log entry 1.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:22:33.749250 32715 pending_rounds.cc:85] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b: Aborting all ops after (but not including) 0
I20260709 12:22:33.749603 32715 pending_rounds.cc:107] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:22:33.749903 32715 raft_consensus.cc:2889] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:33.758548 32504 raft_consensus.cc:1275] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [term 3 FOLLOWER]: Refusing update from remote peer 4a0201cedacd48c2abd9eb3e09ee0d92: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:33.760321 32638 consensus_queue.cc:1048] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:22:33.998660 32304 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:22:34.167800 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:34.179282 32507 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20c26312d2694b5980a2f78bfdc472fe"
dest_uuid: "ba6fd2b98668427bb42cde3ad503803d"
mode: GRACEFUL
new_leader_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
 from {username='slave'} at 127.0.0.1:35788
I20260709 12:22:34.179941 32507 raft_consensus.cc:606] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [term 2 LEADER]: Received request to transfer leadership to TS 4a0201cedacd48c2abd9eb3e09ee0d92
I20260709 12:22:34.182886 32431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37c87edb5fa542a794c3eab947086653"
dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
mode: GRACEFUL
new_leader_uuid: "ba6fd2b98668427bb42cde3ad503803d"
 from {username='slave'} at 127.0.0.1:55018
I20260709 12:22:34.183468 32431 raft_consensus.cc:606] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 LEADER]: Received request to transfer leadership to TS ba6fd2b98668427bb42cde3ad503803d
I20260709 12:22:34.184832 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:34.185408 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:34.186075 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:34.415648 32755 raft_consensus.cc:993] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d: : Instructing follower 4a0201cedacd48c2abd9eb3e09ee0d92 to start an election
I20260709 12:22:34.416301   309 raft_consensus.cc:1081] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [term 2 LEADER]: Signalling peer 4a0201cedacd48c2abd9eb3e09ee0d92 to start an election
I20260709 12:22:34.418116 32431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20c26312d2694b5980a2f78bfdc472fe"
dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
 from {username='slave'} at 127.0.0.1:57474
I20260709 12:22:34.418638 32431 raft_consensus.cc:493] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:34.418941 32431 raft_consensus.cc:3060] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:34.424396 32431 raft_consensus.cc:515] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } }
I20260709 12:22:34.426115 32431 leader_election.cc:290] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 3 election: Requested vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:34.427227 32715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c26312d2694b5980a2f78bfdc472fe" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3be0070ae46940d98553de245ef14d4b"
I20260709 12:22:34.427395 32507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c26312d2694b5980a2f78bfdc472fe" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba6fd2b98668427bb42cde3ad503803d"
I20260709 12:22:34.427994 32715 raft_consensus.cc:3060] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:34.428021 32507 raft_consensus.cc:3055] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:34.428659 32507 raft_consensus.cc:740] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ba6fd2b98668427bb42cde3ad503803d, State: Running, Role: LEADER
I20260709 12:22:34.429637 32507 consensus_queue.cc:260] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } }
I20260709 12:22:34.430992 32507 raft_consensus.cc:3060] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:34.437651 32715 raft_consensus.cc:2468] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0201cedacd48c2abd9eb3e09ee0d92 in term 3.
I20260709 12:22:34.439088 32397 leader_election.cc:304] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b, 4a0201cedacd48c2abd9eb3e09ee0d92; no voters: 
I20260709 12:22:34.439203 32507 raft_consensus.cc:2468] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0201cedacd48c2abd9eb3e09ee0d92 in term 3.
I20260709 12:22:34.440092 32662 raft_consensus.cc:2804] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:34.440690 32662 raft_consensus.cc:697] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 3 LEADER]: Becoming Leader. State: Replica: 4a0201cedacd48c2abd9eb3e09ee0d92, State: Running, Role: LEADER
I20260709 12:22:34.441558 32662 consensus_queue.cc:237] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } }
I20260709 12:22:34.450091 32256 catalog_manager.cc:5697] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 reported cstate change: term changed from 2 to 3, leader changed from ba6fd2b98668427bb42cde3ad503803d (127.22.155.195) to 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194). New cstate: current_term: 3 leader_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:34.532661 32638 raft_consensus.cc:993] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92: : Instructing follower ba6fd2b98668427bb42cde3ad503803d to start an election
I20260709 12:22:34.533166 32662 raft_consensus.cc:1081] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 LEADER]: Signalling peer ba6fd2b98668427bb42cde3ad503803d to start an election
I20260709 12:22:34.534843 32507 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37c87edb5fa542a794c3eab947086653"
dest_uuid: "ba6fd2b98668427bb42cde3ad503803d"
 from {username='slave'} at 127.0.0.1:54976
I20260709 12:22:34.535421 32507 raft_consensus.cc:493] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:34.535765 32507 raft_consensus.cc:3060] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:34.541179 32507 raft_consensus.cc:515] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:34.542834 32507 leader_election.cc:290] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 3 election: Requested vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471)
I20260709 12:22:34.543870 32715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c87edb5fa542a794c3eab947086653" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "3be0070ae46940d98553de245ef14d4b"
I20260709 12:22:34.544553 32715 raft_consensus.cc:3060] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:34.544409 32431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c87edb5fa542a794c3eab947086653" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
I20260709 12:22:34.545467 32431 raft_consensus.cc:3055] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:34.545735 32431 raft_consensus.cc:740] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a0201cedacd48c2abd9eb3e09ee0d92, State: Running, Role: LEADER
I20260709 12:22:34.546504 32431 consensus_queue.cc:260] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:34.547539 32431 raft_consensus.cc:3060] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:34.550705 32715 raft_consensus.cc:2468] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6fd2b98668427bb42cde3ad503803d in term 3.
I20260709 12:22:34.551961 32471 leader_election.cc:304] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b, ba6fd2b98668427bb42cde3ad503803d; no voters: 
I20260709 12:22:34.552729   309 raft_consensus.cc:2804] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:34.553256   309 raft_consensus.cc:697] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d [term 3 LEADER]: Becoming Leader. State: Replica: ba6fd2b98668427bb42cde3ad503803d, State: Running, Role: LEADER
I20260709 12:22:34.553966 32431 raft_consensus.cc:2468] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6fd2b98668427bb42cde3ad503803d in term 3.
I20260709 12:22:34.554276   309 consensus_queue.cc:237] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:34.562350 32256 catalog_manager.cc:5697] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d reported cstate change: term changed from 2 to 3, leader changed from 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194) to ba6fd2b98668427bb42cde3ad503803d (127.22.155.195). New cstate: current_term: 3 leader_uuid: "ba6fd2b98668427bb42cde3ad503803d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:34.920400 32507 raft_consensus.cc:1275] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [term 3 FOLLOWER]: Refusing update from remote peer 4a0201cedacd48c2abd9eb3e09ee0d92: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:34.922016 32662 consensus_queue.cc:1048] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:34.935544 32715 raft_consensus.cc:1275] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [term 3 FOLLOWER]: Refusing update from remote peer 4a0201cedacd48c2abd9eb3e09ee0d92: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:34.937292 32662 consensus_queue.cc:1048] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:34.970005 32715 raft_consensus.cc:1275] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [term 3 FOLLOWER]: Refusing update from remote peer ba6fd2b98668427bb42cde3ad503803d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:34.971688   309 consensus_queue.cc:1048] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:34.983537 32431 raft_consensus.cc:1275] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 3 FOLLOWER]: Refusing update from remote peer ba6fd2b98668427bb42cde3ad503803d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:34.985486   324 consensus_queue.cc:1048] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:34.999711 32304 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:22:35.193311 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:35.201498 32431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6454a4189fd24aabb3b216a8884e5422"
dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
mode: GRACEFUL
new_leader_uuid: "ba6fd2b98668427bb42cde3ad503803d"
 from {username='slave'} at 127.0.0.1:55018
I20260709 12:22:35.202075 32431 raft_consensus.cc:606] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 LEADER]: Received request to transfer leadership to TS ba6fd2b98668427bb42cde3ad503803d
I20260709 12:22:35.204702 32507 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b279692d87ed403dbcb22f1d366edcba"
dest_uuid: "ba6fd2b98668427bb42cde3ad503803d"
mode: GRACEFUL
new_leader_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
 from {username='slave'} at 127.0.0.1:35788
I20260709 12:22:35.205207 32507 raft_consensus.cc:606] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 2 LEADER]: Received request to transfer leadership to TS 4a0201cedacd48c2abd9eb3e09ee0d92
I20260709 12:22:35.206378 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:35.206875 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:35.207440 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:35.229313   309 raft_consensus.cc:993] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d: : Instructing follower 4a0201cedacd48c2abd9eb3e09ee0d92 to start an election
I20260709 12:22:35.229944   324 raft_consensus.cc:1081] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 2 LEADER]: Signalling peer 4a0201cedacd48c2abd9eb3e09ee0d92 to start an election
I20260709 12:22:35.231977 32431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b279692d87ed403dbcb22f1d366edcba"
dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
 from {username='slave'} at 127.0.0.1:57474
I20260709 12:22:35.232523 32431 raft_consensus.cc:493] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:35.232857 32431 raft_consensus.cc:3060] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:35.238023 32431 raft_consensus.cc:515] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:35.239871 32431 leader_election.cc:290] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 3 election: Requested vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:35.241138 32507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b279692d87ed403dbcb22f1d366edcba" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba6fd2b98668427bb42cde3ad503803d"
I20260709 12:22:35.241042 32715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b279692d87ed403dbcb22f1d366edcba" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3be0070ae46940d98553de245ef14d4b"
I20260709 12:22:35.242224 32507 raft_consensus.cc:3055] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:35.242235 32715 raft_consensus.cc:3060] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:35.242847 32507 raft_consensus.cc:740] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ba6fd2b98668427bb42cde3ad503803d, State: Running, Role: LEADER
I20260709 12:22:35.243964 32507 consensus_queue.cc:260] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:35.245510 32507 raft_consensus.cc:3060] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:35.251978 32715 raft_consensus.cc:2468] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0201cedacd48c2abd9eb3e09ee0d92 in term 3.
I20260709 12:22:35.253652 32397 leader_election.cc:304] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b, 4a0201cedacd48c2abd9eb3e09ee0d92; no voters: 
I20260709 12:22:35.254271 32507 raft_consensus.cc:2468] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0201cedacd48c2abd9eb3e09ee0d92 in term 3.
I20260709 12:22:35.254657 32662 raft_consensus.cc:2804] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:35.255224 32662 raft_consensus.cc:697] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 3 LEADER]: Becoming Leader. State: Replica: 4a0201cedacd48c2abd9eb3e09ee0d92, State: Running, Role: LEADER
I20260709 12:22:35.256330 32662 consensus_queue.cc:237] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:35.264267 32256 catalog_manager.cc:5697] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 reported cstate change: term changed from 2 to 3, leader changed from ba6fd2b98668427bb42cde3ad503803d (127.22.155.195) to 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194). New cstate: current_term: 3 leader_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:35.645467 32662 raft_consensus.cc:993] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92: : Instructing follower ba6fd2b98668427bb42cde3ad503803d to start an election
I20260709 12:22:35.646014 32638 raft_consensus.cc:1081] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 LEADER]: Signalling peer ba6fd2b98668427bb42cde3ad503803d to start an election
I20260709 12:22:35.647876 32507 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6454a4189fd24aabb3b216a8884e5422"
dest_uuid: "ba6fd2b98668427bb42cde3ad503803d"
 from {username='slave'} at 127.0.0.1:54976
I20260709 12:22:35.648522 32507 raft_consensus.cc:493] T 6454a4189fd24aabb3b216a8884e5422 P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:35.648954 32507 raft_consensus.cc:3060] T 6454a4189fd24aabb3b216a8884e5422 P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:35.655467 32507 raft_consensus.cc:515] T 6454a4189fd24aabb3b216a8884e5422 P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:35.657491 32507 leader_election.cc:290] T 6454a4189fd24aabb3b216a8884e5422 P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 2 election: Requested vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471)
I20260709 12:22:35.658288 32715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6454a4189fd24aabb3b216a8884e5422" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3be0070ae46940d98553de245ef14d4b"
I20260709 12:22:35.659011 32431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6454a4189fd24aabb3b216a8884e5422" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
I20260709 12:22:35.659075 32715 raft_consensus.cc:3060] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:35.659797 32431 raft_consensus.cc:3055] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:35.660148 32431 raft_consensus.cc:740] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a0201cedacd48c2abd9eb3e09ee0d92, State: Running, Role: LEADER
I20260709 12:22:35.661357 32431 consensus_queue.cc:260] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:35.662791 32431 raft_consensus.cc:3060] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:35.668319 32715 raft_consensus.cc:2468] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6fd2b98668427bb42cde3ad503803d in term 2.
I20260709 12:22:35.670080 32471 leader_election.cc:304] T 6454a4189fd24aabb3b216a8884e5422 P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b, ba6fd2b98668427bb42cde3ad503803d; no voters: 
I20260709 12:22:35.671113   309 raft_consensus.cc:2804] T 6454a4189fd24aabb3b216a8884e5422 P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:35.671600   309 raft_consensus.cc:697] T 6454a4189fd24aabb3b216a8884e5422 P ba6fd2b98668427bb42cde3ad503803d [term 2 LEADER]: Becoming Leader. State: Replica: ba6fd2b98668427bb42cde3ad503803d, State: Running, Role: LEADER
I20260709 12:22:35.671506 32431 raft_consensus.cc:2468] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6fd2b98668427bb42cde3ad503803d in term 2.
I20260709 12:22:35.672972   309 consensus_queue.cc:237] T 6454a4189fd24aabb3b216a8884e5422 P ba6fd2b98668427bb42cde3ad503803d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:35.682173 32256 catalog_manager.cc:5697] T 6454a4189fd24aabb3b216a8884e5422 P ba6fd2b98668427bb42cde3ad503803d reported cstate change: term changed from 1 to 2, leader changed from 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194) to ba6fd2b98668427bb42cde3ad503803d (127.22.155.195). New cstate: current_term: 2 leader_uuid: "ba6fd2b98668427bb42cde3ad503803d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:35.782806 32714 raft_consensus.cc:1275] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [term 3 FOLLOWER]: Refusing update from remote peer 4a0201cedacd48c2abd9eb3e09ee0d92: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:35.784446 32638 consensus_queue.cc:1048] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:35.797152 32507 raft_consensus.cc:1275] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 3 FOLLOWER]: Refusing update from remote peer 4a0201cedacd48c2abd9eb3e09ee0d92: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:35.799139   318 consensus_queue.cc:1048] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:22:36.001049 32304 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:22:36.213758 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:36.221650 32431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b279692d87ed403dbcb22f1d366edcba"
dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
mode: GRACEFUL
new_leader_uuid: "ba6fd2b98668427bb42cde3ad503803d"
 from {username='slave'} at 127.0.0.1:55018
I20260709 12:22:36.222332 32431 raft_consensus.cc:606] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 3 LEADER]: Received request to transfer leadership to TS ba6fd2b98668427bb42cde3ad503803d
I20260709 12:22:36.225425 32507 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3ef7d12ba5a45cab61fdc87dbc39117"
dest_uuid: "ba6fd2b98668427bb42cde3ad503803d"
mode: GRACEFUL
new_leader_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
 from {username='slave'} at 127.0.0.1:35788
I20260709 12:22:36.226001 32507 raft_consensus.cc:606] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 3 LEADER]: Received request to transfer leadership to TS 4a0201cedacd48c2abd9eb3e09ee0d92
I20260709 12:22:36.227316 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:36.227955 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:36.228693 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:36.230206 32715 raft_consensus.cc:1275] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b [term 2 FOLLOWER]: Refusing update from remote peer ba6fd2b98668427bb42cde3ad503803d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:36.231782   309 consensus_queue.cc:1048] T 6454a4189fd24aabb3b216a8884e5422 P ba6fd2b98668427bb42cde3ad503803d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:36.243039 32431 raft_consensus.cc:1275] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Refusing update from remote peer ba6fd2b98668427bb42cde3ad503803d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:36.245261   309 consensus_queue.cc:1048] T 6454a4189fd24aabb3b216a8884e5422 P ba6fd2b98668427bb42cde3ad503803d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:36.269686 32662 raft_consensus.cc:993] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92: : Instructing follower ba6fd2b98668427bb42cde3ad503803d to start an election
I20260709 12:22:36.270375 32638 raft_consensus.cc:1081] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 3 LEADER]: Signalling peer ba6fd2b98668427bb42cde3ad503803d to start an election
I20260709 12:22:36.272596 32507 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b279692d87ed403dbcb22f1d366edcba"
dest_uuid: "ba6fd2b98668427bb42cde3ad503803d"
 from {username='slave'} at 127.0.0.1:54976
I20260709 12:22:36.273411 32507 raft_consensus.cc:493] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:36.273741 32507 raft_consensus.cc:3060] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:36.279901 32507 raft_consensus.cc:515] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:36.281731 32507 leader_election.cc:290] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 4 election: Requested vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471)
I20260709 12:22:36.282862 32715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b279692d87ed403dbcb22f1d366edcba" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3be0070ae46940d98553de245ef14d4b"
I20260709 12:22:36.283146 32431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b279692d87ed403dbcb22f1d366edcba" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
I20260709 12:22:36.283596 32715 raft_consensus.cc:3060] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:36.283931 32431 raft_consensus.cc:3055] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:36.284272 32431 raft_consensus.cc:740] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4a0201cedacd48c2abd9eb3e09ee0d92, State: Running, Role: LEADER
I20260709 12:22:36.285035 32431 consensus_queue.cc:260] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:36.285998 32431 raft_consensus.cc:3060] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:36.289531 32715 raft_consensus.cc:2468] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6fd2b98668427bb42cde3ad503803d in term 4.
I20260709 12:22:36.290809 32471 leader_election.cc:304] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b, ba6fd2b98668427bb42cde3ad503803d; no voters: 
I20260709 12:22:36.291569   309 raft_consensus.cc:2804] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:36.292093   309 raft_consensus.cc:697] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 4 LEADER]: Becoming Leader. State: Replica: ba6fd2b98668427bb42cde3ad503803d, State: Running, Role: LEADER
I20260709 12:22:36.293107   309 consensus_queue.cc:237] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:36.293552 32431 raft_consensus.cc:2468] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6fd2b98668427bb42cde3ad503803d in term 4.
I20260709 12:22:36.299721   309 raft_consensus.cc:993] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d: : Instructing follower 4a0201cedacd48c2abd9eb3e09ee0d92 to start an election
I20260709 12:22:36.300381   339 raft_consensus.cc:1081] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 3 LEADER]: Signalling peer 4a0201cedacd48c2abd9eb3e09ee0d92 to start an election
I20260709 12:22:36.302294 32431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3ef7d12ba5a45cab61fdc87dbc39117"
dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
 from {username='slave'} at 127.0.0.1:57474
I20260709 12:22:36.302949 32431 raft_consensus.cc:493] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:36.303364 32431 raft_consensus.cc:3060] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:36.302531 32255 catalog_manager.cc:5697] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d reported cstate change: term changed from 3 to 4, leader changed from 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194) to ba6fd2b98668427bb42cde3ad503803d (127.22.155.195). New cstate: current_term: 4 leader_uuid: "ba6fd2b98668427bb42cde3ad503803d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:36.310631 32431 raft_consensus.cc:515] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:36.313084 32431 leader_election.cc:290] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 4 election: Requested vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:36.314168 32714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef7d12ba5a45cab61fdc87dbc39117" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "3be0070ae46940d98553de245ef14d4b"
I20260709 12:22:36.315021 32714 raft_consensus.cc:3060] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:36.316731 32507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef7d12ba5a45cab61fdc87dbc39117" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ba6fd2b98668427bb42cde3ad503803d"
I20260709 12:22:36.317487 32507 raft_consensus.cc:3055] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:36.317870 32507 raft_consensus.cc:740] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ba6fd2b98668427bb42cde3ad503803d, State: Running, Role: LEADER
I20260709 12:22:36.318691 32507 consensus_queue.cc:260] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:36.319751 32507 raft_consensus.cc:3060] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:36.322515 32714 raft_consensus.cc:2468] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0201cedacd48c2abd9eb3e09ee0d92 in term 4.
I20260709 12:22:36.323825 32397 leader_election.cc:304] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b, 4a0201cedacd48c2abd9eb3e09ee0d92; no voters: 
I20260709 12:22:36.324843 32638 raft_consensus.cc:2804] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:36.325343 32638 raft_consensus.cc:697] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 4 LEADER]: Becoming Leader. State: Replica: 4a0201cedacd48c2abd9eb3e09ee0d92, State: Running, Role: LEADER
I20260709 12:22:36.326335 32507 raft_consensus.cc:2468] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0201cedacd48c2abd9eb3e09ee0d92 in term 4.
I20260709 12:22:36.326174 32638 consensus_queue.cc:237] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:36.334739 32255 catalog_manager.cc:5697] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 reported cstate change: term changed from 3 to 4, leader changed from ba6fd2b98668427bb42cde3ad503803d (127.22.155.195) to 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194). New cstate: current_term: 4 leader_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:36.721284 32714 raft_consensus.cc:1275] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 4 FOLLOWER]: Refusing update from remote peer 4a0201cedacd48c2abd9eb3e09ee0d92: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:36.722937 32638 consensus_queue.cc:1048] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:36.723544 32431 raft_consensus.cc:1275] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 4 FOLLOWER]: Refusing update from remote peer ba6fd2b98668427bb42cde3ad503803d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:36.725560   309 consensus_queue.cc:1048] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:36.730417 32715 raft_consensus.cc:1275] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [term 4 FOLLOWER]: Refusing update from remote peer ba6fd2b98668427bb42cde3ad503803d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:36.732227   309 consensus_queue.cc:1048] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:36.738957 32507 raft_consensus.cc:1275] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 4 FOLLOWER]: Refusing update from remote peer 4a0201cedacd48c2abd9eb3e09ee0d92: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:36.742645   318 consensus_queue.cc:1048] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:22:37.002338 32304 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:22:37.236193 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:37.246826 32507 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd8f84fc897d4f01b94924403eaf8e64"
dest_uuid: "ba6fd2b98668427bb42cde3ad503803d"
mode: GRACEFUL
new_leader_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
 from {username='slave'} at 127.0.0.1:35788
I20260709 12:22:37.247419 32507 raft_consensus.cc:606] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [term 1 LEADER]: Received request to transfer leadership to TS 4a0201cedacd48c2abd9eb3e09ee0d92
I20260709 12:22:37.250514 32431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3ef7d12ba5a45cab61fdc87dbc39117"
dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
mode: GRACEFUL
new_leader_uuid: "ba6fd2b98668427bb42cde3ad503803d"
 from {username='slave'} at 127.0.0.1:55018
I20260709 12:22:37.251238 32431 raft_consensus.cc:606] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 4 LEADER]: Received request to transfer leadership to TS ba6fd2b98668427bb42cde3ad503803d
I20260709 12:22:37.252619 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:37.253227 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:37.253943 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:37.352001   318 raft_consensus.cc:993] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92: : Instructing follower ba6fd2b98668427bb42cde3ad503803d to start an election
I20260709 12:22:37.352572   350 raft_consensus.cc:1081] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 4 LEADER]: Signalling peer ba6fd2b98668427bb42cde3ad503803d to start an election
I20260709 12:22:37.354332 32507 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3ef7d12ba5a45cab61fdc87dbc39117"
dest_uuid: "ba6fd2b98668427bb42cde3ad503803d"
 from {username='slave'} at 127.0.0.1:54976
I20260709 12:22:37.354867 32507 raft_consensus.cc:493] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:37.355134 32507 raft_consensus.cc:3060] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:37.360980 32507 raft_consensus.cc:515] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:37.362483 32507 leader_election.cc:290] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 5 election: Requested vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471)
I20260709 12:22:37.363703 32714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef7d12ba5a45cab61fdc87dbc39117" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "3be0070ae46940d98553de245ef14d4b"
I20260709 12:22:37.364094 32432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef7d12ba5a45cab61fdc87dbc39117" candidate_uuid: "ba6fd2b98668427bb42cde3ad503803d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
I20260709 12:22:37.364543 32714 raft_consensus.cc:3060] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:37.364770 32432 raft_consensus.cc:3055] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:37.365283 32432 raft_consensus.cc:740] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4a0201cedacd48c2abd9eb3e09ee0d92, State: Running, Role: LEADER
I20260709 12:22:37.366271 32432 consensus_queue.cc:260] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:37.367812 32432 raft_consensus.cc:3060] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:37.373626 32714 raft_consensus.cc:2468] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6fd2b98668427bb42cde3ad503803d in term 5.
I20260709 12:22:37.375190 32471 leader_election.cc:304] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b, ba6fd2b98668427bb42cde3ad503803d; no voters: 
I20260709 12:22:37.376137   339 raft_consensus.cc:2804] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:37.376708   339 raft_consensus.cc:697] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 5 LEADER]: Becoming Leader. State: Replica: ba6fd2b98668427bb42cde3ad503803d, State: Running, Role: LEADER
I20260709 12:22:37.377676   339 consensus_queue.cc:237] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:37.378959 32432 raft_consensus.cc:2468] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6fd2b98668427bb42cde3ad503803d in term 5.
I20260709 12:22:37.392189 32253 catalog_manager.cc:5697] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d reported cstate change: term changed from 4 to 5, leader changed from 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194) to ba6fd2b98668427bb42cde3ad503803d (127.22.155.195). New cstate: current_term: 5 leader_uuid: "ba6fd2b98668427bb42cde3ad503803d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:37.602856   348 raft_consensus.cc:993] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d: : Instructing follower 4a0201cedacd48c2abd9eb3e09ee0d92 to start an election
I20260709 12:22:37.603439   339 raft_consensus.cc:1081] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [term 1 LEADER]: Signalling peer 4a0201cedacd48c2abd9eb3e09ee0d92 to start an election
I20260709 12:22:37.605140 32432 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd8f84fc897d4f01b94924403eaf8e64"
dest_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92"
 from {username='slave'} at 127.0.0.1:57474
I20260709 12:22:37.605708 32432 raft_consensus.cc:493] T bd8f84fc897d4f01b94924403eaf8e64 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:37.606050 32432 raft_consensus.cc:3060] T bd8f84fc897d4f01b94924403eaf8e64 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:37.612553 32432 raft_consensus.cc:515] T bd8f84fc897d4f01b94924403eaf8e64 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:37.614485 32432 leader_election.cc:290] T bd8f84fc897d4f01b94924403eaf8e64 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 2 election: Requested vote from peers 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069), ba6fd2b98668427bb42cde3ad503803d (127.22.155.195:34813)
I20260709 12:22:37.615573 32714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8f84fc897d4f01b94924403eaf8e64" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3be0070ae46940d98553de245ef14d4b"
I20260709 12:22:37.615916 32507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8f84fc897d4f01b94924403eaf8e64" candidate_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba6fd2b98668427bb42cde3ad503803d"
I20260709 12:22:37.616323 32714 raft_consensus.cc:3060] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:37.616709 32507 raft_consensus.cc:3055] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:37.617061 32507 raft_consensus.cc:740] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba6fd2b98668427bb42cde3ad503803d, State: Running, Role: LEADER
I20260709 12:22:37.618018 32507 consensus_queue.cc:260] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:37.619139 32507 raft_consensus.cc:3060] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:37.623472 32714 raft_consensus.cc:2468] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0201cedacd48c2abd9eb3e09ee0d92 in term 2.
I20260709 12:22:37.624749 32507 raft_consensus.cc:2468] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0201cedacd48c2abd9eb3e09ee0d92 in term 2.
I20260709 12:22:37.624861 32397 leader_election.cc:304] T bd8f84fc897d4f01b94924403eaf8e64 P 4a0201cedacd48c2abd9eb3e09ee0d92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be0070ae46940d98553de245ef14d4b, 4a0201cedacd48c2abd9eb3e09ee0d92; no voters: 
I20260709 12:22:37.626019   318 raft_consensus.cc:2804] T bd8f84fc897d4f01b94924403eaf8e64 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:37.626571   318 raft_consensus.cc:697] T bd8f84fc897d4f01b94924403eaf8e64 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 LEADER]: Becoming Leader. State: Replica: 4a0201cedacd48c2abd9eb3e09ee0d92, State: Running, Role: LEADER
I20260709 12:22:37.627485   318 consensus_queue.cc:237] T bd8f84fc897d4f01b94924403eaf8e64 P 4a0201cedacd48c2abd9eb3e09ee0d92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } }
I20260709 12:22:37.635823 32253 catalog_manager.cc:5697] T bd8f84fc897d4f01b94924403eaf8e64 P 4a0201cedacd48c2abd9eb3e09ee0d92 reported cstate change: term changed from 1 to 2, leader changed from ba6fd2b98668427bb42cde3ad503803d (127.22.155.195) to 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194). New cstate: current_term: 2 leader_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:37.825975 32432 raft_consensus.cc:1275] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 5 FOLLOWER]: Refusing update from remote peer ba6fd2b98668427bb42cde3ad503803d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:37.827423   339 consensus_queue.cc:1048] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0201cedacd48c2abd9eb3e09ee0d92" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 33471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:37.843750 32714 raft_consensus.cc:1275] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 5 FOLLOWER]: Refusing update from remote peer ba6fd2b98668427bb42cde3ad503803d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:37.845311   339 consensus_queue.cc:1048] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:22:38.003625 32304 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:22:38.088511 32714 raft_consensus.cc:1275] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b [term 2 FOLLOWER]: Refusing update from remote peer 4a0201cedacd48c2abd9eb3e09ee0d92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:38.090159   350 consensus_queue.cc:1048] T bd8f84fc897d4f01b94924403eaf8e64 P 4a0201cedacd48c2abd9eb3e09ee0d92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be0070ae46940d98553de245ef14d4b" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:38.102830 32507 raft_consensus.cc:1275] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Refusing update from remote peer 4a0201cedacd48c2abd9eb3e09ee0d92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:38.104535   318 consensus_queue.cc:1048] T bd8f84fc897d4f01b94924403eaf8e64 P 4a0201cedacd48c2abd9eb3e09ee0d92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6fd2b98668427bb42cde3ad503803d" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 34813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:38.262094 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:38.292971 23151 tablet_server.cc:179] TabletServer@127.22.155.193:46069 shutting down...
I20260709 12:22:38.323509 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:38.324472 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:38.325223 23151 raft_consensus.cc:2243] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.325709 23151 raft_consensus.cc:2272] T 36a1129de5fd4878b018a89467544ecb P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.328097 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:38.328826 23151 raft_consensus.cc:2243] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.329305 23151 raft_consensus.cc:2272] T e3ef7d12ba5a45cab61fdc87dbc39117 P 3be0070ae46940d98553de245ef14d4b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.332247 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:38.332959 23151 raft_consensus.cc:2243] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.333454 23151 raft_consensus.cc:2272] T bd8f84fc897d4f01b94924403eaf8e64 P 3be0070ae46940d98553de245ef14d4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.336040 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:38.336805 23151 raft_consensus.cc:2243] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.337296 23151 raft_consensus.cc:2272] T 6454a4189fd24aabb3b216a8884e5422 P 3be0070ae46940d98553de245ef14d4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.339341 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:38.339920 23151 raft_consensus.cc:2243] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.340380 23151 raft_consensus.cc:2272] T bda1105bad6e4f8daffc1141ab247524 P 3be0070ae46940d98553de245ef14d4b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.342466 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:38.343096 23151 raft_consensus.cc:2243] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.343581 23151 raft_consensus.cc:2272] T 37c87edb5fa542a794c3eab947086653 P 3be0070ae46940d98553de245ef14d4b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.345628 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:38.346196 23151 raft_consensus.cc:2243] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.346658 23151 raft_consensus.cc:2272] T b279692d87ed403dbcb22f1d366edcba P 3be0070ae46940d98553de245ef14d4b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.348744 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:38.349305 23151 raft_consensus.cc:2243] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.349756 23151 raft_consensus.cc:2272] T 20c26312d2694b5980a2f78bfdc472fe P 3be0070ae46940d98553de245ef14d4b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.351791 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:38.352376 23151 raft_consensus.cc:2243] T 1feae880171f4a4997bc3da8d9aa6460 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.352880 23151 raft_consensus.cc:2272] T 1feae880171f4a4997bc3da8d9aa6460 P 3be0070ae46940d98553de245ef14d4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.354957 23151 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:38.355486 23151 raft_consensus.cc:2243] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.355960 23151 raft_consensus.cc:2272] T 225cfe1201f64d04846232f5b22ec651 P 3be0070ae46940d98553de245ef14d4b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:38.384905 32397 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111) [suppressed 53 similar messages]
W20260709 12:22:38.388799 32397 consensus_peers.cc:597] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 -> Peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Couldn't send request to peer 3be0070ae46940d98553de245ef14d4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:38.390218 23151 tablet_server.cc:196] TabletServer@127.22.155.193:46069 shutdown complete.
I20260709 12:22:38.413146 23151 tablet_server.cc:179] TabletServer@127.22.155.194:0 shutting down...
W20260709 12:22:38.440610 32471 consensus_peers.cc:597] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d -> Peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Couldn't send request to peer 3be0070ae46940d98553de245ef14d4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:38.452175 32471 consensus_peers.cc:597] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d -> Peer 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471): Couldn't send request to peer 4a0201cedacd48c2abd9eb3e09ee0d92. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:38.459053 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:38.459925 23151 tablet_replica.cc:333] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92: stopping tablet replica
I20260709 12:22:38.460813 23151 raft_consensus.cc:2243] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.461323 23151 raft_consensus.cc:2272] T e3ef7d12ba5a45cab61fdc87dbc39117 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.464375 23151 tablet_replica.cc:333] T bd8f84fc897d4f01b94924403eaf8e64 P 4a0201cedacd48c2abd9eb3e09ee0d92: stopping tablet replica
I20260709 12:22:38.465062 23151 raft_consensus.cc:2243] T bd8f84fc897d4f01b94924403eaf8e64 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:38.465979 23151 raft_consensus.cc:2272] T bd8f84fc897d4f01b94924403eaf8e64 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.470449 23151 tablet_replica.cc:333] T 36a1129de5fd4878b018a89467544ecb P 4a0201cedacd48c2abd9eb3e09ee0d92: stopping tablet replica
I20260709 12:22:38.471109 23151 raft_consensus.cc:2243] T 36a1129de5fd4878b018a89467544ecb P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.471628 23151 raft_consensus.cc:2272] T 36a1129de5fd4878b018a89467544ecb P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.474080 23151 tablet_replica.cc:333] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92: stopping tablet replica
I20260709 12:22:38.474761 23151 raft_consensus.cc:2243] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:38.475607 23151 raft_consensus.cc:2272] T bda1105bad6e4f8daffc1141ab247524 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.478201 23151 tablet_replica.cc:333] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92: stopping tablet replica
I20260709 12:22:38.478781 23151 raft_consensus.cc:2243] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.479219 23151 raft_consensus.cc:2272] T 37c87edb5fa542a794c3eab947086653 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.481417 23151 tablet_replica.cc:333] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92: stopping tablet replica
I20260709 12:22:38.482021 23151 raft_consensus.cc:2243] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.482434 23151 raft_consensus.cc:2272] T 6454a4189fd24aabb3b216a8884e5422 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.484467 23151 tablet_replica.cc:333] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92: stopping tablet replica
I20260709 12:22:38.485018 23151 raft_consensus.cc:2243] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.485419 23151 raft_consensus.cc:2272] T b279692d87ed403dbcb22f1d366edcba P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.487438 23151 tablet_replica.cc:333] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92: stopping tablet replica
I20260709 12:22:38.487979 23151 raft_consensus.cc:2243] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:38.488921 23151 raft_consensus.cc:2272] T 225cfe1201f64d04846232f5b22ec651 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.491140 23151 tablet_replica.cc:333] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92: stopping tablet replica
I20260709 12:22:38.491691 23151 raft_consensus.cc:2243] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:38.492498 23151 raft_consensus.cc:2272] T 1feae880171f4a4997bc3da8d9aa6460 P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.494971 23151 tablet_replica.cc:333] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92: stopping tablet replica
I20260709 12:22:38.495496 23151 raft_consensus.cc:2243] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:38.496306 23151 raft_consensus.cc:2272] T 20c26312d2694b5980a2f78bfdc472fe P 4a0201cedacd48c2abd9eb3e09ee0d92 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:38.508764 32471 consensus_peers.cc:597] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d -> Peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Couldn't send request to peer 3be0070ae46940d98553de245ef14d4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:38.530948 23151 tablet_server.cc:196] TabletServer@127.22.155.194:0 shutdown complete.
W20260709 12:22:38.541810 32471 consensus_peers.cc:597] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d -> Peer 3be0070ae46940d98553de245ef14d4b (127.22.155.193:46069): Couldn't send request to peer 3be0070ae46940d98553de245ef14d4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:46069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:38.557044 23151 tablet_server.cc:179] TabletServer@127.22.155.195:0 shutting down...
W20260709 12:22:38.579375 32471 consensus_peers.cc:597] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d -> Peer 4a0201cedacd48c2abd9eb3e09ee0d92 (127.22.155.194:33471): Couldn't send request to peer 4a0201cedacd48c2abd9eb3e09ee0d92. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:33471: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:38.592159 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:38.593107 23151 tablet_replica.cc:333] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d: stopping tablet replica
I20260709 12:22:38.593890 23151 raft_consensus.cc:2243] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.594393 23151 raft_consensus.cc:2272] T bd8f84fc897d4f01b94924403eaf8e64 P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.597364 23151 tablet_replica.cc:333] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d: stopping tablet replica
I20260709 12:22:38.597990 23151 raft_consensus.cc:2243] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:22:38.598803 23151 raft_consensus.cc:2272] T e3ef7d12ba5a45cab61fdc87dbc39117 P ba6fd2b98668427bb42cde3ad503803d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.601625 23151 tablet_replica.cc:333] T 1feae880171f4a4997bc3da8d9aa6460 P ba6fd2b98668427bb42cde3ad503803d: stopping tablet replica
I20260709 12:22:38.602231 23151 raft_consensus.cc:2243] T 1feae880171f4a4997bc3da8d9aa6460 P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.602726 23151 raft_consensus.cc:2272] T 1feae880171f4a4997bc3da8d9aa6460 P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.605634 23151 tablet_replica.cc:333] T 225cfe1201f64d04846232f5b22ec651 P ba6fd2b98668427bb42cde3ad503803d: stopping tablet replica
I20260709 12:22:38.606256 23151 raft_consensus.cc:2243] T 225cfe1201f64d04846232f5b22ec651 P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.606745 23151 raft_consensus.cc:2272] T 225cfe1201f64d04846232f5b22ec651 P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.608968 23151 tablet_replica.cc:333] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d: stopping tablet replica
I20260709 12:22:38.609525 23151 raft_consensus.cc:2243] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.609969 23151 raft_consensus.cc:2272] T 20c26312d2694b5980a2f78bfdc472fe P ba6fd2b98668427bb42cde3ad503803d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.612201 23151 tablet_replica.cc:333] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d: stopping tablet replica
I20260709 12:22:38.612843 23151 raft_consensus.cc:2243] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.613288 23151 raft_consensus.cc:2272] T bda1105bad6e4f8daffc1141ab247524 P ba6fd2b98668427bb42cde3ad503803d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.615331 23151 tablet_replica.cc:333] T 6454a4189fd24aabb3b216a8884e5422 P ba6fd2b98668427bb42cde3ad503803d: stopping tablet replica
I20260709 12:22:38.615897 23151 raft_consensus.cc:2243] T 6454a4189fd24aabb3b216a8884e5422 P ba6fd2b98668427bb42cde3ad503803d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:38.616720 23151 raft_consensus.cc:2272] T 6454a4189fd24aabb3b216a8884e5422 P ba6fd2b98668427bb42cde3ad503803d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.618638 23151 tablet_replica.cc:333] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d: stopping tablet replica
I20260709 12:22:38.619179 23151 raft_consensus.cc:2243] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:38.619966 23151 raft_consensus.cc:2272] T 37c87edb5fa542a794c3eab947086653 P ba6fd2b98668427bb42cde3ad503803d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.622176 23151 tablet_replica.cc:333] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d: stopping tablet replica
I20260709 12:22:38.622718 23151 raft_consensus.cc:2243] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:38.623494 23151 raft_consensus.cc:2272] T b279692d87ed403dbcb22f1d366edcba P ba6fd2b98668427bb42cde3ad503803d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.625521 23151 tablet_replica.cc:333] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d: stopping tablet replica
I20260709 12:22:38.626019 23151 raft_consensus.cc:2243] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:38.626889 23151 raft_consensus.cc:2272] T 36a1129de5fd4878b018a89467544ecb P ba6fd2b98668427bb42cde3ad503803d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.656376 23151 tablet_server.cc:196] TabletServer@127.22.155.195:0 shutdown complete.
I20260709 12:22:38.690106 23151 master.cc:562] Master@127.22.155.254:45051 shutting down...
I20260709 12:22:38.716380 23151 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a7832cbf71144f9db839bb669369d97b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:38.717077 23151 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a7832cbf71144f9db839bb669369d97b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.717456 23151 tablet_replica.cc:333] T 00000000000000000000000000000000 P a7832cbf71144f9db839bb669369d97b: stopping tablet replica
I20260709 12:22:38.738308 23151 master.cc:584] Master@127.22.155.254:45051 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12953 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:22:38.788938 23151 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.155.254:33467
I20260709 12:22:38.790293 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:38.797045   374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:38.797196   373 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:38.798080   376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:38.798934 23151 server_base.cc:1061] running on GCE node
I20260709 12:22:38.800132 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:38.800326 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:38.800498 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599758800482 us; error 0 us; skew 500 ppm
I20260709 12:22:38.801170 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:38.803851 23151 webserver.cc:533] Webserver started at http://127.22.155.254:35301/ using document root <none> and password file <none>
I20260709 12:22:38.804402 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:38.804598 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:38.805125 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:38.806396 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599400258298-23151-0/minicluster-data/master-0-root/instance:
uuid: "13084003de984d61a6310c0108b36064"
format_stamp: "Formatted at 2026-07-09 12:22:38 on dist-test-slave-p7fg"
I20260709 12:22:38.811302 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:22:38.815261   381 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:38.816366 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:22:38.816782 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599400258298-23151-0/minicluster-data/master-0-root
uuid: "13084003de984d61a6310c0108b36064"
format_stamp: "Formatted at 2026-07-09 12:22:38 on dist-test-slave-p7fg"
I20260709 12:22:38.817121 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599400258298-23151-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599400258298-23151-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599400258298-23151-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:38.833916 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:38.835320 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:38.883118 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.254:33467
I20260709 12:22:38.883251   432 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.254:33467 every 8 connection(s)
I20260709 12:22:38.887758   433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:38.899961   433 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13084003de984d61a6310c0108b36064: Bootstrap starting.
I20260709 12:22:38.904987   433 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 13084003de984d61a6310c0108b36064: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.909754   433 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13084003de984d61a6310c0108b36064: No bootstrap required, opened a new log
I20260709 12:22:38.912091   433 raft_consensus.cc:359] T 00000000000000000000000000000000 P 13084003de984d61a6310c0108b36064 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13084003de984d61a6310c0108b36064" member_type: VOTER }
I20260709 12:22:38.912514   433 raft_consensus.cc:385] T 00000000000000000000000000000000 P 13084003de984d61a6310c0108b36064 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.912822   433 raft_consensus.cc:740] T 00000000000000000000000000000000 P 13084003de984d61a6310c0108b36064 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13084003de984d61a6310c0108b36064, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.913470   433 consensus_queue.cc:260] T 00000000000000000000000000000000 P 13084003de984d61a6310c0108b36064 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13084003de984d61a6310c0108b36064" member_type: VOTER }
I20260709 12:22:38.913941   433 raft_consensus.cc:399] T 00000000000000000000000000000000 P 13084003de984d61a6310c0108b36064 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:38.914189   433 raft_consensus.cc:493] T 00000000000000000000000000000000 P 13084003de984d61a6310c0108b36064 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:38.914462   433 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 13084003de984d61a6310c0108b36064 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.919889   433 raft_consensus.cc:515] T 00000000000000000000000000000000 P 13084003de984d61a6310c0108b36064 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13084003de984d61a6310c0108b36064" member_type: VOTER }
I20260709 12:22:38.920445   433 leader_election.cc:304] T 00000000000000000000000000000000 P 13084003de984d61a6310c0108b36064 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 13084003de984d61a6310c0108b36064; no voters: 
I20260709 12:22:38.921694   433 leader_election.cc:290] T 00000000000000000000000000000000 P 13084003de984d61a6310c0108b36064 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:38.922313   436 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 13084003de984d61a6310c0108b36064 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:38.924018   436 raft_consensus.cc:697] T 00000000000000000000000000000000 P 13084003de984d61a6310c0108b36064 [term 1 LEADER]: Becoming Leader. State: Replica: 13084003de984d61a6310c0108b36064, State: Running, Role: LEADER
I20260709 12:22:38.924788   433 sys_catalog.cc:565] T 00000000000000000000000000000000 P 13084003de984d61a6310c0108b36064 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:38.924834   436 consensus_queue.cc:237] T 00000000000000000000000000000000 P 13084003de984d61a6310c0108b36064 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13084003de984d61a6310c0108b36064" member_type: VOTER }
I20260709 12:22:38.929955   438 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13084003de984d61a6310c0108b36064 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 13084003de984d61a6310c0108b36064. Latest consensus state: current_term: 1 leader_uuid: "13084003de984d61a6310c0108b36064" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13084003de984d61a6310c0108b36064" member_type: VOTER } }
I20260709 12:22:38.930567   438 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13084003de984d61a6310c0108b36064 [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:38.933457   437 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13084003de984d61a6310c0108b36064 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "13084003de984d61a6310c0108b36064" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13084003de984d61a6310c0108b36064" member_type: VOTER } }
I20260709 12:22:38.933844   444 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:38.934269   437 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13084003de984d61a6310c0108b36064 [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:38.942271   444 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:38.943312 23151 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:38.952236   444 catalog_manager.cc:1383] Generated new cluster ID: 8e80f4b0d5db44a3a098b75f8f4b161a
I20260709 12:22:38.952840   444 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:38.969250   444 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:38.970918   444 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:38.985508   444 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 13084003de984d61a6310c0108b36064: Generated new TSK 0
I20260709 12:22:38.986248   444 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:39.010320 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:39.016893   454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:39.017980   455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:39.020928   457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:39.021081 23151 server_base.cc:1061] running on GCE node
I20260709 12:22:39.022346 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:39.022575 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:39.022761 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599759022737 us; error 0 us; skew 500 ppm
I20260709 12:22:39.023303 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:39.025821 23151 webserver.cc:533] Webserver started at http://127.22.155.193:43427/ using document root <none> and password file <none>
I20260709 12:22:39.026389 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:39.026602 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:39.026827 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:39.027920 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599400258298-23151-0/minicluster-data/ts-0-root/instance:
uuid: "a546db9f4a334400a87b045cca96bbf7"
format_stamp: "Formatted at 2026-07-09 12:22:39 on dist-test-slave-p7fg"
I20260709 12:22:39.032742 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:22:39.036492   462 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:39.037439 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:22:39.037793 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599400258298-23151-0/minicluster-data/ts-0-root
uuid: "a546db9f4a334400a87b045cca96bbf7"
format_stamp: "Formatted at 2026-07-09 12:22:39 on dist-test-slave-p7fg"
I20260709 12:22:39.038087 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599400258298-23151-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599400258298-23151-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599400258298-23151-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:39.067445 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:39.068742 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:39.070367 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:39.072821 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:39.073048 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:39.073292 23151 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:39.073463 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:39.119135 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.193:42991
I20260709 12:22:39.119445   524 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.193:42991 every 8 connection(s)
I20260709 12:22:39.124042 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:39.132368   529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:39.133414   530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:39.141611 23151 server_base.cc:1061] running on GCE node
W20260709 12:22:39.141705   532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:39.143474 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:39.143798 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:39.144016 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599759143994 us; error 0 us; skew 500 ppm
I20260709 12:22:39.144934 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:39.146343   525 heartbeater.cc:344] Connected to a master server at 127.22.155.254:33467
I20260709 12:22:39.146826   525 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:39.147883   525 heartbeater.cc:507] Master 127.22.155.254:33467 requested a full tablet report, sending...
I20260709 12:22:39.148346 23151 webserver.cc:533] Webserver started at http://127.22.155.194:34999/ using document root <none> and password file <none>
I20260709 12:22:39.149129 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:39.149349 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:39.149698 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:39.150889   398 ts_manager.cc:194] Registered new tserver with Master: a546db9f4a334400a87b045cca96bbf7 (127.22.155.193:42991)
I20260709 12:22:39.151499 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599400258298-23151-0/minicluster-data/ts-1-root/instance:
uuid: "30188513f3b64da49d4de2082234ecbf"
format_stamp: "Formatted at 2026-07-09 12:22:39 on dist-test-slave-p7fg"
I20260709 12:22:39.153123   398 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46602
I20260709 12:22:39.157754 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:22:39.162272   537 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:39.163236 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:22:39.163585 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599400258298-23151-0/minicluster-data/ts-1-root
uuid: "30188513f3b64da49d4de2082234ecbf"
format_stamp: "Formatted at 2026-07-09 12:22:39 on dist-test-slave-p7fg"
I20260709 12:22:39.163877 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599400258298-23151-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599400258298-23151-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599400258298-23151-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:39.178690 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:39.180147 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:39.181977 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:39.184546 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:39.184845 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:22:39.185120 23151 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:39.185300 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:39.237385 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.194:41171
I20260709 12:22:39.237499   599 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.194:41171 every 8 connection(s)
I20260709 12:22:39.243047 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:39.252241   603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:39.253961   604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:39.257010   606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:39.257294 23151 server_base.cc:1061] running on GCE node
I20260709 12:22:39.258069   600 heartbeater.cc:344] Connected to a master server at 127.22.155.254:33467
I20260709 12:22:39.258641   600 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:39.258965 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:39.259347 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:39.259572 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599759259552 us; error 0 us; skew 500 ppm
I20260709 12:22:39.259898   600 heartbeater.cc:507] Master 127.22.155.254:33467 requested a full tablet report, sending...
I20260709 12:22:39.260422 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:39.262742   398 ts_manager.cc:194] Registered new tserver with Master: 30188513f3b64da49d4de2082234ecbf (127.22.155.194:41171)
I20260709 12:22:39.264024 23151 webserver.cc:533] Webserver started at http://127.22.155.195:45639/ using document root <none> and password file <none>
I20260709 12:22:39.264590   398 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46608
I20260709 12:22:39.264799 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:39.265270 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:39.265619 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:39.267200 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599400258298-23151-0/minicluster-data/ts-2-root/instance:
uuid: "26751650be15456b8baeae8df15f200e"
format_stamp: "Formatted at 2026-07-09 12:22:39 on dist-test-slave-p7fg"
I20260709 12:22:39.272876 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:22:39.277587   611 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:39.278515 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:22:39.278941 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599400258298-23151-0/minicluster-data/ts-2-root
uuid: "26751650be15456b8baeae8df15f200e"
format_stamp: "Formatted at 2026-07-09 12:22:39 on dist-test-slave-p7fg"
I20260709 12:22:39.279238 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599400258298-23151-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599400258298-23151-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599400258298-23151-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:39.294924 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:39.296370 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:39.298103 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:39.300674 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:39.300920 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:39.301187 23151 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:39.301383 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:39.351118 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.195:43013
I20260709 12:22:39.351233   673 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.195:43013 every 8 connection(s)
I20260709 12:22:39.366880   674 heartbeater.cc:344] Connected to a master server at 127.22.155.254:33467
I20260709 12:22:39.367323   674 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:39.368032   674 heartbeater.cc:507] Master 127.22.155.254:33467 requested a full tablet report, sending...
I20260709 12:22:39.370337   398 ts_manager.cc:194] Registered new tserver with Master: 26751650be15456b8baeae8df15f200e (127.22.155.195:43013)
I20260709 12:22:39.370774 23151 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015919949s
I20260709 12:22:39.372145   398 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46616
I20260709 12:22:39.400878   398 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46628:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:39.403424   398 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:39.464110   564 tablet_service.cc:1511] Processing CreateTablet for tablet d8a294dfef934e3183d67d4a1a4fae4d (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2a51b1dab40446fa87707c5c56cfb666]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:22:39.464002   565 tablet_service.cc:1511] Processing CreateTablet for tablet f3cb431c0dc34e51b65be406973d5962 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2a51b1dab40446fa87707c5c56cfb666]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:22:39.465755   564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8a294dfef934e3183d67d4a1a4fae4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:39.467211   490 tablet_service.cc:1511] Processing CreateTablet for tablet f3cb431c0dc34e51b65be406973d5962 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2a51b1dab40446fa87707c5c56cfb666]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:22:39.468694   490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3cb431c0dc34e51b65be406973d5962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:39.470213   565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3cb431c0dc34e51b65be406973d5962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:39.472595   638 tablet_service.cc:1511] Processing CreateTablet for tablet d8a294dfef934e3183d67d4a1a4fae4d (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2a51b1dab40446fa87707c5c56cfb666]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:22:39.474181   638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8a294dfef934e3183d67d4a1a4fae4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:39.480037   639 tablet_service.cc:1511] Processing CreateTablet for tablet f3cb431c0dc34e51b65be406973d5962 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2a51b1dab40446fa87707c5c56cfb666]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:22:39.481566   639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3cb431c0dc34e51b65be406973d5962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:39.482749   489 tablet_service.cc:1511] Processing CreateTablet for tablet d8a294dfef934e3183d67d4a1a4fae4d (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2a51b1dab40446fa87707c5c56cfb666]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:22:39.484324   489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8a294dfef934e3183d67d4a1a4fae4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:39.513121   689 tablet_bootstrap.cc:492] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf: Bootstrap starting.
I20260709 12:22:39.514256   690 tablet_bootstrap.cc:492] T f3cb431c0dc34e51b65be406973d5962 P 26751650be15456b8baeae8df15f200e: Bootstrap starting.
I20260709 12:22:39.515436   691 tablet_bootstrap.cc:492] T f3cb431c0dc34e51b65be406973d5962 P a546db9f4a334400a87b045cca96bbf7: Bootstrap starting.
I20260709 12:22:39.520816   689 tablet_bootstrap.cc:654] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.522239   690 tablet_bootstrap.cc:654] T f3cb431c0dc34e51b65be406973d5962 P 26751650be15456b8baeae8df15f200e: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.525532   691 tablet_bootstrap.cc:654] T f3cb431c0dc34e51b65be406973d5962 P a546db9f4a334400a87b045cca96bbf7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.527443   689 tablet_bootstrap.cc:492] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf: No bootstrap required, opened a new log
I20260709 12:22:39.528292   689 ts_tablet_manager.cc:1403] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf: Time spent bootstrapping tablet: real 0.020s	user 0.004s	sys 0.009s
I20260709 12:22:39.528801   690 tablet_bootstrap.cc:492] T f3cb431c0dc34e51b65be406973d5962 P 26751650be15456b8baeae8df15f200e: No bootstrap required, opened a new log
I20260709 12:22:39.529371   690 ts_tablet_manager.cc:1403] T f3cb431c0dc34e51b65be406973d5962 P 26751650be15456b8baeae8df15f200e: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 12:22:39.532245   690 raft_consensus.cc:359] T f3cb431c0dc34e51b65be406973d5962 P 26751650be15456b8baeae8df15f200e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.532455   689 raft_consensus.cc:359] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.533102   690 raft_consensus.cc:385] T f3cb431c0dc34e51b65be406973d5962 P 26751650be15456b8baeae8df15f200e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.533223   689 raft_consensus.cc:385] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.533499   690 raft_consensus.cc:740] T f3cb431c0dc34e51b65be406973d5962 P 26751650be15456b8baeae8df15f200e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26751650be15456b8baeae8df15f200e, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.533615   689 raft_consensus.cc:740] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30188513f3b64da49d4de2082234ecbf, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.534060   691 tablet_bootstrap.cc:492] T f3cb431c0dc34e51b65be406973d5962 P a546db9f4a334400a87b045cca96bbf7: No bootstrap required, opened a new log
I20260709 12:22:39.534690   691 ts_tablet_manager.cc:1403] T f3cb431c0dc34e51b65be406973d5962 P a546db9f4a334400a87b045cca96bbf7: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.004s
I20260709 12:22:39.534416   690 consensus_queue.cc:260] T f3cb431c0dc34e51b65be406973d5962 P 26751650be15456b8baeae8df15f200e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.534416   689 consensus_queue.cc:260] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.539004   691 raft_consensus.cc:359] T f3cb431c0dc34e51b65be406973d5962 P a546db9f4a334400a87b045cca96bbf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.539822   691 raft_consensus.cc:385] T f3cb431c0dc34e51b65be406973d5962 P a546db9f4a334400a87b045cca96bbf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.540141   691 raft_consensus.cc:740] T f3cb431c0dc34e51b65be406973d5962 P a546db9f4a334400a87b045cca96bbf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a546db9f4a334400a87b045cca96bbf7, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.540593   674 heartbeater.cc:499] Master 127.22.155.254:33467 was elected leader, sending a full tablet report...
I20260709 12:22:39.541335   690 ts_tablet_manager.cc:1434] T f3cb431c0dc34e51b65be406973d5962 P 26751650be15456b8baeae8df15f200e: Time spent starting tablet: real 0.012s	user 0.012s	sys 0.000s
I20260709 12:22:39.541209   691 consensus_queue.cc:260] T f3cb431c0dc34e51b65be406973d5962 P a546db9f4a334400a87b045cca96bbf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.543035   690 tablet_bootstrap.cc:492] T d8a294dfef934e3183d67d4a1a4fae4d P 26751650be15456b8baeae8df15f200e: Bootstrap starting.
I20260709 12:22:39.549989   600 heartbeater.cc:499] Master 127.22.155.254:33467 was elected leader, sending a full tablet report...
I20260709 12:22:39.550704   689 ts_tablet_manager.cc:1434] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf: Time spent starting tablet: real 0.022s	user 0.011s	sys 0.011s
I20260709 12:22:39.554121   690 tablet_bootstrap.cc:654] T d8a294dfef934e3183d67d4a1a4fae4d P 26751650be15456b8baeae8df15f200e: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.556159   689 tablet_bootstrap.cc:492] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf: Bootstrap starting.
I20260709 12:22:39.565155   525 heartbeater.cc:499] Master 127.22.155.254:33467 was elected leader, sending a full tablet report...
I20260709 12:22:39.565344   691 ts_tablet_manager.cc:1434] T f3cb431c0dc34e51b65be406973d5962 P a546db9f4a334400a87b045cca96bbf7: Time spent starting tablet: real 0.030s	user 0.024s	sys 0.004s
I20260709 12:22:39.566828   691 tablet_bootstrap.cc:492] T d8a294dfef934e3183d67d4a1a4fae4d P a546db9f4a334400a87b045cca96bbf7: Bootstrap starting.
I20260709 12:22:39.565232   689 tablet_bootstrap.cc:654] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.569458   690 tablet_bootstrap.cc:492] T d8a294dfef934e3183d67d4a1a4fae4d P 26751650be15456b8baeae8df15f200e: No bootstrap required, opened a new log
I20260709 12:22:39.570101   690 ts_tablet_manager.cc:1403] T d8a294dfef934e3183d67d4a1a4fae4d P 26751650be15456b8baeae8df15f200e: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.004s
I20260709 12:22:39.574231   690 raft_consensus.cc:359] T d8a294dfef934e3183d67d4a1a4fae4d P 26751650be15456b8baeae8df15f200e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.575277   690 raft_consensus.cc:385] T d8a294dfef934e3183d67d4a1a4fae4d P 26751650be15456b8baeae8df15f200e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.575645   690 raft_consensus.cc:740] T d8a294dfef934e3183d67d4a1a4fae4d P 26751650be15456b8baeae8df15f200e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26751650be15456b8baeae8df15f200e, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.577061   691 tablet_bootstrap.cc:654] T d8a294dfef934e3183d67d4a1a4fae4d P a546db9f4a334400a87b045cca96bbf7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.576923   690 consensus_queue.cc:260] T d8a294dfef934e3183d67d4a1a4fae4d P 26751650be15456b8baeae8df15f200e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.580531   690 ts_tablet_manager.cc:1434] T d8a294dfef934e3183d67d4a1a4fae4d P 26751650be15456b8baeae8df15f200e: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:22:39.593219   689 tablet_bootstrap.cc:492] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf: No bootstrap required, opened a new log
I20260709 12:22:39.593299   691 tablet_bootstrap.cc:492] T d8a294dfef934e3183d67d4a1a4fae4d P a546db9f4a334400a87b045cca96bbf7: No bootstrap required, opened a new log
I20260709 12:22:39.593925   689 ts_tablet_manager.cc:1403] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf: Time spent bootstrapping tablet: real 0.038s	user 0.027s	sys 0.006s
I20260709 12:22:39.594233   691 ts_tablet_manager.cc:1403] T d8a294dfef934e3183d67d4a1a4fae4d P a546db9f4a334400a87b045cca96bbf7: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.011s
I20260709 12:22:39.597136   689 raft_consensus.cc:359] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.597761   689 raft_consensus.cc:385] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.597632   691 raft_consensus.cc:359] T d8a294dfef934e3183d67d4a1a4fae4d P a546db9f4a334400a87b045cca96bbf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.598150   689 raft_consensus.cc:740] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30188513f3b64da49d4de2082234ecbf, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.598477   691 raft_consensus.cc:385] T d8a294dfef934e3183d67d4a1a4fae4d P a546db9f4a334400a87b045cca96bbf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.598858   691 raft_consensus.cc:740] T d8a294dfef934e3183d67d4a1a4fae4d P a546db9f4a334400a87b045cca96bbf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a546db9f4a334400a87b045cca96bbf7, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.599089   689 consensus_queue.cc:260] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.599491   691 consensus_queue.cc:260] T d8a294dfef934e3183d67d4a1a4fae4d P a546db9f4a334400a87b045cca96bbf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.601397   689 ts_tablet_manager.cc:1434] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.006s
I20260709 12:22:39.601826   691 ts_tablet_manager.cc:1434] T d8a294dfef934e3183d67d4a1a4fae4d P a546db9f4a334400a87b045cca96bbf7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:22:39.658691   696 raft_consensus.cc:493] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.659404   696 raft_consensus.cc:515] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.662462   696 leader_election.cc:290] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a546db9f4a334400a87b045cca96bbf7 (127.22.155.193:42991), 26751650be15456b8baeae8df15f200e (127.22.155.195:43013)
I20260709 12:22:39.675836   500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a294dfef934e3183d67d4a1a4fae4d" candidate_uuid: "30188513f3b64da49d4de2082234ecbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a546db9f4a334400a87b045cca96bbf7" is_pre_election: true
I20260709 12:22:39.676790   500 raft_consensus.cc:2468] T d8a294dfef934e3183d67d4a1a4fae4d P a546db9f4a334400a87b045cca96bbf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30188513f3b64da49d4de2082234ecbf in term 0.
I20260709 12:22:39.677392   649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a294dfef934e3183d67d4a1a4fae4d" candidate_uuid: "30188513f3b64da49d4de2082234ecbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26751650be15456b8baeae8df15f200e" is_pre_election: true
I20260709 12:22:39.678061   539 leader_election.cc:304] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30188513f3b64da49d4de2082234ecbf, a546db9f4a334400a87b045cca96bbf7; no voters: 
I20260709 12:22:39.678529   649 raft_consensus.cc:2468] T d8a294dfef934e3183d67d4a1a4fae4d P 26751650be15456b8baeae8df15f200e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30188513f3b64da49d4de2082234ecbf in term 0.
I20260709 12:22:39.679039   696 raft_consensus.cc:2804] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:39.679371   696 raft_consensus.cc:493] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.679673   696 raft_consensus.cc:3060] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.685492   696 raft_consensus.cc:515] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.687422   696 leader_election.cc:290] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [CANDIDATE]: Term 1 election: Requested vote from peers a546db9f4a334400a87b045cca96bbf7 (127.22.155.193:42991), 26751650be15456b8baeae8df15f200e (127.22.155.195:43013)
I20260709 12:22:39.688197   500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a294dfef934e3183d67d4a1a4fae4d" candidate_uuid: "30188513f3b64da49d4de2082234ecbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a546db9f4a334400a87b045cca96bbf7"
I20260709 12:22:39.688509   649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a294dfef934e3183d67d4a1a4fae4d" candidate_uuid: "30188513f3b64da49d4de2082234ecbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26751650be15456b8baeae8df15f200e"
I20260709 12:22:39.688905   500 raft_consensus.cc:3060] T d8a294dfef934e3183d67d4a1a4fae4d P a546db9f4a334400a87b045cca96bbf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.689129   649 raft_consensus.cc:3060] T d8a294dfef934e3183d67d4a1a4fae4d P 26751650be15456b8baeae8df15f200e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.696951   649 raft_consensus.cc:2468] T d8a294dfef934e3183d67d4a1a4fae4d P 26751650be15456b8baeae8df15f200e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30188513f3b64da49d4de2082234ecbf in term 1.
I20260709 12:22:39.696951   500 raft_consensus.cc:2468] T d8a294dfef934e3183d67d4a1a4fae4d P a546db9f4a334400a87b045cca96bbf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30188513f3b64da49d4de2082234ecbf in term 1.
I20260709 12:22:39.698508   539 leader_election.cc:304] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30188513f3b64da49d4de2082234ecbf, a546db9f4a334400a87b045cca96bbf7; no voters: 
I20260709 12:22:39.699404   696 raft_consensus.cc:2804] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:39.700489   696 raft_consensus.cc:697] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [term 1 LEADER]: Becoming Leader. State: Replica: 30188513f3b64da49d4de2082234ecbf, State: Running, Role: LEADER
I20260709 12:22:39.701337   696 consensus_queue.cc:237] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.711411   397 catalog_manager.cc:5697] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf reported cstate change: term changed from 0 to 1, leader changed from <none> to 30188513f3b64da49d4de2082234ecbf (127.22.155.194). New cstate: current_term: 1 leader_uuid: "30188513f3b64da49d4de2082234ecbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:39.746343   696 raft_consensus.cc:493] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.746903   696 raft_consensus.cc:515] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.748858   696 leader_election.cc:290] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a546db9f4a334400a87b045cca96bbf7 (127.22.155.193:42991), 26751650be15456b8baeae8df15f200e (127.22.155.195:43013)
I20260709 12:22:39.750020   649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cb431c0dc34e51b65be406973d5962" candidate_uuid: "30188513f3b64da49d4de2082234ecbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26751650be15456b8baeae8df15f200e" is_pre_election: true
I20260709 12:22:39.750054   500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cb431c0dc34e51b65be406973d5962" candidate_uuid: "30188513f3b64da49d4de2082234ecbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a546db9f4a334400a87b045cca96bbf7" is_pre_election: true
I20260709 12:22:39.750785   649 raft_consensus.cc:2468] T f3cb431c0dc34e51b65be406973d5962 P 26751650be15456b8baeae8df15f200e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30188513f3b64da49d4de2082234ecbf in term 0.
I20260709 12:22:39.750944   500 raft_consensus.cc:2468] T f3cb431c0dc34e51b65be406973d5962 P a546db9f4a334400a87b045cca96bbf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30188513f3b64da49d4de2082234ecbf in term 0.
I20260709 12:22:39.752004   540 leader_election.cc:304] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26751650be15456b8baeae8df15f200e, 30188513f3b64da49d4de2082234ecbf; no voters: 
I20260709 12:22:39.752902   696 raft_consensus.cc:2804] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:39.753399   696 raft_consensus.cc:493] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.753683   696 raft_consensus.cc:3060] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.760146   696 raft_consensus.cc:515] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.762085   696 leader_election.cc:290] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [CANDIDATE]: Term 1 election: Requested vote from peers a546db9f4a334400a87b045cca96bbf7 (127.22.155.193:42991), 26751650be15456b8baeae8df15f200e (127.22.155.195:43013)
I20260709 12:22:39.763229   500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cb431c0dc34e51b65be406973d5962" candidate_uuid: "30188513f3b64da49d4de2082234ecbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a546db9f4a334400a87b045cca96bbf7"
I20260709 12:22:39.763402   649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cb431c0dc34e51b65be406973d5962" candidate_uuid: "30188513f3b64da49d4de2082234ecbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26751650be15456b8baeae8df15f200e"
I20260709 12:22:39.763960   500 raft_consensus.cc:3060] T f3cb431c0dc34e51b65be406973d5962 P a546db9f4a334400a87b045cca96bbf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.764031   649 raft_consensus.cc:3060] T f3cb431c0dc34e51b65be406973d5962 P 26751650be15456b8baeae8df15f200e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.770337   500 raft_consensus.cc:2468] T f3cb431c0dc34e51b65be406973d5962 P a546db9f4a334400a87b045cca96bbf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30188513f3b64da49d4de2082234ecbf in term 1.
I20260709 12:22:39.770329   649 raft_consensus.cc:2468] T f3cb431c0dc34e51b65be406973d5962 P 26751650be15456b8baeae8df15f200e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30188513f3b64da49d4de2082234ecbf in term 1.
I20260709 12:22:39.771860   539 leader_election.cc:304] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30188513f3b64da49d4de2082234ecbf, a546db9f4a334400a87b045cca96bbf7; no voters: 
I20260709 12:22:39.772810   696 raft_consensus.cc:2804] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:39.773314   696 raft_consensus.cc:697] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [term 1 LEADER]: Becoming Leader. State: Replica: 30188513f3b64da49d4de2082234ecbf, State: Running, Role: LEADER
I20260709 12:22:39.774056   696 consensus_queue.cc:237] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.782187   397 catalog_manager.cc:5697] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf reported cstate change: term changed from 0 to 1, leader changed from <none> to 30188513f3b64da49d4de2082234ecbf (127.22.155.194). New cstate: current_term: 1 leader_uuid: "30188513f3b64da49d4de2082234ecbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:39.820463   397 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46642:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:39.822744   397 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:39.848662   489 tablet_service.cc:1511] Processing CreateTablet for tablet 6a6c56432f394ca4989f10a000a792a3 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7451b20a8800446ca48ef6b4c528ff53]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:22:39.850039   489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a6c56432f394ca4989f10a000a792a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:39.850039   565 tablet_service.cc:1511] Processing CreateTablet for tablet 6a6c56432f394ca4989f10a000a792a3 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7451b20a8800446ca48ef6b4c528ff53]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:22:39.851519   639 tablet_service.cc:1511] Processing CreateTablet for tablet 6a6c56432f394ca4989f10a000a792a3 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7451b20a8800446ca48ef6b4c528ff53]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:22:39.852874   639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a6c56432f394ca4989f10a000a792a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:39.853538   490 tablet_service.cc:1511] Processing CreateTablet for tablet 9dbc88a94854413fa67bae3424c9412c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7451b20a8800446ca48ef6b4c528ff53]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:22:39.854775   490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dbc88a94854413fa67bae3424c9412c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:39.851553   565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a6c56432f394ca4989f10a000a792a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:39.856076   638 tablet_service.cc:1511] Processing CreateTablet for tablet 9dbc88a94854413fa67bae3424c9412c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7451b20a8800446ca48ef6b4c528ff53]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:22:39.857309   638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dbc88a94854413fa67bae3424c9412c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:39.859066   564 tablet_service.cc:1511] Processing CreateTablet for tablet 9dbc88a94854413fa67bae3424c9412c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7451b20a8800446ca48ef6b4c528ff53]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:22:39.860389   564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dbc88a94854413fa67bae3424c9412c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:39.870028   691 tablet_bootstrap.cc:492] T 6a6c56432f394ca4989f10a000a792a3 P a546db9f4a334400a87b045cca96bbf7: Bootstrap starting.
I20260709 12:22:39.877446   690 tablet_bootstrap.cc:492] T 9dbc88a94854413fa67bae3424c9412c P 26751650be15456b8baeae8df15f200e: Bootstrap starting.
I20260709 12:22:39.880889   691 tablet_bootstrap.cc:654] T 6a6c56432f394ca4989f10a000a792a3 P a546db9f4a334400a87b045cca96bbf7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.888085   690 tablet_bootstrap.cc:654] T 9dbc88a94854413fa67bae3424c9412c P 26751650be15456b8baeae8df15f200e: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.900684   689 tablet_bootstrap.cc:492] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf: Bootstrap starting.
I20260709 12:22:39.902483   690 tablet_bootstrap.cc:492] T 9dbc88a94854413fa67bae3424c9412c P 26751650be15456b8baeae8df15f200e: No bootstrap required, opened a new log
I20260709 12:22:39.903111   690 ts_tablet_manager.cc:1403] T 9dbc88a94854413fa67bae3424c9412c P 26751650be15456b8baeae8df15f200e: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.007s
I20260709 12:22:39.906646   690 raft_consensus.cc:359] T 9dbc88a94854413fa67bae3424c9412c P 26751650be15456b8baeae8df15f200e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.907510   690 raft_consensus.cc:385] T 9dbc88a94854413fa67bae3424c9412c P 26751650be15456b8baeae8df15f200e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.907855   690 raft_consensus.cc:740] T 9dbc88a94854413fa67bae3424c9412c P 26751650be15456b8baeae8df15f200e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26751650be15456b8baeae8df15f200e, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.908885   690 consensus_queue.cc:260] T 9dbc88a94854413fa67bae3424c9412c P 26751650be15456b8baeae8df15f200e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.910092   691 tablet_bootstrap.cc:492] T 6a6c56432f394ca4989f10a000a792a3 P a546db9f4a334400a87b045cca96bbf7: No bootstrap required, opened a new log
I20260709 12:22:39.910808   691 ts_tablet_manager.cc:1403] T 6a6c56432f394ca4989f10a000a792a3 P a546db9f4a334400a87b045cca96bbf7: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.015s
I20260709 12:22:39.911728   690 ts_tablet_manager.cc:1434] T 9dbc88a94854413fa67bae3424c9412c P 26751650be15456b8baeae8df15f200e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 12:22:39.909951   689 tablet_bootstrap.cc:654] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.913087   690 tablet_bootstrap.cc:492] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e: Bootstrap starting.
I20260709 12:22:39.914568   691 raft_consensus.cc:359] T 6a6c56432f394ca4989f10a000a792a3 P a546db9f4a334400a87b045cca96bbf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.915501   691 raft_consensus.cc:385] T 6a6c56432f394ca4989f10a000a792a3 P a546db9f4a334400a87b045cca96bbf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.915964   691 raft_consensus.cc:740] T 6a6c56432f394ca4989f10a000a792a3 P a546db9f4a334400a87b045cca96bbf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a546db9f4a334400a87b045cca96bbf7, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.917109   691 consensus_queue.cc:260] T 6a6c56432f394ca4989f10a000a792a3 P a546db9f4a334400a87b045cca96bbf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.920188   691 ts_tablet_manager.cc:1434] T 6a6c56432f394ca4989f10a000a792a3 P a546db9f4a334400a87b045cca96bbf7: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:22:39.921103   690 tablet_bootstrap.cc:654] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.921921   691 tablet_bootstrap.cc:492] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7: Bootstrap starting.
I20260709 12:22:39.930190   689 tablet_bootstrap.cc:492] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf: No bootstrap required, opened a new log
I20260709 12:22:39.930903   689 ts_tablet_manager.cc:1403] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.009s
I20260709 12:22:39.933773   690 tablet_bootstrap.cc:492] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e: No bootstrap required, opened a new log
I20260709 12:22:39.934461   690 ts_tablet_manager.cc:1403] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.008s
I20260709 12:22:39.934618   691 tablet_bootstrap.cc:654] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.934536   689 raft_consensus.cc:359] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.935899   689 raft_consensus.cc:385] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.936300   689 raft_consensus.cc:740] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30188513f3b64da49d4de2082234ecbf, State: Initialized, Role: FOLLOWER
W20260709 12:22:39.937000   446 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:39.937407   689 consensus_queue.cc:260] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.938377   690 raft_consensus.cc:359] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.939272   690 raft_consensus.cc:385] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.939607   690 raft_consensus.cc:740] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26751650be15456b8baeae8df15f200e, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.939944   689 ts_tablet_manager.cc:1434] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 12:22:39.940598   690 consensus_queue.cc:260] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.941232   689 tablet_bootstrap.cc:492] T 6a6c56432f394ca4989f10a000a792a3 P 30188513f3b64da49d4de2082234ecbf: Bootstrap starting.
I20260709 12:22:39.943316   690 ts_tablet_manager.cc:1434] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:39.946413   696 raft_consensus.cc:493] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.947078   696 raft_consensus.cc:515] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.950516   689 tablet_bootstrap.cc:654] T 6a6c56432f394ca4989f10a000a792a3 P 30188513f3b64da49d4de2082234ecbf: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.950340   500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc88a94854413fa67bae3424c9412c" candidate_uuid: "30188513f3b64da49d4de2082234ecbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a546db9f4a334400a87b045cca96bbf7" is_pre_election: true
W20260709 12:22:39.952198   539 leader_election.cc:343] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a546db9f4a334400a87b045cca96bbf7 (127.22.155.193:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:39.953415   691 tablet_bootstrap.cc:492] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7: No bootstrap required, opened a new log
I20260709 12:22:39.954121   691 ts_tablet_manager.cc:1403] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.010s
I20260709 12:22:39.957392   691 raft_consensus.cc:359] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.958206   691 raft_consensus.cc:385] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.959048   691 raft_consensus.cc:740] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a546db9f4a334400a87b045cca96bbf7, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.959888   649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc88a94854413fa67bae3424c9412c" candidate_uuid: "30188513f3b64da49d4de2082234ecbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26751650be15456b8baeae8df15f200e" is_pre_election: true
I20260709 12:22:39.959896   691 consensus_queue.cc:260] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.957875   696 leader_election.cc:290] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a546db9f4a334400a87b045cca96bbf7 (127.22.155.193:42991), 26751650be15456b8baeae8df15f200e (127.22.155.195:43013)
I20260709 12:22:39.960819   649 raft_consensus.cc:2468] T 9dbc88a94854413fa67bae3424c9412c P 26751650be15456b8baeae8df15f200e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30188513f3b64da49d4de2082234ecbf in term 0.
I20260709 12:22:39.962405   540 leader_election.cc:304] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26751650be15456b8baeae8df15f200e, 30188513f3b64da49d4de2082234ecbf; no voters: a546db9f4a334400a87b045cca96bbf7
I20260709 12:22:39.962603   691 ts_tablet_manager.cc:1434] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:39.963775   696 raft_consensus.cc:2804] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:39.964208   696 raft_consensus.cc:493] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.964515   696 raft_consensus.cc:3060] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.966933   689 tablet_bootstrap.cc:492] T 6a6c56432f394ca4989f10a000a792a3 P 30188513f3b64da49d4de2082234ecbf: No bootstrap required, opened a new log
I20260709 12:22:39.967567   689 ts_tablet_manager.cc:1403] T 6a6c56432f394ca4989f10a000a792a3 P 30188513f3b64da49d4de2082234ecbf: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.010s
I20260709 12:22:39.973064   689 raft_consensus.cc:359] T 6a6c56432f394ca4989f10a000a792a3 P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.973852   689 raft_consensus.cc:385] T 6a6c56432f394ca4989f10a000a792a3 P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.973577   696 raft_consensus.cc:515] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.974177   689 raft_consensus.cc:740] T 6a6c56432f394ca4989f10a000a792a3 P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30188513f3b64da49d4de2082234ecbf, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.975137   689 consensus_queue.cc:260] T 6a6c56432f394ca4989f10a000a792a3 P 30188513f3b64da49d4de2082234ecbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.976722   696 leader_election.cc:290] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [CANDIDATE]: Term 1 election: Requested vote from peers a546db9f4a334400a87b045cca96bbf7 (127.22.155.193:42991), 26751650be15456b8baeae8df15f200e (127.22.155.195:43013)
I20260709 12:22:39.976781   500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc88a94854413fa67bae3424c9412c" candidate_uuid: "30188513f3b64da49d4de2082234ecbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a546db9f4a334400a87b045cca96bbf7"
I20260709 12:22:39.977733   500 raft_consensus.cc:3060] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.978543   689 ts_tablet_manager.cc:1434] T 6a6c56432f394ca4989f10a000a792a3 P 30188513f3b64da49d4de2082234ecbf: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 12:22:39.978413   649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc88a94854413fa67bae3424c9412c" candidate_uuid: "30188513f3b64da49d4de2082234ecbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26751650be15456b8baeae8df15f200e"
I20260709 12:22:39.979344   649 raft_consensus.cc:3060] T 9dbc88a94854413fa67bae3424c9412c P 26751650be15456b8baeae8df15f200e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.979734   695 raft_consensus.cc:493] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.980268   695 raft_consensus.cc:515] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:39.983052   695 leader_election.cc:290] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a546db9f4a334400a87b045cca96bbf7 (127.22.155.193:42991), 30188513f3b64da49d4de2082234ecbf (127.22.155.194:41171)
I20260709 12:22:39.986512   500 raft_consensus.cc:2468] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30188513f3b64da49d4de2082234ecbf in term 1.
I20260709 12:22:39.988226   539 leader_election.cc:304] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30188513f3b64da49d4de2082234ecbf, a546db9f4a334400a87b045cca96bbf7; no voters: 
I20260709 12:22:39.989619   696 raft_consensus.cc:2804] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:39.990257   696 raft_consensus.cc:697] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [term 1 LEADER]: Becoming Leader. State: Replica: 30188513f3b64da49d4de2082234ecbf, State: Running, Role: LEADER
I20260709 12:22:39.991384   696 consensus_queue.cc:237] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:40.000777   649 raft_consensus.cc:2468] T 9dbc88a94854413fa67bae3424c9412c P 26751650be15456b8baeae8df15f200e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30188513f3b64da49d4de2082234ecbf in term 1.
I20260709 12:22:40.014364   397 catalog_manager.cc:5697] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf reported cstate change: term changed from 0 to 1, leader changed from <none> to 30188513f3b64da49d4de2082234ecbf (127.22.155.194). New cstate: current_term: 1 leader_uuid: "30188513f3b64da49d4de2082234ecbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:40.019534   500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a6c56432f394ca4989f10a000a792a3" candidate_uuid: "26751650be15456b8baeae8df15f200e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a546db9f4a334400a87b045cca96bbf7" is_pre_election: true
I20260709 12:22:40.020325   500 raft_consensus.cc:2468] T 6a6c56432f394ca4989f10a000a792a3 P a546db9f4a334400a87b045cca96bbf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26751650be15456b8baeae8df15f200e in term 0.
I20260709 12:22:40.021871   575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a6c56432f394ca4989f10a000a792a3" candidate_uuid: "26751650be15456b8baeae8df15f200e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30188513f3b64da49d4de2082234ecbf" is_pre_election: true
I20260709 12:22:40.022437   613 leader_election.cc:304] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26751650be15456b8baeae8df15f200e, a546db9f4a334400a87b045cca96bbf7; no voters: 
I20260709 12:22:40.022651   575 raft_consensus.cc:2468] T 6a6c56432f394ca4989f10a000a792a3 P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26751650be15456b8baeae8df15f200e in term 0.
I20260709 12:22:40.023900   695 raft_consensus.cc:2804] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:40.024304   695 raft_consensus.cc:493] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:40.024672   695 raft_consensus.cc:3060] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:40.031279   695 raft_consensus.cc:515] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:40.033694   695 leader_election.cc:290] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [CANDIDATE]: Term 1 election: Requested vote from peers a546db9f4a334400a87b045cca96bbf7 (127.22.155.193:42991), 30188513f3b64da49d4de2082234ecbf (127.22.155.194:41171)
I20260709 12:22:40.033978   500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a6c56432f394ca4989f10a000a792a3" candidate_uuid: "26751650be15456b8baeae8df15f200e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a546db9f4a334400a87b045cca96bbf7"
I20260709 12:22:40.034407   575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a6c56432f394ca4989f10a000a792a3" candidate_uuid: "26751650be15456b8baeae8df15f200e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30188513f3b64da49d4de2082234ecbf"
I20260709 12:22:40.034895   500 raft_consensus.cc:3060] T 6a6c56432f394ca4989f10a000a792a3 P a546db9f4a334400a87b045cca96bbf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:40.034984   575 raft_consensus.cc:3060] T 6a6c56432f394ca4989f10a000a792a3 P 30188513f3b64da49d4de2082234ecbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:40.043743   575 raft_consensus.cc:2468] T 6a6c56432f394ca4989f10a000a792a3 P 30188513f3b64da49d4de2082234ecbf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26751650be15456b8baeae8df15f200e in term 1.
I20260709 12:22:40.043743   500 raft_consensus.cc:2468] T 6a6c56432f394ca4989f10a000a792a3 P a546db9f4a334400a87b045cca96bbf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26751650be15456b8baeae8df15f200e in term 1.
I20260709 12:22:40.045485   613 leader_election.cc:304] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26751650be15456b8baeae8df15f200e, a546db9f4a334400a87b045cca96bbf7; no voters: 
I20260709 12:22:40.046361   695 raft_consensus.cc:2804] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:40.047448   695 raft_consensus.cc:697] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [term 1 LEADER]: Becoming Leader. State: Replica: 26751650be15456b8baeae8df15f200e, State: Running, Role: LEADER
I20260709 12:22:40.048202   695 consensus_queue.cc:237] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:40.057485   396 catalog_manager.cc:5697] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e reported cstate change: term changed from 0 to 1, leader changed from <none> to 26751650be15456b8baeae8df15f200e (127.22.155.195). New cstate: current_term: 1 leader_uuid: "26751650be15456b8baeae8df15f200e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:40.112869   575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3cb431c0dc34e51b65be406973d5962"
dest_uuid: "30188513f3b64da49d4de2082234ecbf"
mode: GRACEFUL
new_leader_uuid: "a546db9f4a334400a87b045cca96bbf7"
 from {username='slave'} at 127.0.0.1:51332
I20260709 12:22:40.113642   575 raft_consensus.cc:606] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [term 1 LEADER]: Received request to transfer leadership to TS a546db9f4a334400a87b045cca96bbf7
I20260709 12:22:40.120167   575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8a294dfef934e3183d67d4a1a4fae4d"
dest_uuid: "30188513f3b64da49d4de2082234ecbf"
mode: GRACEFUL
new_leader_uuid: "26751650be15456b8baeae8df15f200e"
 from {username='slave'} at 127.0.0.1:51332
I20260709 12:22:40.120850   575 raft_consensus.cc:606] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [term 1 LEADER]: Received request to transfer leadership to TS 26751650be15456b8baeae8df15f200e
I20260709 12:22:40.135278   649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a6c56432f394ca4989f10a000a792a3"
dest_uuid: "26751650be15456b8baeae8df15f200e"
mode: GRACEFUL
new_leader_uuid: "a546db9f4a334400a87b045cca96bbf7"
 from {username='slave'} at 127.0.0.1:42500
I20260709 12:22:40.135823   649 raft_consensus.cc:606] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [term 1 LEADER]: Received request to transfer leadership to TS a546db9f4a334400a87b045cca96bbf7
I20260709 12:22:40.142297   575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dbc88a94854413fa67bae3424c9412c"
dest_uuid: "30188513f3b64da49d4de2082234ecbf"
mode: GRACEFUL
new_leader_uuid: "a546db9f4a334400a87b045cca96bbf7"
 from {username='slave'} at 127.0.0.1:51332
I20260709 12:22:40.142868   575 raft_consensus.cc:606] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [term 1 LEADER]: Received request to transfer leadership to TS a546db9f4a334400a87b045cca96bbf7
I20260709 12:22:40.267321   696 consensus_queue.cc:1048] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:40.276487   696 consensus_queue.cc:1048] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:40.290818   702 consensus_queue.cc:1048] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:22:40.304773   726 raft_consensus.cc:993] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf: : Instructing follower a546db9f4a334400a87b045cca96bbf7 to start an election
I20260709 12:22:40.305377   726 raft_consensus.cc:1081] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [term 1 LEADER]: Signalling peer a546db9f4a334400a87b045cca96bbf7 to start an election
I20260709 12:22:40.307157   726 consensus_queue.cc:1048] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:40.310700   499 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3cb431c0dc34e51b65be406973d5962"
dest_uuid: "a546db9f4a334400a87b045cca96bbf7"
 from {username='slave'} at 127.0.0.1:59326
I20260709 12:22:40.312184   499 raft_consensus.cc:493] T f3cb431c0dc34e51b65be406973d5962 P a546db9f4a334400a87b045cca96bbf7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:40.312750   499 raft_consensus.cc:3060] T f3cb431c0dc34e51b65be406973d5962 P a546db9f4a334400a87b045cca96bbf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.322259   696 raft_consensus.cc:993] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf: : Instructing follower 26751650be15456b8baeae8df15f200e to start an election
I20260709 12:22:40.325556   730 raft_consensus.cc:1081] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [term 1 LEADER]: Signalling peer 26751650be15456b8baeae8df15f200e to start an election
I20260709 12:22:40.330971   499 raft_consensus.cc:515] T f3cb431c0dc34e51b65be406973d5962 P a546db9f4a334400a87b045cca96bbf7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:40.331200   648 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8a294dfef934e3183d67d4a1a4fae4d"
dest_uuid: "26751650be15456b8baeae8df15f200e"
 from {username='slave'} at 127.0.0.1:42486
I20260709 12:22:40.332119   648 raft_consensus.cc:493] T d8a294dfef934e3183d67d4a1a4fae4d P 26751650be15456b8baeae8df15f200e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:40.332542   648 raft_consensus.cc:3060] T d8a294dfef934e3183d67d4a1a4fae4d P 26751650be15456b8baeae8df15f200e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.352798   648 raft_consensus.cc:515] T d8a294dfef934e3183d67d4a1a4fae4d P 26751650be15456b8baeae8df15f200e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:40.354102   499 leader_election.cc:290] T f3cb431c0dc34e51b65be406973d5962 P a546db9f4a334400a87b045cca96bbf7 [CANDIDATE]: Term 2 election: Requested vote from peers 30188513f3b64da49d4de2082234ecbf (127.22.155.194:41171), 26751650be15456b8baeae8df15f200e (127.22.155.195:43013)
I20260709 12:22:40.355129   648 leader_election.cc:290] T d8a294dfef934e3183d67d4a1a4fae4d P 26751650be15456b8baeae8df15f200e [CANDIDATE]: Term 2 election: Requested vote from peers a546db9f4a334400a87b045cca96bbf7 (127.22.155.193:42991), 30188513f3b64da49d4de2082234ecbf (127.22.155.194:41171)
I20260709 12:22:40.356379   500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a294dfef934e3183d67d4a1a4fae4d" candidate_uuid: "26751650be15456b8baeae8df15f200e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a546db9f4a334400a87b045cca96bbf7"
I20260709 12:22:40.356853   575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a294dfef934e3183d67d4a1a4fae4d" candidate_uuid: "26751650be15456b8baeae8df15f200e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30188513f3b64da49d4de2082234ecbf"
I20260709 12:22:40.357723   575 raft_consensus.cc:3055] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:40.358098   575 raft_consensus.cc:740] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30188513f3b64da49d4de2082234ecbf, State: Running, Role: LEADER
I20260709 12:22:40.359014   575 consensus_queue.cc:260] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:40.357208   500 raft_consensus.cc:3060] T d8a294dfef934e3183d67d4a1a4fae4d P a546db9f4a334400a87b045cca96bbf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.363197   575 raft_consensus.cc:3060] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.369412   500 raft_consensus.cc:2468] T d8a294dfef934e3183d67d4a1a4fae4d P a546db9f4a334400a87b045cca96bbf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26751650be15456b8baeae8df15f200e in term 2.
I20260709 12:22:40.370949   613 leader_election.cc:304] T d8a294dfef934e3183d67d4a1a4fae4d P 26751650be15456b8baeae8df15f200e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26751650be15456b8baeae8df15f200e, a546db9f4a334400a87b045cca96bbf7; no voters: 
I20260709 12:22:40.372231   695 raft_consensus.cc:2804] T d8a294dfef934e3183d67d4a1a4fae4d P 26751650be15456b8baeae8df15f200e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:40.372781   695 raft_consensus.cc:697] T d8a294dfef934e3183d67d4a1a4fae4d P 26751650be15456b8baeae8df15f200e [term 2 LEADER]: Becoming Leader. State: Replica: 26751650be15456b8baeae8df15f200e, State: Running, Role: LEADER
I20260709 12:22:40.373695   695 consensus_queue.cc:237] T d8a294dfef934e3183d67d4a1a4fae4d P 26751650be15456b8baeae8df15f200e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:40.374362   575 raft_consensus.cc:2468] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26751650be15456b8baeae8df15f200e in term 2.
I20260709 12:22:40.373678   574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cb431c0dc34e51b65be406973d5962" candidate_uuid: "a546db9f4a334400a87b045cca96bbf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30188513f3b64da49d4de2082234ecbf"
I20260709 12:22:40.376041   574 raft_consensus.cc:3055] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:40.376327   574 raft_consensus.cc:740] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30188513f3b64da49d4de2082234ecbf, State: Running, Role: LEADER
I20260709 12:22:40.377202   574 consensus_queue.cc:260] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:40.378692   574 raft_consensus.cc:3060] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.382196   398 catalog_manager.cc:5697] T d8a294dfef934e3183d67d4a1a4fae4d P 26751650be15456b8baeae8df15f200e reported cstate change: term changed from 1 to 2, leader changed from 30188513f3b64da49d4de2082234ecbf (127.22.155.194) to 26751650be15456b8baeae8df15f200e (127.22.155.195). New cstate: current_term: 2 leader_uuid: "26751650be15456b8baeae8df15f200e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:40.384395   648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cb431c0dc34e51b65be406973d5962" candidate_uuid: "a546db9f4a334400a87b045cca96bbf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "26751650be15456b8baeae8df15f200e"
I20260709 12:22:40.386452   648 raft_consensus.cc:3060] T f3cb431c0dc34e51b65be406973d5962 P 26751650be15456b8baeae8df15f200e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.387063   574 raft_consensus.cc:2468] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a546db9f4a334400a87b045cca96bbf7 in term 2.
I20260709 12:22:40.388645   463 leader_election.cc:304] T f3cb431c0dc34e51b65be406973d5962 P a546db9f4a334400a87b045cca96bbf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30188513f3b64da49d4de2082234ecbf, a546db9f4a334400a87b045cca96bbf7; no voters: 
I20260709 12:22:40.389685   697 raft_consensus.cc:2804] T f3cb431c0dc34e51b65be406973d5962 P a546db9f4a334400a87b045cca96bbf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:40.393929   697 raft_consensus.cc:697] T f3cb431c0dc34e51b65be406973d5962 P a546db9f4a334400a87b045cca96bbf7 [term 2 LEADER]: Becoming Leader. State: Replica: a546db9f4a334400a87b045cca96bbf7, State: Running, Role: LEADER
I20260709 12:22:40.395462   697 consensus_queue.cc:237] T f3cb431c0dc34e51b65be406973d5962 P a546db9f4a334400a87b045cca96bbf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:40.395774   648 raft_consensus.cc:2468] T f3cb431c0dc34e51b65be406973d5962 P 26751650be15456b8baeae8df15f200e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a546db9f4a334400a87b045cca96bbf7 in term 2.
I20260709 12:22:40.403524   398 catalog_manager.cc:5697] T f3cb431c0dc34e51b65be406973d5962 P a546db9f4a334400a87b045cca96bbf7 reported cstate change: term changed from 1 to 2, leader changed from 30188513f3b64da49d4de2082234ecbf (127.22.155.194) to a546db9f4a334400a87b045cca96bbf7 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "a546db9f4a334400a87b045cca96bbf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:40.432327   695 consensus_queue.cc:1048] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [LEADER]: Connected to new peer: Peer: permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:40.445178   695 consensus_queue.cc:1048] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:40.454160   720 raft_consensus.cc:993] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e: : Instructing follower a546db9f4a334400a87b045cca96bbf7 to start an election
I20260709 12:22:40.454722   695 raft_consensus.cc:1081] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [term 1 LEADER]: Signalling peer a546db9f4a334400a87b045cca96bbf7 to start an election
I20260709 12:22:40.456570   500 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a6c56432f394ca4989f10a000a792a3"
dest_uuid: "a546db9f4a334400a87b045cca96bbf7"
 from {username='slave'} at 127.0.0.1:59334
I20260709 12:22:40.457224   500 raft_consensus.cc:493] T 6a6c56432f394ca4989f10a000a792a3 P a546db9f4a334400a87b045cca96bbf7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:40.457545   500 raft_consensus.cc:3060] T 6a6c56432f394ca4989f10a000a792a3 P a546db9f4a334400a87b045cca96bbf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.463188   500 raft_consensus.cc:515] T 6a6c56432f394ca4989f10a000a792a3 P a546db9f4a334400a87b045cca96bbf7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:40.465312   500 leader_election.cc:290] T 6a6c56432f394ca4989f10a000a792a3 P a546db9f4a334400a87b045cca96bbf7 [CANDIDATE]: Term 2 election: Requested vote from peers 30188513f3b64da49d4de2082234ecbf (127.22.155.194:41171), 26751650be15456b8baeae8df15f200e (127.22.155.195:43013)
I20260709 12:22:40.466336   574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a6c56432f394ca4989f10a000a792a3" candidate_uuid: "a546db9f4a334400a87b045cca96bbf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30188513f3b64da49d4de2082234ecbf"
I20260709 12:22:40.466825   648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a6c56432f394ca4989f10a000a792a3" candidate_uuid: "a546db9f4a334400a87b045cca96bbf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "26751650be15456b8baeae8df15f200e"
I20260709 12:22:40.467133   574 raft_consensus.cc:3060] T 6a6c56432f394ca4989f10a000a792a3 P 30188513f3b64da49d4de2082234ecbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.467569   648 raft_consensus.cc:3055] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:40.467949   648 raft_consensus.cc:740] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 26751650be15456b8baeae8df15f200e, State: Running, Role: LEADER
I20260709 12:22:40.468887   648 consensus_queue.cc:260] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:40.470283   648 raft_consensus.cc:3060] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.474211   574 raft_consensus.cc:2468] T 6a6c56432f394ca4989f10a000a792a3 P 30188513f3b64da49d4de2082234ecbf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a546db9f4a334400a87b045cca96bbf7 in term 2.
I20260709 12:22:40.475487   463 leader_election.cc:304] T 6a6c56432f394ca4989f10a000a792a3 P a546db9f4a334400a87b045cca96bbf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30188513f3b64da49d4de2082234ecbf, a546db9f4a334400a87b045cca96bbf7; no voters: 
I20260709 12:22:40.476282   697 raft_consensus.cc:2804] T 6a6c56432f394ca4989f10a000a792a3 P a546db9f4a334400a87b045cca96bbf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:40.476447   648 raft_consensus.cc:2468] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a546db9f4a334400a87b045cca96bbf7 in term 2.
I20260709 12:22:40.476909   697 raft_consensus.cc:697] T 6a6c56432f394ca4989f10a000a792a3 P a546db9f4a334400a87b045cca96bbf7 [term 2 LEADER]: Becoming Leader. State: Replica: a546db9f4a334400a87b045cca96bbf7, State: Running, Role: LEADER
I20260709 12:22:40.477821   697 consensus_queue.cc:237] T 6a6c56432f394ca4989f10a000a792a3 P a546db9f4a334400a87b045cca96bbf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:40.485466   396 catalog_manager.cc:5697] T 6a6c56432f394ca4989f10a000a792a3 P a546db9f4a334400a87b045cca96bbf7 reported cstate change: term changed from 1 to 2, leader changed from 26751650be15456b8baeae8df15f200e (127.22.155.195) to a546db9f4a334400a87b045cca96bbf7 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "a546db9f4a334400a87b045cca96bbf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:40.506031   732 consensus_queue.cc:1048] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:40.514240   731 raft_consensus.cc:993] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf: : Instructing follower a546db9f4a334400a87b045cca96bbf7 to start an election
I20260709 12:22:40.514837   730 raft_consensus.cc:1081] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [term 1 LEADER]: Signalling peer a546db9f4a334400a87b045cca96bbf7 to start an election
I20260709 12:22:40.517480   499 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9dbc88a94854413fa67bae3424c9412c"
dest_uuid: "a546db9f4a334400a87b045cca96bbf7"
 from {username='slave'} at 127.0.0.1:59326
I20260709 12:22:40.518157   499 raft_consensus.cc:493] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:40.519518   499 raft_consensus.cc:3060] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.522549   731 consensus_queue.cc:1048] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:40.528012   499 raft_consensus.cc:515] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:40.531227   499 leader_election.cc:290] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7 [CANDIDATE]: Term 2 election: Requested vote from peers 30188513f3b64da49d4de2082234ecbf (127.22.155.194:41171), 26751650be15456b8baeae8df15f200e (127.22.155.195:43013)
I20260709 12:22:40.533304   649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc88a94854413fa67bae3424c9412c" candidate_uuid: "a546db9f4a334400a87b045cca96bbf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "26751650be15456b8baeae8df15f200e"
I20260709 12:22:40.533516   574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc88a94854413fa67bae3424c9412c" candidate_uuid: "a546db9f4a334400a87b045cca96bbf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30188513f3b64da49d4de2082234ecbf"
I20260709 12:22:40.533973   649 raft_consensus.cc:3060] T 9dbc88a94854413fa67bae3424c9412c P 26751650be15456b8baeae8df15f200e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.534360   574 raft_consensus.cc:3055] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:40.534667   574 raft_consensus.cc:740] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30188513f3b64da49d4de2082234ecbf, State: Running, Role: LEADER
I20260709 12:22:40.535420   574 consensus_queue.cc:260] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:40.538645   574 raft_consensus.cc:3060] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.544620   649 raft_consensus.cc:2468] T 9dbc88a94854413fa67bae3424c9412c P 26751650be15456b8baeae8df15f200e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a546db9f4a334400a87b045cca96bbf7 in term 2.
I20260709 12:22:40.545490   574 raft_consensus.cc:2468] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a546db9f4a334400a87b045cca96bbf7 in term 2.
I20260709 12:22:40.545985   465 leader_election.cc:304] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26751650be15456b8baeae8df15f200e, a546db9f4a334400a87b045cca96bbf7; no voters: 
I20260709 12:22:40.547025   697 raft_consensus.cc:2804] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:40.547546   697 raft_consensus.cc:697] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7 [term 2 LEADER]: Becoming Leader. State: Replica: a546db9f4a334400a87b045cca96bbf7, State: Running, Role: LEADER
I20260709 12:22:40.548447   697 consensus_queue.cc:237] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:40.555325   398 catalog_manager.cc:5697] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7 reported cstate change: term changed from 1 to 2, leader changed from 30188513f3b64da49d4de2082234ecbf (127.22.155.194) to a546db9f4a334400a87b045cca96bbf7 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "a546db9f4a334400a87b045cca96bbf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:40.654537 23151 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:22:40.656080 23151 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:22:40.656425 23151 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:22:40.669922   499 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dbc88a94854413fa67bae3424c9412c"
dest_uuid: "a546db9f4a334400a87b045cca96bbf7"
mode: GRACEFUL
new_leader_uuid: "30188513f3b64da49d4de2082234ecbf"
 from {username='slave'} at 127.0.0.1:59340
I20260709 12:22:40.670571   499 raft_consensus.cc:606] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7 [term 2 LEADER]: Received request to transfer leadership to TS 30188513f3b64da49d4de2082234ecbf
I20260709 12:22:40.672238 23151 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:22:40.794243   499 raft_consensus.cc:1275] T d8a294dfef934e3183d67d4a1a4fae4d P a546db9f4a334400a87b045cca96bbf7 [term 2 FOLLOWER]: Refusing update from remote peer 26751650be15456b8baeae8df15f200e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:40.795756   695 consensus_queue.cc:1048] T d8a294dfef934e3183d67d4a1a4fae4d P 26751650be15456b8baeae8df15f200e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:40.804970   574 raft_consensus.cc:1275] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [term 2 FOLLOWER]: Refusing update from remote peer 26751650be15456b8baeae8df15f200e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:40.807193   720 consensus_queue.cc:1048] T d8a294dfef934e3183d67d4a1a4fae4d P 26751650be15456b8baeae8df15f200e [LEADER]: Connected to new peer: Peer: permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:40.854260   649 raft_consensus.cc:1275] T f3cb431c0dc34e51b65be406973d5962 P 26751650be15456b8baeae8df15f200e [term 2 FOLLOWER]: Refusing update from remote peer a546db9f4a334400a87b045cca96bbf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:40.855787   697 consensus_queue.cc:1048] T f3cb431c0dc34e51b65be406973d5962 P a546db9f4a334400a87b045cca96bbf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:40.864770   574 raft_consensus.cc:1275] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [term 2 FOLLOWER]: Refusing update from remote peer a546db9f4a334400a87b045cca96bbf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:40.866600   745 consensus_queue.cc:1048] T f3cb431c0dc34e51b65be406973d5962 P a546db9f4a334400a87b045cca96bbf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:40.926223   649 raft_consensus.cc:1275] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [term 2 FOLLOWER]: Refusing update from remote peer a546db9f4a334400a87b045cca96bbf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:40.928035   745 consensus_queue.cc:1048] T 6a6c56432f394ca4989f10a000a792a3 P a546db9f4a334400a87b045cca96bbf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:40.928380   574 raft_consensus.cc:1275] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [term 2 FOLLOWER]: Refusing update from remote peer a546db9f4a334400a87b045cca96bbf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:40.929957   745 consensus_queue.cc:1048] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:40.942402   745 raft_consensus.cc:993] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7: : Instructing follower 30188513f3b64da49d4de2082234ecbf to start an election
I20260709 12:22:40.947880   574 raft_consensus.cc:1275] T 6a6c56432f394ca4989f10a000a792a3 P 30188513f3b64da49d4de2082234ecbf [term 2 FOLLOWER]: Refusing update from remote peer a546db9f4a334400a87b045cca96bbf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:40.949663   745 raft_consensus.cc:1081] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7 [term 2 LEADER]: Signalling peer 30188513f3b64da49d4de2082234ecbf to start an election
I20260709 12:22:40.952797   574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9dbc88a94854413fa67bae3424c9412c"
dest_uuid: "30188513f3b64da49d4de2082234ecbf"
 from {username='slave'} at 127.0.0.1:51340
I20260709 12:22:40.953496   574 raft_consensus.cc:493] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:40.952703   736 consensus_queue.cc:1048] T 6a6c56432f394ca4989f10a000a792a3 P a546db9f4a334400a87b045cca96bbf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:40.953917   574 raft_consensus.cc:3060] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:40.955782   649 raft_consensus.cc:1275] T 9dbc88a94854413fa67bae3424c9412c P 26751650be15456b8baeae8df15f200e [term 2 FOLLOWER]: Refusing update from remote peer a546db9f4a334400a87b045cca96bbf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:40.962729   745 consensus_queue.cc:1048] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:40.963858   574 raft_consensus.cc:515] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:40.967113   574 leader_election.cc:290] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [CANDIDATE]: Term 3 election: Requested vote from peers a546db9f4a334400a87b045cca96bbf7 (127.22.155.193:42991), 26751650be15456b8baeae8df15f200e (127.22.155.195:43013)
I20260709 12:22:40.968230   648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc88a94854413fa67bae3424c9412c" candidate_uuid: "30188513f3b64da49d4de2082234ecbf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "26751650be15456b8baeae8df15f200e"
I20260709 12:22:40.968511   499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc88a94854413fa67bae3424c9412c" candidate_uuid: "30188513f3b64da49d4de2082234ecbf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a546db9f4a334400a87b045cca96bbf7"
I20260709 12:22:40.969343   499 raft_consensus.cc:3055] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:40.969702   499 raft_consensus.cc:740] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a546db9f4a334400a87b045cca96bbf7, State: Running, Role: LEADER
I20260709 12:22:40.970618   499 consensus_queue.cc:260] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:40.972023   499 raft_consensus.cc:3060] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:40.980015   499 raft_consensus.cc:2468] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30188513f3b64da49d4de2082234ecbf in term 3.
I20260709 12:22:40.981359   539 leader_election.cc:304] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30188513f3b64da49d4de2082234ecbf, a546db9f4a334400a87b045cca96bbf7; no voters: 26751650be15456b8baeae8df15f200e
I20260709 12:22:40.982182   731 raft_consensus.cc:2804] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:40.982686   731 raft_consensus.cc:697] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [term 3 LEADER]: Becoming Leader. State: Replica: 30188513f3b64da49d4de2082234ecbf, State: Running, Role: LEADER
I20260709 12:22:40.983402   731 consensus_queue.cc:237] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } }
I20260709 12:22:40.989588   396 catalog_manager.cc:5697] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf reported cstate change: term changed from 2 to 3, leader changed from a546db9f4a334400a87b045cca96bbf7 (127.22.155.193) to 30188513f3b64da49d4de2082234ecbf (127.22.155.194). New cstate: current_term: 3 leader_uuid: "30188513f3b64da49d4de2082234ecbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a546db9f4a334400a87b045cca96bbf7" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 42991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30188513f3b64da49d4de2082234ecbf" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 41171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26751650be15456b8baeae8df15f200e" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 43013 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:41.037307 23151 tablet_server.cc:179] TabletServer@127.22.155.193:0 shutting down...
I20260709 12:22:41.063131 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:41.063850 23151 tablet_replica.cc:333] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7: stopping tablet replica
I20260709 12:22:41.064479 23151 raft_consensus.cc:2243] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:41.064999 23151 raft_consensus.cc:2272] T 9dbc88a94854413fa67bae3424c9412c P a546db9f4a334400a87b045cca96bbf7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:41.067459 23151 tablet_replica.cc:333] T 6a6c56432f394ca4989f10a000a792a3 P a546db9f4a334400a87b045cca96bbf7: stopping tablet replica
I20260709 12:22:41.067943 23151 raft_consensus.cc:2243] T 6a6c56432f394ca4989f10a000a792a3 P a546db9f4a334400a87b045cca96bbf7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:41.068794 23151 raft_consensus.cc:2272] T 6a6c56432f394ca4989f10a000a792a3 P a546db9f4a334400a87b045cca96bbf7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:41.071053 23151 tablet_replica.cc:333] T d8a294dfef934e3183d67d4a1a4fae4d P a546db9f4a334400a87b045cca96bbf7: stopping tablet replica
I20260709 12:22:41.071527 23151 raft_consensus.cc:2243] T d8a294dfef934e3183d67d4a1a4fae4d P a546db9f4a334400a87b045cca96bbf7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:41.071962 23151 raft_consensus.cc:2272] T d8a294dfef934e3183d67d4a1a4fae4d P a546db9f4a334400a87b045cca96bbf7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:41.074340 23151 tablet_replica.cc:333] T f3cb431c0dc34e51b65be406973d5962 P a546db9f4a334400a87b045cca96bbf7: stopping tablet replica
I20260709 12:22:41.074844 23151 raft_consensus.cc:2243] T f3cb431c0dc34e51b65be406973d5962 P a546db9f4a334400a87b045cca96bbf7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:41.075733 23151 raft_consensus.cc:2272] T f3cb431c0dc34e51b65be406973d5962 P a546db9f4a334400a87b045cca96bbf7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:41.091648 23151 tablet_server.cc:196] TabletServer@127.22.155.193:0 shutdown complete.
I20260709 12:22:41.107398 23151 tablet_server.cc:179] TabletServer@127.22.155.194:0 shutting down...
I20260709 12:22:41.128939 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:41.129596 23151 tablet_replica.cc:333] T 6a6c56432f394ca4989f10a000a792a3 P 30188513f3b64da49d4de2082234ecbf: stopping tablet replica
I20260709 12:22:41.130185 23151 raft_consensus.cc:2243] T 6a6c56432f394ca4989f10a000a792a3 P 30188513f3b64da49d4de2082234ecbf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:41.130668 23151 raft_consensus.cc:2272] T 6a6c56432f394ca4989f10a000a792a3 P 30188513f3b64da49d4de2082234ecbf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:41.133142 23151 tablet_replica.cc:333] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf: stopping tablet replica
I20260709 12:22:41.133662 23151 raft_consensus.cc:2243] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:41.134308 23151 pending_rounds.cc:70] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf: Trying to abort 1 pending ops.
I20260709 12:22:41.134516 23151 pending_rounds.cc:77] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305624620995629056 op_type: NO_OP noop_request { }
I20260709 12:22:41.134821 23151 raft_consensus.cc:2889] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:22:41.135094 23151 raft_consensus.cc:2272] T 9dbc88a94854413fa67bae3424c9412c P 30188513f3b64da49d4de2082234ecbf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:41.137409 23151 tablet_replica.cc:333] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf: stopping tablet replica
I20260709 12:22:41.137928 23151 raft_consensus.cc:2243] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:41.138362 23151 raft_consensus.cc:2272] T d8a294dfef934e3183d67d4a1a4fae4d P 30188513f3b64da49d4de2082234ecbf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:41.140509 23151 tablet_replica.cc:333] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf: stopping tablet replica
I20260709 12:22:41.141052 23151 raft_consensus.cc:2243] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:41.141503 23151 raft_consensus.cc:2272] T f3cb431c0dc34e51b65be406973d5962 P 30188513f3b64da49d4de2082234ecbf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:41.155284 23151 tablet_server.cc:196] TabletServer@127.22.155.194:0 shutdown complete.
I20260709 12:22:41.170344 23151 tablet_server.cc:179] TabletServer@127.22.155.195:0 shutting down...
I20260709 12:22:41.192984 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:41.193800 23151 tablet_replica.cc:333] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e: stopping tablet replica
I20260709 12:22:41.194445 23151 raft_consensus.cc:2243] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:41.194953 23151 raft_consensus.cc:2272] T 6a6c56432f394ca4989f10a000a792a3 P 26751650be15456b8baeae8df15f200e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:41.197680 23151 tablet_replica.cc:333] T 9dbc88a94854413fa67bae3424c9412c P 26751650be15456b8baeae8df15f200e: stopping tablet replica
I20260709 12:22:41.198218 23151 raft_consensus.cc:2243] T 9dbc88a94854413fa67bae3424c9412c P 26751650be15456b8baeae8df15f200e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:41.198660 23151 raft_consensus.cc:2272] T 9dbc88a94854413fa67bae3424c9412c P 26751650be15456b8baeae8df15f200e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:41.201555 23151 tablet_replica.cc:333] T d8a294dfef934e3183d67d4a1a4fae4d P 26751650be15456b8baeae8df15f200e: stopping tablet replica
I20260709 12:22:41.202066 23151 raft_consensus.cc:2243] T d8a294dfef934e3183d67d4a1a4fae4d P 26751650be15456b8baeae8df15f200e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:41.202984 23151 raft_consensus.cc:2272] T d8a294dfef934e3183d67d4a1a4fae4d P 26751650be15456b8baeae8df15f200e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:41.205578 23151 tablet_replica.cc:333] T f3cb431c0dc34e51b65be406973d5962 P 26751650be15456b8baeae8df15f200e: stopping tablet replica
I20260709 12:22:41.206069 23151 raft_consensus.cc:2243] T f3cb431c0dc34e51b65be406973d5962 P 26751650be15456b8baeae8df15f200e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:41.206485 23151 raft_consensus.cc:2272] T f3cb431c0dc34e51b65be406973d5962 P 26751650be15456b8baeae8df15f200e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:41.232560 23151 tablet_server.cc:196] TabletServer@127.22.155.195:0 shutdown complete.
I20260709 12:22:41.247821 23151 master.cc:562] Master@127.22.155.254:33467 shutting down...
I20260709 12:22:41.266966 23151 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 13084003de984d61a6310c0108b36064 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:41.267619 23151 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 13084003de984d61a6310c0108b36064 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:41.267970 23151 tablet_replica.cc:333] T 00000000000000000000000000000000 P 13084003de984d61a6310c0108b36064: stopping tablet replica
I20260709 12:22:41.288295 23151 master.cc:584] Master@127.22.155.254:33467 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2532 ms)
[----------] 6 tests from LeaderRebalancerTest (360881 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:22:41.321642 23151 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.155.254:44079
I20260709 12:22:41.323020 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:41.328995   748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:41.329308   749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:41.330699   751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:41.332036 23151 server_base.cc:1061] running on GCE node
I20260709 12:22:41.333026 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:41.333250 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:41.333410 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599761333388 us; error 0 us; skew 500 ppm
I20260709 12:22:41.334002 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:41.336715 23151 webserver.cc:533] Webserver started at http://127.22.155.254:34431/ using document root <none> and password file <none>
I20260709 12:22:41.337245 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:41.337457 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:41.337764 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:41.338984 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599400258298-23151-0/minicluster-data/master-0-root/instance:
uuid: "3b3a5bb5af134348a37a7f0fc773a300"
format_stamp: "Formatted at 2026-07-09 12:22:41 on dist-test-slave-p7fg"
I20260709 12:22:41.344126 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:22:41.348073   756 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:41.349119 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:22:41.349392 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599400258298-23151-0/minicluster-data/master-0-root
uuid: "3b3a5bb5af134348a37a7f0fc773a300"
format_stamp: "Formatted at 2026-07-09 12:22:41 on dist-test-slave-p7fg"
I20260709 12:22:41.349661 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599400258298-23151-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599400258298-23151-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599400258298-23151-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:41.361624 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:41.362602 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:41.401506 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.254:44079
I20260709 12:22:41.401664   807 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.254:44079 every 8 connection(s)
I20260709 12:22:41.405715   808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:41.417897   808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b3a5bb5af134348a37a7f0fc773a300: Bootstrap starting.
I20260709 12:22:41.422856   808 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b3a5bb5af134348a37a7f0fc773a300: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:41.427479   808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b3a5bb5af134348a37a7f0fc773a300: No bootstrap required, opened a new log
I20260709 12:22:41.429881   808 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3b3a5bb5af134348a37a7f0fc773a300 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b3a5bb5af134348a37a7f0fc773a300" member_type: VOTER }
I20260709 12:22:41.430330   808 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3b3a5bb5af134348a37a7f0fc773a300 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.430673   808 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3b3a5bb5af134348a37a7f0fc773a300 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b3a5bb5af134348a37a7f0fc773a300, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.431433   808 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b3a5bb5af134348a37a7f0fc773a300 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b3a5bb5af134348a37a7f0fc773a300" member_type: VOTER }
I20260709 12:22:41.432094   808 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3b3a5bb5af134348a37a7f0fc773a300 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:41.432386   808 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3b3a5bb5af134348a37a7f0fc773a300 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:41.455233   808 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3b3a5bb5af134348a37a7f0fc773a300 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.463661   808 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3b3a5bb5af134348a37a7f0fc773a300 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b3a5bb5af134348a37a7f0fc773a300" member_type: VOTER }
I20260709 12:22:41.464311   808 leader_election.cc:304] T 00000000000000000000000000000000 P 3b3a5bb5af134348a37a7f0fc773a300 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3b3a5bb5af134348a37a7f0fc773a300; no voters: 
I20260709 12:22:41.465751   808 leader_election.cc:290] T 00000000000000000000000000000000 P 3b3a5bb5af134348a37a7f0fc773a300 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:41.466460   812 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3b3a5bb5af134348a37a7f0fc773a300 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:41.468600   812 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3b3a5bb5af134348a37a7f0fc773a300 [term 1 LEADER]: Becoming Leader. State: Replica: 3b3a5bb5af134348a37a7f0fc773a300, State: Running, Role: LEADER
I20260709 12:22:41.469596   808 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3b3a5bb5af134348a37a7f0fc773a300 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:41.469615   812 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b3a5bb5af134348a37a7f0fc773a300 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b3a5bb5af134348a37a7f0fc773a300" member_type: VOTER }
I20260709 12:22:41.475067   814 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b3a5bb5af134348a37a7f0fc773a300 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b3a5bb5af134348a37a7f0fc773a300. Latest consensus state: current_term: 1 leader_uuid: "3b3a5bb5af134348a37a7f0fc773a300" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b3a5bb5af134348a37a7f0fc773a300" member_type: VOTER } }
I20260709 12:22:41.475044   813 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b3a5bb5af134348a37a7f0fc773a300 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3b3a5bb5af134348a37a7f0fc773a300" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b3a5bb5af134348a37a7f0fc773a300" member_type: VOTER } }
I20260709 12:22:41.475863   813 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b3a5bb5af134348a37a7f0fc773a300 [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:41.476444   814 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b3a5bb5af134348a37a7f0fc773a300 [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:41.484494   818 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:41.490511   818 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:41.491977 23151 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:41.501550   818 catalog_manager.cc:1383] Generated new cluster ID: b6e3aef7da954e8a84b7fc5d9d0e8dbb
I20260709 12:22:41.501946   818 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:41.529698   818 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:41.531307   818 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:41.544724   818 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3b3a5bb5af134348a37a7f0fc773a300: Generated new TSK 0
I20260709 12:22:41.545456   818 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:41.559716 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:41.568917   830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:41.570009   831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:41.571408   833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:41.573020 23151 server_base.cc:1061] running on GCE node
I20260709 12:22:41.574252 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:41.574457 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:41.574695 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599761574676 us; error 0 us; skew 500 ppm
I20260709 12:22:41.575399 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:41.578696 23151 webserver.cc:533] Webserver started at http://127.22.155.193:45845/ using document root <none> and password file <none>
I20260709 12:22:41.579306 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:41.579524 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:41.579957 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:41.581641 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599400258298-23151-0/minicluster-data/ts-0-root/instance:
uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
format_stamp: "Formatted at 2026-07-09 12:22:41 on dist-test-slave-p7fg"
I20260709 12:22:41.587394 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.003s
I20260709 12:22:41.591722   838 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:41.592756 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:22:41.593153 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599400258298-23151-0/minicluster-data/ts-0-root
uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
format_stamp: "Formatted at 2026-07-09 12:22:41 on dist-test-slave-p7fg"
I20260709 12:22:41.593505 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599400258298-23151-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599400258298-23151-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599400258298-23151-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:41.605791 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:41.607390 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:41.609256 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:41.612259 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:41.612500 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:41.612802 23151 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:41.612957 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:41.665418 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.193:33605
I20260709 12:22:41.665584   900 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.193:33605 every 8 connection(s)
I20260709 12:22:41.673501 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:41.683882   905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:41.685029   906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:41.693635   901 heartbeater.cc:344] Connected to a master server at 127.22.155.254:44079
I20260709 12:22:41.693780 23151 server_base.cc:1061] running on GCE node
I20260709 12:22:41.694192   901 heartbeater.cc:461] Registering TS with master...
W20260709 12:22:41.694507   909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:41.695463   901 heartbeater.cc:507] Master 127.22.155.254:44079 requested a full tablet report, sending...
I20260709 12:22:41.696147 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:41.696395 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:41.696621 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599761696599 us; error 0 us; skew 500 ppm
I20260709 12:22:41.697592 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:41.698386   773 ts_manager.cc:194] Registered new tserver with Master: 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605)
I20260709 12:22:41.700623 23151 webserver.cc:533] Webserver started at http://127.22.155.194:33997/ using document root <none> and password file <none>
I20260709 12:22:41.701074   773 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54590
I20260709 12:22:41.701335 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:41.701669 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:41.701977 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:41.703683 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599400258298-23151-0/minicluster-data/ts-1-root/instance:
uuid: "a92e1b02d25b49cfb108c1156f368fc3"
format_stamp: "Formatted at 2026-07-09 12:22:41 on dist-test-slave-p7fg"
I20260709 12:22:41.708796 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:22:41.712838   913 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:41.713835 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:22:41.714123 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599400258298-23151-0/minicluster-data/ts-1-root
uuid: "a92e1b02d25b49cfb108c1156f368fc3"
format_stamp: "Formatted at 2026-07-09 12:22:41 on dist-test-slave-p7fg"
I20260709 12:22:41.714380 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599400258298-23151-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599400258298-23151-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599400258298-23151-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:41.727440 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:41.728711 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:41.730300 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:41.732800 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:41.732988 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:41.733312 23151 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:41.733456 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:41.780521 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.194:39583
I20260709 12:22:41.780915   975 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.194:39583 every 8 connection(s)
I20260709 12:22:41.786098 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:41.794667   979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:41.795747   980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:41.799045   982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:41.800206 23151 server_base.cc:1061] running on GCE node
I20260709 12:22:41.800885   976 heartbeater.cc:344] Connected to a master server at 127.22.155.254:44079
I20260709 12:22:41.801362   976 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:41.801520 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:41.801847 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:41.802047 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599761802008 us; error 0 us; skew 500 ppm
I20260709 12:22:41.802304   976 heartbeater.cc:507] Master 127.22.155.254:44079 requested a full tablet report, sending...
I20260709 12:22:41.802834 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:41.804968   773 ts_manager.cc:194] Registered new tserver with Master: a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583)
I20260709 12:22:41.806293 23151 webserver.cc:533] Webserver started at http://127.22.155.195:39661/ using document root <none> and password file <none>
I20260709 12:22:41.807099 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:41.807180   773 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54600
I20260709 12:22:41.807382 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:41.807803 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:41.809598 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599400258298-23151-0/minicluster-data/ts-2-root/instance:
uuid: "91fb18caf57c4ad685ecac3334f1794f"
format_stamp: "Formatted at 2026-07-09 12:22:41 on dist-test-slave-p7fg"
I20260709 12:22:41.814622 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:22:41.818698   987 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:41.819636 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:22:41.819993 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599400258298-23151-0/minicluster-data/ts-2-root
uuid: "91fb18caf57c4ad685ecac3334f1794f"
format_stamp: "Formatted at 2026-07-09 12:22:41 on dist-test-slave-p7fg"
I20260709 12:22:41.820340 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599400258298-23151-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599400258298-23151-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599400258298-23151-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:41.843410 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:41.844875 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:41.846570 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:41.849067 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:41.849342 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:41.849604 23151 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:41.849822 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:41.898988 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.195:38329
I20260709 12:22:41.899096  1049 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.195:38329 every 8 connection(s)
I20260709 12:22:41.915174  1050 heartbeater.cc:344] Connected to a master server at 127.22.155.254:44079
I20260709 12:22:41.915689  1050 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:41.916837  1050 heartbeater.cc:507] Master 127.22.155.254:44079 requested a full tablet report, sending...
I20260709 12:22:41.919118   773 ts_manager.cc:194] Registered new tserver with Master: 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:41.920099 23151 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017351694s
I20260709 12:22:41.920976   773 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54616
I20260709 12:22:41.952211   773 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54626:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:41.955291   773 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:42.030814   941 tablet_service.cc:1511] Processing CreateTablet for tablet a949969ca97842678559e3c98dcbacab (DEFAULT_TABLE table=test-workload [id=92df9487e6914655a121bac29ae757ed]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:42.031075   940 tablet_service.cc:1511] Processing CreateTablet for tablet 158ee92d754f40d187a7702eb6807583 (DEFAULT_TABLE table=test-workload [id=92df9487e6914655a121bac29ae757ed]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:42.032516   941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a949969ca97842678559e3c98dcbacab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:42.033311   940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 158ee92d754f40d187a7702eb6807583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:42.045763   866 tablet_service.cc:1511] Processing CreateTablet for tablet a949969ca97842678559e3c98dcbacab (DEFAULT_TABLE table=test-workload [id=92df9487e6914655a121bac29ae757ed]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:42.047318   866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a949969ca97842678559e3c98dcbacab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:42.049840  1013 tablet_service.cc:1511] Processing CreateTablet for tablet 4c947c22c6224f85b77fef1e288bc140 (DEFAULT_TABLE table=test-workload [id=92df9487e6914655a121bac29ae757ed]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:42.050374  1014 tablet_service.cc:1511] Processing CreateTablet for tablet 158ee92d754f40d187a7702eb6807583 (DEFAULT_TABLE table=test-workload [id=92df9487e6914655a121bac29ae757ed]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:42.050529   939 tablet_service.cc:1511] Processing CreateTablet for tablet 4c947c22c6224f85b77fef1e288bc140 (DEFAULT_TABLE table=test-workload [id=92df9487e6914655a121bac29ae757ed]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:42.051422  1013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c947c22c6224f85b77fef1e288bc140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:42.052292   939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c947c22c6224f85b77fef1e288bc140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:42.053112   864 tablet_service.cc:1511] Processing CreateTablet for tablet 4c947c22c6224f85b77fef1e288bc140 (DEFAULT_TABLE table=test-workload [id=92df9487e6914655a121bac29ae757ed]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:42.054664   864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c947c22c6224f85b77fef1e288bc140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:42.045588   865 tablet_service.cc:1511] Processing CreateTablet for tablet 158ee92d754f40d187a7702eb6807583 (DEFAULT_TABLE table=test-workload [id=92df9487e6914655a121bac29ae757ed]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:42.057256  1015 tablet_service.cc:1511] Processing CreateTablet for tablet a949969ca97842678559e3c98dcbacab (DEFAULT_TABLE table=test-workload [id=92df9487e6914655a121bac29ae757ed]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:42.058203   865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 158ee92d754f40d187a7702eb6807583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:42.058686  1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a949969ca97842678559e3c98dcbacab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:42.059154   938 tablet_service.cc:1511] Processing CreateTablet for tablet 8a51831e613e4dfc83fcde95752585a6 (DEFAULT_TABLE table=test-workload [id=92df9487e6914655a121bac29ae757ed]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:42.060786   938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a51831e613e4dfc83fcde95752585a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:42.062670  1012 tablet_service.cc:1511] Processing CreateTablet for tablet 8a51831e613e4dfc83fcde95752585a6 (DEFAULT_TABLE table=test-workload [id=92df9487e6914655a121bac29ae757ed]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:42.064296  1012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a51831e613e4dfc83fcde95752585a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:42.065330   863 tablet_service.cc:1511] Processing CreateTablet for tablet 8a51831e613e4dfc83fcde95752585a6 (DEFAULT_TABLE table=test-workload [id=92df9487e6914655a121bac29ae757ed]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:42.066962   863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a51831e613e4dfc83fcde95752585a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:42.067085  1011 tablet_service.cc:1511] Processing CreateTablet for tablet 25d5d6c8f96143a1abaef7b427036b5e (DEFAULT_TABLE table=test-workload [id=92df9487e6914655a121bac29ae757ed]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:42.069975   937 tablet_service.cc:1511] Processing CreateTablet for tablet 25d5d6c8f96143a1abaef7b427036b5e (DEFAULT_TABLE table=test-workload [id=92df9487e6914655a121bac29ae757ed]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:42.070318   936 tablet_service.cc:1511] Processing CreateTablet for tablet 711fc51040264325aa09cebd07d5d5f4 (DEFAULT_TABLE table=test-workload [id=92df9487e6914655a121bac29ae757ed]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:42.071547   937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d5d6c8f96143a1abaef7b427036b5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:42.072141  1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 158ee92d754f40d187a7702eb6807583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:42.072208   936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 711fc51040264325aa09cebd07d5d5f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:42.073714  1011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d5d6c8f96143a1abaef7b427036b5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:42.075241   862 tablet_service.cc:1511] Processing CreateTablet for tablet 25d5d6c8f96143a1abaef7b427036b5e (DEFAULT_TABLE table=test-workload [id=92df9487e6914655a121bac29ae757ed]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:42.076946   862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d5d6c8f96143a1abaef7b427036b5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:42.085117  1010 tablet_service.cc:1511] Processing CreateTablet for tablet 711fc51040264325aa09cebd07d5d5f4 (DEFAULT_TABLE table=test-workload [id=92df9487e6914655a121bac29ae757ed]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:42.086742  1010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 711fc51040264325aa09cebd07d5d5f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:42.091807   861 tablet_service.cc:1511] Processing CreateTablet for tablet 711fc51040264325aa09cebd07d5d5f4 (DEFAULT_TABLE table=test-workload [id=92df9487e6914655a121bac29ae757ed]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:42.093660   861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 711fc51040264325aa09cebd07d5d5f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:42.117313   860 tablet_service.cc:1511] Processing CreateTablet for tablet 3c3711921af14a5ab73080170199d621 (DEFAULT_TABLE table=test-workload [id=92df9487e6914655a121bac29ae757ed]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:42.119683   860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c3711921af14a5ab73080170199d621. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:42.132028   935 tablet_service.cc:1511] Processing CreateTablet for tablet 3c3711921af14a5ab73080170199d621 (DEFAULT_TABLE table=test-workload [id=92df9487e6914655a121bac29ae757ed]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:42.133752   935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c3711921af14a5ab73080170199d621. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:42.135288  1009 tablet_service.cc:1511] Processing CreateTablet for tablet 3c3711921af14a5ab73080170199d621 (DEFAULT_TABLE table=test-workload [id=92df9487e6914655a121bac29ae757ed]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:42.136942  1009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c3711921af14a5ab73080170199d621. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:42.149075   859 tablet_service.cc:1511] Processing CreateTablet for tablet 3001aaf097cd4643b552a2d9ffe4e451 (DEFAULT_TABLE table=test-workload [id=92df9487e6914655a121bac29ae757ed]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:42.150709   859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3001aaf097cd4643b552a2d9ffe4e451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:42.159493   934 tablet_service.cc:1511] Processing CreateTablet for tablet 3001aaf097cd4643b552a2d9ffe4e451 (DEFAULT_TABLE table=test-workload [id=92df9487e6914655a121bac29ae757ed]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:42.161132   934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3001aaf097cd4643b552a2d9ffe4e451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:42.164584  1065 tablet_bootstrap.cc:492] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3: Bootstrap starting.
I20260709 12:22:42.225529  1065 tablet_bootstrap.cc:654] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.225612  1066 tablet_bootstrap.cc:492] T 711fc51040264325aa09cebd07d5d5f4 P 91fb18caf57c4ad685ecac3334f1794f: Bootstrap starting.
I20260709 12:22:42.233911  1014 tablet_service.cc:1511] Processing CreateTablet for tablet 3001aaf097cd4643b552a2d9ffe4e451 (DEFAULT_TABLE table=test-workload [id=92df9487e6914655a121bac29ae757ed]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:42.237171  1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3001aaf097cd4643b552a2d9ffe4e451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:42.239589  1066 tablet_bootstrap.cc:654] T 711fc51040264325aa09cebd07d5d5f4 P 91fb18caf57c4ad685ecac3334f1794f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.247937  1011 tablet_service.cc:1511] Processing CreateTablet for tablet 8fcfa22eac4141c4861b32aac5eaa5eb (DEFAULT_TABLE table=test-workload [id=92df9487e6914655a121bac29ae757ed]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:42.250072  1011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fcfa22eac4141c4861b32aac5eaa5eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:42.253093  1067 tablet_bootstrap.cc:492] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18: Bootstrap starting.
I20260709 12:22:42.259949   934 tablet_service.cc:1511] Processing CreateTablet for tablet 8fcfa22eac4141c4861b32aac5eaa5eb (DEFAULT_TABLE table=test-workload [id=92df9487e6914655a121bac29ae757ed]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:42.261533   934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fcfa22eac4141c4861b32aac5eaa5eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:42.264412   863 tablet_service.cc:1511] Processing CreateTablet for tablet 8fcfa22eac4141c4861b32aac5eaa5eb (DEFAULT_TABLE table=test-workload [id=92df9487e6914655a121bac29ae757ed]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:42.265709  1065 tablet_bootstrap.cc:492] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3: No bootstrap required, opened a new log
I20260709 12:22:42.265957   863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fcfa22eac4141c4861b32aac5eaa5eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:42.266386  1067 tablet_bootstrap.cc:654] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.266438  1065 ts_tablet_manager.cc:1403] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3: Time spent bootstrapping tablet: real 0.102s	user 0.019s	sys 0.013s
I20260709 12:22:42.270799  1065 raft_consensus.cc:359] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.271581  1065 raft_consensus.cc:385] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.271901  1065 raft_consensus.cc:740] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.272676  1066 tablet_bootstrap.cc:492] T 711fc51040264325aa09cebd07d5d5f4 P 91fb18caf57c4ad685ecac3334f1794f: No bootstrap required, opened a new log
I20260709 12:22:42.273499  1066 ts_tablet_manager.cc:1403] T 711fc51040264325aa09cebd07d5d5f4 P 91fb18caf57c4ad685ecac3334f1794f: Time spent bootstrapping tablet: real 0.048s	user 0.006s	sys 0.010s
I20260709 12:22:42.272776  1065 consensus_queue.cc:260] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.277087  1066 raft_consensus.cc:359] T 711fc51040264325aa09cebd07d5d5f4 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.277889  1066 raft_consensus.cc:385] T 711fc51040264325aa09cebd07d5d5f4 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.278358  1066 raft_consensus.cc:740] T 711fc51040264325aa09cebd07d5d5f4 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.279378  1066 consensus_queue.cc:260] T 711fc51040264325aa09cebd07d5d5f4 P 91fb18caf57c4ad685ecac3334f1794f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.290819  1066 ts_tablet_manager.cc:1434] T 711fc51040264325aa09cebd07d5d5f4 P 91fb18caf57c4ad685ecac3334f1794f: Time spent starting tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 12:22:42.291288  1067 tablet_bootstrap.cc:492] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18: No bootstrap required, opened a new log
I20260709 12:22:42.291682  1050 heartbeater.cc:499] Master 127.22.155.254:44079 was elected leader, sending a full tablet report...
I20260709 12:22:42.292028  1067 ts_tablet_manager.cc:1403] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.003s
I20260709 12:22:42.296711   976 heartbeater.cc:499] Master 127.22.155.254:44079 was elected leader, sending a full tablet report...
I20260709 12:22:42.297211  1065 ts_tablet_manager.cc:1434] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3: Time spent starting tablet: real 0.030s	user 0.017s	sys 0.013s
I20260709 12:22:42.298484  1065 tablet_bootstrap.cc:492] T 4c947c22c6224f85b77fef1e288bc140 P a92e1b02d25b49cfb108c1156f368fc3: Bootstrap starting.
I20260709 12:22:42.305964  1065 tablet_bootstrap.cc:654] T 4c947c22c6224f85b77fef1e288bc140 P a92e1b02d25b49cfb108c1156f368fc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.307936  1067 raft_consensus.cc:359] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.308985  1067 raft_consensus.cc:385] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.309309  1067 raft_consensus.cc:740] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.310284  1067 consensus_queue.cc:260] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.311379  1066 tablet_bootstrap.cc:492] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f: Bootstrap starting.
I20260709 12:22:42.328824  1072 raft_consensus.cc:493] T 711fc51040264325aa09cebd07d5d5f4 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.329769  1072 raft_consensus.cc:515] T 711fc51040264325aa09cebd07d5d5f4 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.352895  1072 leader_election.cc:290] T 711fc51040264325aa09cebd07d5d5f4 P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583)
I20260709 12:22:42.363691  1067 ts_tablet_manager.cc:1434] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent starting tablet: real 0.071s	user 0.024s	sys 0.014s
I20260709 12:22:42.364429  1066 tablet_bootstrap.cc:654] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.366673   901 heartbeater.cc:499] Master 127.22.155.254:44079 was elected leader, sending a full tablet report...
I20260709 12:22:42.372519  1067 tablet_bootstrap.cc:492] T 3001aaf097cd4643b552a2d9ffe4e451 P 92e9b78bc90b4d2199d6926b30ce4f18: Bootstrap starting.
I20260709 12:22:42.376848  1074 raft_consensus.cc:493] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.377741  1074 raft_consensus.cc:515] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.380707  1067 tablet_bootstrap.cc:654] T 3001aaf097cd4643b552a2d9ffe4e451 P 92e9b78bc90b4d2199d6926b30ce4f18: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.392524  1065 tablet_bootstrap.cc:492] T 4c947c22c6224f85b77fef1e288bc140 P a92e1b02d25b49cfb108c1156f368fc3: No bootstrap required, opened a new log
I20260709 12:22:42.393204  1065 ts_tablet_manager.cc:1403] T 4c947c22c6224f85b77fef1e288bc140 P a92e1b02d25b49cfb108c1156f368fc3: Time spent bootstrapping tablet: real 0.095s	user 0.034s	sys 0.031s
I20260709 12:22:42.399886   876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711fc51040264325aa09cebd07d5d5f4" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" is_pre_election: true
I20260709 12:22:42.397590  1065 raft_consensus.cc:359] T 4c947c22c6224f85b77fef1e288bc140 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.402107  1065 raft_consensus.cc:385] T 4c947c22c6224f85b77fef1e288bc140 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:22:42.402374   988 leader_election.cc:343] T 711fc51040264325aa09cebd07d5d5f4 P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:42.402474  1065 raft_consensus.cc:740] T 4c947c22c6224f85b77fef1e288bc140 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.404495  1074 leader_election.cc:290] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:42.407850  1065 consensus_queue.cc:260] T 4c947c22c6224f85b77fef1e288bc140 P a92e1b02d25b49cfb108c1156f368fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.413658  1065 ts_tablet_manager.cc:1434] T 4c947c22c6224f85b77fef1e288bc140 P a92e1b02d25b49cfb108c1156f368fc3: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.001s
I20260709 12:22:42.414263  1066 tablet_bootstrap.cc:492] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f: No bootstrap required, opened a new log
I20260709 12:22:42.414883  1065 tablet_bootstrap.cc:492] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3: Bootstrap starting.
I20260709 12:22:42.414932  1066 ts_tablet_manager.cc:1403] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f: Time spent bootstrapping tablet: real 0.110s	user 0.011s	sys 0.009s
I20260709 12:22:42.421756  1066 raft_consensus.cc:359] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.423111  1066 raft_consensus.cc:385] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.423440  1066 raft_consensus.cc:740] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.423400   951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711fc51040264325aa09cebd07d5d5f4" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3" is_pre_election: true
I20260709 12:22:42.424831  1066 consensus_queue.cc:260] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.434357  1065 tablet_bootstrap.cc:654] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.436535  1066 ts_tablet_manager.cc:1434] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.002s
I20260709 12:22:42.428434  1067 tablet_bootstrap.cc:492] T 3001aaf097cd4643b552a2d9ffe4e451 P 92e9b78bc90b4d2199d6926b30ce4f18: No bootstrap required, opened a new log
W20260709 12:22:42.430533   991 leader_election.cc:343] T 711fc51040264325aa09cebd07d5d5f4 P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:42.437461   991 leader_election.cc:304] T 711fc51040264325aa09cebd07d5d5f4 P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f; no voters: 92e9b78bc90b4d2199d6926b30ce4f18, a92e1b02d25b49cfb108c1156f368fc3
I20260709 12:22:42.437824  1066 tablet_bootstrap.cc:492] T 158ee92d754f40d187a7702eb6807583 P 91fb18caf57c4ad685ecac3334f1794f: Bootstrap starting.
I20260709 12:22:42.438390  1072 raft_consensus.cc:2749] T 711fc51040264325aa09cebd07d5d5f4 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:42.439014  1067 ts_tablet_manager.cc:1403] T 3001aaf097cd4643b552a2d9ffe4e451 P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.003s
I20260709 12:22:42.443224  1067 raft_consensus.cc:359] T 3001aaf097cd4643b552a2d9ffe4e451 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.443799  1067 raft_consensus.cc:385] T 3001aaf097cd4643b552a2d9ffe4e451 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.444018  1067 raft_consensus.cc:740] T 3001aaf097cd4643b552a2d9ffe4e451 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.444700  1067 consensus_queue.cc:260] T 3001aaf097cd4643b552a2d9ffe4e451 P 92e9b78bc90b4d2199d6926b30ce4f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.446425  1067 ts_tablet_manager.cc:1434] T 3001aaf097cd4643b552a2d9ffe4e451 P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:22:42.447275  1067 tablet_bootstrap.cc:492] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18: Bootstrap starting.
I20260709 12:22:42.449033  1071 raft_consensus.cc:493] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.449270  1025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c947c22c6224f85b77fef1e288bc140" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f" is_pre_election: true
I20260709 12:22:42.449633  1071 raft_consensus.cc:515] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.450224   951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c947c22c6224f85b77fef1e288bc140" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3" is_pre_election: true
W20260709 12:22:42.451022   842 leader_election.cc:343] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:42.451310   951 raft_consensus.cc:2468] T 4c947c22c6224f85b77fef1e288bc140 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 0.
I20260709 12:22:42.458470  1066 tablet_bootstrap.cc:654] T 158ee92d754f40d187a7702eb6807583 P 91fb18caf57c4ad685ecac3334f1794f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.464944  1071 leader_election.cc:290] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:42.475075  1067 tablet_bootstrap.cc:654] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.474970   842 leader_election.cc:304] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92e9b78bc90b4d2199d6926b30ce4f18, a92e1b02d25b49cfb108c1156f368fc3; no voters: 91fb18caf57c4ad685ecac3334f1794f
I20260709 12:22:42.475858  1065 tablet_bootstrap.cc:492] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3: No bootstrap required, opened a new log
I20260709 12:22:42.476416  1065 ts_tablet_manager.cc:1403] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3: Time spent bootstrapping tablet: real 0.062s	user 0.025s	sys 0.016s
I20260709 12:22:42.476792  1074 raft_consensus.cc:2804] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:42.477259  1074 raft_consensus.cc:493] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.477596  1074 raft_consensus.cc:3060] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.480177  1065 raft_consensus.cc:359] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.480849  1066 tablet_bootstrap.cc:492] T 158ee92d754f40d187a7702eb6807583 P 91fb18caf57c4ad685ecac3334f1794f: No bootstrap required, opened a new log
I20260709 12:22:42.481114  1065 raft_consensus.cc:385] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.481659  1065 raft_consensus.cc:740] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Initialized, Role: FOLLOWER
W20260709 12:22:42.484192   822 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:42.483911  1065 consensus_queue.cc:260] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.487154  1065 ts_tablet_manager.cc:1434] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 12:22:42.487510  1066 ts_tablet_manager.cc:1403] T 158ee92d754f40d187a7702eb6807583 P 91fb18caf57c4ad685ecac3334f1794f: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.003s
I20260709 12:22:42.490984  1065 tablet_bootstrap.cc:492] T a949969ca97842678559e3c98dcbacab P a92e1b02d25b49cfb108c1156f368fc3: Bootstrap starting.
I20260709 12:22:42.492442  1066 raft_consensus.cc:359] T 158ee92d754f40d187a7702eb6807583 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.493299  1066 raft_consensus.cc:385] T 158ee92d754f40d187a7702eb6807583 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.493605  1066 raft_consensus.cc:740] T 158ee92d754f40d187a7702eb6807583 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.494519  1066 consensus_queue.cc:260] T 158ee92d754f40d187a7702eb6807583 P 91fb18caf57c4ad685ecac3334f1794f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.488487  1074 raft_consensus.cc:515] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.499634  1065 tablet_bootstrap.cc:654] T a949969ca97842678559e3c98dcbacab P a92e1b02d25b49cfb108c1156f368fc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.500399  1067 tablet_bootstrap.cc:492] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18: No bootstrap required, opened a new log
I20260709 12:22:42.501083  1067 ts_tablet_manager.cc:1403] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.008s
I20260709 12:22:42.502549   951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c947c22c6224f85b77fef1e288bc140" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
I20260709 12:22:42.503275   951 raft_consensus.cc:3060] T 4c947c22c6224f85b77fef1e288bc140 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.505059  1074 leader_election.cc:290] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 election: Requested vote from peers a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:42.509598  1025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c947c22c6224f85b77fef1e288bc140" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
W20260709 12:22:42.512233   842 leader_election.cc:343] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:42.513087  1065 tablet_bootstrap.cc:492] T a949969ca97842678559e3c98dcbacab P a92e1b02d25b49cfb108c1156f368fc3: No bootstrap required, opened a new log
I20260709 12:22:42.512884  1067 raft_consensus.cc:359] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.513311  1025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ee92d754f40d187a7702eb6807583" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f" is_pre_election: true
I20260709 12:22:42.513768  1067 raft_consensus.cc:385] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.513878  1065 ts_tablet_manager.cc:1403] T a949969ca97842678559e3c98dcbacab P a92e1b02d25b49cfb108c1156f368fc3: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.012s
I20260709 12:22:42.514130  1067 raft_consensus.cc:740] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.514060  1025 raft_consensus.cc:2468] T 158ee92d754f40d187a7702eb6807583 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 0.
I20260709 12:22:42.515179  1067 consensus_queue.cc:260] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.515960   917 leader_election.cc:304] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:42.517081  1071 raft_consensus.cc:2804] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:42.517447  1071 raft_consensus.cc:493] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.517686  1067 ts_tablet_manager.cc:1434] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:22:42.517715  1065 raft_consensus.cc:359] T a949969ca97842678559e3c98dcbacab P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.519016  1065 raft_consensus.cc:385] T a949969ca97842678559e3c98dcbacab P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.519268  1067 tablet_bootstrap.cc:492] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18: Bootstrap starting.
I20260709 12:22:42.519361  1065 raft_consensus.cc:740] T a949969ca97842678559e3c98dcbacab P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.520330  1066 ts_tablet_manager.cc:1434] T 158ee92d754f40d187a7702eb6807583 P 91fb18caf57c4ad685ecac3334f1794f: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:22:42.524556  1066 tablet_bootstrap.cc:492] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f: Bootstrap starting.
I20260709 12:22:42.520490  1065 consensus_queue.cc:260] T a949969ca97842678559e3c98dcbacab P a92e1b02d25b49cfb108c1156f368fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.526892  1067 tablet_bootstrap.cc:654] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.535175  1066 tablet_bootstrap.cc:654] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.517786  1071 raft_consensus.cc:3060] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.538862  1067 tablet_bootstrap.cc:492] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18: No bootstrap required, opened a new log
I20260709 12:22:42.539479  1067 ts_tablet_manager.cc:1403] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 12:22:42.542768  1067 raft_consensus.cc:359] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.543538  1067 raft_consensus.cc:385] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.543833  1067 raft_consensus.cc:740] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.544867  1067 consensus_queue.cc:260] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.547510  1067 ts_tablet_manager.cc:1434] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:42.548588  1067 tablet_bootstrap.cc:492] T 158ee92d754f40d187a7702eb6807583 P 92e9b78bc90b4d2199d6926b30ce4f18: Bootstrap starting.
I20260709 12:22:42.553273  1066 tablet_bootstrap.cc:492] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f: No bootstrap required, opened a new log
I20260709 12:22:42.554224  1066 ts_tablet_manager.cc:1403] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.003s
I20260709 12:22:42.555622  1067 tablet_bootstrap.cc:654] T 158ee92d754f40d187a7702eb6807583 P 92e9b78bc90b4d2199d6926b30ce4f18: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.558746   951 raft_consensus.cc:2468] T 4c947c22c6224f85b77fef1e288bc140 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 1.
I20260709 12:22:42.569878   842 leader_election.cc:304] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92e9b78bc90b4d2199d6926b30ce4f18, a92e1b02d25b49cfb108c1156f368fc3; no voters: 91fb18caf57c4ad685ecac3334f1794f
I20260709 12:22:42.570766  1074 raft_consensus.cc:2804] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:42.571249  1074 raft_consensus.cc:697] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Becoming Leader. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Running, Role: LEADER
I20260709 12:22:42.571581  1065 ts_tablet_manager.cc:1434] T a949969ca97842678559e3c98dcbacab P a92e1b02d25b49cfb108c1156f368fc3: Time spent starting tablet: real 0.057s	user 0.024s	sys 0.029s
I20260709 12:22:42.572139  1074 consensus_queue.cc:237] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.573290  1065 tablet_bootstrap.cc:492] T 3c3711921af14a5ab73080170199d621 P a92e1b02d25b49cfb108c1156f368fc3: Bootstrap starting.
I20260709 12:22:42.558947  1066 raft_consensus.cc:359] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.561498   876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ee92d754f40d187a7702eb6807583" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" is_pre_election: true
I20260709 12:22:42.567617  1067 tablet_bootstrap.cc:492] T 158ee92d754f40d187a7702eb6807583 P 92e9b78bc90b4d2199d6926b30ce4f18: No bootstrap required, opened a new log
I20260709 12:22:42.575701  1067 ts_tablet_manager.cc:1403] T 158ee92d754f40d187a7702eb6807583 P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.009s
I20260709 12:22:42.576017  1066 raft_consensus.cc:385] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.576587  1066 raft_consensus.cc:740] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Initialized, Role: FOLLOWER
W20260709 12:22:42.576884   914 leader_election.cc:343] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:42.577800  1066 consensus_queue.cc:260] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.580000  1067 raft_consensus.cc:359] T 158ee92d754f40d187a7702eb6807583 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.581112  1067 raft_consensus.cc:385] T 158ee92d754f40d187a7702eb6807583 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.581415  1067 raft_consensus.cc:740] T 158ee92d754f40d187a7702eb6807583 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.581688  1065 tablet_bootstrap.cc:654] T 3c3711921af14a5ab73080170199d621 P a92e1b02d25b49cfb108c1156f368fc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.582208  1067 consensus_queue.cc:260] T 158ee92d754f40d187a7702eb6807583 P 92e9b78bc90b4d2199d6926b30ce4f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.585081  1067 ts_tablet_manager.cc:1434] T 158ee92d754f40d187a7702eb6807583 P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 12:22:42.586144  1067 tablet_bootstrap.cc:492] T 8a51831e613e4dfc83fcde95752585a6 P 92e9b78bc90b4d2199d6926b30ce4f18: Bootstrap starting.
I20260709 12:22:42.589243  1066 ts_tablet_manager.cc:1434] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.004s
I20260709 12:22:42.591014  1066 tablet_bootstrap.cc:492] T 3c3711921af14a5ab73080170199d621 P 91fb18caf57c4ad685ecac3334f1794f: Bootstrap starting.
I20260709 12:22:42.593415  1067 tablet_bootstrap.cc:654] T 8a51831e613e4dfc83fcde95752585a6 P 92e9b78bc90b4d2199d6926b30ce4f18: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.604027  1071 raft_consensus.cc:515] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.605581  1067 tablet_bootstrap.cc:492] T 8a51831e613e4dfc83fcde95752585a6 P 92e9b78bc90b4d2199d6926b30ce4f18: No bootstrap required, opened a new log
I20260709 12:22:42.606156  1067 ts_tablet_manager.cc:1403] T 8a51831e613e4dfc83fcde95752585a6 P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.009s
I20260709 12:22:42.607311   876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ee92d754f40d187a7702eb6807583" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
I20260709 12:22:42.608052   876 raft_consensus.cc:3060] T 158ee92d754f40d187a7702eb6807583 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.609633  1067 raft_consensus.cc:359] T 8a51831e613e4dfc83fcde95752585a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.610464  1067 raft_consensus.cc:385] T 8a51831e613e4dfc83fcde95752585a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.610747  1067 raft_consensus.cc:740] T 8a51831e613e4dfc83fcde95752585a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.611567  1067 consensus_queue.cc:260] T 8a51831e613e4dfc83fcde95752585a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.613396  1075 raft_consensus.cc:493] T 3001aaf097cd4643b552a2d9ffe4e451 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.613878  1075 raft_consensus.cc:515] T 3001aaf097cd4643b552a2d9ffe4e451 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.614362  1066 tablet_bootstrap.cc:654] T 3c3711921af14a5ab73080170199d621 P 91fb18caf57c4ad685ecac3334f1794f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.616106  1075 leader_election.cc:290] T 3001aaf097cd4643b552a2d9ffe4e451 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:42.618120  1025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3001aaf097cd4643b552a2d9ffe4e451" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f" is_pre_election: true
I20260709 12:22:42.618121   951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3001aaf097cd4643b552a2d9ffe4e451" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3" is_pre_election: true
I20260709 12:22:42.619431  1067 ts_tablet_manager.cc:1434] T 8a51831e613e4dfc83fcde95752585a6 P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
W20260709 12:22:42.620471   842 leader_election.cc:343] T 3001aaf097cd4643b552a2d9ffe4e451 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:42.621235   842 leader_election.cc:343] T 3001aaf097cd4643b552a2d9ffe4e451 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:42.621652   842 leader_election.cc:304] T 3001aaf097cd4643b552a2d9ffe4e451 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92e9b78bc90b4d2199d6926b30ce4f18; no voters: 91fb18caf57c4ad685ecac3334f1794f, a92e1b02d25b49cfb108c1156f368fc3
I20260709 12:22:42.622764  1075 raft_consensus.cc:2749] T 3001aaf097cd4643b552a2d9ffe4e451 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:42.622761  1025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ee92d754f40d187a7702eb6807583" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
I20260709 12:22:42.624284  1067 tablet_bootstrap.cc:492] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18: Bootstrap starting.
I20260709 12:22:42.624287  1025 raft_consensus.cc:3060] T 158ee92d754f40d187a7702eb6807583 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.631345  1075 raft_consensus.cc:493] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.632196  1067 tablet_bootstrap.cc:654] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.631965  1075 raft_consensus.cc:515] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.633958  1066 tablet_bootstrap.cc:492] T 3c3711921af14a5ab73080170199d621 P 91fb18caf57c4ad685ecac3334f1794f: No bootstrap required, opened a new log
I20260709 12:22:42.634353  1075 leader_election.cc:290] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:42.634666  1066 ts_tablet_manager.cc:1403] T 3c3711921af14a5ab73080170199d621 P 91fb18caf57c4ad685ecac3334f1794f: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.011s
I20260709 12:22:42.635015  1088 raft_consensus.cc:493] T a949969ca97842678559e3c98dcbacab P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.635694  1088 raft_consensus.cc:515] T a949969ca97842678559e3c98dcbacab P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.623175  1071 leader_election.cc:290] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 election: Requested vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:42.637517   951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a949969ca97842678559e3c98dcbacab" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3" is_pre_election: true
I20260709 12:22:42.638245   951 raft_consensus.cc:2468] T a949969ca97842678559e3c98dcbacab P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 0.
I20260709 12:22:42.638319  1024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a949969ca97842678559e3c98dcbacab" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f" is_pre_election: true
I20260709 12:22:42.639111  1088 leader_election.cc:290] T a949969ca97842678559e3c98dcbacab P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:42.643285  1066 raft_consensus.cc:359] T 3c3711921af14a5ab73080170199d621 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.623586   876 raft_consensus.cc:2468] T 158ee92d754f40d187a7702eb6807583 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 1.
I20260709 12:22:42.642086  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a949969ca97842678559e3c98dcbacab" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f" is_pre_election: true
I20260709 12:22:42.640062   842 leader_election.cc:304] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e9b78bc90b4d2199d6926b30ce4f18, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:42.649016  1066 raft_consensus.cc:385] T 3c3711921af14a5ab73080170199d621 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:22:42.649399   842 leader_election.cc:343] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:42.649513  1066 raft_consensus.cc:740] T 3c3711921af14a5ab73080170199d621 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Initialized, Role: FOLLOWER
W20260709 12:22:42.649994   917 leader_election.cc:343] T a949969ca97842678559e3c98dcbacab P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:42.650483  1075 raft_consensus.cc:2804] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:42.650904  1075 raft_consensus.cc:493] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.651257  1075 raft_consensus.cc:3060] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.651779   914 leader_election.cc:304] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e9b78bc90b4d2199d6926b30ce4f18, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:42.652806  1088 raft_consensus.cc:2804] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:42.653322  1088 raft_consensus.cc:697] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 LEADER]: Becoming Leader. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Running, Role: LEADER
I20260709 12:22:42.653129  1066 consensus_queue.cc:260] T 3c3711921af14a5ab73080170199d621 P 91fb18caf57c4ad685ecac3334f1794f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.654495  1088 consensus_queue.cc:237] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.640523   875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a949969ca97842678559e3c98dcbacab" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" is_pre_election: true
I20260709 12:22:42.658931  1025 raft_consensus.cc:2468] T 158ee92d754f40d187a7702eb6807583 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 1.
I20260709 12:22:42.661319  1075 raft_consensus.cc:515] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.662528   875 raft_consensus.cc:2393] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a92e1b02d25b49cfb108c1156f368fc3 in current term 1: Already voted for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in this term.
I20260709 12:22:42.666870  1066 ts_tablet_manager.cc:1434] T 3c3711921af14a5ab73080170199d621 P 91fb18caf57c4ad685ecac3334f1794f: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.008s
I20260709 12:22:42.668222  1066 tablet_bootstrap.cc:492] T 4c947c22c6224f85b77fef1e288bc140 P 91fb18caf57c4ad685ecac3334f1794f: Bootstrap starting.
I20260709 12:22:42.673476  1075 leader_election.cc:290] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 election: Requested vote from peers a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:42.673676   914 leader_election.cc:304] T a949969ca97842678559e3c98dcbacab P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a92e1b02d25b49cfb108c1156f368fc3; no voters: 91fb18caf57c4ad685ecac3334f1794f, 92e9b78bc90b4d2199d6926b30ce4f18
I20260709 12:22:42.676010  1066 tablet_bootstrap.cc:654] T 4c947c22c6224f85b77fef1e288bc140 P 91fb18caf57c4ad685ecac3334f1794f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.676537  1067 tablet_bootstrap.cc:492] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18: No bootstrap required, opened a new log
I20260709 12:22:42.677008   951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a949969ca97842678559e3c98dcbacab" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
I20260709 12:22:42.677187  1067 ts_tablet_manager.cc:1403] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.000s
I20260709 12:22:42.677721   951 raft_consensus.cc:3060] T a949969ca97842678559e3c98dcbacab P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.681317  1067 raft_consensus.cc:359] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.682227  1067 raft_consensus.cc:385] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.682361  1066 tablet_bootstrap.cc:492] T 4c947c22c6224f85b77fef1e288bc140 P 91fb18caf57c4ad685ecac3334f1794f: No bootstrap required, opened a new log
I20260709 12:22:42.682559  1067 raft_consensus.cc:740] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.683231  1066 ts_tablet_manager.cc:1403] T 4c947c22c6224f85b77fef1e288bc140 P 91fb18caf57c4ad685ecac3334f1794f: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.005s
I20260709 12:22:42.683768  1067 consensus_queue.cc:260] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.671507   771 catalog_manager.cc:5697] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:42.685776   951 raft_consensus.cc:2468] T a949969ca97842678559e3c98dcbacab P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 1.
I20260709 12:22:42.686398  1071 raft_consensus.cc:2749] T a949969ca97842678559e3c98dcbacab P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:42.686712  1067 ts_tablet_manager.cc:1434] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 12:22:42.686664  1066 raft_consensus.cc:359] T 4c947c22c6224f85b77fef1e288bc140 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.687646  1066 raft_consensus.cc:385] T 4c947c22c6224f85b77fef1e288bc140 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.687969  1066 raft_consensus.cc:740] T 4c947c22c6224f85b77fef1e288bc140 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.688071  1067 tablet_bootstrap.cc:492] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18: Bootstrap starting.
I20260709 12:22:42.688522  1025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a949969ca97842678559e3c98dcbacab" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
I20260709 12:22:42.688851  1066 consensus_queue.cc:260] T 4c947c22c6224f85b77fef1e288bc140 P 91fb18caf57c4ad685ecac3334f1794f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.689177   842 leader_election.cc:304] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e9b78bc90b4d2199d6926b30ce4f18, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:42.690593  1075 raft_consensus.cc:2804] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:42.691080  1075 raft_consensus.cc:697] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Becoming Leader. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Running, Role: LEADER
I20260709 12:22:42.691809  1066 ts_tablet_manager.cc:1434] T 4c947c22c6224f85b77fef1e288bc140 P 91fb18caf57c4ad685ecac3334f1794f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:22:42.691936  1075 consensus_queue.cc:237] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.693068  1066 tablet_bootstrap.cc:492] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f: Bootstrap starting.
I20260709 12:22:42.696774  1067 tablet_bootstrap.cc:654] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:42.696872   842 leader_election.cc:343] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:42.701108  1066 tablet_bootstrap.cc:654] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.701584  1065 tablet_bootstrap.cc:492] T 3c3711921af14a5ab73080170199d621 P a92e1b02d25b49cfb108c1156f368fc3: No bootstrap required, opened a new log
I20260709 12:22:42.702306  1065 ts_tablet_manager.cc:1403] T 3c3711921af14a5ab73080170199d621 P a92e1b02d25b49cfb108c1156f368fc3: Time spent bootstrapping tablet: real 0.129s	user 0.035s	sys 0.043s
I20260709 12:22:42.710906  1065 raft_consensus.cc:359] T 3c3711921af14a5ab73080170199d621 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.712005  1065 raft_consensus.cc:385] T 3c3711921af14a5ab73080170199d621 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.712445  1065 raft_consensus.cc:740] T 3c3711921af14a5ab73080170199d621 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.713917  1065 consensus_queue.cc:260] T 3c3711921af14a5ab73080170199d621 P a92e1b02d25b49cfb108c1156f368fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.718031  1065 ts_tablet_manager.cc:1434] T 3c3711921af14a5ab73080170199d621 P a92e1b02d25b49cfb108c1156f368fc3: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 12:22:42.719626  1065 tablet_bootstrap.cc:492] T 3001aaf097cd4643b552a2d9ffe4e451 P a92e1b02d25b49cfb108c1156f368fc3: Bootstrap starting.
I20260709 12:22:42.720253   772 catalog_manager.cc:5697] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "a92e1b02d25b49cfb108c1156f368fc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:42.730034  1065 tablet_bootstrap.cc:654] T 3001aaf097cd4643b552a2d9ffe4e451 P a92e1b02d25b49cfb108c1156f368fc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.738025  1066 tablet_bootstrap.cc:492] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f: No bootstrap required, opened a new log
I20260709 12:22:42.738592  1066 ts_tablet_manager.cc:1403] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.030s
I20260709 12:22:42.739571  1067 tablet_bootstrap.cc:492] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18: No bootstrap required, opened a new log
I20260709 12:22:42.740237  1067 ts_tablet_manager.cc:1403] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.027s
I20260709 12:22:42.744916  1067 raft_consensus.cc:359] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.745831  1067 raft_consensus.cc:385] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.746165  1067 raft_consensus.cc:740] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.746537  1066 raft_consensus.cc:359] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.747394  1066 raft_consensus.cc:385] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.747145  1067 consensus_queue.cc:260] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.749763  1067 ts_tablet_manager.cc:1434] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:22:42.749897  1065 tablet_bootstrap.cc:492] T 3001aaf097cd4643b552a2d9ffe4e451 P a92e1b02d25b49cfb108c1156f368fc3: No bootstrap required, opened a new log
I20260709 12:22:42.750463  1065 ts_tablet_manager.cc:1403] T 3001aaf097cd4643b552a2d9ffe4e451 P a92e1b02d25b49cfb108c1156f368fc3: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.005s
I20260709 12:22:42.750862  1067 tablet_bootstrap.cc:492] T 8fcfa22eac4141c4861b32aac5eaa5eb P 92e9b78bc90b4d2199d6926b30ce4f18: Bootstrap starting.
I20260709 12:22:42.753957  1065 raft_consensus.cc:359] T 3001aaf097cd4643b552a2d9ffe4e451 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.754807  1065 raft_consensus.cc:385] T 3001aaf097cd4643b552a2d9ffe4e451 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.755112  1065 raft_consensus.cc:740] T 3001aaf097cd4643b552a2d9ffe4e451 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.755921  1065 consensus_queue.cc:260] T 3001aaf097cd4643b552a2d9ffe4e451 P a92e1b02d25b49cfb108c1156f368fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.757709  1067 tablet_bootstrap.cc:654] T 8fcfa22eac4141c4861b32aac5eaa5eb P 92e9b78bc90b4d2199d6926b30ce4f18: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.758692  1065 ts_tablet_manager.cc:1434] T 3001aaf097cd4643b552a2d9ffe4e451 P a92e1b02d25b49cfb108c1156f368fc3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:22:42.758327   771 catalog_manager.cc:5697] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:42.759845  1065 tablet_bootstrap.cc:492] T 8a51831e613e4dfc83fcde95752585a6 P a92e1b02d25b49cfb108c1156f368fc3: Bootstrap starting.
I20260709 12:22:42.747712  1066 raft_consensus.cc:740] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.761359  1066 consensus_queue.cc:260] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.763890  1066 ts_tablet_manager.cc:1434] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 12:22:42.765229  1066 tablet_bootstrap.cc:492] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f: Bootstrap starting.
I20260709 12:22:42.768369  1065 tablet_bootstrap.cc:654] T 8a51831e613e4dfc83fcde95752585a6 P a92e1b02d25b49cfb108c1156f368fc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.772817  1066 tablet_bootstrap.cc:654] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.782075  1072 raft_consensus.cc:493] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.782955  1072 raft_consensus.cc:515] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.785049  1075 raft_consensus.cc:493] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.785694  1075 raft_consensus.cc:515] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.787575   875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a51831e613e4dfc83fcde95752585a6" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" is_pre_election: true
I20260709 12:22:42.787984  1075 leader_election.cc:290] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:42.788440   875 raft_consensus.cc:2468] T 8a51831e613e4dfc83fcde95752585a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fb18caf57c4ad685ecac3334f1794f in term 0.
I20260709 12:22:42.790547  1088 raft_consensus.cc:493] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.790807   951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d5d6c8f96143a1abaef7b427036b5e" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3" is_pre_election: true
I20260709 12:22:42.791208  1088 raft_consensus.cc:515] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.792477   951 raft_consensus.cc:2468] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 0.
I20260709 12:22:42.793807  1088 leader_election.cc:290] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:42.794709  1065 tablet_bootstrap.cc:492] T 8a51831e613e4dfc83fcde95752585a6 P a92e1b02d25b49cfb108c1156f368fc3: No bootstrap required, opened a new log
I20260709 12:22:42.795341  1065 ts_tablet_manager.cc:1403] T 8a51831e613e4dfc83fcde95752585a6 P a92e1b02d25b49cfb108c1156f368fc3: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.013s
I20260709 12:22:42.795301  1025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d5d6c8f96143a1abaef7b427036b5e" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f" is_pre_election: true
I20260709 12:22:42.795713  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d5d6c8f96143a1abaef7b427036b5e" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f" is_pre_election: true
I20260709 12:22:42.796275  1025 raft_consensus.cc:2468] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 0.
I20260709 12:22:42.799325  1065 raft_consensus.cc:359] T 8a51831e613e4dfc83fcde95752585a6 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.800197  1065 raft_consensus.cc:385] T 8a51831e613e4dfc83fcde95752585a6 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.801803  1067 tablet_bootstrap.cc:492] T 8fcfa22eac4141c4861b32aac5eaa5eb P 92e9b78bc90b4d2199d6926b30ce4f18: No bootstrap required, opened a new log
I20260709 12:22:42.801658   917 leader_election.cc:304] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:42.802868  1067 ts_tablet_manager.cc:1403] T 8fcfa22eac4141c4861b32aac5eaa5eb P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent bootstrapping tablet: real 0.052s	user 0.019s	sys 0.010s
I20260709 12:22:42.803193   842 leader_election.cc:304] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92e9b78bc90b4d2199d6926b30ce4f18, a92e1b02d25b49cfb108c1156f368fc3; no voters: 91fb18caf57c4ad685ecac3334f1794f
I20260709 12:22:42.804445  1075 raft_consensus.cc:2804] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:42.804908  1075 raft_consensus.cc:493] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.805037  1072 leader_election.cc:290] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583)
I20260709 12:22:42.800505  1065 raft_consensus.cc:740] T 8a51831e613e4dfc83fcde95752585a6 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.805600   875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d5d6c8f96143a1abaef7b427036b5e" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" is_pre_election: true
I20260709 12:22:42.805269  1075 raft_consensus.cc:3060] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.806542  1065 consensus_queue.cc:260] T 8a51831e613e4dfc83fcde95752585a6 P a92e1b02d25b49cfb108c1156f368fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.807757  1071 raft_consensus.cc:2804] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:42.808149  1071 raft_consensus.cc:493] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.808233  1066 tablet_bootstrap.cc:492] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f: No bootstrap required, opened a new log
I20260709 12:22:42.808578  1071 raft_consensus.cc:3060] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.809010  1066 ts_tablet_manager.cc:1403] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.011s
I20260709 12:22:42.809232  1065 ts_tablet_manager.cc:1434] T 8a51831e613e4dfc83fcde95752585a6 P a92e1b02d25b49cfb108c1156f368fc3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 12:22:42.810393  1065 tablet_bootstrap.cc:492] T 711fc51040264325aa09cebd07d5d5f4 P a92e1b02d25b49cfb108c1156f368fc3: Bootstrap starting.
I20260709 12:22:42.812120  1066 raft_consensus.cc:359] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.812975  1066 raft_consensus.cc:385] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.813091   951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a51831e613e4dfc83fcde95752585a6" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3" is_pre_election: true
I20260709 12:22:42.813337  1066 raft_consensus.cc:740] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.813805   951 raft_consensus.cc:2468] T 8a51831e613e4dfc83fcde95752585a6 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fb18caf57c4ad685ecac3334f1794f in term 0.
I20260709 12:22:42.814263  1066 consensus_queue.cc:260] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.816841  1066 ts_tablet_manager.cc:1434] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:22:42.817884  1066 tablet_bootstrap.cc:492] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f: Bootstrap starting.
I20260709 12:22:42.804986   988 leader_election.cc:304] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, 92e9b78bc90b4d2199d6926b30ce4f18; no voters: 
I20260709 12:22:42.818928  1065 tablet_bootstrap.cc:654] T 711fc51040264325aa09cebd07d5d5f4 P a92e1b02d25b49cfb108c1156f368fc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.819602  1072 raft_consensus.cc:2804] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:42.820127  1072 raft_consensus.cc:493] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.820503  1072 raft_consensus.cc:3060] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.825444  1066 tablet_bootstrap.cc:654] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.828085  1067 raft_consensus.cc:359] T 8fcfa22eac4141c4861b32aac5eaa5eb P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.829070  1067 raft_consensus.cc:385] T 8fcfa22eac4141c4861b32aac5eaa5eb P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.829422  1067 raft_consensus.cc:740] T 8fcfa22eac4141c4861b32aac5eaa5eb P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.830294  1075 raft_consensus.cc:515] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.834033  1071 raft_consensus.cc:515] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.837162   875 raft_consensus.cc:2393] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a92e1b02d25b49cfb108c1156f368fc3 in current term 1: Already voted for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in this term.
I20260709 12:22:42.838117   876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d5d6c8f96143a1abaef7b427036b5e" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
I20260709 12:22:42.839314   876 raft_consensus.cc:2393] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a92e1b02d25b49cfb108c1156f368fc3 in current term 1: Already voted for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in this term.
I20260709 12:22:42.843298   951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d5d6c8f96143a1abaef7b427036b5e" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
I20260709 12:22:42.844355   951 raft_consensus.cc:2393] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92e9b78bc90b4d2199d6926b30ce4f18 in current term 1: Already voted for candidate a92e1b02d25b49cfb108c1156f368fc3 in this term.
I20260709 12:22:42.845937  1074 raft_consensus.cc:493] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.846797  1074 raft_consensus.cc:515] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.848415  1075 leader_election.cc:290] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 election: Requested vote from peers a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:42.849787  1074 leader_election.cc:290] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:42.849603  1067 consensus_queue.cc:260] T 8fcfa22eac4141c4861b32aac5eaa5eb P 92e9b78bc90b4d2199d6926b30ce4f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.851004  1071 leader_election.cc:290] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 election: Requested vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:42.856838   951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3711921af14a5ab73080170199d621" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3" is_pre_election: true
I20260709 12:22:42.857940   951 raft_consensus.cc:2468] T 3c3711921af14a5ab73080170199d621 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 0.
I20260709 12:22:42.859642   842 leader_election.cc:304] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e9b78bc90b4d2199d6926b30ce4f18, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:42.862660  1074 raft_consensus.cc:2804] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:42.863238  1074 raft_consensus.cc:493] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.863668  1074 raft_consensus.cc:3060] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.870597  1067 ts_tablet_manager.cc:1434] T 8fcfa22eac4141c4861b32aac5eaa5eb P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
I20260709 12:22:42.890583  1066 tablet_bootstrap.cc:492] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f: No bootstrap required, opened a new log
I20260709 12:22:42.891201  1066 ts_tablet_manager.cc:1403] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f: Time spent bootstrapping tablet: real 0.074s	user 0.037s	sys 0.031s
I20260709 12:22:42.891749  1074 raft_consensus.cc:515] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.892236  1065 tablet_bootstrap.cc:492] T 711fc51040264325aa09cebd07d5d5f4 P a92e1b02d25b49cfb108c1156f368fc3: No bootstrap required, opened a new log
I20260709 12:22:42.893144  1065 ts_tablet_manager.cc:1403] T 711fc51040264325aa09cebd07d5d5f4 P a92e1b02d25b49cfb108c1156f368fc3: Time spent bootstrapping tablet: real 0.083s	user 0.047s	sys 0.034s
I20260709 12:22:42.894665  1074 leader_election.cc:290] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 election: Requested vote from peers a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:42.894667  1066 raft_consensus.cc:359] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.895663  1066 raft_consensus.cc:385] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.895965  1066 raft_consensus.cc:740] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.896196   951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3711921af14a5ab73080170199d621" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
I20260709 12:22:42.896991   951 raft_consensus.cc:3060] T 3c3711921af14a5ab73080170199d621 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.896739  1065 raft_consensus.cc:359] T 711fc51040264325aa09cebd07d5d5f4 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.896883  1066 consensus_queue.cc:260] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.898140  1065 raft_consensus.cc:385] T 711fc51040264325aa09cebd07d5d5f4 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.898521  1065 raft_consensus.cc:740] T 711fc51040264325aa09cebd07d5d5f4 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.899477  1065 consensus_queue.cc:260] T 711fc51040264325aa09cebd07d5d5f4 P a92e1b02d25b49cfb108c1156f368fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.900808  1112 raft_consensus.cc:493] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.901386  1112 raft_consensus.cc:515] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.904294  1065 ts_tablet_manager.cc:1434] T 711fc51040264325aa09cebd07d5d5f4 P a92e1b02d25b49cfb108c1156f368fc3: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:22:42.905506  1065 tablet_bootstrap.cc:492] T 8fcfa22eac4141c4861b32aac5eaa5eb P a92e1b02d25b49cfb108c1156f368fc3: Bootstrap starting.
I20260709 12:22:42.908877  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d5d6c8f96143a1abaef7b427036b5e" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
I20260709 12:22:42.909672  1023 raft_consensus.cc:3060] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.910732  1072 raft_consensus.cc:515] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.913591  1025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d5d6c8f96143a1abaef7b427036b5e" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
I20260709 12:22:42.914192  1024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3711921af14a5ab73080170199d621" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f" is_pre_election: true
I20260709 12:22:42.914868  1024 raft_consensus.cc:2468] T 3c3711921af14a5ab73080170199d621 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 0.
I20260709 12:22:42.916076  1022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3711921af14a5ab73080170199d621" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
I20260709 12:22:42.916821  1022 raft_consensus.cc:3060] T 3c3711921af14a5ab73080170199d621 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.916857   917 leader_election.cc:304] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a92e1b02d25b49cfb108c1156f368fc3; no voters: 91fb18caf57c4ad685ecac3334f1794f, 92e9b78bc90b4d2199d6926b30ce4f18
I20260709 12:22:42.920609  1065 tablet_bootstrap.cc:654] T 8fcfa22eac4141c4861b32aac5eaa5eb P a92e1b02d25b49cfb108c1156f368fc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.920903  1071 raft_consensus.cc:2749] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:42.923501   875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcfa22eac4141c4861b32aac5eaa5eb" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" is_pre_election: true
I20260709 12:22:42.924315   875 raft_consensus.cc:2468] T 8fcfa22eac4141c4861b32aac5eaa5eb P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fb18caf57c4ad685ecac3334f1794f in term 0.
I20260709 12:22:42.913128  1074 raft_consensus.cc:493] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.925136  1074 raft_consensus.cc:515] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.925866   988 leader_election.cc:304] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, 92e9b78bc90b4d2199d6926b30ce4f18; no voters: 
I20260709 12:22:42.931751  1022 raft_consensus.cc:2468] T 3c3711921af14a5ab73080170199d621 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 1.
I20260709 12:22:42.932806   949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcfa22eac4141c4861b32aac5eaa5eb" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3" is_pre_election: true
I20260709 12:22:42.933519   950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711fc51040264325aa09cebd07d5d5f4" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3" is_pre_election: true
I20260709 12:22:42.934682   950 raft_consensus.cc:2468] T 711fc51040264325aa09cebd07d5d5f4 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 0.
W20260709 12:22:42.935163   991 leader_election.cc:343] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:42.936547   842 leader_election.cc:304] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e9b78bc90b4d2199d6926b30ce4f18, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:42.939810  1113 raft_consensus.cc:493] T 3c3711921af14a5ab73080170199d621 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.940380  1113 raft_consensus.cc:515] T 3c3711921af14a5ab73080170199d621 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.932686  1112 leader_election.cc:290] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583)
I20260709 12:22:42.952481  1066 ts_tablet_manager.cc:1434] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f: Time spent starting tablet: real 0.061s	user 0.021s	sys 0.028s
I20260709 12:22:42.947216  1075 raft_consensus.cc:2804] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:42.961203  1112 raft_consensus.cc:2804] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:42.961742  1112 raft_consensus.cc:493] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.962116  1112 raft_consensus.cc:3060] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.963006  1074 leader_election.cc:290] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:42.965133  1114 raft_consensus.cc:493] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.965680  1114 raft_consensus.cc:515] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.968020  1114 leader_election.cc:290] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583), 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605)
I20260709 12:22:42.954372   842 leader_election.cc:304] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, 92e9b78bc90b4d2199d6926b30ce4f18; no voters: 
I20260709 12:22:42.955940  1075 raft_consensus.cc:493] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.969978  1075 raft_consensus.cc:3060] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.969197  1113 leader_election.cc:290] T 3c3711921af14a5ab73080170199d621 P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583)
I20260709 12:22:42.971133  1112 raft_consensus.cc:515] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.972564  1023 raft_consensus.cc:2468] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 1.
I20260709 12:22:42.973575  1112 leader_election.cc:290] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 1 election: Requested vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583)
I20260709 12:22:42.977350  1074 raft_consensus.cc:2804] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:22:42.978948   988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.193:33605, user_credentials={real_user=slave}} blocked reactor thread for 53180.9us
I20260709 12:22:42.983103   950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a949969ca97842678559e3c98dcbacab" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3" is_pre_election: true
I20260709 12:22:42.984053   950 raft_consensus.cc:2393] T a949969ca97842678559e3c98dcbacab P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91fb18caf57c4ad685ecac3334f1794f in current term 1: Already voted for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in this term.
I20260709 12:22:42.984289   842 leader_election.cc:304] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, 92e9b78bc90b4d2199d6926b30ce4f18; no voters: a92e1b02d25b49cfb108c1156f368fc3
I20260709 12:22:42.984666   875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3711921af14a5ab73080170199d621" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" is_pre_election: true
I20260709 12:22:42.984890  1075 raft_consensus.cc:515] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.985257   948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcfa22eac4141c4861b32aac5eaa5eb" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
I20260709 12:22:42.982581   949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3711921af14a5ab73080170199d621" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3" is_pre_election: true
I20260709 12:22:42.987247  1075 leader_election.cc:290] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 election: Requested vote from peers a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:42.979732  1072 leader_election.cc:290] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 1 election: Requested vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583)
I20260709 12:22:42.982556  1065 tablet_bootstrap.cc:492] T 8fcfa22eac4141c4861b32aac5eaa5eb P a92e1b02d25b49cfb108c1156f368fc3: No bootstrap required, opened a new log
I20260709 12:22:42.988759  1065 ts_tablet_manager.cc:1403] T 8fcfa22eac4141c4861b32aac5eaa5eb P a92e1b02d25b49cfb108c1156f368fc3: Time spent bootstrapping tablet: real 0.084s	user 0.027s	sys 0.010s
I20260709 12:22:42.987720  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711fc51040264325aa09cebd07d5d5f4" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f" is_pre_election: true
I20260709 12:22:42.989182  1075 raft_consensus.cc:2804] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:42.989369  1023 raft_consensus.cc:2468] T 711fc51040264325aa09cebd07d5d5f4 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 0.
I20260709 12:22:42.989480   949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a51831e613e4dfc83fcde95752585a6" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
I20260709 12:22:42.989809  1075 raft_consensus.cc:697] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Becoming Leader. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Running, Role: LEADER
I20260709 12:22:42.990303   949 raft_consensus.cc:3060] T 8a51831e613e4dfc83fcde95752585a6 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.990775  1075 consensus_queue.cc:237] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.991708  1065 raft_consensus.cc:359] T 8fcfa22eac4141c4861b32aac5eaa5eb P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:42.992422  1065 raft_consensus.cc:385] T 8fcfa22eac4141c4861b32aac5eaa5eb P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.992713  1065 raft_consensus.cc:740] T 8fcfa22eac4141c4861b32aac5eaa5eb P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.987720   876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a51831e613e4dfc83fcde95752585a6" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
I20260709 12:22:42.993389   874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a949969ca97842678559e3c98dcbacab" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" is_pre_election: true
I20260709 12:22:42.993636   876 raft_consensus.cc:3060] T 8a51831e613e4dfc83fcde95752585a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.996464   874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcfa22eac4141c4861b32aac5eaa5eb" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
I20260709 12:22:42.997169   874 raft_consensus.cc:3060] T 8fcfa22eac4141c4861b32aac5eaa5eb P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:42.998238   991 leader_election.cc:343] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:43.005326   876 raft_consensus.cc:2468] T 8a51831e613e4dfc83fcde95752585a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fb18caf57c4ad685ecac3334f1794f in term 1.
I20260709 12:22:42.999887   951 raft_consensus.cc:2468] T 3c3711921af14a5ab73080170199d621 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 1.
I20260709 12:22:43.007071  1065 consensus_queue.cc:260] T 8fcfa22eac4141c4861b32aac5eaa5eb P a92e1b02d25b49cfb108c1156f368fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:43.008217  1072 raft_consensus.cc:493] T 4c947c22c6224f85b77fef1e288bc140 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.003372   949 raft_consensus.cc:2468] T 8a51831e613e4dfc83fcde95752585a6 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fb18caf57c4ad685ecac3334f1794f in term 1.
I20260709 12:22:43.011086  1072 raft_consensus.cc:515] T 4c947c22c6224f85b77fef1e288bc140 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:43.007222  1074 raft_consensus.cc:697] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Becoming Leader. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Running, Role: LEADER
I20260709 12:22:43.012516   991 leader_election.cc:304] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:43.013550  1072 leader_election.cc:290] T 4c947c22c6224f85b77fef1e288bc140 P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583)
I20260709 12:22:43.014194  1072 raft_consensus.cc:2804] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:43.013965  1074 consensus_queue.cc:237] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:43.014752  1072 raft_consensus.cc:697] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [term 1 LEADER]: Becoming Leader. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Running, Role: LEADER
I20260709 12:22:43.014950   949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c947c22c6224f85b77fef1e288bc140" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3" is_pre_election: true
I20260709 12:22:43.016233   949 raft_consensus.cc:2393] T 4c947c22c6224f85b77fef1e288bc140 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91fb18caf57c4ad685ecac3334f1794f in current term 1: Already voted for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in this term.
I20260709 12:22:43.016153  1072 consensus_queue.cc:237] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:43.017535   988 leader_election.cc:304] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f; no voters: 92e9b78bc90b4d2199d6926b30ce4f18, a92e1b02d25b49cfb108c1156f368fc3
I20260709 12:22:43.009886  1065 ts_tablet_manager.cc:1434] T 8fcfa22eac4141c4861b32aac5eaa5eb P a92e1b02d25b49cfb108c1156f368fc3: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:22:43.007119   874 raft_consensus.cc:2468] T 8fcfa22eac4141c4861b32aac5eaa5eb P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fb18caf57c4ad685ecac3334f1794f in term 1.
I20260709 12:22:43.023856   876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c947c22c6224f85b77fef1e288bc140" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" is_pre_election: true
I20260709 12:22:43.024796   949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711fc51040264325aa09cebd07d5d5f4" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
I20260709 12:22:43.025501   949 raft_consensus.cc:3060] T 711fc51040264325aa09cebd07d5d5f4 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:43.025645  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711fc51040264325aa09cebd07d5d5f4" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
I20260709 12:22:43.026249  1023 raft_consensus.cc:3060] T 711fc51040264325aa09cebd07d5d5f4 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:43.027523   773 catalog_manager.cc:5697] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:43.033438  1112 raft_consensus.cc:3060] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:43.034160  1023 raft_consensus.cc:2468] T 711fc51040264325aa09cebd07d5d5f4 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 1.
I20260709 12:22:43.036247   842 leader_election.cc:304] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, 92e9b78bc90b4d2199d6926b30ce4f18; no voters: 
I20260709 12:22:43.038587   949 raft_consensus.cc:2468] T 711fc51040264325aa09cebd07d5d5f4 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 1.
I20260709 12:22:43.040057  1118 raft_consensus.cc:2804] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:43.040534  1118 raft_consensus.cc:697] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Becoming Leader. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Running, Role: LEADER
I20260709 12:22:43.041342   988 leader_election.cc:304] T 3c3711921af14a5ab73080170199d621 P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f; no voters: 92e9b78bc90b4d2199d6926b30ce4f18, a92e1b02d25b49cfb108c1156f368fc3
I20260709 12:22:43.045511  1116 raft_consensus.cc:2749] T 3c3711921af14a5ab73080170199d621 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:43.043839  1112 raft_consensus.cc:2749] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:43.046077   988 leader_election.cc:304] T 4c947c22c6224f85b77fef1e288bc140 P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f; no voters: 92e9b78bc90b4d2199d6926b30ce4f18, a92e1b02d25b49cfb108c1156f368fc3
I20260709 12:22:43.046926  1074 consensus_queue.cc:1048] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:22:43.045926   773 catalog_manager.cc:5697] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:43.048981  1116 raft_consensus.cc:3060] T 4c947c22c6224f85b77fef1e288bc140 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:43.049577   988 leader_election.cc:304] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, 92e9b78bc90b4d2199d6926b30ce4f18; no voters: a92e1b02d25b49cfb108c1156f368fc3
I20260709 12:22:43.056545  1113 raft_consensus.cc:2804] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:43.057137  1113 raft_consensus.cc:697] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f [term 1 LEADER]: Becoming Leader. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Running, Role: LEADER
I20260709 12:22:43.057988  1113 consensus_queue.cc:237] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:43.045635  1118 consensus_queue.cc:237] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:43.068570  1088 raft_consensus.cc:493] T 8fcfa22eac4141c4861b32aac5eaa5eb P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.070226  1088 raft_consensus.cc:515] T 8fcfa22eac4141c4861b32aac5eaa5eb P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:43.073570  1088 leader_election.cc:290] T 8fcfa22eac4141c4861b32aac5eaa5eb P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:43.074132   874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcfa22eac4141c4861b32aac5eaa5eb" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" is_pre_election: true
I20260709 12:22:43.074877  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcfa22eac4141c4861b32aac5eaa5eb" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f" is_pre_election: true
I20260709 12:22:43.075376   874 raft_consensus.cc:2393] T 8fcfa22eac4141c4861b32aac5eaa5eb P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a92e1b02d25b49cfb108c1156f368fc3 in current term 1: Already voted for candidate 91fb18caf57c4ad685ecac3334f1794f in this term.
I20260709 12:22:43.083681  1116 raft_consensus.cc:2749] T 4c947c22c6224f85b77fef1e288bc140 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:43.079487   914 leader_election.cc:304] T 8fcfa22eac4141c4861b32aac5eaa5eb P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a92e1b02d25b49cfb108c1156f368fc3; no voters: 91fb18caf57c4ad685ecac3334f1794f, 92e9b78bc90b4d2199d6926b30ce4f18
I20260709 12:22:43.086992  1088 raft_consensus.cc:3060] T 8fcfa22eac4141c4861b32aac5eaa5eb P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:43.087517   773 catalog_manager.cc:5697] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f reported cstate change: term changed from 0 to 1, leader changed from <none> to 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195). New cstate: current_term: 1 leader_uuid: "91fb18caf57c4ad685ecac3334f1794f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:43.093037   769 catalog_manager.cc:5697] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:43.097560  1088 raft_consensus.cc:2749] T 8fcfa22eac4141c4861b32aac5eaa5eb P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:43.101675  1118 consensus_queue.cc:1048] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:43.105515   773 catalog_manager.cc:5697] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f reported cstate change: term changed from 0 to 1, leader changed from <none> to 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195). New cstate: current_term: 1 leader_uuid: "91fb18caf57c4ad685ecac3334f1794f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:43.106498  1074 consensus_queue.cc:1048] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:43.112797  1113 raft_consensus.cc:493] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.113432  1113 raft_consensus.cc:515] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:43.117528   949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3001aaf097cd4643b552a2d9ffe4e451" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3" is_pre_election: true
I20260709 12:22:43.117705  1113 leader_election.cc:290] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583)
I20260709 12:22:43.118789   874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3001aaf097cd4643b552a2d9ffe4e451" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" is_pre_election: true
I20260709 12:22:43.122243   949 raft_consensus.cc:2468] T 3001aaf097cd4643b552a2d9ffe4e451 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fb18caf57c4ad685ecac3334f1794f in term 0.
I20260709 12:22:43.122416   874 raft_consensus.cc:2468] T 3001aaf097cd4643b552a2d9ffe4e451 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fb18caf57c4ad685ecac3334f1794f in term 0.
I20260709 12:22:43.123764   991 leader_election.cc:304] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:43.125579  1113 raft_consensus.cc:2804] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:43.125990  1113 raft_consensus.cc:493] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.126410  1113 raft_consensus.cc:3060] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:43.128070  1117 consensus_queue.cc:1048] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:43.136323  1113 raft_consensus.cc:515] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:43.145627   874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3001aaf097cd4643b552a2d9ffe4e451" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
I20260709 12:22:43.146085  1113 leader_election.cc:290] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 1 election: Requested vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583)
I20260709 12:22:43.146477   874 raft_consensus.cc:3060] T 3001aaf097cd4643b552a2d9ffe4e451 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:43.147457   951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3001aaf097cd4643b552a2d9ffe4e451" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
I20260709 12:22:43.148116   951 raft_consensus.cc:3060] T 3001aaf097cd4643b552a2d9ffe4e451 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:43.156208   874 raft_consensus.cc:2468] T 3001aaf097cd4643b552a2d9ffe4e451 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fb18caf57c4ad685ecac3334f1794f in term 1.
I20260709 12:22:43.157680   988 leader_election.cc:304] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, 92e9b78bc90b4d2199d6926b30ce4f18; no voters: 
I20260709 12:22:43.159543  1113 raft_consensus.cc:2804] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:43.160374  1113 raft_consensus.cc:697] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [term 1 LEADER]: Becoming Leader. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Running, Role: LEADER
I20260709 12:22:43.161409  1113 consensus_queue.cc:237] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:43.164063   951 raft_consensus.cc:2468] T 3001aaf097cd4643b552a2d9ffe4e451 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fb18caf57c4ad685ecac3334f1794f in term 1.
I20260709 12:22:43.179767   772 catalog_manager.cc:5697] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f reported cstate change: term changed from 0 to 1, leader changed from <none> to 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195). New cstate: current_term: 1 leader_uuid: "91fb18caf57c4ad685ecac3334f1794f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:43.236595  1088 consensus_queue.cc:1048] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:43.250077  1088 consensus_queue.cc:1048] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:43.402653  1117 consensus_queue.cc:1048] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:43.408245  1113 consensus_queue.cc:1048] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:43.409737  1117 consensus_queue.cc:1048] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:43.425333  1118 consensus_queue.cc:1048] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:43.433307  1118 consensus_queue.cc:1048] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:43.438300  1116 consensus_queue.cc:1048] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:43.480800  1118 consensus_queue.cc:1048] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:43.483450   949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "158ee92d754f40d187a7702eb6807583"
dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
mode: GRACEFUL
new_leader_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
 from {username='slave'} at 127.0.0.1:56680
I20260709 12:22:43.484197   949 raft_consensus.cc:606] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 LEADER]: Received request to transfer leadership to TS 92e9b78bc90b4d2199d6926b30ce4f18
I20260709 12:22:43.495522  1113 consensus_queue.cc:1048] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:43.500031  1118 consensus_queue.cc:1048] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:43.527993  1112 consensus_queue.cc:1048] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:43.531709  1023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a51831e613e4dfc83fcde95752585a6"
dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
mode: GRACEFUL
new_leader_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
 from {username='slave'} at 127.0.0.1:41404
I20260709 12:22:43.532548  1023 raft_consensus.cc:606] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [term 1 LEADER]: Received request to transfer leadership to TS 92e9b78bc90b4d2199d6926b30ce4f18
I20260709 12:22:43.550271  1112 consensus_queue.cc:1048] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:43.555557   876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25d5d6c8f96143a1abaef7b427036b5e"
dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
mode: GRACEFUL
new_leader_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
 from {username='slave'} at 127.0.0.1:38622
I20260709 12:22:43.556243   876 raft_consensus.cc:606] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Received request to transfer leadership to TS a92e1b02d25b49cfb108c1156f368fc3
I20260709 12:22:43.564090  1072 consensus_queue.cc:1048] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:43.567493   874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "711fc51040264325aa09cebd07d5d5f4"
dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
mode: GRACEFUL
new_leader_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
 from {username='slave'} at 127.0.0.1:38622
I20260709 12:22:43.568290   874 raft_consensus.cc:606] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Received request to transfer leadership to TS a92e1b02d25b49cfb108c1156f368fc3
I20260709 12:22:43.576341   874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c3711921af14a5ab73080170199d621"
dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
mode: GRACEFUL
new_leader_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
 from {username='slave'} at 127.0.0.1:38622
I20260709 12:22:43.577059   874 raft_consensus.cc:606] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Received request to transfer leadership to TS a92e1b02d25b49cfb108c1156f368fc3
I20260709 12:22:43.583925  1023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3001aaf097cd4643b552a2d9ffe4e451"
dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
mode: GRACEFUL
new_leader_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
 from {username='slave'} at 127.0.0.1:41404
I20260709 12:22:43.584682  1023 raft_consensus.cc:606] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [term 1 LEADER]: Received request to transfer leadership to TS a92e1b02d25b49cfb108c1156f368fc3
I20260709 12:22:43.699518  1088 raft_consensus.cc:993] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3: : Instructing follower 92e9b78bc90b4d2199d6926b30ce4f18 to start an election
I20260709 12:22:43.700039  1071 raft_consensus.cc:1081] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 LEADER]: Signalling peer 92e9b78bc90b4d2199d6926b30ce4f18 to start an election
I20260709 12:22:43.701761   874 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "158ee92d754f40d187a7702eb6807583"
dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
 from {username='slave'} at 127.0.0.1:38616
I20260709 12:22:43.702258   874 raft_consensus.cc:493] T 158ee92d754f40d187a7702eb6807583 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:43.702528   874 raft_consensus.cc:3060] T 158ee92d754f40d187a7702eb6807583 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:43.707619   874 raft_consensus.cc:515] T 158ee92d754f40d187a7702eb6807583 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:43.709319   874 leader_election.cc:290] T 158ee92d754f40d187a7702eb6807583 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 2 election: Requested vote from peers a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:43.710345   949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ee92d754f40d187a7702eb6807583" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
I20260709 12:22:43.710516  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ee92d754f40d187a7702eb6807583" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
I20260709 12:22:43.711273   949 raft_consensus.cc:3055] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:43.711341  1023 raft_consensus.cc:3060] T 158ee92d754f40d187a7702eb6807583 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:43.711645   949 raft_consensus.cc:740] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Running, Role: LEADER
I20260709 12:22:43.712677   949 consensus_queue.cc:260] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:43.713788   949 raft_consensus.cc:3060] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:43.716938  1023 raft_consensus.cc:2468] T 158ee92d754f40d187a7702eb6807583 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 2.
I20260709 12:22:43.718189   842 leader_election.cc:304] T 158ee92d754f40d187a7702eb6807583 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, 92e9b78bc90b4d2199d6926b30ce4f18; no voters: 
I20260709 12:22:43.718937  1118 raft_consensus.cc:2804] T 158ee92d754f40d187a7702eb6807583 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:43.719476  1118 raft_consensus.cc:697] T 158ee92d754f40d187a7702eb6807583 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 LEADER]: Becoming Leader. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Running, Role: LEADER
I20260709 12:22:43.720583   949 raft_consensus.cc:2468] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 2.
I20260709 12:22:43.720394  1118 consensus_queue.cc:237] T 158ee92d754f40d187a7702eb6807583 P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:43.728297   773 catalog_manager.cc:5697] T 158ee92d754f40d187a7702eb6807583 P 92e9b78bc90b4d2199d6926b30ce4f18 reported cstate change: term changed from 1 to 2, leader changed from a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194) to 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:43.863456  1114 raft_consensus.cc:993] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f: : Instructing follower 92e9b78bc90b4d2199d6926b30ce4f18 to start an election
I20260709 12:22:43.864032  1072 raft_consensus.cc:1081] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [term 1 LEADER]: Signalling peer 92e9b78bc90b4d2199d6926b30ce4f18 to start an election
I20260709 12:22:43.866233   874 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a51831e613e4dfc83fcde95752585a6"
dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
 from {username='slave'} at 127.0.0.1:38606
I20260709 12:22:43.866859   874 raft_consensus.cc:493] T 8a51831e613e4dfc83fcde95752585a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:43.867182   874 raft_consensus.cc:3060] T 8a51831e613e4dfc83fcde95752585a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:43.873951   874 raft_consensus.cc:515] T 8a51831e613e4dfc83fcde95752585a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:43.875947   874 leader_election.cc:290] T 8a51831e613e4dfc83fcde95752585a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 2 election: Requested vote from peers a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:43.877056   949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a51831e613e4dfc83fcde95752585a6" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
I20260709 12:22:43.877521  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a51831e613e4dfc83fcde95752585a6" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
I20260709 12:22:43.877902   949 raft_consensus.cc:3060] T 8a51831e613e4dfc83fcde95752585a6 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:43.878301  1023 raft_consensus.cc:3055] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:43.878654  1023 raft_consensus.cc:740] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Running, Role: LEADER
I20260709 12:22:43.879490  1023 consensus_queue.cc:260] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:43.880761  1023 raft_consensus.cc:3060] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:43.884140   949 raft_consensus.cc:2468] T 8a51831e613e4dfc83fcde95752585a6 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 2.
I20260709 12:22:43.885537   842 leader_election.cc:304] T 8a51831e613e4dfc83fcde95752585a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e9b78bc90b4d2199d6926b30ce4f18, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:43.886287  1118 raft_consensus.cc:2804] T 8a51831e613e4dfc83fcde95752585a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:43.886739  1118 raft_consensus.cc:697] T 8a51831e613e4dfc83fcde95752585a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 LEADER]: Becoming Leader. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Running, Role: LEADER
I20260709 12:22:43.887516  1118 consensus_queue.cc:237] T 8a51831e613e4dfc83fcde95752585a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:43.887822  1023 raft_consensus.cc:2468] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 2.
I20260709 12:22:43.894757   773 catalog_manager.cc:5697] T 8a51831e613e4dfc83fcde95752585a6 P 92e9b78bc90b4d2199d6926b30ce4f18 reported cstate change: term changed from 1 to 2, leader changed from 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195) to 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:43.963348  1074 raft_consensus.cc:993] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18: : Instructing follower a92e1b02d25b49cfb108c1156f368fc3 to start an election
I20260709 12:22:43.963924  1118 raft_consensus.cc:1081] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Signalling peer a92e1b02d25b49cfb108c1156f368fc3 to start an election
I20260709 12:22:43.966114   949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25d5d6c8f96143a1abaef7b427036b5e"
dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
 from {username='slave'} at 127.0.0.1:56666
I20260709 12:22:43.966732   949 raft_consensus.cc:493] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:43.967103   949 raft_consensus.cc:3060] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:43.973399   949 raft_consensus.cc:515] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:43.975466   949 leader_election.cc:290] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 2 election: Requested vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:43.976529   874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d5d6c8f96143a1abaef7b427036b5e" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
I20260709 12:22:43.976935  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d5d6c8f96143a1abaef7b427036b5e" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
I20260709 12:22:43.977365   874 raft_consensus.cc:3055] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:43.977653  1023 raft_consensus.cc:3060] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:43.977798   874 raft_consensus.cc:740] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Running, Role: LEADER
I20260709 12:22:43.978865   874 consensus_queue.cc:260] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:43.980386   874 raft_consensus.cc:3060] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:43.984167  1117 raft_consensus.cc:993] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18: : Instructing follower a92e1b02d25b49cfb108c1156f368fc3 to start an election
I20260709 12:22:43.984992  1118 raft_consensus.cc:1081] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Signalling peer a92e1b02d25b49cfb108c1156f368fc3 to start an election
I20260709 12:22:43.987303   949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c3711921af14a5ab73080170199d621"
dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
 from {username='slave'} at 127.0.0.1:56666
I20260709 12:22:43.988062   949 raft_consensus.cc:493] T 3c3711921af14a5ab73080170199d621 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:43.988722   949 raft_consensus.cc:3060] T 3c3711921af14a5ab73080170199d621 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:43.989691  1023 raft_consensus.cc:2468] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 2.
I20260709 12:22:43.990091   874 raft_consensus.cc:2468] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 2.
I20260709 12:22:43.991323   917 leader_election.cc:304] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:43.992729  1071 raft_consensus.cc:2804] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:43.993312  1071 raft_consensus.cc:697] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [term 2 LEADER]: Becoming Leader. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Running, Role: LEADER
I20260709 12:22:43.994211  1071 consensus_queue.cc:237] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:43.997785   949 raft_consensus.cc:515] T 3c3711921af14a5ab73080170199d621 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:44.001307   874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3711921af14a5ab73080170199d621" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
I20260709 12:22:44.001348   949 leader_election.cc:290] T 3c3711921af14a5ab73080170199d621 P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 2 election: Requested vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:44.002151   874 raft_consensus.cc:3055] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:44.002651   874 raft_consensus.cc:740] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Running, Role: LEADER
I20260709 12:22:44.002693  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3711921af14a5ab73080170199d621" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
I20260709 12:22:44.003561  1023 raft_consensus.cc:3060] T 3c3711921af14a5ab73080170199d621 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:44.003674   874 consensus_queue.cc:260] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:44.004168   773 catalog_manager.cc:5697] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 reported cstate change: term changed from 1 to 2, leader changed from 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193) to a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194). New cstate: current_term: 2 leader_uuid: "a92e1b02d25b49cfb108c1156f368fc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:44.005290   874 raft_consensus.cc:3060] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:44.011085  1023 raft_consensus.cc:2468] T 3c3711921af14a5ab73080170199d621 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 2.
I20260709 12:22:44.012429   917 leader_election.cc:304] T 3c3711921af14a5ab73080170199d621 P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:44.013384  1071 raft_consensus.cc:2804] T 3c3711921af14a5ab73080170199d621 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:44.013657  1074 raft_consensus.cc:993] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18: : Instructing follower a92e1b02d25b49cfb108c1156f368fc3 to start an election
I20260709 12:22:44.013955  1071 raft_consensus.cc:697] T 3c3711921af14a5ab73080170199d621 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 LEADER]: Becoming Leader. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Running, Role: LEADER
I20260709 12:22:44.014186  1074 raft_consensus.cc:1081] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Signalling peer a92e1b02d25b49cfb108c1156f368fc3 to start an election
I20260709 12:22:44.014945  1071 consensus_queue.cc:237] T 3c3711921af14a5ab73080170199d621 P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:44.016300   949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "711fc51040264325aa09cebd07d5d5f4"
dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
 from {username='slave'} at 127.0.0.1:56666
I20260709 12:22:44.017253   949 raft_consensus.cc:493] T 711fc51040264325aa09cebd07d5d5f4 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:44.017722   949 raft_consensus.cc:3060] T 711fc51040264325aa09cebd07d5d5f4 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:44.019375   874 raft_consensus.cc:2468] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 2.
I20260709 12:22:44.026412   949 raft_consensus.cc:515] T 711fc51040264325aa09cebd07d5d5f4 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:44.026136   773 catalog_manager.cc:5697] T 3c3711921af14a5ab73080170199d621 P a92e1b02d25b49cfb108c1156f368fc3 reported cstate change: term changed from 1 to 2, leader changed from 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193) to a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194). New cstate: current_term: 2 leader_uuid: "a92e1b02d25b49cfb108c1156f368fc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:44.029469   949 leader_election.cc:290] T 711fc51040264325aa09cebd07d5d5f4 P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 2 election: Requested vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:44.029783   874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711fc51040264325aa09cebd07d5d5f4" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
I20260709 12:22:44.030180  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711fc51040264325aa09cebd07d5d5f4" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
I20260709 12:22:44.030709   874 raft_consensus.cc:3055] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:44.031038  1023 raft_consensus.cc:3060] T 711fc51040264325aa09cebd07d5d5f4 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:44.031265   874 raft_consensus.cc:740] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Running, Role: LEADER
I20260709 12:22:44.032438   874 consensus_queue.cc:260] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:44.033776   874 raft_consensus.cc:3060] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:44.039588  1023 raft_consensus.cc:2468] T 711fc51040264325aa09cebd07d5d5f4 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 2.
I20260709 12:22:44.039731   874 raft_consensus.cc:2468] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 2.
I20260709 12:22:44.040907   917 leader_election.cc:304] T 711fc51040264325aa09cebd07d5d5f4 P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:44.041769  1071 raft_consensus.cc:2804] T 711fc51040264325aa09cebd07d5d5f4 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:44.042277  1071 raft_consensus.cc:697] T 711fc51040264325aa09cebd07d5d5f4 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 LEADER]: Becoming Leader. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Running, Role: LEADER
I20260709 12:22:44.042985  1071 consensus_queue.cc:237] T 711fc51040264325aa09cebd07d5d5f4 P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:44.049813   773 catalog_manager.cc:5697] T 711fc51040264325aa09cebd07d5d5f4 P a92e1b02d25b49cfb108c1156f368fc3 reported cstate change: term changed from 1 to 2, leader changed from 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193) to a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194). New cstate: current_term: 2 leader_uuid: "a92e1b02d25b49cfb108c1156f368fc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:44.121544  1072 raft_consensus.cc:993] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f: : Instructing follower a92e1b02d25b49cfb108c1156f368fc3 to start an election
I20260709 12:22:44.122227  1072 raft_consensus.cc:1081] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [term 1 LEADER]: Signalling peer a92e1b02d25b49cfb108c1156f368fc3 to start an election
I20260709 12:22:44.123946   949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3001aaf097cd4643b552a2d9ffe4e451"
dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
 from {username='slave'} at 127.0.0.1:56658
I20260709 12:22:44.124560   949 raft_consensus.cc:493] T 3001aaf097cd4643b552a2d9ffe4e451 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:44.124974   949 raft_consensus.cc:3060] T 3001aaf097cd4643b552a2d9ffe4e451 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:44.131600   949 raft_consensus.cc:515] T 3001aaf097cd4643b552a2d9ffe4e451 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:44.133574   949 leader_election.cc:290] T 3001aaf097cd4643b552a2d9ffe4e451 P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 2 election: Requested vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:44.134788   874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3001aaf097cd4643b552a2d9ffe4e451" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
I20260709 12:22:44.134936  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3001aaf097cd4643b552a2d9ffe4e451" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
I20260709 12:22:44.135516   874 raft_consensus.cc:3060] T 3001aaf097cd4643b552a2d9ffe4e451 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:44.135629  1023 raft_consensus.cc:3055] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:44.136096  1023 raft_consensus.cc:740] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Running, Role: LEADER
I20260709 12:22:44.136914  1023 consensus_queue.cc:260] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:44.137979  1023 raft_consensus.cc:3060] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:44.142266   874 raft_consensus.cc:2468] T 3001aaf097cd4643b552a2d9ffe4e451 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 2.
I20260709 12:22:44.143769   914 leader_election.cc:304] T 3001aaf097cd4643b552a2d9ffe4e451 P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e9b78bc90b4d2199d6926b30ce4f18, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:44.144506  1023 raft_consensus.cc:2468] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 2.
I20260709 12:22:44.144829  1071 raft_consensus.cc:2804] T 3001aaf097cd4643b552a2d9ffe4e451 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:44.145767  1071 raft_consensus.cc:697] T 3001aaf097cd4643b552a2d9ffe4e451 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 LEADER]: Becoming Leader. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Running, Role: LEADER
I20260709 12:22:44.146584  1071 consensus_queue.cc:237] T 3001aaf097cd4643b552a2d9ffe4e451 P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:44.152880   773 catalog_manager.cc:5697] T 3001aaf097cd4643b552a2d9ffe4e451 P a92e1b02d25b49cfb108c1156f368fc3 reported cstate change: term changed from 1 to 2, leader changed from 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195) to a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194). New cstate: current_term: 2 leader_uuid: "a92e1b02d25b49cfb108c1156f368fc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:44.213497   951 raft_consensus.cc:1275] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Refusing update from remote peer 92e9b78bc90b4d2199d6926b30ce4f18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:44.214926  1118 consensus_queue.cc:1048] T 158ee92d754f40d187a7702eb6807583 P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:44.227571  1023 raft_consensus.cc:1275] T 158ee92d754f40d187a7702eb6807583 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Refusing update from remote peer 92e9b78bc90b4d2199d6926b30ce4f18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:44.230171  1117 consensus_queue.cc:1048] T 158ee92d754f40d187a7702eb6807583 P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:44.339268   951 raft_consensus.cc:1275] T 8a51831e613e4dfc83fcde95752585a6 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Refusing update from remote peer 92e9b78bc90b4d2199d6926b30ce4f18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:44.340962  1117 consensus_queue.cc:1048] T 8a51831e613e4dfc83fcde95752585a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:44.353415  1023 raft_consensus.cc:1275] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Refusing update from remote peer 92e9b78bc90b4d2199d6926b30ce4f18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:44.358327  1117 consensus_queue.cc:1048] T 8a51831e613e4dfc83fcde95752585a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:44.461481  1023 raft_consensus.cc:1275] T 3c3711921af14a5ab73080170199d621 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Refusing update from remote peer a92e1b02d25b49cfb108c1156f368fc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:44.463276  1071 consensus_queue.cc:1048] T 3c3711921af14a5ab73080170199d621 P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:44.472898   874 raft_consensus.cc:1275] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Refusing update from remote peer a92e1b02d25b49cfb108c1156f368fc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:44.474702  1088 consensus_queue.cc:1048] T 3c3711921af14a5ab73080170199d621 P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:44.496217  1023 raft_consensus.cc:1275] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Refusing update from remote peer a92e1b02d25b49cfb108c1156f368fc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:44.497706  1088 consensus_queue.cc:1048] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:44.507454   874 raft_consensus.cc:1275] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Refusing update from remote peer a92e1b02d25b49cfb108c1156f368fc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:44.510444  1158 consensus_queue.cc:1048] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:44.552938  1023 raft_consensus.cc:1275] T 711fc51040264325aa09cebd07d5d5f4 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Refusing update from remote peer a92e1b02d25b49cfb108c1156f368fc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:44.554431  1158 consensus_queue.cc:1048] T 711fc51040264325aa09cebd07d5d5f4 P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:44.564698   874 raft_consensus.cc:1275] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Refusing update from remote peer a92e1b02d25b49cfb108c1156f368fc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:44.567292  1071 consensus_queue.cc:1048] T 711fc51040264325aa09cebd07d5d5f4 P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:44.723308   874 raft_consensus.cc:1275] T 3001aaf097cd4643b552a2d9ffe4e451 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Refusing update from remote peer a92e1b02d25b49cfb108c1156f368fc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:44.724774  1071 consensus_queue.cc:1048] T 3001aaf097cd4643b552a2d9ffe4e451 P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:44.736019  1023 raft_consensus.cc:1275] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Refusing update from remote peer a92e1b02d25b49cfb108c1156f368fc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:44.737952  1165 consensus_queue.cc:1048] T 3001aaf097cd4643b552a2d9ffe4e451 P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:46.619050   769 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54628:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:46.621634   769 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:46.677780   863 tablet_service.cc:1511] Processing CreateTablet for tablet 7831d6e821344a38ae5852abd18bb3fe (DEFAULT_TABLE table=soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:46.679175   863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7831d6e821344a38ae5852abd18bb3fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.679538   934 tablet_service.cc:1511] Processing CreateTablet for tablet 7831d6e821344a38ae5852abd18bb3fe (DEFAULT_TABLE table=soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:46.680605  1014 tablet_service.cc:1511] Processing CreateTablet for tablet 7831d6e821344a38ae5852abd18bb3fe (DEFAULT_TABLE table=soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:46.681196   934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7831d6e821344a38ae5852abd18bb3fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.682027  1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7831d6e821344a38ae5852abd18bb3fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.684844   860 tablet_service.cc:1511] Processing CreateTablet for tablet 84f31361412f4c9b92508e13138f16a6 (DEFAULT_TABLE table=soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:46.686407   860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f31361412f4c9b92508e13138f16a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.699016   936 tablet_service.cc:1511] Processing CreateTablet for tablet 84f31361412f4c9b92508e13138f16a6 (DEFAULT_TABLE table=soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:46.699860  1011 tablet_service.cc:1511] Processing CreateTablet for tablet 84f31361412f4c9b92508e13138f16a6 (DEFAULT_TABLE table=soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:46.700867   936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f31361412f4c9b92508e13138f16a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.701875  1011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f31361412f4c9b92508e13138f16a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.704680  1178 tablet_bootstrap.cc:492] T 7831d6e821344a38ae5852abd18bb3fe P 92e9b78bc90b4d2199d6926b30ce4f18: Bootstrap starting.
I20260709 12:22:46.712652  1178 tablet_bootstrap.cc:654] T 7831d6e821344a38ae5852abd18bb3fe P 92e9b78bc90b4d2199d6926b30ce4f18: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:46.716313   863 tablet_service.cc:1511] Processing CreateTablet for tablet 4e64b69135784d4b9f5c0b183b5b07e0 (DEFAULT_TABLE table=soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:46.717921   863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e64b69135784d4b9f5c0b183b5b07e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.723682   938 tablet_service.cc:1511] Processing CreateTablet for tablet 4e64b69135784d4b9f5c0b183b5b07e0 (DEFAULT_TABLE table=soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:46.725436   938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e64b69135784d4b9f5c0b183b5b07e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.727193   861 tablet_service.cc:1511] Processing CreateTablet for tablet 7b7ce2d5c2024a7bbce3f957b5c5d998 (DEFAULT_TABLE table=soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:46.730135   861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b7ce2d5c2024a7bbce3f957b5c5d998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.730629  1015 tablet_service.cc:1511] Processing CreateTablet for tablet 4e64b69135784d4b9f5c0b183b5b07e0 (DEFAULT_TABLE table=soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:46.731391   941 tablet_service.cc:1511] Processing CreateTablet for tablet 7b7ce2d5c2024a7bbce3f957b5c5d998 (DEFAULT_TABLE table=soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:46.734535  1013 tablet_service.cc:1511] Processing CreateTablet for tablet 7b7ce2d5c2024a7bbce3f957b5c5d998 (DEFAULT_TABLE table=soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:46.732142  1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e64b69135784d4b9f5c0b183b5b07e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.736970  1013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b7ce2d5c2024a7bbce3f957b5c5d998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.740793   941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b7ce2d5c2024a7bbce3f957b5c5d998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.752207  1179 tablet_bootstrap.cc:492] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3: Bootstrap starting.
I20260709 12:22:46.761718   934 tablet_service.cc:1511] Processing CreateTablet for tablet c3c892001314454ca65c7c2e8edf5fc3 (DEFAULT_TABLE table=soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:46.763703   934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3c892001314454ca65c7c2e8edf5fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.772830   860 tablet_service.cc:1511] Processing CreateTablet for tablet c3c892001314454ca65c7c2e8edf5fc3 (DEFAULT_TABLE table=soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:46.774369   860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3c892001314454ca65c7c2e8edf5fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.777758  1180 tablet_bootstrap.cc:492] T 7831d6e821344a38ae5852abd18bb3fe P 91fb18caf57c4ad685ecac3334f1794f: Bootstrap starting.
I20260709 12:22:46.779078  1011 tablet_service.cc:1511] Processing CreateTablet for tablet c3c892001314454ca65c7c2e8edf5fc3 (DEFAULT_TABLE table=soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:46.780571   865 tablet_service.cc:1511] Processing CreateTablet for tablet ec6b4ed2c5584d1ab830484e259e639d (DEFAULT_TABLE table=soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:46.781515  1011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3c892001314454ca65c7c2e8edf5fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.782068   865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec6b4ed2c5584d1ab830484e259e639d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.782666  1179 tablet_bootstrap.cc:654] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:46.787187   936 tablet_service.cc:1511] Processing CreateTablet for tablet ec6b4ed2c5584d1ab830484e259e639d (DEFAULT_TABLE table=soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:46.788584   936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec6b4ed2c5584d1ab830484e259e639d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.796905   866 tablet_service.cc:1511] Processing CreateTablet for tablet 9fc4c255f6b249f69626768f14e626f2 (DEFAULT_TABLE table=soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:46.797868   935 tablet_service.cc:1511] Processing CreateTablet for tablet 9fc4c255f6b249f69626768f14e626f2 (DEFAULT_TABLE table=soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:46.798499   866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fc4c255f6b249f69626768f14e626f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.799225   935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fc4c255f6b249f69626768f14e626f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.815335  1014 tablet_service.cc:1511] Processing CreateTablet for tablet 9fc4c255f6b249f69626768f14e626f2 (DEFAULT_TABLE table=soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:46.822760  1015 tablet_service.cc:1511] Processing CreateTablet for tablet ec6b4ed2c5584d1ab830484e259e639d (DEFAULT_TABLE table=soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:46.819021  1178 tablet_bootstrap.cc:492] T 7831d6e821344a38ae5852abd18bb3fe P 92e9b78bc90b4d2199d6926b30ce4f18: No bootstrap required, opened a new log
I20260709 12:22:46.824085  1178 ts_tablet_manager.cc:1403] T 7831d6e821344a38ae5852abd18bb3fe P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent bootstrapping tablet: real 0.120s	user 0.013s	sys 0.004s
I20260709 12:22:46.825052  1179 tablet_bootstrap.cc:492] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3: No bootstrap required, opened a new log
I20260709 12:22:46.826457  1179 ts_tablet_manager.cc:1403] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3: Time spent bootstrapping tablet: real 0.075s	user 0.007s	sys 0.006s
I20260709 12:22:46.829293  1178 raft_consensus.cc:359] T 7831d6e821344a38ae5852abd18bb3fe P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:46.829862  1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fc4c255f6b249f69626768f14e626f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.834808   941 tablet_service.cc:1511] Processing CreateTablet for tablet d4e3b537fd694288a9d3edbc614d48a0 (DEFAULT_TABLE table=soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:46.836390   941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4e3b537fd694288a9d3edbc614d48a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.838678  1180 tablet_bootstrap.cc:654] T 7831d6e821344a38ae5852abd18bb3fe P 91fb18caf57c4ad685ecac3334f1794f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:46.834849  1178 raft_consensus.cc:385] T 7831d6e821344a38ae5852abd18bb3fe P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:46.841652  1178 raft_consensus.cc:740] T 7831d6e821344a38ae5852abd18bb3fe P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Initialized, Role: FOLLOWER
I20260709 12:22:46.842336  1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec6b4ed2c5584d1ab830484e259e639d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.829878  1179 raft_consensus.cc:359] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:46.843640  1179 raft_consensus.cc:385] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:46.843940  1179 raft_consensus.cc:740] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Initialized, Role: FOLLOWER
I20260709 12:22:46.848469  1179 consensus_queue.cc:260] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:46.852825  1167 raft_consensus.cc:493] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.853515  1167 raft_consensus.cc:515] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:46.856766   861 tablet_service.cc:1511] Processing CreateTablet for tablet d4e3b537fd694288a9d3edbc614d48a0 (DEFAULT_TABLE table=soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:46.858222   861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4e3b537fd694288a9d3edbc614d48a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.861207  1178 consensus_queue.cc:260] T 7831d6e821344a38ae5852abd18bb3fe P 92e9b78bc90b4d2199d6926b30ce4f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:46.865685   874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7831d6e821344a38ae5852abd18bb3fe" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" is_pre_election: true
I20260709 12:22:46.866427   874 raft_consensus.cc:2468] T 7831d6e821344a38ae5852abd18bb3fe P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 0.
I20260709 12:22:46.868098   914 leader_election.cc:304] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e9b78bc90b4d2199d6926b30ce4f18, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:46.869107  1165 raft_consensus.cc:2804] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:46.869499  1165 raft_consensus.cc:493] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.869843  1165 raft_consensus.cc:3060] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:46.878731  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7831d6e821344a38ae5852abd18bb3fe" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f" is_pre_election: true
W20260709 12:22:46.880718   917 leader_election.cc:343] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:46.882098  1167 leader_election.cc:290] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:46.882580  1178 ts_tablet_manager.cc:1434] T 7831d6e821344a38ae5852abd18bb3fe P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent starting tablet: real 0.057s	user 0.009s	sys 0.000s
I20260709 12:22:46.885938  1180 tablet_bootstrap.cc:492] T 7831d6e821344a38ae5852abd18bb3fe P 91fb18caf57c4ad685ecac3334f1794f: No bootstrap required, opened a new log
I20260709 12:22:46.888181  1178 tablet_bootstrap.cc:492] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18: Bootstrap starting.
I20260709 12:22:46.889724  1014 tablet_service.cc:1511] Processing CreateTablet for tablet d4e3b537fd694288a9d3edbc614d48a0 (DEFAULT_TABLE table=soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:46.891439  1180 ts_tablet_manager.cc:1403] T 7831d6e821344a38ae5852abd18bb3fe P 91fb18caf57c4ad685ecac3334f1794f: Time spent bootstrapping tablet: real 0.114s	user 0.010s	sys 0.004s
I20260709 12:22:46.892556  1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4e3b537fd694288a9d3edbc614d48a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.899343  1179 ts_tablet_manager.cc:1434] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.006s
I20260709 12:22:46.900679  1179 tablet_bootstrap.cc:492] T 84f31361412f4c9b92508e13138f16a6 P a92e1b02d25b49cfb108c1156f368fc3: Bootstrap starting.
I20260709 12:22:46.901774  1180 raft_consensus.cc:359] T 7831d6e821344a38ae5852abd18bb3fe P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:46.902715  1180 raft_consensus.cc:385] T 7831d6e821344a38ae5852abd18bb3fe P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:46.903007  1180 raft_consensus.cc:740] T 7831d6e821344a38ae5852abd18bb3fe P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Initialized, Role: FOLLOWER
I20260709 12:22:46.903759  1180 consensus_queue.cc:260] T 7831d6e821344a38ae5852abd18bb3fe P 91fb18caf57c4ad685ecac3334f1794f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:46.908406   860 tablet_service.cc:1511] Processing CreateTablet for tablet 7a49fd62ea774c2f94dc9816c84129f3 (DEFAULT_TABLE table=soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:46.909974   860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a49fd62ea774c2f94dc9816c84129f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.886204  1165 raft_consensus.cc:515] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:46.915717  1165 leader_election.cc:290] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 election: Requested vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:46.919400   874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7831d6e821344a38ae5852abd18bb3fe" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
I20260709 12:22:46.922188  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7831d6e821344a38ae5852abd18bb3fe" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
I20260709 12:22:46.939810  1023 raft_consensus.cc:3060] T 7831d6e821344a38ae5852abd18bb3fe P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:46.923360   935 tablet_service.cc:1511] Processing CreateTablet for tablet 7a49fd62ea774c2f94dc9816c84129f3 (DEFAULT_TABLE table=soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:46.942112   935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a49fd62ea774c2f94dc9816c84129f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.929006  1011 tablet_service.cc:1511] Processing CreateTablet for tablet 7a49fd62ea774c2f94dc9816c84129f3 (DEFAULT_TABLE table=soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:46.945894  1011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a49fd62ea774c2f94dc9816c84129f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.939052   874 raft_consensus.cc:3060] T 7831d6e821344a38ae5852abd18bb3fe P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:46.921586  1180 ts_tablet_manager.cc:1434] T 7831d6e821344a38ae5852abd18bb3fe P 91fb18caf57c4ad685ecac3334f1794f: Time spent starting tablet: real 0.029s	user 0.002s	sys 0.005s
I20260709 12:22:46.955331  1180 tablet_bootstrap.cc:492] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f: Bootstrap starting.
I20260709 12:22:46.918399  1178 tablet_bootstrap.cc:654] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:46.959726  1023 raft_consensus.cc:2468] T 7831d6e821344a38ae5852abd18bb3fe P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 1.
I20260709 12:22:46.962072   917 leader_election.cc:304] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:46.963112  1165 raft_consensus.cc:2804] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:46.963676  1165 raft_consensus.cc:697] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [term 1 LEADER]: Becoming Leader. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Running, Role: LEADER
I20260709 12:22:46.964551  1165 consensus_queue.cc:237] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:46.939003  1179 tablet_bootstrap.cc:654] T 84f31361412f4c9b92508e13138f16a6 P a92e1b02d25b49cfb108c1156f368fc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:46.972918  1180 tablet_bootstrap.cc:654] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:46.987350   874 raft_consensus.cc:2468] T 7831d6e821344a38ae5852abd18bb3fe P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 1.
I20260709 12:22:47.008288  1179 tablet_bootstrap.cc:492] T 84f31361412f4c9b92508e13138f16a6 P a92e1b02d25b49cfb108c1156f368fc3: No bootstrap required, opened a new log
I20260709 12:22:47.008374  1178 tablet_bootstrap.cc:492] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18: No bootstrap required, opened a new log
I20260709 12:22:47.009137  1179 ts_tablet_manager.cc:1403] T 84f31361412f4c9b92508e13138f16a6 P a92e1b02d25b49cfb108c1156f368fc3: Time spent bootstrapping tablet: real 0.109s	user 0.016s	sys 0.039s
I20260709 12:22:47.009208  1178 ts_tablet_manager.cc:1403] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent bootstrapping tablet: real 0.121s	user 0.012s	sys 0.009s
I20260709 12:22:47.013382  1178 raft_consensus.cc:359] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.014179  1178 raft_consensus.cc:385] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.014987  1178 raft_consensus.cc:740] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.014081  1179 raft_consensus.cc:359] T 84f31361412f4c9b92508e13138f16a6 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.015595  1179 raft_consensus.cc:385] T 84f31361412f4c9b92508e13138f16a6 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.016010  1179 raft_consensus.cc:740] T 84f31361412f4c9b92508e13138f16a6 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.015947  1178 consensus_queue.cc:260] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.017277  1179 consensus_queue.cc:260] T 84f31361412f4c9b92508e13138f16a6 P a92e1b02d25b49cfb108c1156f368fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.017418   769 catalog_manager.cc:5697] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "a92e1b02d25b49cfb108c1156f368fc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:47.020589  1179 ts_tablet_manager.cc:1434] T 84f31361412f4c9b92508e13138f16a6 P a92e1b02d25b49cfb108c1156f368fc3: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 12:22:47.021716  1179 tablet_bootstrap.cc:492] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P a92e1b02d25b49cfb108c1156f368fc3: Bootstrap starting.
I20260709 12:22:47.025815  1178 ts_tablet_manager.cc:1434] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:22:47.027066  1178 tablet_bootstrap.cc:492] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18: Bootstrap starting.
I20260709 12:22:47.029098  1179 tablet_bootstrap.cc:654] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P a92e1b02d25b49cfb108c1156f368fc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.036031  1179 tablet_bootstrap.cc:492] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P a92e1b02d25b49cfb108c1156f368fc3: No bootstrap required, opened a new log
I20260709 12:22:47.036602  1179 ts_tablet_manager.cc:1403] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P a92e1b02d25b49cfb108c1156f368fc3: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 12:22:47.037171  1180 tablet_bootstrap.cc:492] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f: No bootstrap required, opened a new log
I20260709 12:22:47.037851  1180 ts_tablet_manager.cc:1403] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f: Time spent bootstrapping tablet: real 0.083s	user 0.011s	sys 0.021s
I20260709 12:22:47.039754  1178 tablet_bootstrap.cc:654] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.039760  1179 raft_consensus.cc:359] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.040853  1179 raft_consensus.cc:385] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.041188  1179 raft_consensus.cc:740] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.041419  1180 raft_consensus.cc:359] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.042183  1180 raft_consensus.cc:385] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.042564  1180 raft_consensus.cc:740] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.042061  1179 consensus_queue.cc:260] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P a92e1b02d25b49cfb108c1156f368fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.043293  1180 consensus_queue.cc:260] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.045892  1180 ts_tablet_manager.cc:1434] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:47.048153  1179 ts_tablet_manager.cc:1434] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P a92e1b02d25b49cfb108c1156f368fc3: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 12:22:47.049118  1180 tablet_bootstrap.cc:492] T 4e64b69135784d4b9f5c0b183b5b07e0 P 91fb18caf57c4ad685ecac3334f1794f: Bootstrap starting.
I20260709 12:22:47.049403  1179 tablet_bootstrap.cc:492] T 4e64b69135784d4b9f5c0b183b5b07e0 P a92e1b02d25b49cfb108c1156f368fc3: Bootstrap starting.
I20260709 12:22:47.049571  1178 tablet_bootstrap.cc:492] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18: No bootstrap required, opened a new log
I20260709 12:22:47.050479  1178 ts_tablet_manager.cc:1403] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.003s
I20260709 12:22:47.053886  1178 raft_consensus.cc:359] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.054724  1178 raft_consensus.cc:385] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.055087  1178 raft_consensus.cc:740] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.056015  1178 consensus_queue.cc:260] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.057709  1179 tablet_bootstrap.cc:654] T 4e64b69135784d4b9f5c0b183b5b07e0 P a92e1b02d25b49cfb108c1156f368fc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.058055  1180 tablet_bootstrap.cc:654] T 4e64b69135784d4b9f5c0b183b5b07e0 P 91fb18caf57c4ad685ecac3334f1794f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.058660  1178 ts_tablet_manager.cc:1434] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:22:47.059966  1178 tablet_bootstrap.cc:492] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18: Bootstrap starting.
I20260709 12:22:47.068418  1178 tablet_bootstrap.cc:654] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.077072  1180 tablet_bootstrap.cc:492] T 4e64b69135784d4b9f5c0b183b5b07e0 P 91fb18caf57c4ad685ecac3334f1794f: No bootstrap required, opened a new log
I20260709 12:22:47.077668  1180 ts_tablet_manager.cc:1403] T 4e64b69135784d4b9f5c0b183b5b07e0 P 91fb18caf57c4ad685ecac3334f1794f: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.004s
I20260709 12:22:47.077678  1179 tablet_bootstrap.cc:492] T 4e64b69135784d4b9f5c0b183b5b07e0 P a92e1b02d25b49cfb108c1156f368fc3: No bootstrap required, opened a new log
I20260709 12:22:47.078464  1179 ts_tablet_manager.cc:1403] T 4e64b69135784d4b9f5c0b183b5b07e0 P a92e1b02d25b49cfb108c1156f368fc3: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.000s
I20260709 12:22:47.080560  1178 tablet_bootstrap.cc:492] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18: No bootstrap required, opened a new log
I20260709 12:22:47.081233  1178 ts_tablet_manager.cc:1403] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent bootstrapping tablet: real 0.022s	user 0.000s	sys 0.020s
I20260709 12:22:47.081585  1180 raft_consensus.cc:359] T 4e64b69135784d4b9f5c0b183b5b07e0 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.081866  1179 raft_consensus.cc:359] T 4e64b69135784d4b9f5c0b183b5b07e0 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.082515  1180 raft_consensus.cc:385] T 4e64b69135784d4b9f5c0b183b5b07e0 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.082775  1179 raft_consensus.cc:385] T 4e64b69135784d4b9f5c0b183b5b07e0 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.082911  1180 raft_consensus.cc:740] T 4e64b69135784d4b9f5c0b183b5b07e0 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.083302  1179 raft_consensus.cc:740] T 4e64b69135784d4b9f5c0b183b5b07e0 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.084048  1180 consensus_queue.cc:260] T 4e64b69135784d4b9f5c0b183b5b07e0 P 91fb18caf57c4ad685ecac3334f1794f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.084251  1179 consensus_queue.cc:260] T 4e64b69135784d4b9f5c0b183b5b07e0 P a92e1b02d25b49cfb108c1156f368fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.085366  1178 raft_consensus.cc:359] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.086184  1178 raft_consensus.cc:385] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.086512  1178 raft_consensus.cc:740] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.087054  1180 ts_tablet_manager.cc:1434] T 4e64b69135784d4b9f5c0b183b5b07e0 P 91fb18caf57c4ad685ecac3334f1794f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.004s
I20260709 12:22:47.087481  1178 consensus_queue.cc:260] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.088243  1179 ts_tablet_manager.cc:1434] T 4e64b69135784d4b9f5c0b183b5b07e0 P a92e1b02d25b49cfb108c1156f368fc3: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:22:47.089326  1179 tablet_bootstrap.cc:492] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3: Bootstrap starting.
I20260709 12:22:47.090179  1178 ts_tablet_manager.cc:1434] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 12:22:47.091351  1178 tablet_bootstrap.cc:492] T ec6b4ed2c5584d1ab830484e259e639d P 92e9b78bc90b4d2199d6926b30ce4f18: Bootstrap starting.
I20260709 12:22:47.093604  1180 tablet_bootstrap.cc:492] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 91fb18caf57c4ad685ecac3334f1794f: Bootstrap starting.
I20260709 12:22:47.096414  1179 tablet_bootstrap.cc:654] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.098680  1178 tablet_bootstrap.cc:654] T ec6b4ed2c5584d1ab830484e259e639d P 92e9b78bc90b4d2199d6926b30ce4f18: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.101737  1180 tablet_bootstrap.cc:654] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 91fb18caf57c4ad685ecac3334f1794f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.109484  1179 tablet_bootstrap.cc:492] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3: No bootstrap required, opened a new log
I20260709 12:22:47.110204  1179 ts_tablet_manager.cc:1403] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.001s
I20260709 12:22:47.109495  1178 tablet_bootstrap.cc:492] T ec6b4ed2c5584d1ab830484e259e639d P 92e9b78bc90b4d2199d6926b30ce4f18: No bootstrap required, opened a new log
I20260709 12:22:47.113479  1178 ts_tablet_manager.cc:1403] T ec6b4ed2c5584d1ab830484e259e639d P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.007s
I20260709 12:22:47.117807  1180 tablet_bootstrap.cc:492] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 91fb18caf57c4ad685ecac3334f1794f: No bootstrap required, opened a new log
I20260709 12:22:47.117561  1178 raft_consensus.cc:359] T ec6b4ed2c5584d1ab830484e259e639d P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.118321  1178 raft_consensus.cc:385] T ec6b4ed2c5584d1ab830484e259e639d P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.118382  1180 ts_tablet_manager.cc:1403] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 91fb18caf57c4ad685ecac3334f1794f: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.005s
I20260709 12:22:47.118714  1178 raft_consensus.cc:740] T ec6b4ed2c5584d1ab830484e259e639d P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.120441  1178 consensus_queue.cc:260] T ec6b4ed2c5584d1ab830484e259e639d P 92e9b78bc90b4d2199d6926b30ce4f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.120751  1179 raft_consensus.cc:359] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.121546  1183 raft_consensus.cc:493] T ec6b4ed2c5584d1ab830484e259e639d P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.121583  1179 raft_consensus.cc:385] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.121646  1180 raft_consensus.cc:359] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.122421  1179 raft_consensus.cc:740] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.122680  1180 raft_consensus.cc:385] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.122515  1183 raft_consensus.cc:515] T ec6b4ed2c5584d1ab830484e259e639d P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.123186  1180 raft_consensus.cc:740] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.123477  1179 consensus_queue.cc:260] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.124028  1180 consensus_queue.cc:260] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 91fb18caf57c4ad685ecac3334f1794f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.126364  1180 ts_tablet_manager.cc:1434] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 91fb18caf57c4ad685ecac3334f1794f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:22:47.126364  1179 ts_tablet_manager.cc:1434] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:22:47.127750  1179 tablet_bootstrap.cc:492] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3: Bootstrap starting.
I20260709 12:22:47.127902  1180 tablet_bootstrap.cc:492] T c3c892001314454ca65c7c2e8edf5fc3 P 91fb18caf57c4ad685ecac3334f1794f: Bootstrap starting.
I20260709 12:22:47.131083   949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6b4ed2c5584d1ab830484e259e639d" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3" is_pre_election: true
W20260709 12:22:47.132807   842 leader_election.cc:343] T ec6b4ed2c5584d1ab830484e259e639d P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:47.135294  1180 tablet_bootstrap.cc:654] T c3c892001314454ca65c7c2e8edf5fc3 P 91fb18caf57c4ad685ecac3334f1794f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.137785  1183 leader_election.cc:290] T ec6b4ed2c5584d1ab830484e259e639d P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:47.139823  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6b4ed2c5584d1ab830484e259e639d" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f" is_pre_election: true
I20260709 12:22:47.142287  1178 ts_tablet_manager.cc:1434] T ec6b4ed2c5584d1ab830484e259e639d P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 12:22:47.143888  1178 tablet_bootstrap.cc:492] T c3c892001314454ca65c7c2e8edf5fc3 P 92e9b78bc90b4d2199d6926b30ce4f18: Bootstrap starting.
W20260709 12:22:47.146498   842 leader_election.cc:343] T ec6b4ed2c5584d1ab830484e259e639d P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:47.147295   842 leader_election.cc:304] T ec6b4ed2c5584d1ab830484e259e639d P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92e9b78bc90b4d2199d6926b30ce4f18; no voters: 91fb18caf57c4ad685ecac3334f1794f, a92e1b02d25b49cfb108c1156f368fc3
I20260709 12:22:47.148378  1118 raft_consensus.cc:2749] T ec6b4ed2c5584d1ab830484e259e639d P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:47.151881  1179 tablet_bootstrap.cc:654] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.155787  1178 tablet_bootstrap.cc:654] T c3c892001314454ca65c7c2e8edf5fc3 P 92e9b78bc90b4d2199d6926b30ce4f18: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.162003  1180 tablet_bootstrap.cc:492] T c3c892001314454ca65c7c2e8edf5fc3 P 91fb18caf57c4ad685ecac3334f1794f: No bootstrap required, opened a new log
I20260709 12:22:47.162550  1180 ts_tablet_manager.cc:1403] T c3c892001314454ca65c7c2e8edf5fc3 P 91fb18caf57c4ad685ecac3334f1794f: Time spent bootstrapping tablet: real 0.035s	user 0.023s	sys 0.008s
I20260709 12:22:47.165170  1180 raft_consensus.cc:359] T c3c892001314454ca65c7c2e8edf5fc3 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.165784  1180 raft_consensus.cc:385] T c3c892001314454ca65c7c2e8edf5fc3 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.166004  1180 raft_consensus.cc:740] T c3c892001314454ca65c7c2e8edf5fc3 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.167157  1178 tablet_bootstrap.cc:492] T c3c892001314454ca65c7c2e8edf5fc3 P 92e9b78bc90b4d2199d6926b30ce4f18: No bootstrap required, opened a new log
I20260709 12:22:47.166790  1180 consensus_queue.cc:260] T c3c892001314454ca65c7c2e8edf5fc3 P 91fb18caf57c4ad685ecac3334f1794f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.167819  1178 ts_tablet_manager.cc:1403] T c3c892001314454ca65c7c2e8edf5fc3 P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.004s
I20260709 12:22:47.167886  1179 tablet_bootstrap.cc:492] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3: No bootstrap required, opened a new log
I20260709 12:22:47.168514  1179 ts_tablet_manager.cc:1403] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.001s
I20260709 12:22:47.169381  1180 ts_tablet_manager.cc:1434] T c3c892001314454ca65c7c2e8edf5fc3 P 91fb18caf57c4ad685ecac3334f1794f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:47.170882  1180 tablet_bootstrap.cc:492] T 9fc4c255f6b249f69626768f14e626f2 P 91fb18caf57c4ad685ecac3334f1794f: Bootstrap starting.
I20260709 12:22:47.171391  1178 raft_consensus.cc:359] T c3c892001314454ca65c7c2e8edf5fc3 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.172254  1178 raft_consensus.cc:385] T c3c892001314454ca65c7c2e8edf5fc3 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.172588  1178 raft_consensus.cc:740] T c3c892001314454ca65c7c2e8edf5fc3 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.172932  1179 raft_consensus.cc:359] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.173815  1179 raft_consensus.cc:385] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.173563  1178 consensus_queue.cc:260] T c3c892001314454ca65c7c2e8edf5fc3 P 92e9b78bc90b4d2199d6926b30ce4f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.174191  1179 raft_consensus.cc:740] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.175288  1179 consensus_queue.cc:260] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.178323  1178 ts_tablet_manager.cc:1434] T c3c892001314454ca65c7c2e8edf5fc3 P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:22:47.178340  1180 tablet_bootstrap.cc:654] T 9fc4c255f6b249f69626768f14e626f2 P 91fb18caf57c4ad685ecac3334f1794f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.179831  1178 tablet_bootstrap.cc:492] T 9fc4c255f6b249f69626768f14e626f2 P 92e9b78bc90b4d2199d6926b30ce4f18: Bootstrap starting.
I20260709 12:22:47.188081  1178 tablet_bootstrap.cc:654] T 9fc4c255f6b249f69626768f14e626f2 P 92e9b78bc90b4d2199d6926b30ce4f18: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.188750  1179 ts_tablet_manager.cc:1434] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:22:47.190582  1179 tablet_bootstrap.cc:492] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3: Bootstrap starting.
I20260709 12:22:47.190630  1180 tablet_bootstrap.cc:492] T 9fc4c255f6b249f69626768f14e626f2 P 91fb18caf57c4ad685ecac3334f1794f: No bootstrap required, opened a new log
I20260709 12:22:47.191335  1180 ts_tablet_manager.cc:1403] T 9fc4c255f6b249f69626768f14e626f2 P 91fb18caf57c4ad685ecac3334f1794f: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.000s
I20260709 12:22:47.194661  1180 raft_consensus.cc:359] T 9fc4c255f6b249f69626768f14e626f2 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.195480  1180 raft_consensus.cc:385] T 9fc4c255f6b249f69626768f14e626f2 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.195783  1180 raft_consensus.cc:740] T 9fc4c255f6b249f69626768f14e626f2 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.198642  1185 raft_consensus.cc:493] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.199079  1167 raft_consensus.cc:493] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.199173  1185 raft_consensus.cc:515] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.199630  1167 raft_consensus.cc:515] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.201517  1185 leader_election.cc:290] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583)
I20260709 12:22:47.204461  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c892001314454ca65c7c2e8edf5fc3" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f" is_pre_election: true
I20260709 12:22:47.205137  1023 raft_consensus.cc:2468] T c3c892001314454ca65c7c2e8edf5fc3 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 0.
I20260709 12:22:47.205279  1180 consensus_queue.cc:260] T 9fc4c255f6b249f69626768f14e626f2 P 91fb18caf57c4ad685ecac3334f1794f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.205456   949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f31361412f4c9b92508e13138f16a6" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3" is_pre_election: true
I20260709 12:22:47.201526  1167 leader_election.cc:290] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:47.210393  1179 tablet_bootstrap.cc:654] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.207746  1180 ts_tablet_manager.cc:1434] T 9fc4c255f6b249f69626768f14e626f2 P 91fb18caf57c4ad685ecac3334f1794f: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:22:47.208117   917 leader_election.cc:304] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:47.206625   949 raft_consensus.cc:2468] T 84f31361412f4c9b92508e13138f16a6 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fb18caf57c4ad685ecac3334f1794f in term 0.
I20260709 12:22:47.212019  1180 tablet_bootstrap.cc:492] T ec6b4ed2c5584d1ab830484e259e639d P 91fb18caf57c4ad685ecac3334f1794f: Bootstrap starting.
I20260709 12:22:47.212500  1189 raft_consensus.cc:2804] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:47.212952  1189 raft_consensus.cc:493] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.213290  1189 raft_consensus.cc:3060] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.210529   874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f31361412f4c9b92508e13138f16a6" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" is_pre_election: true
I20260709 12:22:47.210438   876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c892001314454ca65c7c2e8edf5fc3" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" is_pre_election: true
I20260709 12:22:47.214471   874 raft_consensus.cc:2468] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fb18caf57c4ad685ecac3334f1794f in term 0.
I20260709 12:22:47.214876   876 raft_consensus.cc:2468] T c3c892001314454ca65c7c2e8edf5fc3 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 0.
I20260709 12:22:47.215958   988 leader_election.cc:304] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, 92e9b78bc90b4d2199d6926b30ce4f18; no voters: 
I20260709 12:22:47.217254  1178 tablet_bootstrap.cc:492] T 9fc4c255f6b249f69626768f14e626f2 P 92e9b78bc90b4d2199d6926b30ce4f18: No bootstrap required, opened a new log
I20260709 12:22:47.217826  1178 ts_tablet_manager.cc:1403] T 9fc4c255f6b249f69626768f14e626f2 P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.016s
I20260709 12:22:47.221225  1178 raft_consensus.cc:359] T 9fc4c255f6b249f69626768f14e626f2 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.222229  1178 raft_consensus.cc:385] T 9fc4c255f6b249f69626768f14e626f2 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.222537  1178 raft_consensus.cc:740] T 9fc4c255f6b249f69626768f14e626f2 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.223543  1180 tablet_bootstrap.cc:654] T ec6b4ed2c5584d1ab830484e259e639d P 91fb18caf57c4ad685ecac3334f1794f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.223309  1178 consensus_queue.cc:260] T 9fc4c255f6b249f69626768f14e626f2 P 92e9b78bc90b4d2199d6926b30ce4f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.225996  1178 ts_tablet_manager.cc:1434] T 9fc4c255f6b249f69626768f14e626f2 P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:47.226426  1185 raft_consensus.cc:2804] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:47.226926  1185 raft_consensus.cc:493] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.227378  1185 raft_consensus.cc:3060] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.227954  1178 tablet_bootstrap.cc:492] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18: Bootstrap starting.
I20260709 12:22:47.236817  1178 tablet_bootstrap.cc:654] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.242178  1167 raft_consensus.cc:493] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.242942  1167 raft_consensus.cc:515] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.247668   876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fc4c255f6b249f69626768f14e626f2" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" is_pre_election: true
I20260709 12:22:47.248679   876 raft_consensus.cc:2468] T 9fc4c255f6b249f69626768f14e626f2 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 0.
I20260709 12:22:47.250617  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fc4c255f6b249f69626768f14e626f2" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f" is_pre_election: true
I20260709 12:22:47.251497  1023 raft_consensus.cc:2468] T 9fc4c255f6b249f69626768f14e626f2 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 0.
I20260709 12:22:47.251220  1185 raft_consensus.cc:515] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.253064   914 leader_election.cc:304] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e9b78bc90b4d2199d6926b30ce4f18, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:47.254215  1165 raft_consensus.cc:2804] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:47.254693  1165 raft_consensus.cc:493] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.255090  1165 raft_consensus.cc:3060] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.255468  1167 leader_election.cc:290] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:47.254961   876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f31361412f4c9b92508e13138f16a6" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
I20260709 12:22:47.259608   876 raft_consensus.cc:3060] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.257409  1185 leader_election.cc:290] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 1 election: Requested vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583)
I20260709 12:22:47.261533  1178 tablet_bootstrap.cc:492] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18: No bootstrap required, opened a new log
I20260709 12:22:47.262337  1178 ts_tablet_manager.cc:1403] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.011s
I20260709 12:22:47.258646  1179 tablet_bootstrap.cc:492] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3: No bootstrap required, opened a new log
I20260709 12:22:47.258678   949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f31361412f4c9b92508e13138f16a6" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
I20260709 12:22:47.268285   949 raft_consensus.cc:3060] T 84f31361412f4c9b92508e13138f16a6 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.268266  1179 ts_tablet_manager.cc:1403] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3: Time spent bootstrapping tablet: real 0.078s	user 0.011s	sys 0.015s
I20260709 12:22:47.270274  1189 raft_consensus.cc:515] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.273700  1179 raft_consensus.cc:359] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.274909  1179 raft_consensus.cc:385] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.272562  1165 raft_consensus.cc:515] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.276283   874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c892001314454ca65c7c2e8edf5fc3" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
I20260709 12:22:47.277034   874 raft_consensus.cc:3060] T c3c892001314454ca65c7c2e8edf5fc3 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.277839   875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fc4c255f6b249f69626768f14e626f2" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
I20260709 12:22:47.278515   875 raft_consensus.cc:3060] T 9fc4c255f6b249f69626768f14e626f2 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.266584  1178 raft_consensus.cc:359] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.281009  1178 raft_consensus.cc:385] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.281503  1178 raft_consensus.cc:740] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.282574  1178 consensus_queue.cc:260] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.286278  1178 ts_tablet_manager.cc:1434] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.001s
I20260709 12:22:47.287786  1178 tablet_bootstrap.cc:492] T 7a49fd62ea774c2f94dc9816c84129f3 P 92e9b78bc90b4d2199d6926b30ce4f18: Bootstrap starting.
I20260709 12:22:47.271889   876 raft_consensus.cc:2468] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fb18caf57c4ad685ecac3334f1794f in term 1.
I20260709 12:22:47.291420   988 leader_election.cc:304] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, 92e9b78bc90b4d2199d6926b30ce4f18; no voters: 
I20260709 12:22:47.291994   949 raft_consensus.cc:2468] T 84f31361412f4c9b92508e13138f16a6 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fb18caf57c4ad685ecac3334f1794f in term 1.
I20260709 12:22:47.292384  1185 raft_consensus.cc:2804] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:47.293203  1165 leader_election.cc:290] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 election: Requested vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:47.275241  1179 raft_consensus.cc:740] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.294641  1179 consensus_queue.cc:260] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.295346  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fc4c255f6b249f69626768f14e626f2" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
I20260709 12:22:47.295953  1023 raft_consensus.cc:3060] T 9fc4c255f6b249f69626768f14e626f2 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.297667  1179 ts_tablet_manager.cc:1434] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 12:22:47.303393  1178 tablet_bootstrap.cc:654] T 7a49fd62ea774c2f94dc9816c84129f3 P 92e9b78bc90b4d2199d6926b30ce4f18: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.300981   875 raft_consensus.cc:2468] T 9fc4c255f6b249f69626768f14e626f2 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 1.
I20260709 12:22:47.298857  1185 raft_consensus.cc:697] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [term 1 LEADER]: Becoming Leader. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Running, Role: LEADER
I20260709 12:22:47.312666   914 leader_election.cc:304] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e9b78bc90b4d2199d6926b30ce4f18, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:47.312495  1185 consensus_queue.cc:237] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.318863  1165 raft_consensus.cc:2804] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:47.319429  1165 raft_consensus.cc:697] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 LEADER]: Becoming Leader. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Running, Role: LEADER
I20260709 12:22:47.320355  1165 consensus_queue.cc:237] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.324664   874 raft_consensus.cc:2468] T c3c892001314454ca65c7c2e8edf5fc3 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 1.
I20260709 12:22:47.298815  1179 tablet_bootstrap.cc:492] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3: Bootstrap starting.
I20260709 12:22:47.339341   914 leader_election.cc:304] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e9b78bc90b4d2199d6926b30ce4f18, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:47.332661  1178 tablet_bootstrap.cc:492] T 7a49fd62ea774c2f94dc9816c84129f3 P 92e9b78bc90b4d2199d6926b30ce4f18: No bootstrap required, opened a new log
I20260709 12:22:47.341113  1178 ts_tablet_manager.cc:1403] T 7a49fd62ea774c2f94dc9816c84129f3 P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent bootstrapping tablet: real 0.054s	user 0.023s	sys 0.011s
I20260709 12:22:47.341761  1022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c892001314454ca65c7c2e8edf5fc3" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
I20260709 12:22:47.342588  1022 raft_consensus.cc:3060] T c3c892001314454ca65c7c2e8edf5fc3 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.337823  1189 leader_election.cc:290] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 election: Requested vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:47.343576  1189 raft_consensus.cc:2804] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:47.337927  1023 raft_consensus.cc:2468] T 9fc4c255f6b249f69626768f14e626f2 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 1.
I20260709 12:22:47.340466   771 catalog_manager.cc:5697] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "a92e1b02d25b49cfb108c1156f368fc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:47.349956  1180 tablet_bootstrap.cc:492] T ec6b4ed2c5584d1ab830484e259e639d P 91fb18caf57c4ad685ecac3334f1794f: No bootstrap required, opened a new log
I20260709 12:22:47.344053  1189 raft_consensus.cc:697] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 LEADER]: Becoming Leader. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Running, Role: LEADER
I20260709 12:22:47.350643  1180 ts_tablet_manager.cc:1403] T ec6b4ed2c5584d1ab830484e259e639d P 91fb18caf57c4ad685ecac3334f1794f: Time spent bootstrapping tablet: real 0.139s	user 0.037s	sys 0.073s
I20260709 12:22:47.351186  1189 consensus_queue.cc:237] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.352607  1167 raft_consensus.cc:493] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.355018  1167 raft_consensus.cc:515] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.357362  1167 leader_election.cc:290] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:47.358227   874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6b4ed2c5584d1ab830484e259e639d" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" is_pre_election: true
I20260709 12:22:47.365825   874 raft_consensus.cc:2468] T ec6b4ed2c5584d1ab830484e259e639d P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 0.
I20260709 12:22:47.367121   914 leader_election.cc:304] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e9b78bc90b4d2199d6926b30ce4f18, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:47.357980  1180 raft_consensus.cc:359] T ec6b4ed2c5584d1ab830484e259e639d P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.360064  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6b4ed2c5584d1ab830484e259e639d" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f" is_pre_election: true
I20260709 12:22:47.362942  1022 raft_consensus.cc:2468] T c3c892001314454ca65c7c2e8edf5fc3 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 1.
I20260709 12:22:47.349072  1178 raft_consensus.cc:359] T 7a49fd62ea774c2f94dc9816c84129f3 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.368542  1179 tablet_bootstrap.cc:654] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.368978  1178 raft_consensus.cc:385] T 7a49fd62ea774c2f94dc9816c84129f3 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.369340  1178 raft_consensus.cc:740] T 7a49fd62ea774c2f94dc9816c84129f3 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.368438  1180 raft_consensus.cc:385] T ec6b4ed2c5584d1ab830484e259e639d P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.370404  1180 raft_consensus.cc:740] T ec6b4ed2c5584d1ab830484e259e639d P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.370242  1178 consensus_queue.cc:260] T 7a49fd62ea774c2f94dc9816c84129f3 P 92e9b78bc90b4d2199d6926b30ce4f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.371753  1180 consensus_queue.cc:260] T ec6b4ed2c5584d1ab830484e259e639d P 91fb18caf57c4ad685ecac3334f1794f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.373101  1178 ts_tablet_manager.cc:1434] T 7a49fd62ea774c2f94dc9816c84129f3 P 92e9b78bc90b4d2199d6926b30ce4f18: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.003s
I20260709 12:22:47.373407  1023 raft_consensus.cc:2468] T ec6b4ed2c5584d1ab830484e259e639d P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 0.
I20260709 12:22:47.377362  1183 raft_consensus.cc:493] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.377952  1183 raft_consensus.cc:515] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.380095  1183 leader_election.cc:290] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:47.380280  1180 ts_tablet_manager.cc:1434] T ec6b4ed2c5584d1ab830484e259e639d P 91fb18caf57c4ad685ecac3334f1794f: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 12:22:47.381731   949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7ce2d5c2024a7bbce3f957b5c5d998" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3" is_pre_election: true
I20260709 12:22:47.381875  1180 tablet_bootstrap.cc:492] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f: Bootstrap starting.
I20260709 12:22:47.382206  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7ce2d5c2024a7bbce3f957b5c5d998" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f" is_pre_election: true
I20260709 12:22:47.381918  1189 consensus_queue.cc:1048] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:47.382601   949 raft_consensus.cc:2468] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 0.
I20260709 12:22:47.383098  1023 raft_consensus.cc:2468] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 0.
I20260709 12:22:47.384905   842 leader_election.cc:304] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e9b78bc90b4d2199d6926b30ce4f18, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:47.368459  1167 raft_consensus.cc:2804] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:47.386243  1167 raft_consensus.cc:493] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.386579  1167 raft_consensus.cc:3060] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.386672  1183 raft_consensus.cc:2804] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:47.387320  1183 raft_consensus.cc:493] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.387687  1183 raft_consensus.cc:3060] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.390780  1180 tablet_bootstrap.cc:654] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.393738  1118 raft_consensus.cc:493] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.394505  1118 raft_consensus.cc:515] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.399223   772 catalog_manager.cc:5697] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "a92e1b02d25b49cfb108c1156f368fc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:47.400554   949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e64b69135784d4b9f5c0b183b5b07e0" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3" is_pre_election: true
I20260709 12:22:47.401816  1118 leader_election.cc:290] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:47.401978   949 raft_consensus.cc:2468] T 4e64b69135784d4b9f5c0b183b5b07e0 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 0.
I20260709 12:22:47.404666   842 leader_election.cc:304] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e9b78bc90b4d2199d6926b30ce4f18, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:47.405831  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e64b69135784d4b9f5c0b183b5b07e0" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f" is_pre_election: true
I20260709 12:22:47.406571  1023 raft_consensus.cc:2468] T 4e64b69135784d4b9f5c0b183b5b07e0 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 0.
I20260709 12:22:47.407711  1118 raft_consensus.cc:2804] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:47.408126  1118 raft_consensus.cc:493] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.408491  1118 raft_consensus.cc:3060] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.418581  1180 tablet_bootstrap.cc:492] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f: No bootstrap required, opened a new log
I20260709 12:22:47.419343  1179 tablet_bootstrap.cc:492] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3: No bootstrap required, opened a new log
I20260709 12:22:47.419482  1180 ts_tablet_manager.cc:1403] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.015s
I20260709 12:22:47.420535  1179 ts_tablet_manager.cc:1403] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3: Time spent bootstrapping tablet: real 0.122s	user 0.009s	sys 0.008s
I20260709 12:22:47.422912  1180 raft_consensus.cc:359] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.423697  1180 raft_consensus.cc:385] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.423967  1180 raft_consensus.cc:740] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.425747  1180 consensus_queue.cc:260] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.427989  1180 ts_tablet_manager.cc:1434] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:22:47.428901  1180 tablet_bootstrap.cc:492] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f: Bootstrap starting.
I20260709 12:22:47.412247  1183 raft_consensus.cc:515] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.440857  1179 raft_consensus.cc:359] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.441686  1179 raft_consensus.cc:385] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.441960  1179 raft_consensus.cc:740] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.442636  1179 consensus_queue.cc:260] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.443127   949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7ce2d5c2024a7bbce3f957b5c5d998" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
I20260709 12:22:47.444111   949 raft_consensus.cc:3060] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.445055  1179 ts_tablet_manager.cc:1434] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:22:47.445886  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7ce2d5c2024a7bbce3f957b5c5d998" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
I20260709 12:22:47.446126  1179 tablet_bootstrap.cc:492] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3: Bootstrap starting.
I20260709 12:22:47.446501  1023 raft_consensus.cc:3060] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.450461   771 catalog_manager.cc:5697] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f reported cstate change: term changed from 0 to 1, leader changed from <none> to 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195). New cstate: current_term: 1 leader_uuid: "91fb18caf57c4ad685ecac3334f1794f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:47.453397  1179 tablet_bootstrap.cc:654] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.458072  1023 raft_consensus.cc:2468] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 1.
I20260709 12:22:47.459538   842 leader_election.cc:304] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, 92e9b78bc90b4d2199d6926b30ce4f18; no voters: 
I20260709 12:22:47.458019  1183 leader_election.cc:290] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 election: Requested vote from peers a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:47.444123  1167 raft_consensus.cc:515] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.468587  1214 raft_consensus.cc:493] T 7a49fd62ea774c2f94dc9816c84129f3 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.469971  1214 raft_consensus.cc:515] T 7a49fd62ea774c2f94dc9816c84129f3 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.468071  1183 raft_consensus.cc:2804] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:47.480764  1214 leader_election.cc:290] T 7a49fd62ea774c2f94dc9816c84129f3 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:47.483067   951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a49fd62ea774c2f94dc9816c84129f3" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3" is_pre_election: true
I20260709 12:22:47.491587  1183 raft_consensus.cc:697] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Becoming Leader. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Running, Role: LEADER
I20260709 12:22:47.502125  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a49fd62ea774c2f94dc9816c84129f3" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f" is_pre_election: true
W20260709 12:22:47.503436   842 leader_election.cc:343] T 7a49fd62ea774c2f94dc9816c84129f3 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:47.504662  1180 tablet_bootstrap.cc:654] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.504828  1217 consensus_queue.cc:1048] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:47.496033  1118 raft_consensus.cc:515] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.506171   874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6b4ed2c5584d1ab830484e259e639d" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
W20260709 12:22:47.507997   842 leader_election.cc:343] T 7a49fd62ea774c2f94dc9816c84129f3 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:47.510726   874 raft_consensus.cc:3060] T ec6b4ed2c5584d1ab830484e259e639d P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.513291  1118 leader_election.cc:290] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 election: Requested vote from peers a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:47.516345   842 leader_election.cc:304] T 7a49fd62ea774c2f94dc9816c84129f3 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92e9b78bc90b4d2199d6926b30ce4f18; no voters: 91fb18caf57c4ad685ecac3334f1794f, a92e1b02d25b49cfb108c1156f368fc3
I20260709 12:22:47.506536  1183 consensus_queue.cc:237] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.517827  1118 raft_consensus.cc:2749] T 7a49fd62ea774c2f94dc9816c84129f3 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:47.521449  1167 leader_election.cc:290] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 election: Requested vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:47.523850  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6b4ed2c5584d1ab830484e259e639d" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
I20260709 12:22:47.524590  1023 raft_consensus.cc:3060] T ec6b4ed2c5584d1ab830484e259e639d P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.532554   951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e64b69135784d4b9f5c0b183b5b07e0" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
I20260709 12:22:47.533373   951 raft_consensus.cc:3060] T 4e64b69135784d4b9f5c0b183b5b07e0 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.533751   874 raft_consensus.cc:2468] T ec6b4ed2c5584d1ab830484e259e639d P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 1.
I20260709 12:22:47.534610  1023 raft_consensus.cc:2468] T ec6b4ed2c5584d1ab830484e259e639d P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 1.
I20260709 12:22:47.535218   914 leader_election.cc:304] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e9b78bc90b4d2199d6926b30ce4f18, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:47.538990  1180 tablet_bootstrap.cc:492] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f: No bootstrap required, opened a new log
I20260709 12:22:47.539211  1118 raft_consensus.cc:493] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.539592  1180 ts_tablet_manager.cc:1403] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f: Time spent bootstrapping tablet: real 0.111s	user 0.016s	sys 0.009s
I20260709 12:22:47.539794  1118 raft_consensus.cc:515] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.541182   951 raft_consensus.cc:2468] T 4e64b69135784d4b9f5c0b183b5b07e0 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 1.
I20260709 12:22:47.542277  1118 leader_election.cc:290] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:47.543119  1180 raft_consensus.cc:359] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.543885  1180 raft_consensus.cc:385] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.544164  1180 raft_consensus.cc:740] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.544538  1219 raft_consensus.cc:2804] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:47.544663   948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e3b537fd694288a9d3edbc614d48a0" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3" is_pre_election: true
I20260709 12:22:47.545192  1180 consensus_queue.cc:260] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.545516   948 raft_consensus.cc:2468] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 0.
I20260709 12:22:47.545529  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e64b69135784d4b9f5c0b183b5b07e0" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
I20260709 12:22:47.545143  1219 raft_consensus.cc:697] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3 [term 1 LEADER]: Becoming Leader. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Running, Role: LEADER
I20260709 12:22:47.546450  1023 raft_consensus.cc:3060] T 4e64b69135784d4b9f5c0b183b5b07e0 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.547235  1219 consensus_queue.cc:237] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.550220  1179 tablet_bootstrap.cc:492] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3: No bootstrap required, opened a new log
I20260709 12:22:47.551043  1180 ts_tablet_manager.cc:1434] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 12:22:47.551090  1179 ts_tablet_manager.cc:1403] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3: Time spent bootstrapping tablet: real 0.105s	user 0.013s	sys 0.005s
I20260709 12:22:47.552387  1024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e3b537fd694288a9d3edbc614d48a0" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f" is_pre_election: true
I20260709 12:22:47.553223  1024 raft_consensus.cc:2468] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 0.
I20260709 12:22:47.554898  1023 raft_consensus.cc:2468] T 4e64b69135784d4b9f5c0b183b5b07e0 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 1.
I20260709 12:22:47.555226  1179 raft_consensus.cc:359] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.556218  1179 raft_consensus.cc:385] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.556516  1179 raft_consensus.cc:740] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.557667  1179 consensus_queue.cc:260] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.531116   949 raft_consensus.cc:2468] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 1.
I20260709 12:22:47.560451  1179 ts_tablet_manager.cc:1434] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:22:47.556346   842 leader_election.cc:304] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e9b78bc90b4d2199d6926b30ce4f18, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
W20260709 12:22:47.564291   822 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:47.565136   842 leader_election.cc:304] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e9b78bc90b4d2199d6926b30ce4f18, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:47.569360  1118 raft_consensus.cc:2804] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:47.569773  1118 raft_consensus.cc:493] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.570091  1118 raft_consensus.cc:3060] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.579011  1118 raft_consensus.cc:515] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.566237  1183 raft_consensus.cc:2804] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:47.567226   773 catalog_manager.cc:5697] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:47.581743  1118 leader_election.cc:290] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 election: Requested vote from peers a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:47.584024  1022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e3b537fd694288a9d3edbc614d48a0" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
I20260709 12:22:47.584414   949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e3b537fd694288a9d3edbc614d48a0" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
I20260709 12:22:47.584842  1022 raft_consensus.cc:3060] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.585289   949 raft_consensus.cc:3060] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.588172   772 catalog_manager.cc:5697] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "a92e1b02d25b49cfb108c1156f368fc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:47.593518  1022 raft_consensus.cc:2468] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 1.
I20260709 12:22:47.594137   949 raft_consensus.cc:2468] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 1.
I20260709 12:22:47.594940   842 leader_election.cc:304] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, 92e9b78bc90b4d2199d6926b30ce4f18; no voters: 
I20260709 12:22:47.595999  1214 raft_consensus.cc:2804] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:47.596503  1214 raft_consensus.cc:697] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Becoming Leader. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Running, Role: LEADER
I20260709 12:22:47.596731  1183 raft_consensus.cc:697] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Becoming Leader. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Running, Role: LEADER
I20260709 12:22:47.597565  1214 consensus_queue.cc:237] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.598289  1183 consensus_queue.cc:237] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.613201   772 catalog_manager.cc:5697] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:47.614713   772 catalog_manager.cc:5697] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:47.709165  1219 consensus_queue.cc:1048] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:47.721433  1219 consensus_queue.cc:1048] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:47.752918  1219 consensus_queue.cc:1048] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:47.764144  1219 consensus_queue.cc:1048] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:47.809418  1219 raft_consensus.cc:493] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.809900  1219 raft_consensus.cc:515] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.811899  1219 leader_election.cc:290] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:47.812844   874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a49fd62ea774c2f94dc9816c84129f3" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" is_pre_election: true
I20260709 12:22:47.813248  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a49fd62ea774c2f94dc9816c84129f3" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f" is_pre_election: true
I20260709 12:22:47.813449   874 raft_consensus.cc:2468] T 7a49fd62ea774c2f94dc9816c84129f3 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 0.
I20260709 12:22:47.813982  1023 raft_consensus.cc:2468] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 0.
I20260709 12:22:47.814684   914 leader_election.cc:304] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e9b78bc90b4d2199d6926b30ce4f18, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:47.815624  1219 raft_consensus.cc:2804] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:47.816130  1219 raft_consensus.cc:493] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.816418  1219 raft_consensus.cc:3060] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.823413  1219 raft_consensus.cc:515] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.825397  1219 leader_election.cc:290] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 election: Requested vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:47.826383   874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a49fd62ea774c2f94dc9816c84129f3" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
I20260709 12:22:47.826992  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a49fd62ea774c2f94dc9816c84129f3" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
I20260709 12:22:47.827142   874 raft_consensus.cc:3060] T 7a49fd62ea774c2f94dc9816c84129f3 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.827581  1023 raft_consensus.cc:3060] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.829373  1185 consensus_queue.cc:1048] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:47.834290  1023 raft_consensus.cc:2468] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 1.
I20260709 12:22:47.834290   874 raft_consensus.cc:2468] T 7a49fd62ea774c2f94dc9816c84129f3 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 1.
I20260709 12:22:47.835875   917 leader_election.cc:304] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:47.836779  1219 raft_consensus.cc:2804] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:47.837349  1219 raft_consensus.cc:697] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 LEADER]: Becoming Leader. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Running, Role: LEADER
I20260709 12:22:47.838142  1219 consensus_queue.cc:237] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:47.844381  1185 consensus_queue.cc:1048] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:47.852851   771 catalog_manager.cc:5697] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "a92e1b02d25b49cfb108c1156f368fc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:47.890918   949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7831d6e821344a38ae5852abd18bb3fe"
dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
mode: GRACEFUL
new_leader_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
 from {username='slave'} at 127.0.0.1:56680
I20260709 12:22:47.891489   949 raft_consensus.cc:606] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [term 1 LEADER]: Received request to transfer leadership to TS 92e9b78bc90b4d2199d6926b30ce4f18
I20260709 12:22:47.898260  1023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84f31361412f4c9b92508e13138f16a6"
dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
mode: GRACEFUL
new_leader_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
 from {username='slave'} at 127.0.0.1:41404
I20260709 12:22:47.898839  1023 raft_consensus.cc:606] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [term 1 LEADER]: Received request to transfer leadership to TS 92e9b78bc90b4d2199d6926b30ce4f18
I20260709 12:22:47.920239   875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4e3b537fd694288a9d3edbc614d48a0"
dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
mode: GRACEFUL
new_leader_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
 from {username='slave'} at 127.0.0.1:38622
I20260709 12:22:47.920874   875 raft_consensus.cc:606] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Received request to transfer leadership to TS a92e1b02d25b49cfb108c1156f368fc3
I20260709 12:22:47.926949   949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a49fd62ea774c2f94dc9816c84129f3"
dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
mode: GRACEFUL
new_leader_uuid: "91fb18caf57c4ad685ecac3334f1794f"
 from {username='slave'} at 127.0.0.1:56680
I20260709 12:22:47.927649   949 raft_consensus.cc:606] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 LEADER]: Received request to transfer leadership to TS 91fb18caf57c4ad685ecac3334f1794f
I20260709 12:22:47.965418  1219 consensus_queue.cc:1048] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:47.978552  1189 consensus_queue.cc:1048] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:47.985467  1183 consensus_queue.cc:1048] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:47.993607  1214 raft_consensus.cc:993] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18: : Instructing follower a92e1b02d25b49cfb108c1156f368fc3 to start an election
I20260709 12:22:47.994199  1214 raft_consensus.cc:1081] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Signalling peer a92e1b02d25b49cfb108c1156f368fc3 to start an election
I20260709 12:22:47.997184   951 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4e3b537fd694288a9d3edbc614d48a0"
dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
 from {username='slave'} at 127.0.0.1:56666
I20260709 12:22:47.998888  1214 consensus_queue.cc:1048] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:48.002873   951 raft_consensus.cc:493] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:48.003484   951 raft_consensus.cc:3060] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:48.011526   951 raft_consensus.cc:515] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:48.018054   951 leader_election.cc:290] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 2 election: Requested vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:48.018790   875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e3b537fd694288a9d3edbc614d48a0" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
I20260709 12:22:48.019492   875 raft_consensus.cc:3055] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:48.019832   875 raft_consensus.cc:740] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Running, Role: LEADER
I20260709 12:22:48.020592   875 consensus_queue.cc:260] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:48.021893   875 raft_consensus.cc:3060] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:48.021646  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e3b537fd694288a9d3edbc614d48a0" candidate_uuid: "a92e1b02d25b49cfb108c1156f368fc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
I20260709 12:22:48.022594  1023 raft_consensus.cc:3060] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:48.029613   875 raft_consensus.cc:2468] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 2.
I20260709 12:22:48.030753  1023 raft_consensus.cc:2468] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92e1b02d25b49cfb108c1156f368fc3 in term 2.
I20260709 12:22:48.031296   914 leader_election.cc:304] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e9b78bc90b4d2199d6926b30ce4f18, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:48.032303  1189 raft_consensus.cc:2804] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:48.032719  1189 raft_consensus.cc:697] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 LEADER]: Becoming Leader. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Running, Role: LEADER
I20260709 12:22:48.033453  1189 consensus_queue.cc:237] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:48.040985   772 catalog_manager.cc:5697] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 reported cstate change: term changed from 1 to 2, leader changed from 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193) to a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194). New cstate: current_term: 2 leader_uuid: "a92e1b02d25b49cfb108c1156f368fc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:48.076162  1167 raft_consensus.cc:993] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3: : Instructing follower 92e9b78bc90b4d2199d6926b30ce4f18 to start an election
I20260709 12:22:48.076761  1217 raft_consensus.cc:1081] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [term 1 LEADER]: Signalling peer 92e9b78bc90b4d2199d6926b30ce4f18 to start an election
I20260709 12:22:48.078349   874 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7831d6e821344a38ae5852abd18bb3fe"
dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
 from {username='slave'} at 127.0.0.1:38616
I20260709 12:22:48.078924   874 raft_consensus.cc:493] T 7831d6e821344a38ae5852abd18bb3fe P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:48.079238   874 raft_consensus.cc:3060] T 7831d6e821344a38ae5852abd18bb3fe P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:48.084616   874 raft_consensus.cc:515] T 7831d6e821344a38ae5852abd18bb3fe P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:48.085309  1214 consensus_queue.cc:1048] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:48.086331   874 leader_election.cc:290] T 7831d6e821344a38ae5852abd18bb3fe P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 2 election: Requested vote from peers a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:48.087487   951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7831d6e821344a38ae5852abd18bb3fe" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
I20260709 12:22:48.087747  1023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7831d6e821344a38ae5852abd18bb3fe" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
I20260709 12:22:48.088294   951 raft_consensus.cc:3055] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:48.088335  1023 raft_consensus.cc:3060] T 7831d6e821344a38ae5852abd18bb3fe P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:48.088886   951 raft_consensus.cc:740] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Running, Role: LEADER
I20260709 12:22:48.089810   951 consensus_queue.cc:260] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:48.091476   951 raft_consensus.cc:3060] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:48.099269  1118 consensus_queue.cc:1048] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:48.101681  1023 raft_consensus.cc:2468] T 7831d6e821344a38ae5852abd18bb3fe P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 2.
I20260709 12:22:48.103757   842 leader_election.cc:304] T 7831d6e821344a38ae5852abd18bb3fe P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, 92e9b78bc90b4d2199d6926b30ce4f18; no voters: 
I20260709 12:22:48.104593  1118 raft_consensus.cc:2804] T 7831d6e821344a38ae5852abd18bb3fe P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:48.105131  1118 raft_consensus.cc:697] T 7831d6e821344a38ae5852abd18bb3fe P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 LEADER]: Becoming Leader. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Running, Role: LEADER
I20260709 12:22:48.106215  1118 consensus_queue.cc:237] T 7831d6e821344a38ae5852abd18bb3fe P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:48.110265   951 raft_consensus.cc:2468] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 2.
I20260709 12:22:48.118822  1214 consensus_queue.cc:1048] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:48.120352   771 catalog_manager.cc:5697] T 7831d6e821344a38ae5852abd18bb3fe P 92e9b78bc90b4d2199d6926b30ce4f18 reported cstate change: term changed from 1 to 2, leader changed from a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194) to 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:48.122151  1214 consensus_queue.cc:1048] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:48.289462  1072 raft_consensus.cc:993] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f: : Instructing follower 92e9b78bc90b4d2199d6926b30ce4f18 to start an election
I20260709 12:22:48.290030  1185 raft_consensus.cc:1081] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [term 1 LEADER]: Signalling peer 92e9b78bc90b4d2199d6926b30ce4f18 to start an election
I20260709 12:22:48.292021   874 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84f31361412f4c9b92508e13138f16a6"
dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
 from {username='slave'} at 127.0.0.1:38606
I20260709 12:22:48.292671   874 raft_consensus.cc:493] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:48.293048   874 raft_consensus.cc:3060] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:48.298508   874 raft_consensus.cc:515] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:48.300200   874 leader_election.cc:290] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 2 election: Requested vote from peers a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583), 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195:38329)
I20260709 12:22:48.301780   951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f31361412f4c9b92508e13138f16a6" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
I20260709 12:22:48.302620  1022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f31361412f4c9b92508e13138f16a6" candidate_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
I20260709 12:22:48.303313  1022 raft_consensus.cc:3055] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:48.303628  1022 raft_consensus.cc:740] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Running, Role: LEADER
I20260709 12:22:48.302696   951 raft_consensus.cc:3060] T 84f31361412f4c9b92508e13138f16a6 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:48.304463  1022 consensus_queue.cc:260] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:48.305792  1022 raft_consensus.cc:3060] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:48.314025  1022 raft_consensus.cc:2468] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 2.
I20260709 12:22:48.315676   842 leader_election.cc:304] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, 92e9b78bc90b4d2199d6926b30ce4f18; no voters: 
I20260709 12:22:48.317236  1214 raft_consensus.cc:2804] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:48.317824  1214 raft_consensus.cc:697] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 LEADER]: Becoming Leader. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Running, Role: LEADER
I20260709 12:22:48.318380   951 raft_consensus.cc:2468] T 84f31361412f4c9b92508e13138f16a6 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e9b78bc90b4d2199d6926b30ce4f18 in term 2.
I20260709 12:22:48.318603  1214 consensus_queue.cc:237] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:48.319298   948 raft_consensus.cc:1240] T 84f31361412f4c9b92508e13138f16a6 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Rejecting Update request from peer 91fb18caf57c4ad685ecac3334f1794f for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:48.326819   773 catalog_manager.cc:5697] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 reported cstate change: term changed from 1 to 2, leader changed from 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195) to 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:48.400557  1217 consensus_queue.cc:1048] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:48.409587  1189 raft_consensus.cc:993] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3: : Instructing follower 91fb18caf57c4ad685ecac3334f1794f to start an election
I20260709 12:22:48.410176  1167 raft_consensus.cc:1081] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 LEADER]: Signalling peer 91fb18caf57c4ad685ecac3334f1794f to start an election
I20260709 12:22:48.412798  1023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a49fd62ea774c2f94dc9816c84129f3"
dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
 from {username='slave'} at 127.0.0.1:41396
I20260709 12:22:48.413419  1023 raft_consensus.cc:493] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:48.413743  1023 raft_consensus.cc:3060] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:48.416859  1217 consensus_queue.cc:1048] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:48.420508  1023 raft_consensus.cc:515] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:48.422022  1022 raft_consensus.cc:1240] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Rejecting Update request from peer a92e1b02d25b49cfb108c1156f368fc3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:48.424387   875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a49fd62ea774c2f94dc9816c84129f3" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
I20260709 12:22:48.425668  1023 leader_election.cc:290] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 2 election: Requested vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583)
I20260709 12:22:48.426322   948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a49fd62ea774c2f94dc9816c84129f3" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
I20260709 12:22:48.427038   948 raft_consensus.cc:3055] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:48.427361   948 raft_consensus.cc:740] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Running, Role: LEADER
I20260709 12:22:48.427958  1189 consensus_queue.cc:1059] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:48.429066   948 consensus_queue.cc:260] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:48.430754   948 raft_consensus.cc:3060] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:48.432956  1022 raft_consensus.cc:1275] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Refusing update from remote peer a92e1b02d25b49cfb108c1156f368fc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:48.434684  1189 consensus_queue.cc:1048] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:48.438097   948 raft_consensus.cc:2468] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fb18caf57c4ad685ecac3334f1794f in term 2.
I20260709 12:22:48.439689   991 leader_election.cc:304] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, a92e1b02d25b49cfb108c1156f368fc3; no voters: 92e9b78bc90b4d2199d6926b30ce4f18
I20260709 12:22:48.440508  1243 raft_consensus.cc:2804] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:48.441025  1243 raft_consensus.cc:697] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f [term 2 LEADER]: Becoming Leader. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Running, Role: LEADER
I20260709 12:22:48.441793  1243 consensus_queue.cc:237] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:48.448156   874 raft_consensus.cc:1275] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Refusing update from remote peer a92e1b02d25b49cfb108c1156f368fc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:48.450212  1189 consensus_queue.cc:1048] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:48.453764   771 catalog_manager.cc:5697] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f reported cstate change: term changed from 1 to 2, leader changed from a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194) to 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195). New cstate: current_term: 2 leader_uuid: "91fb18caf57c4ad685ecac3334f1794f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:48.654644   948 raft_consensus.cc:1275] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Refusing update from remote peer 92e9b78bc90b4d2199d6926b30ce4f18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:48.656525  1118 consensus_queue.cc:1048] T 7831d6e821344a38ae5852abd18bb3fe P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:48.660594  1022 raft_consensus.cc:1275] T 7831d6e821344a38ae5852abd18bb3fe P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Refusing update from remote peer 92e9b78bc90b4d2199d6926b30ce4f18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:48.662225  1118 consensus_queue.cc:1048] T 7831d6e821344a38ae5852abd18bb3fe P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:48.775230   948 raft_consensus.cc:1275] T 84f31361412f4c9b92508e13138f16a6 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Refusing update from remote peer 92e9b78bc90b4d2199d6926b30ce4f18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:48.775821  1023 raft_consensus.cc:1275] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Refusing update from remote peer 92e9b78bc90b4d2199d6926b30ce4f18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:48.776757  1118 consensus_queue.cc:1048] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:48.777532  1214 consensus_queue.cc:1048] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:48.928256   874 raft_consensus.cc:3060] T 7a49fd62ea774c2f94dc9816c84129f3 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:48.928665   948 raft_consensus.cc:1275] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Refusing update from remote peer 91fb18caf57c4ad685ecac3334f1794f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:48.930359  1243 consensus_queue.cc:1048] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:48.935361   874 raft_consensus.cc:1275] T 7a49fd62ea774c2f94dc9816c84129f3 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Refusing update from remote peer 91fb18caf57c4ad685ecac3334f1794f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:48.937670  1243 consensus_queue.cc:1048] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:50.931556   772 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54628:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:22:50.952276   772 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54628:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:22:51.022833 23151 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 12:22:51.160162   842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:39583, user_credentials={real_user=slave}} blocked reactor thread for 66531.3us
W20260709 12:22:51.164243  1272 log.cc:927] Time spent T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3: Append to log took a long time: real 0.114s	user 0.000s	sys 0.002s
I20260709 12:22:51.239996  1298 tablet.cc:1724] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:51.248404  1299 tablet.cc:1724] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:51.331039  1298 tablet.cc:1724] T c3c892001314454ca65c7c2e8edf5fc3 P 92e9b78bc90b4d2199d6926b30ce4f18: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:51.330583  1305 tablet.cc:1724] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 91fb18caf57c4ad685ecac3334f1794f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:22:51.367532  1051 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:7b7ce2d5c2024a7bbce3f957b5c5d998)
I20260709 12:22:51.341909  1311 tablet.cc:1724] T c3c892001314454ca65c7c2e8edf5fc3 P 91fb18caf57c4ad685ecac3334f1794f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:22:51.382988  1051 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:7b7ce2d5c2024a7bbce3f957b5c5d998)
W20260709 12:22:51.384555  1051 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:7b7ce2d5c2024a7bbce3f957b5c5d998)
I20260709 12:22:51.394909   874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84f31361412f4c9b92508e13138f16a6"
dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
mode: GRACEFUL
new_leader_uuid: "91fb18caf57c4ad685ecac3334f1794f"
 from {username='slave'} at 127.0.0.1:38638
I20260709 12:22:51.388820  1314 tablet.cc:1724] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:51.395623   874 raft_consensus.cc:606] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 LEADER]: Received request to transfer leadership to TS 91fb18caf57c4ad685ecac3334f1794f
I20260709 12:22:51.394948  1316 tablet.cc:1724] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:22:51.404963  1304 log.cc:927] Time spent T 9fc4c255f6b249f69626768f14e626f2 P 92e9b78bc90b4d2199d6926b30ce4f18: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:22:51.407786  1299 tablet.cc:1724] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:51.427681  1286 raft_consensus.cc:993] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18: : Instructing follower 91fb18caf57c4ad685ecac3334f1794f to start an election
I20260709 12:22:51.428473  1286 raft_consensus.cc:1081] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 LEADER]: Signalling peer 91fb18caf57c4ad685ecac3334f1794f to start an election
I20260709 12:22:51.429275  1317 tablet.cc:1724] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:51.405201  1312 tablet.cc:1724] T 84f31361412f4c9b92508e13138f16a6 P a92e1b02d25b49cfb108c1156f368fc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:51.450708  1321 tablet.cc:1724] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:22:51.457353  1306 log.cc:927] Time spent T 4e64b69135784d4b9f5c0b183b5b07e0 P a92e1b02d25b49cfb108c1156f368fc3: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:22:51.472574  1316 tablet.cc:1724] T 9fc4c255f6b249f69626768f14e626f2 P 91fb18caf57c4ad685ecac3334f1794f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:22:51.482923   988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.193:33605, user_credentials={real_user=slave}} blocked reactor thread for 88834.2us
W20260709 12:22:51.481367   917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:38329, user_credentials={real_user=slave}} blocked reactor thread for 100521us
I20260709 12:22:51.504963  1298 tablet.cc:1724] T 9fc4c255f6b249f69626768f14e626f2 P 92e9b78bc90b4d2199d6926b30ce4f18: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:51.506042  1017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84f31361412f4c9b92508e13138f16a6"
dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
 from {username='slave'} at 127.0.0.1:41394
I20260709 12:22:51.507031  1017 raft_consensus.cc:493] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:51.507426  1017 raft_consensus.cc:3060] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:51.508481  1311 tablet.cc:1724] T 4e64b69135784d4b9f5c0b183b5b07e0 P 91fb18caf57c4ad685ecac3334f1794f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:51.508922  1299 tablet.cc:1724] T ec6b4ed2c5584d1ab830484e259e639d P 92e9b78bc90b4d2199d6926b30ce4f18: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:51.514829  1305 tablet.cc:1724] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:51.519433  1327 tablet.cc:1724] T 7831d6e821344a38ae5852abd18bb3fe P 91fb18caf57c4ad685ecac3334f1794f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:51.534947  1317 tablet.cc:1724] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:51.538230  1298 tablet.cc:1724] T 7831d6e821344a38ae5852abd18bb3fe P 92e9b78bc90b4d2199d6926b30ce4f18: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:51.539529  1314 tablet.cc:1724] T 7a49fd62ea774c2f94dc9816c84129f3 P 92e9b78bc90b4d2199d6926b30ce4f18: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:51.551024  1324 tablet.cc:1724] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:51.590410  1316 tablet.cc:1724] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:51.573866  1312 tablet.cc:1724] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:51.599188  1321 tablet.cc:1724] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P a92e1b02d25b49cfb108c1156f368fc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:51.571313  1311 tablet.cc:1724] T ec6b4ed2c5584d1ab830484e259e639d P 91fb18caf57c4ad685ecac3334f1794f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:51.604288  1324 tablet.cc:1724] T 4e64b69135784d4b9f5c0b183b5b07e0 P a92e1b02d25b49cfb108c1156f368fc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:51.614090  1317 tablet.cc:1724] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:51.674579   949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4e3b537fd694288a9d3edbc614d48a0"
dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
mode: GRACEFUL
new_leader_uuid: "91fb18caf57c4ad685ecac3334f1794f"
 from {username='slave'} at 127.0.0.1:56696
I20260709 12:22:51.678009   949 raft_consensus.cc:606] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 LEADER]: Received request to transfer leadership to TS 91fb18caf57c4ad685ecac3334f1794f
I20260709 12:22:51.715473 23151 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:22:51.715852  1017 raft_consensus.cc:515] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:51.718930 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:51.771308   876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f31361412f4c9b92508e13138f16a6" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
I20260709 12:22:51.772809   876 raft_consensus.cc:3055] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:51.773291   876 raft_consensus.cc:740] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Running, Role: LEADER
I20260709 12:22:51.774471   949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25d5d6c8f96143a1abaef7b427036b5e"
dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
mode: GRACEFUL
new_leader_uuid: "91fb18caf57c4ad685ecac3334f1794f"
 from {username='slave'} at 127.0.0.1:56696
I20260709 12:22:51.775249   949 raft_consensus.cc:606] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [term 2 LEADER]: Received request to transfer leadership to TS 91fb18caf57c4ad685ecac3334f1794f
I20260709 12:22:51.774561   876 consensus_queue.cc:260] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:51.777666   876 raft_consensus.cc:3060] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:51.778829  1017 leader_election.cc:290] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 3 election: Requested vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583)
I20260709 12:22:51.782059   949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f31361412f4c9b92508e13138f16a6" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
I20260709 12:22:51.787499   874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a949969ca97842678559e3c98dcbacab"
dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
mode: GRACEFUL
new_leader_uuid: "91fb18caf57c4ad685ecac3334f1794f"
 from {username='slave'} at 127.0.0.1:38638
I20260709 12:22:51.788321   874 raft_consensus.cc:606] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Received request to transfer leadership to TS 91fb18caf57c4ad685ecac3334f1794f
I20260709 12:22:51.790863 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:51.791720 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:51.790783   949 raft_consensus.cc:3060] T 84f31361412f4c9b92508e13138f16a6 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:51.804198   949 raft_consensus.cc:2468] T 84f31361412f4c9b92508e13138f16a6 P a92e1b02d25b49cfb108c1156f368fc3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fb18caf57c4ad685ecac3334f1794f in term 3.
I20260709 12:22:51.804205   876 raft_consensus.cc:2468] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fb18caf57c4ad685ecac3334f1794f in term 3.
I20260709 12:22:51.806497   991 leader_election.cc:304] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:51.807778  1294 raft_consensus.cc:2804] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:51.808641  1294 raft_consensus.cc:697] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [term 3 LEADER]: Becoming Leader. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Running, Role: LEADER
I20260709 12:22:51.810077  1294 consensus_queue.cc:237] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:51.816833   772 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 3b3a5bb5af134348a37a7f0fc773a300: soft_deleted_table [id=3761cc2ade03430cba0fa9979f3a4fa3] alter complete (version 1)
I20260709 12:22:51.824968   772 catalog_manager.cc:5697] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f reported cstate change: term changed from 2 to 3, leader changed from 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193) to 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195). New cstate: current_term: 3 leader_uuid: "91fb18caf57c4ad685ecac3334f1794f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:51.936411  1295 raft_consensus.cc:993] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18: : Instructing follower 91fb18caf57c4ad685ecac3334f1794f to start an election
I20260709 12:22:51.937232  1246 raft_consensus.cc:1081] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Signalling peer 91fb18caf57c4ad685ecac3334f1794f to start an election
I20260709 12:22:51.939213  1017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a949969ca97842678559e3c98dcbacab"
dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
 from {username='slave'} at 127.0.0.1:41394
I20260709 12:22:51.939822  1017 raft_consensus.cc:493] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:51.940161  1017 raft_consensus.cc:3060] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:51.948524  1017 raft_consensus.cc:515] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:51.950590  1017 leader_election.cc:290] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 2 election: Requested vote from peers a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583), 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605)
I20260709 12:22:51.951738   949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a949969ca97842678559e3c98dcbacab" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
I20260709 12:22:51.952351   876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a949969ca97842678559e3c98dcbacab" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
I20260709 12:22:51.952575   949 raft_consensus.cc:3060] T a949969ca97842678559e3c98dcbacab P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:51.953156   876 raft_consensus.cc:3055] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:51.953474   876 raft_consensus.cc:740] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92e9b78bc90b4d2199d6926b30ce4f18, State: Running, Role: LEADER
I20260709 12:22:51.954376   876 consensus_queue.cc:260] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:51.955835   876 raft_consensus.cc:3060] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:51.958907   949 raft_consensus.cc:2468] T a949969ca97842678559e3c98dcbacab P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fb18caf57c4ad685ecac3334f1794f in term 2.
I20260709 12:22:51.960175   991 leader_election.cc:304] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:51.960901  1294 raft_consensus.cc:2804] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:51.961328  1294 raft_consensus.cc:697] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f [term 2 LEADER]: Becoming Leader. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Running, Role: LEADER
I20260709 12:22:51.963141  1294 consensus_queue.cc:237] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:51.963336   876 raft_consensus.cc:2468] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fb18caf57c4ad685ecac3334f1794f in term 2.
I20260709 12:22:51.974912   772 catalog_manager.cc:5697] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f reported cstate change: term changed from 1 to 2, leader changed from 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193) to 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195). New cstate: current_term: 2 leader_uuid: "91fb18caf57c4ad685ecac3334f1794f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:52.014266  1318 raft_consensus.cc:993] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3: : Instructing follower 91fb18caf57c4ad685ecac3334f1794f to start an election
I20260709 12:22:52.014837  1318 raft_consensus.cc:1081] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 LEADER]: Signalling peer 91fb18caf57c4ad685ecac3334f1794f to start an election
I20260709 12:22:52.017020  1018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4e3b537fd694288a9d3edbc614d48a0"
dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
 from {username='slave'} at 127.0.0.1:41396
I20260709 12:22:52.017643  1018 raft_consensus.cc:493] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:52.018043  1018 raft_consensus.cc:3060] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:52.025517  1018 raft_consensus.cc:515] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:52.027412  1018 leader_election.cc:290] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 3 election: Requested vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583)
I20260709 12:22:52.028481   949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e3b537fd694288a9d3edbc614d48a0" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
I20260709 12:22:52.028558   876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e3b537fd694288a9d3edbc614d48a0" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
I20260709 12:22:52.029209   949 raft_consensus.cc:3055] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:52.029683   949 raft_consensus.cc:740] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Running, Role: LEADER
I20260709 12:22:52.029551   876 raft_consensus.cc:3060] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:52.030709   949 consensus_queue.cc:260] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:52.031937   949 raft_consensus.cc:3060] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:52.037405   949 raft_consensus.cc:2468] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fb18caf57c4ad685ecac3334f1794f in term 3.
I20260709 12:22:52.037911   876 raft_consensus.cc:2468] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fb18caf57c4ad685ecac3334f1794f in term 3.
I20260709 12:22:52.038578   991 leader_election.cc:304] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, a92e1b02d25b49cfb108c1156f368fc3; no voters: 
I20260709 12:22:52.039600  1294 raft_consensus.cc:2804] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:52.040098  1294 raft_consensus.cc:697] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f [term 3 LEADER]: Becoming Leader. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Running, Role: LEADER
I20260709 12:22:52.041136  1294 consensus_queue.cc:237] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:52.050098   772 catalog_manager.cc:5697] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f reported cstate change: term changed from 2 to 3, leader changed from a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194) to 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195). New cstate: current_term: 3 leader_uuid: "91fb18caf57c4ad685ecac3334f1794f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:52.317826  1167 raft_consensus.cc:993] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3: : Instructing follower 91fb18caf57c4ad685ecac3334f1794f to start an election
I20260709 12:22:52.318423  1167 raft_consensus.cc:1081] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [term 2 LEADER]: Signalling peer 91fb18caf57c4ad685ecac3334f1794f to start an election
I20260709 12:22:52.320310  1018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25d5d6c8f96143a1abaef7b427036b5e"
dest_uuid: "91fb18caf57c4ad685ecac3334f1794f"
 from {username='slave'} at 127.0.0.1:41396
I20260709 12:22:52.320976  1018 raft_consensus.cc:493] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:52.321379  1018 raft_consensus.cc:3060] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:52.328685  1018 raft_consensus.cc:515] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:52.330703  1018 leader_election.cc:290] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 3 election: Requested vote from peers 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605), a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583)
I20260709 12:22:52.332043   876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d5d6c8f96143a1abaef7b427036b5e" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "92e9b78bc90b4d2199d6926b30ce4f18"
I20260709 12:22:52.332532   949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d5d6c8f96143a1abaef7b427036b5e" candidate_uuid: "91fb18caf57c4ad685ecac3334f1794f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a92e1b02d25b49cfb108c1156f368fc3"
I20260709 12:22:52.333204   949 raft_consensus.cc:3055] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:52.333211   876 raft_consensus.cc:3060] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:52.333731   949 raft_consensus.cc:740] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a92e1b02d25b49cfb108c1156f368fc3, State: Running, Role: LEADER
I20260709 12:22:52.334964   949 consensus_queue.cc:260] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:52.336419   949 raft_consensus.cc:3060] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:52.342645   876 raft_consensus.cc:2468] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fb18caf57c4ad685ecac3334f1794f in term 3.
I20260709 12:22:52.344127   988 leader_election.cc:304] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fb18caf57c4ad685ecac3334f1794f, 92e9b78bc90b4d2199d6926b30ce4f18; no voters: 
I20260709 12:22:52.345083   949 raft_consensus.cc:2468] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fb18caf57c4ad685ecac3334f1794f in term 3.
I20260709 12:22:52.345244  1294 raft_consensus.cc:2804] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:52.346665  1294 raft_consensus.cc:697] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f [term 3 LEADER]: Becoming Leader. State: Replica: 91fb18caf57c4ad685ecac3334f1794f, State: Running, Role: LEADER
I20260709 12:22:52.348549  1294 consensus_queue.cc:237] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } }
I20260709 12:22:52.358276   772 catalog_manager.cc:5697] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f reported cstate change: term changed from 2 to 3, leader changed from a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194) to 91fb18caf57c4ad685ecac3334f1794f (127.22.155.195). New cstate: current_term: 3 leader_uuid: "91fb18caf57c4ad685ecac3334f1794f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fb18caf57c4ad685ecac3334f1794f" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 38329 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:52.394357   876 raft_consensus.cc:1275] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 3 FOLLOWER]: Refusing update from remote peer 91fb18caf57c4ad685ecac3334f1794f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:22:52.395807  1294 consensus_queue.cc:1048] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:52.398105   949 raft_consensus.cc:1275] T a949969ca97842678559e3c98dcbacab P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Refusing update from remote peer 91fb18caf57c4ad685ecac3334f1794f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:52.400862  1294 consensus_queue.cc:1048] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:52.413697   949 raft_consensus.cc:1275] T 84f31361412f4c9b92508e13138f16a6 P a92e1b02d25b49cfb108c1156f368fc3 [term 3 FOLLOWER]: Refusing update from remote peer 91fb18caf57c4ad685ecac3334f1794f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:22:52.427016  1294 consensus_queue.cc:1048] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:52.434654   874 raft_consensus.cc:1275] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Refusing update from remote peer 91fb18caf57c4ad685ecac3334f1794f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:52.444864  1294 consensus_queue.cc:1048] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:52.647482   950 raft_consensus.cc:1275] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 [term 3 FOLLOWER]: Refusing update from remote peer 91fb18caf57c4ad685ecac3334f1794f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:22:52.648973  1338 consensus_queue.cc:1048] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:52.661145   876 raft_consensus.cc:1275] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 3 FOLLOWER]: Refusing update from remote peer 91fb18caf57c4ad685ecac3334f1794f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:22:52.662747  1339 consensus_queue.cc:1048] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:52.793411 23151 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:22:52.799453 23151 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:22:52.799988 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:52.807674 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:52.808321 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:52.842038   876 raft_consensus.cc:1275] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [term 3 FOLLOWER]: Refusing update from remote peer 91fb18caf57c4ad685ecac3334f1794f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:52.843859  1339 consensus_queue.cc:1048] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e9b78bc90b4d2199d6926b30ce4f18" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:52.855507   950 raft_consensus.cc:1275] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [term 3 FOLLOWER]: Refusing update from remote peer 91fb18caf57c4ad685ecac3334f1794f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:52.858091  1339 consensus_queue.cc:1048] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a92e1b02d25b49cfb108c1156f368fc3" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 39583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:53.809567 23151 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:22:53.815632 23151 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:22:53.816159 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:53.825026 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:53.825625 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:54.826972 23151 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:22:54.832486 23151 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:22:54.833065 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:54.839569 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:54.840147 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:55.841315 23151 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:22:55.846400 23151 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:22:55.846817 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:55.851729 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:55.852288 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:56.853610 23151 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:22:56.859407 23151 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:22:56.859936 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:56.865149 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:56.865731 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:57.866905 23151 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:22:57.872757 23151 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:22:57.873245 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:57.878145 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:57.878619 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:58.879771 23151 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:22:58.885426 23151 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:22:58.885954 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:58.891829 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:58.892328 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:59.893786 23151 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:22:59.901026 23151 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:22:59.901621 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:59.908504 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:59.909159 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:00.910270 23151 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:23:00.917094 23151 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:23:00.917595 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:00.923504 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:00.923936 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:02.006016 23151 tablet_server.cc:179] TabletServer@127.22.155.193:0 shutting down...
I20260709 12:23:02.065328 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:02.066254 23151 tablet_replica.cc:333] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18: stopping tablet replica
I20260709 12:23:02.067582 23151 raft_consensus.cc:2243] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.068572 23151 raft_consensus.cc:2272] T d4e3b537fd694288a9d3edbc614d48a0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.071674 23151 tablet_replica.cc:333] T c3c892001314454ca65c7c2e8edf5fc3 P 92e9b78bc90b4d2199d6926b30ce4f18: stopping tablet replica
I20260709 12:23:02.072476 23151 raft_consensus.cc:2243] T c3c892001314454ca65c7c2e8edf5fc3 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.073167 23151 raft_consensus.cc:2272] T c3c892001314454ca65c7c2e8edf5fc3 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.075769 23151 tablet_replica.cc:333] T ec6b4ed2c5584d1ab830484e259e639d P 92e9b78bc90b4d2199d6926b30ce4f18: stopping tablet replica
I20260709 12:23:02.076377 23151 raft_consensus.cc:2243] T ec6b4ed2c5584d1ab830484e259e639d P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.077060 23151 raft_consensus.cc:2272] T ec6b4ed2c5584d1ab830484e259e639d P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.079620 23151 tablet_replica.cc:333] T 7831d6e821344a38ae5852abd18bb3fe P 92e9b78bc90b4d2199d6926b30ce4f18: stopping tablet replica
I20260709 12:23:02.080312 23151 raft_consensus.cc:2243] T 7831d6e821344a38ae5852abd18bb3fe P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.081609 23151 raft_consensus.cc:2272] T 7831d6e821344a38ae5852abd18bb3fe P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.084539 23151 tablet_replica.cc:333] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18: stopping tablet replica
I20260709 12:23:02.085361 23151 raft_consensus.cc:2243] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.086051 23151 raft_consensus.cc:2272] T 3c3711921af14a5ab73080170199d621 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.090731 23151 tablet_replica.cc:333] T 7a49fd62ea774c2f94dc9816c84129f3 P 92e9b78bc90b4d2199d6926b30ce4f18: stopping tablet replica
W20260709 12:23:02.090739   914 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
I20260709 12:23:02.092229 23151 raft_consensus.cc:2243] T 7a49fd62ea774c2f94dc9816c84129f3 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.093364 23151 raft_consensus.cc:2272] T 7a49fd62ea774c2f94dc9816c84129f3 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:02.096185   914 consensus_peers.cc:597] T 711fc51040264325aa09cebd07d5d5f4 P a92e1b02d25b49cfb108c1156f368fc3 -> Peer 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605): Couldn't send request to peer 92e9b78bc90b4d2199d6926b30ce4f18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:02.098114 23151 tablet_replica.cc:333] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18: stopping tablet replica
I20260709 12:23:02.099155 23151 raft_consensus.cc:2243] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.100142 23151 raft_consensus.cc:2272] T 711fc51040264325aa09cebd07d5d5f4 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:02.105026   914 consensus_peers.cc:597] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3 -> Peer 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605): Couldn't send request to peer 92e9b78bc90b4d2199d6926b30ce4f18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:02.105073 23151 tablet_replica.cc:333] T 3001aaf097cd4643b552a2d9ffe4e451 P 92e9b78bc90b4d2199d6926b30ce4f18: stopping tablet replica
I20260709 12:23:02.106658 23151 raft_consensus.cc:2243] T 3001aaf097cd4643b552a2d9ffe4e451 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.107678 23151 raft_consensus.cc:2272] T 3001aaf097cd4643b552a2d9ffe4e451 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:02.110090   988 consensus_peers.cc:597] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f -> Peer 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605): Couldn't send request to peer 92e9b78bc90b4d2199d6926b30ce4f18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:02.111375 23151 tablet_replica.cc:333] T 9fc4c255f6b249f69626768f14e626f2 P 92e9b78bc90b4d2199d6926b30ce4f18: stopping tablet replica
I20260709 12:23:02.112208 23151 raft_consensus.cc:2243] T 9fc4c255f6b249f69626768f14e626f2 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.112886 23151 raft_consensus.cc:2272] T 9fc4c255f6b249f69626768f14e626f2 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.117013 23151 tablet_replica.cc:333] T 158ee92d754f40d187a7702eb6807583 P 92e9b78bc90b4d2199d6926b30ce4f18: stopping tablet replica
I20260709 12:23:02.117935 23151 raft_consensus.cc:2243] T 158ee92d754f40d187a7702eb6807583 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.119967 23151 raft_consensus.cc:2272] T 158ee92d754f40d187a7702eb6807583 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.122768 23151 tablet_replica.cc:333] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18: stopping tablet replica
I20260709 12:23:02.123404 23151 raft_consensus.cc:2243] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.124542 23151 raft_consensus.cc:2272] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.127085 23151 tablet_replica.cc:333] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18: stopping tablet replica
I20260709 12:23:02.127575 23151 raft_consensus.cc:2243] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.128049 23151 raft_consensus.cc:2272] T a949969ca97842678559e3c98dcbacab P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.130424 23151 tablet_replica.cc:333] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18: stopping tablet replica
I20260709 12:23:02.130921 23151 raft_consensus.cc:2243] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.131407 23151 raft_consensus.cc:2272] T 84f31361412f4c9b92508e13138f16a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.133981 23151 tablet_replica.cc:333] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18: stopping tablet replica
I20260709 12:23:02.134613 23151 raft_consensus.cc:2243] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.135646 23151 raft_consensus.cc:2272] T 4e64b69135784d4b9f5c0b183b5b07e0 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.137923 23151 tablet_replica.cc:333] T 8fcfa22eac4141c4861b32aac5eaa5eb P 92e9b78bc90b4d2199d6926b30ce4f18: stopping tablet replica
I20260709 12:23:02.138441 23151 raft_consensus.cc:2243] T 8fcfa22eac4141c4861b32aac5eaa5eb P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.138895 23151 raft_consensus.cc:2272] T 8fcfa22eac4141c4861b32aac5eaa5eb P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.141273 23151 tablet_replica.cc:333] T 8a51831e613e4dfc83fcde95752585a6 P 92e9b78bc90b4d2199d6926b30ce4f18: stopping tablet replica
I20260709 12:23:02.141763 23151 raft_consensus.cc:2243] T 8a51831e613e4dfc83fcde95752585a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.142673 23151 raft_consensus.cc:2272] T 8a51831e613e4dfc83fcde95752585a6 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.144968 23151 tablet_replica.cc:333] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18: stopping tablet replica
I20260709 12:23:02.145457 23151 raft_consensus.cc:2243] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.145951 23151 raft_consensus.cc:2272] T 25d5d6c8f96143a1abaef7b427036b5e P 92e9b78bc90b4d2199d6926b30ce4f18 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.148272 23151 tablet_replica.cc:333] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18: stopping tablet replica
I20260709 12:23:02.148815 23151 raft_consensus.cc:2243] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.149940 23151 raft_consensus.cc:2272] T 4c947c22c6224f85b77fef1e288bc140 P 92e9b78bc90b4d2199d6926b30ce4f18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.200450 23151 tablet_server.cc:196] TabletServer@127.22.155.193:0 shutdown complete.
I20260709 12:23:02.255581 23151 tablet_server.cc:179] TabletServer@127.22.155.194:0 shutting down...
W20260709 12:23:02.286656   914 consensus_peers.cc:597] T 3c3711921af14a5ab73080170199d621 P a92e1b02d25b49cfb108c1156f368fc3 -> Peer 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605): Couldn't send request to peer 92e9b78bc90b4d2199d6926b30ce4f18. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:33605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:02.312017   988 consensus_peers.cc:597] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f -> Peer 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605): Couldn't send request to peer 92e9b78bc90b4d2199d6926b30ce4f18. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:33605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:02.318050 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:02.319199 23151 tablet_replica.cc:333] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3: stopping tablet replica
I20260709 12:23:02.320708 23151 raft_consensus.cc:2243] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.321748 23151 raft_consensus.cc:2272] T d4e3b537fd694288a9d3edbc614d48a0 P a92e1b02d25b49cfb108c1156f368fc3 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:02.326169   988 consensus_peers.cc:597] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f -> Peer 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605): Couldn't send request to peer 92e9b78bc90b4d2199d6926b30ce4f18. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:33605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:02.326918 23151 tablet_replica.cc:333] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3: stopping tablet replica
I20260709 12:23:02.328161 23151 raft_consensus.cc:2243] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.329905 23151 raft_consensus.cc:2272] T ec6b4ed2c5584d1ab830484e259e639d P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:02.332747   914 consensus_peers.cc:597] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3 -> Peer 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605): Couldn't send request to peer 92e9b78bc90b4d2199d6926b30ce4f18. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:33605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:02.333703   988 consensus_peers.cc:597] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f -> Peer 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605): Couldn't send request to peer 92e9b78bc90b4d2199d6926b30ce4f18. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:33605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:02.334452 23151 tablet_replica.cc:333] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3: stopping tablet replica
I20260709 12:23:02.335702 23151 raft_consensus.cc:2243] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.336923 23151 raft_consensus.cc:2272] T c3c892001314454ca65c7c2e8edf5fc3 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.340335 23151 tablet_replica.cc:333] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3: stopping tablet replica
I20260709 12:23:02.341166 23151 raft_consensus.cc:2243] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.341857 23151 raft_consensus.cc:2272] T 7831d6e821344a38ae5852abd18bb3fe P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.344838 23151 tablet_replica.cc:333] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3: stopping tablet replica
I20260709 12:23:02.345485 23151 raft_consensus.cc:2243] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.346086 23151 raft_consensus.cc:2272] T 7a49fd62ea774c2f94dc9816c84129f3 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.348716 23151 tablet_replica.cc:333] T 711fc51040264325aa09cebd07d5d5f4 P a92e1b02d25b49cfb108c1156f368fc3: stopping tablet replica
I20260709 12:23:02.349390 23151 raft_consensus.cc:2243] T 711fc51040264325aa09cebd07d5d5f4 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.350558 23151 raft_consensus.cc:2272] T 711fc51040264325aa09cebd07d5d5f4 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.354017 23151 tablet_replica.cc:333] T 3c3711921af14a5ab73080170199d621 P a92e1b02d25b49cfb108c1156f368fc3: stopping tablet replica
I20260709 12:23:02.354755 23151 raft_consensus.cc:2243] T 3c3711921af14a5ab73080170199d621 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:23:02.355343   914 consensus_peers.cc:597] T 3001aaf097cd4643b552a2d9ffe4e451 P a92e1b02d25b49cfb108c1156f368fc3 -> Peer 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605): Couldn't send request to peer 92e9b78bc90b4d2199d6926b30ce4f18. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:33605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:02.356128 23151 raft_consensus.cc:2272] T 3c3711921af14a5ab73080170199d621 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.358819 23151 tablet_replica.cc:333] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P a92e1b02d25b49cfb108c1156f368fc3: stopping tablet replica
I20260709 12:23:02.359437 23151 raft_consensus.cc:2243] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.359973 23151 raft_consensus.cc:2272] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.362497 23151 tablet_replica.cc:333] T a949969ca97842678559e3c98dcbacab P a92e1b02d25b49cfb108c1156f368fc3: stopping tablet replica
I20260709 12:23:02.363148 23151 raft_consensus.cc:2243] T a949969ca97842678559e3c98dcbacab P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.363621 23151 raft_consensus.cc:2272] T a949969ca97842678559e3c98dcbacab P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.366092 23151 tablet_replica.cc:333] T 84f31361412f4c9b92508e13138f16a6 P a92e1b02d25b49cfb108c1156f368fc3: stopping tablet replica
I20260709 12:23:02.366624 23151 raft_consensus.cc:2243] T 84f31361412f4c9b92508e13138f16a6 P a92e1b02d25b49cfb108c1156f368fc3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.367049 23151 raft_consensus.cc:2272] T 84f31361412f4c9b92508e13138f16a6 P a92e1b02d25b49cfb108c1156f368fc3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.369591 23151 tablet_replica.cc:333] T 4e64b69135784d4b9f5c0b183b5b07e0 P a92e1b02d25b49cfb108c1156f368fc3: stopping tablet replica
I20260709 12:23:02.370112 23151 raft_consensus.cc:2243] T 4e64b69135784d4b9f5c0b183b5b07e0 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.370697 23151 raft_consensus.cc:2272] T 4e64b69135784d4b9f5c0b183b5b07e0 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.373478 23151 tablet_replica.cc:333] T 8fcfa22eac4141c4861b32aac5eaa5eb P a92e1b02d25b49cfb108c1156f368fc3: stopping tablet replica
I20260709 12:23:02.374046 23151 raft_consensus.cc:2243] T 8fcfa22eac4141c4861b32aac5eaa5eb P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.374493 23151 raft_consensus.cc:2272] T 8fcfa22eac4141c4861b32aac5eaa5eb P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.377027 23151 tablet_replica.cc:333] T 8a51831e613e4dfc83fcde95752585a6 P a92e1b02d25b49cfb108c1156f368fc3: stopping tablet replica
I20260709 12:23:02.377566 23151 raft_consensus.cc:2243] T 8a51831e613e4dfc83fcde95752585a6 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.378078 23151 raft_consensus.cc:2272] T 8a51831e613e4dfc83fcde95752585a6 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.380702 23151 tablet_replica.cc:333] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3: stopping tablet replica
I20260709 12:23:02.381316 23151 raft_consensus.cc:2243] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.381819 23151 raft_consensus.cc:2272] T 25d5d6c8f96143a1abaef7b427036b5e P a92e1b02d25b49cfb108c1156f368fc3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.385216 23151 tablet_replica.cc:333] T 4c947c22c6224f85b77fef1e288bc140 P a92e1b02d25b49cfb108c1156f368fc3: stopping tablet replica
I20260709 12:23:02.385808 23151 raft_consensus.cc:2243] T 4c947c22c6224f85b77fef1e288bc140 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.386502 23151 raft_consensus.cc:2272] T 4c947c22c6224f85b77fef1e288bc140 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:02.387475   988 consensus_peers.cc:597] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f -> Peer 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605): Couldn't send request to peer 92e9b78bc90b4d2199d6926b30ce4f18. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:33605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:02.389422 23151 tablet_replica.cc:333] T 3001aaf097cd4643b552a2d9ffe4e451 P a92e1b02d25b49cfb108c1156f368fc3: stopping tablet replica
I20260709 12:23:02.390139 23151 raft_consensus.cc:2243] T 3001aaf097cd4643b552a2d9ffe4e451 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.391220 23151 raft_consensus.cc:2272] T 3001aaf097cd4643b552a2d9ffe4e451 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.394835 23151 tablet_replica.cc:333] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3: stopping tablet replica
I20260709 12:23:02.395642 23151 raft_consensus.cc:2243] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.396979 23151 raft_consensus.cc:2272] T 9fc4c255f6b249f69626768f14e626f2 P a92e1b02d25b49cfb108c1156f368fc3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:02.398453   988 consensus_peers.cc:597] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f -> Peer 92e9b78bc90b4d2199d6926b30ce4f18 (127.22.155.193:33605): Couldn't send request to peer 92e9b78bc90b4d2199d6926b30ce4f18. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:33605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:02.400035 23151 tablet_replica.cc:333] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3: stopping tablet replica
I20260709 12:23:02.400795 23151 raft_consensus.cc:2243] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.401469 23151 raft_consensus.cc:2272] T 158ee92d754f40d187a7702eb6807583 P a92e1b02d25b49cfb108c1156f368fc3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:02.423938   991 consensus_peers.cc:597] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f -> Peer a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583): Couldn't send request to peer a92e1b02d25b49cfb108c1156f368fc3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:02.430727   991 consensus_peers.cc:597] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f -> Peer a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583): Couldn't send request to peer a92e1b02d25b49cfb108c1156f368fc3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:02.456360 23151 tablet_server.cc:196] TabletServer@127.22.155.194:0 shutdown complete.
W20260709 12:23:02.470621   991 consensus_peers.cc:597] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f -> Peer a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583): Couldn't send request to peer a92e1b02d25b49cfb108c1156f368fc3. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:39583: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:02.484357   991 consensus_peers.cc:597] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f -> Peer a92e1b02d25b49cfb108c1156f368fc3 (127.22.155.194:39583): Couldn't send request to peer a92e1b02d25b49cfb108c1156f368fc3. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:39583: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:02.511129 23151 tablet_server.cc:179] TabletServer@127.22.155.195:0 shutting down...
I20260709 12:23:02.560571 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:02.561579 23151 tablet_replica.cc:333] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f: stopping tablet replica
I20260709 12:23:02.562848 23151 raft_consensus.cc:2243] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.564137 23151 raft_consensus.cc:2272] T d4e3b537fd694288a9d3edbc614d48a0 P 91fb18caf57c4ad685ecac3334f1794f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.566890 23151 tablet_replica.cc:333] T ec6b4ed2c5584d1ab830484e259e639d P 91fb18caf57c4ad685ecac3334f1794f: stopping tablet replica
I20260709 12:23:02.567509 23151 raft_consensus.cc:2243] T ec6b4ed2c5584d1ab830484e259e639d P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.568044 23151 raft_consensus.cc:2272] T ec6b4ed2c5584d1ab830484e259e639d P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.570549 23151 tablet_replica.cc:333] T c3c892001314454ca65c7c2e8edf5fc3 P 91fb18caf57c4ad685ecac3334f1794f: stopping tablet replica
I20260709 12:23:02.571130 23151 raft_consensus.cc:2243] T c3c892001314454ca65c7c2e8edf5fc3 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.571642 23151 raft_consensus.cc:2272] T c3c892001314454ca65c7c2e8edf5fc3 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.574169 23151 tablet_replica.cc:333] T 7831d6e821344a38ae5852abd18bb3fe P 91fb18caf57c4ad685ecac3334f1794f: stopping tablet replica
I20260709 12:23:02.574862 23151 raft_consensus.cc:2243] T 7831d6e821344a38ae5852abd18bb3fe P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.575462 23151 raft_consensus.cc:2272] T 7831d6e821344a38ae5852abd18bb3fe P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.578024 23151 tablet_replica.cc:333] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 91fb18caf57c4ad685ecac3334f1794f: stopping tablet replica
I20260709 12:23:02.578689 23151 raft_consensus.cc:2243] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.579308 23151 raft_consensus.cc:2272] T 7b7ce2d5c2024a7bbce3f957b5c5d998 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.581670 23151 tablet_replica.cc:333] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f: stopping tablet replica
I20260709 12:23:02.582278 23151 raft_consensus.cc:2243] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.583428 23151 raft_consensus.cc:2272] T a949969ca97842678559e3c98dcbacab P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.585748 23151 tablet_replica.cc:333] T 4c947c22c6224f85b77fef1e288bc140 P 91fb18caf57c4ad685ecac3334f1794f: stopping tablet replica
I20260709 12:23:02.586338 23151 raft_consensus.cc:2243] T 4c947c22c6224f85b77fef1e288bc140 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.586872 23151 raft_consensus.cc:2272] T 4c947c22c6224f85b77fef1e288bc140 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.589092 23151 tablet_replica.cc:333] T 3c3711921af14a5ab73080170199d621 P 91fb18caf57c4ad685ecac3334f1794f: stopping tablet replica
I20260709 12:23:02.589706 23151 raft_consensus.cc:2243] T 3c3711921af14a5ab73080170199d621 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.590178 23151 raft_consensus.cc:2272] T 3c3711921af14a5ab73080170199d621 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.592756 23151 tablet_replica.cc:333] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f: stopping tablet replica
I20260709 12:23:02.593374 23151 raft_consensus.cc:2243] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.594318 23151 raft_consensus.cc:2272] T 84f31361412f4c9b92508e13138f16a6 P 91fb18caf57c4ad685ecac3334f1794f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.596791 23151 tablet_replica.cc:333] T 4e64b69135784d4b9f5c0b183b5b07e0 P 91fb18caf57c4ad685ecac3334f1794f: stopping tablet replica
I20260709 12:23:02.597405 23151 raft_consensus.cc:2243] T 4e64b69135784d4b9f5c0b183b5b07e0 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.597898 23151 raft_consensus.cc:2272] T 4e64b69135784d4b9f5c0b183b5b07e0 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.600086 23151 tablet_replica.cc:333] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f: stopping tablet replica
I20260709 12:23:02.600734 23151 raft_consensus.cc:2243] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.601727 23151 raft_consensus.cc:2272] T 8fcfa22eac4141c4861b32aac5eaa5eb P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.604051 23151 tablet_replica.cc:333] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f: stopping tablet replica
I20260709 12:23:02.604701 23151 raft_consensus.cc:2243] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.605255 23151 raft_consensus.cc:2272] T 8a51831e613e4dfc83fcde95752585a6 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.608321 23151 tablet_replica.cc:333] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f: stopping tablet replica
I20260709 12:23:02.609050 23151 raft_consensus.cc:2243] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.610024 23151 raft_consensus.cc:2272] T 25d5d6c8f96143a1abaef7b427036b5e P 91fb18caf57c4ad685ecac3334f1794f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.612457 23151 tablet_replica.cc:333] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f: stopping tablet replica
I20260709 12:23:02.613128 23151 raft_consensus.cc:2243] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.613674 23151 raft_consensus.cc:2272] T 3001aaf097cd4643b552a2d9ffe4e451 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.615916 23151 tablet_replica.cc:333] T 9fc4c255f6b249f69626768f14e626f2 P 91fb18caf57c4ad685ecac3334f1794f: stopping tablet replica
I20260709 12:23:02.616516 23151 raft_consensus.cc:2243] T 9fc4c255f6b249f69626768f14e626f2 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.617067 23151 raft_consensus.cc:2272] T 9fc4c255f6b249f69626768f14e626f2 P 91fb18caf57c4ad685ecac3334f1794f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.619285 23151 tablet_replica.cc:333] T 158ee92d754f40d187a7702eb6807583 P 91fb18caf57c4ad685ecac3334f1794f: stopping tablet replica
I20260709 12:23:02.619858 23151 raft_consensus.cc:2243] T 158ee92d754f40d187a7702eb6807583 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.620349 23151 raft_consensus.cc:2272] T 158ee92d754f40d187a7702eb6807583 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.622753 23151 tablet_replica.cc:333] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f: stopping tablet replica
I20260709 12:23:02.623291 23151 raft_consensus.cc:2243] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.624189 23151 raft_consensus.cc:2272] T 7a49fd62ea774c2f94dc9816c84129f3 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.626559 23151 tablet_replica.cc:333] T 711fc51040264325aa09cebd07d5d5f4 P 91fb18caf57c4ad685ecac3334f1794f: stopping tablet replica
I20260709 12:23:02.627091 23151 raft_consensus.cc:2243] T 711fc51040264325aa09cebd07d5d5f4 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.627621 23151 raft_consensus.cc:2272] T 711fc51040264325aa09cebd07d5d5f4 P 91fb18caf57c4ad685ecac3334f1794f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.661921 23151 tablet_server.cc:196] TabletServer@127.22.155.195:0 shutdown complete.
I20260709 12:23:02.708025 23151 master.cc:562] Master@127.22.155.254:44079 shutting down...
I20260709 12:23:02.736249 23151 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3b3a5bb5af134348a37a7f0fc773a300 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.737176 23151 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3b3a5bb5af134348a37a7f0fc773a300 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.737540 23151 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3b3a5bb5af134348a37a7f0fc773a300: stopping tablet replica
I20260709 12:23:02.759028 23151 master.cc:584] Master@127.22.155.254:44079 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (21504 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:23:02.827044 23151 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.155.254:35515
I20260709 12:23:02.828487 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:02.835567  1377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:02.836367  1376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:02.837073  1379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:02.838142 23151 server_base.cc:1061] running on GCE node
I20260709 12:23:02.839284 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:02.839488 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:02.839613 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599782839602 us; error 0 us; skew 500 ppm
I20260709 12:23:02.840077 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:02.843142 23151 webserver.cc:533] Webserver started at http://127.22.155.254:34547/ using document root <none> and password file <none>
I20260709 12:23:02.843642 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:02.843804 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:02.844030 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:02.845307 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599400258298-23151-0/minicluster-data/master-0-root/instance:
uuid: "d1f480894fd94fb4b03b592b62dad15e"
format_stamp: "Formatted at 2026-07-09 12:23:02 on dist-test-slave-p7fg"
I20260709 12:23:02.850169 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:23:02.853969  1384 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:02.854979 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:23:02.855325 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599400258298-23151-0/minicluster-data/master-0-root
uuid: "d1f480894fd94fb4b03b592b62dad15e"
format_stamp: "Formatted at 2026-07-09 12:23:02 on dist-test-slave-p7fg"
I20260709 12:23:02.855669 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599400258298-23151-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599400258298-23151-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599400258298-23151-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:02.869961 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:02.871330 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:02.914371 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.254:35515
I20260709 12:23:02.914530  1435 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.254:35515 every 8 connection(s)
I20260709 12:23:02.919072  1436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.932679  1436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1f480894fd94fb4b03b592b62dad15e: Bootstrap starting.
I20260709 12:23:02.938426  1436 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d1f480894fd94fb4b03b592b62dad15e: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:02.943929  1436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1f480894fd94fb4b03b592b62dad15e: No bootstrap required, opened a new log
I20260709 12:23:02.946537  1436 raft_consensus.cc:359] T 00000000000000000000000000000000 P d1f480894fd94fb4b03b592b62dad15e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1f480894fd94fb4b03b592b62dad15e" member_type: VOTER }
I20260709 12:23:02.947026  1436 raft_consensus.cc:385] T 00000000000000000000000000000000 P d1f480894fd94fb4b03b592b62dad15e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:02.947219  1436 raft_consensus.cc:740] T 00000000000000000000000000000000 P d1f480894fd94fb4b03b592b62dad15e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1f480894fd94fb4b03b592b62dad15e, State: Initialized, Role: FOLLOWER
I20260709 12:23:02.947742  1436 consensus_queue.cc:260] T 00000000000000000000000000000000 P d1f480894fd94fb4b03b592b62dad15e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1f480894fd94fb4b03b592b62dad15e" member_type: VOTER }
I20260709 12:23:02.948210  1436 raft_consensus.cc:399] T 00000000000000000000000000000000 P d1f480894fd94fb4b03b592b62dad15e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:23:02.948417  1436 raft_consensus.cc:493] T 00000000000000000000000000000000 P d1f480894fd94fb4b03b592b62dad15e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:23:02.948710  1436 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d1f480894fd94fb4b03b592b62dad15e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:02.954486  1436 raft_consensus.cc:515] T 00000000000000000000000000000000 P d1f480894fd94fb4b03b592b62dad15e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1f480894fd94fb4b03b592b62dad15e" member_type: VOTER }
I20260709 12:23:02.955031  1436 leader_election.cc:304] T 00000000000000000000000000000000 P d1f480894fd94fb4b03b592b62dad15e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d1f480894fd94fb4b03b592b62dad15e; no voters: 
I20260709 12:23:02.956470  1436 leader_election.cc:290] T 00000000000000000000000000000000 P d1f480894fd94fb4b03b592b62dad15e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:23:02.957198  1439 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d1f480894fd94fb4b03b592b62dad15e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:02.958827  1439 raft_consensus.cc:697] T 00000000000000000000000000000000 P d1f480894fd94fb4b03b592b62dad15e [term 1 LEADER]: Becoming Leader. State: Replica: d1f480894fd94fb4b03b592b62dad15e, State: Running, Role: LEADER
I20260709 12:23:02.959587  1439 consensus_queue.cc:237] T 00000000000000000000000000000000 P d1f480894fd94fb4b03b592b62dad15e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1f480894fd94fb4b03b592b62dad15e" member_type: VOTER }
I20260709 12:23:02.960137  1436 sys_catalog.cc:565] T 00000000000000000000000000000000 P d1f480894fd94fb4b03b592b62dad15e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:23:02.965538  1440 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1f480894fd94fb4b03b592b62dad15e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d1f480894fd94fb4b03b592b62dad15e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1f480894fd94fb4b03b592b62dad15e" member_type: VOTER } }
I20260709 12:23:02.965744  1441 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1f480894fd94fb4b03b592b62dad15e [sys.catalog]: SysCatalogTable state changed. Reason: New leader d1f480894fd94fb4b03b592b62dad15e. Latest consensus state: current_term: 1 leader_uuid: "d1f480894fd94fb4b03b592b62dad15e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1f480894fd94fb4b03b592b62dad15e" member_type: VOTER } }
I20260709 12:23:02.966393  1441 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1f480894fd94fb4b03b592b62dad15e [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:02.966455  1440 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1f480894fd94fb4b03b592b62dad15e [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:02.970014  1447 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:23:02.977336  1447 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:23:02.978796 23151 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:23:02.987679  1447 catalog_manager.cc:1383] Generated new cluster ID: 023c0a3ab3df43fe8a7e563b56b0b151
I20260709 12:23:02.988087  1447 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:23:03.002743  1447 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:23:03.004460  1447 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:23:03.023312  1447 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d1f480894fd94fb4b03b592b62dad15e: Generated new TSK 0
I20260709 12:23:03.024010  1447 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:23:03.046033 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:03.052923  1457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:03.054131  1458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:03.056475 23151 server_base.cc:1061] running on GCE node
W20260709 12:23:03.057080  1460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:03.058343 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:03.058552 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:03.058682 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599783058670 us; error 0 us; skew 500 ppm
I20260709 12:23:03.059173 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:03.061852 23151 webserver.cc:533] Webserver started at http://127.22.155.193:45027/ using document root <none> and password file <none>
I20260709 12:23:03.062439 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:03.062664 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:03.062953 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:03.064194 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599400258298-23151-0/minicluster-data/ts-0-root/instance:
uuid: "f7b98485eacd4e838f526f29916c9241"
format_stamp: "Formatted at 2026-07-09 12:23:03 on dist-test-slave-p7fg"
I20260709 12:23:03.069516 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:23:03.074010  1465 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:03.075055 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:23:03.075515 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599400258298-23151-0/minicluster-data/ts-0-root
uuid: "f7b98485eacd4e838f526f29916c9241"
format_stamp: "Formatted at 2026-07-09 12:23:03 on dist-test-slave-p7fg"
I20260709 12:23:03.075922 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599400258298-23151-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599400258298-23151-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599400258298-23151-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:03.101069 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:03.102660 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:03.104597 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:03.107425 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:03.107692 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:03.107966 23151 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:03.108230 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:03.159024 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.193:41841
I20260709 12:23:03.159184  1527 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.193:41841 every 8 connection(s)
I20260709 12:23:03.164695 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:03.174099  1532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:03.175987  1533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:03.177479  1535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:03.178272 23151 server_base.cc:1061] running on GCE node
I20260709 12:23:03.179715 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:03.179937 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:03.180163 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599783180143 us; error 0 us; skew 500 ppm
I20260709 12:23:03.180859 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:03.183954 23151 webserver.cc:533] Webserver started at http://127.22.155.194:38743/ using document root <none> and password file <none>
I20260709 12:23:03.184574 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:03.184755  1528 heartbeater.cc:344] Connected to a master server at 127.22.155.254:35515
I20260709 12:23:03.184850 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:03.185400  1528 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:03.185467 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:03.186350  1528 heartbeater.cc:507] Master 127.22.155.254:35515 requested a full tablet report, sending...
I20260709 12:23:03.186946 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599400258298-23151-0/minicluster-data/ts-1-root/instance:
uuid: "683a2f1018404bbea77e99732b6baeb7"
format_stamp: "Formatted at 2026-07-09 12:23:03 on dist-test-slave-p7fg"
I20260709 12:23:03.188910  1401 ts_manager.cc:194] Registered new tserver with Master: f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841)
I20260709 12:23:03.191504  1401 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52796
I20260709 12:23:03.193445 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:23:03.197431  1540 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:03.198400 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:23:03.198773 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599400258298-23151-0/minicluster-data/ts-1-root
uuid: "683a2f1018404bbea77e99732b6baeb7"
format_stamp: "Formatted at 2026-07-09 12:23:03 on dist-test-slave-p7fg"
I20260709 12:23:03.199085 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599400258298-23151-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599400258298-23151-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599400258298-23151-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:03.217541 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:03.218783 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:03.220381 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:03.222852 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:03.223088 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:03.223347 23151 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:03.223528 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:03.269150 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.194:35903
I20260709 12:23:03.269305  1602 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.194:35903 every 8 connection(s)
I20260709 12:23:03.274370 23151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:03.282619  1606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:03.285281  1607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:03.287115  1609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:03.290973  1603 heartbeater.cc:344] Connected to a master server at 127.22.155.254:35515
I20260709 12:23:03.291604  1603 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:03.292423  1603 heartbeater.cc:507] Master 127.22.155.254:35515 requested a full tablet report, sending...
I20260709 12:23:03.293037 23151 server_base.cc:1061] running on GCE node
I20260709 12:23:03.294152 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:03.294396 23151 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:03.294610 23151 hybrid_clock.cc:648] HybridClock initialized: now 1783599783294593 us; error 0 us; skew 500 ppm
I20260709 12:23:03.295099  1401 ts_manager.cc:194] Registered new tserver with Master: 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:03.295172 23151 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:03.297257  1401 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52804
I20260709 12:23:03.298533 23151 webserver.cc:533] Webserver started at http://127.22.155.195:39199/ using document root <none> and password file <none>
I20260709 12:23:03.299315 23151 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:03.299580 23151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:03.299909 23151 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:03.301326 23151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599400258298-23151-0/minicluster-data/ts-2-root/instance:
uuid: "5a653ba4e41749d7b863fa58e89f6444"
format_stamp: "Formatted at 2026-07-09 12:23:03 on dist-test-slave-p7fg"
I20260709 12:23:03.306084 23151 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:23:03.311347  1614 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:03.312196 23151 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:23:03.312578 23151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599400258298-23151-0/minicluster-data/ts-2-root
uuid: "5a653ba4e41749d7b863fa58e89f6444"
format_stamp: "Formatted at 2026-07-09 12:23:03 on dist-test-slave-p7fg"
I20260709 12:23:03.312979 23151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599400258298-23151-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599400258298-23151-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskUsVlgM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599400258298-23151-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:03.330721 23151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:03.332086 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:03.333870 23151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:03.336447 23151 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:03.336730 23151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:23:03.337013 23151 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:03.337215 23151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:03.386310 23151 rpc_server.cc:307] RPC server started. Bound to: 127.22.155.195:40949
I20260709 12:23:03.386475  1676 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.155.195:40949 every 8 connection(s)
I20260709 12:23:03.403614  1677 heartbeater.cc:344] Connected to a master server at 127.22.155.254:35515
I20260709 12:23:03.404284  1677 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:03.405165  1677 heartbeater.cc:507] Master 127.22.155.254:35515 requested a full tablet report, sending...
I20260709 12:23:03.407424  1401 ts_manager.cc:194] Registered new tserver with Master: 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:03.407725 23151 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017806607s
I20260709 12:23:03.409089  1401 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52816
I20260709 12:23:03.439193  1401 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52826:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:03.442092  1401 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:03.520874  1642 tablet_service.cc:1511] Processing CreateTablet for tablet f062c725755040f99ed0fef6f284f193 (DEFAULT_TABLE table=test-workload [id=b8252fbeae59496590fb06e4a2443ef9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:03.522375  1642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f062c725755040f99ed0fef6f284f193. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.522835  1492 tablet_service.cc:1511] Processing CreateTablet for tablet 2f1d51316b514da6932b968cef61ed95 (DEFAULT_TABLE table=test-workload [id=b8252fbeae59496590fb06e4a2443ef9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:03.524279  1492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f1d51316b514da6932b968cef61ed95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.524479  1491 tablet_service.cc:1511] Processing CreateTablet for tablet d3aad6b70d2340a0aeda7e4edd7c55d8 (DEFAULT_TABLE table=test-workload [id=b8252fbeae59496590fb06e4a2443ef9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:03.525861  1491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3aad6b70d2340a0aeda7e4edd7c55d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.525482  1568 tablet_service.cc:1511] Processing CreateTablet for tablet f062c725755040f99ed0fef6f284f193 (DEFAULT_TABLE table=test-workload [id=b8252fbeae59496590fb06e4a2443ef9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:03.527122  1568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f062c725755040f99ed0fef6f284f193. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.529198  1490 tablet_service.cc:1511] Processing CreateTablet for tablet 30cddd6873234c5f9f6078f1fb193e4a (DEFAULT_TABLE table=test-workload [id=b8252fbeae59496590fb06e4a2443ef9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:03.529500  1640 tablet_service.cc:1511] Processing CreateTablet for tablet d3aad6b70d2340a0aeda7e4edd7c55d8 (DEFAULT_TABLE table=test-workload [id=b8252fbeae59496590fb06e4a2443ef9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:03.529906  1566 tablet_service.cc:1511] Processing CreateTablet for tablet d3aad6b70d2340a0aeda7e4edd7c55d8 (DEFAULT_TABLE table=test-workload [id=b8252fbeae59496590fb06e4a2443ef9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:03.530671  1490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30cddd6873234c5f9f6078f1fb193e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.530828  1640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3aad6b70d2340a0aeda7e4edd7c55d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.532613  1565 tablet_service.cc:1511] Processing CreateTablet for tablet 30cddd6873234c5f9f6078f1fb193e4a (DEFAULT_TABLE table=test-workload [id=b8252fbeae59496590fb06e4a2443ef9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:03.533802  1493 tablet_service.cc:1511] Processing CreateTablet for tablet f062c725755040f99ed0fef6f284f193 (DEFAULT_TABLE table=test-workload [id=b8252fbeae59496590fb06e4a2443ef9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:03.535252  1493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f062c725755040f99ed0fef6f284f193. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.535480  1567 tablet_service.cc:1511] Processing CreateTablet for tablet 2f1d51316b514da6932b968cef61ed95 (DEFAULT_TABLE table=test-workload [id=b8252fbeae59496590fb06e4a2443ef9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:03.535660  1639 tablet_service.cc:1511] Processing CreateTablet for tablet 30cddd6873234c5f9f6078f1fb193e4a (DEFAULT_TABLE table=test-workload [id=b8252fbeae59496590fb06e4a2443ef9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:03.537115  1639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30cddd6873234c5f9f6078f1fb193e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.536885  1641 tablet_service.cc:1511] Processing CreateTablet for tablet 2f1d51316b514da6932b968cef61ed95 (DEFAULT_TABLE table=test-workload [id=b8252fbeae59496590fb06e4a2443ef9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:03.538612  1641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f1d51316b514da6932b968cef61ed95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.538806  1489 tablet_service.cc:1511] Processing CreateTablet for tablet f963b0bc8284494bb00908db689b8a42 (DEFAULT_TABLE table=test-workload [id=b8252fbeae59496590fb06e4a2443ef9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:03.539587  1638 tablet_service.cc:1511] Processing CreateTablet for tablet f963b0bc8284494bb00908db689b8a42 (DEFAULT_TABLE table=test-workload [id=b8252fbeae59496590fb06e4a2443ef9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:03.540345  1489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f963b0bc8284494bb00908db689b8a42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.541245  1638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f963b0bc8284494bb00908db689b8a42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.561739  1562 tablet_service.cc:1511] Processing CreateTablet for tablet e891cda7a3bf4536a9729ebc2669c144 (DEFAULT_TABLE table=test-workload [id=b8252fbeae59496590fb06e4a2443ef9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:03.564682  1561 tablet_service.cc:1511] Processing CreateTablet for tablet 8decea69eec245aba482134428dcbfb9 (DEFAULT_TABLE table=test-workload [id=b8252fbeae59496590fb06e4a2443ef9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:03.566309  1561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8decea69eec245aba482134428dcbfb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.541890  1488 tablet_service.cc:1511] Processing CreateTablet for tablet 1d6923852b214d25b708fd501a7158fb (DEFAULT_TABLE table=test-workload [id=b8252fbeae59496590fb06e4a2443ef9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:03.566978  1634 tablet_service.cc:1511] Processing CreateTablet for tablet aef1ee0de44340bcac5c557df76496bc (DEFAULT_TABLE table=test-workload [id=b8252fbeae59496590fb06e4a2443ef9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:03.567580  1567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f1d51316b514da6932b968cef61ed95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.568282  1488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d6923852b214d25b708fd501a7158fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.545809  1564 tablet_service.cc:1511] Processing CreateTablet for tablet f963b0bc8284494bb00908db689b8a42 (DEFAULT_TABLE table=test-workload [id=b8252fbeae59496590fb06e4a2443ef9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:03.547705  1563 tablet_service.cc:1511] Processing CreateTablet for tablet 1d6923852b214d25b708fd501a7158fb (DEFAULT_TABLE table=test-workload [id=b8252fbeae59496590fb06e4a2443ef9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:03.549595  1636 tablet_service.cc:1511] Processing CreateTablet for tablet e891cda7a3bf4536a9729ebc2669c144 (DEFAULT_TABLE table=test-workload [id=b8252fbeae59496590fb06e4a2443ef9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:03.550362  1637 tablet_service.cc:1511] Processing CreateTablet for tablet 1d6923852b214d25b708fd501a7158fb (DEFAULT_TABLE table=test-workload [id=b8252fbeae59496590fb06e4a2443ef9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:03.569973  1485 tablet_service.cc:1511] Processing CreateTablet for tablet aef1ee0de44340bcac5c557df76496bc (DEFAULT_TABLE table=test-workload [id=b8252fbeae59496590fb06e4a2443ef9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:03.554190  1487 tablet_service.cc:1511] Processing CreateTablet for tablet e891cda7a3bf4536a9729ebc2669c144 (DEFAULT_TABLE table=test-workload [id=b8252fbeae59496590fb06e4a2443ef9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:03.556113  1486 tablet_service.cc:1511] Processing CreateTablet for tablet 8decea69eec245aba482134428dcbfb9 (DEFAULT_TABLE table=test-workload [id=b8252fbeae59496590fb06e4a2443ef9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:03.571624  1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aef1ee0de44340bcac5c557df76496bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.558145  1635 tablet_service.cc:1511] Processing CreateTablet for tablet 8decea69eec245aba482134428dcbfb9 (DEFAULT_TABLE table=test-workload [id=b8252fbeae59496590fb06e4a2443ef9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:03.573287  1635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8decea69eec245aba482134428dcbfb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.571635  1566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3aad6b70d2340a0aeda7e4edd7c55d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.577003  1636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e891cda7a3bf4536a9729ebc2669c144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.582664  1485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aef1ee0de44340bcac5c557df76496bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.585029  1486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8decea69eec245aba482134428dcbfb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.588534  1637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d6923852b214d25b708fd501a7158fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.577004  1565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30cddd6873234c5f9f6078f1fb193e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.591670  1487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e891cda7a3bf4536a9729ebc2669c144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.592994  1564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f963b0bc8284494bb00908db689b8a42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.595520  1562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e891cda7a3bf4536a9729ebc2669c144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.599661  1563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d6923852b214d25b708fd501a7158fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.600955  1560 tablet_service.cc:1511] Processing CreateTablet for tablet aef1ee0de44340bcac5c557df76496bc (DEFAULT_TABLE table=test-workload [id=b8252fbeae59496590fb06e4a2443ef9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:03.602413  1560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aef1ee0de44340bcac5c557df76496bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.614537  1693 tablet_bootstrap.cc:492] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241: Bootstrap starting.
I20260709 12:23:03.690641  1693 tablet_bootstrap.cc:654] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.691813  1694 tablet_bootstrap.cc:492] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444: Bootstrap starting.
I20260709 12:23:03.771888  1696 tablet_bootstrap.cc:492] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7: Bootstrap starting.
I20260709 12:23:03.774718  1694 tablet_bootstrap.cc:654] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.780341  1696 tablet_bootstrap.cc:654] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.794575  1693 tablet_bootstrap.cc:492] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241: No bootstrap required, opened a new log
I20260709 12:23:03.795179  1693 ts_tablet_manager.cc:1403] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241: Time spent bootstrapping tablet: real 0.181s	user 0.022s	sys 0.019s
I20260709 12:23:03.798967  1693 raft_consensus.cc:359] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } }
I20260709 12:23:03.800096  1693 raft_consensus.cc:385] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.800509  1693 raft_consensus.cc:740] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.802007  1693 consensus_queue.cc:260] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } }
I20260709 12:23:03.807783  1528 heartbeater.cc:499] Master 127.22.155.254:35515 was elected leader, sending a full tablet report...
I20260709 12:23:03.808305  1696 tablet_bootstrap.cc:492] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7: No bootstrap required, opened a new log
I20260709 12:23:03.808964  1696 ts_tablet_manager.cc:1403] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.019s
I20260709 12:23:03.809212  1693 ts_tablet_manager.cc:1434] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:23:03.810410  1693 tablet_bootstrap.cc:492] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241: Bootstrap starting.
I20260709 12:23:03.814108  1694 tablet_bootstrap.cc:492] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444: No bootstrap required, opened a new log
I20260709 12:23:03.814678  1694 ts_tablet_manager.cc:1403] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444: Time spent bootstrapping tablet: real 0.123s	user 0.005s	sys 0.015s
I20260709 12:23:03.816362  1693 tablet_bootstrap.cc:654] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.816817  1696 raft_consensus.cc:359] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:03.817708  1696 raft_consensus.cc:385] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.817514  1694 raft_consensus.cc:359] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:03.818037  1696 raft_consensus.cc:740] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.818367  1694 raft_consensus.cc:385] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.818676  1694 raft_consensus.cc:740] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.819057  1696 consensus_queue.cc:260] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:03.819422  1694 consensus_queue.cc:260] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:03.838372  1603 heartbeater.cc:499] Master 127.22.155.254:35515 was elected leader, sending a full tablet report...
I20260709 12:23:03.839807  1677 heartbeater.cc:499] Master 127.22.155.254:35515 was elected leader, sending a full tablet report...
I20260709 12:23:03.840456  1694 ts_tablet_manager.cc:1434] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.015s
I20260709 12:23:03.841701  1694 tablet_bootstrap.cc:492] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444: Bootstrap starting.
I20260709 12:23:03.843115  1693 tablet_bootstrap.cc:492] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241: No bootstrap required, opened a new log
I20260709 12:23:03.843801  1693 ts_tablet_manager.cc:1403] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.013s
I20260709 12:23:03.847072  1693 raft_consensus.cc:359] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:03.847942  1693 raft_consensus.cc:385] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.848304  1693 raft_consensus.cc:740] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.849476  1694 tablet_bootstrap.cc:654] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.849264  1693 consensus_queue.cc:260] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:03.851052  1696 ts_tablet_manager.cc:1434] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.016s
I20260709 12:23:03.852106  1693 ts_tablet_manager.cc:1434] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.007s
I20260709 12:23:03.852402  1696 tablet_bootstrap.cc:492] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7: Bootstrap starting.
I20260709 12:23:03.853483  1693 tablet_bootstrap.cc:492] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241: Bootstrap starting.
I20260709 12:23:03.861532  1693 tablet_bootstrap.cc:654] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.862118  1696 tablet_bootstrap.cc:654] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.864146  1694 tablet_bootstrap.cc:492] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444: No bootstrap required, opened a new log
I20260709 12:23:03.864861  1694 ts_tablet_manager.cc:1403] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.010s
I20260709 12:23:03.873611  1694 raft_consensus.cc:359] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:03.874790  1694 raft_consensus.cc:385] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.875190  1694 raft_consensus.cc:740] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.876521  1694 consensus_queue.cc:260] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:03.880237  1694 ts_tablet_manager.cc:1434] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 12:23:03.881795  1694 tablet_bootstrap.cc:492] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444: Bootstrap starting.
I20260709 12:23:03.888332  1696 tablet_bootstrap.cc:492] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7: No bootstrap required, opened a new log
I20260709 12:23:03.889124  1696 ts_tablet_manager.cc:1403] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7: Time spent bootstrapping tablet: real 0.037s	user 0.031s	sys 0.004s
I20260709 12:23:03.889227  1693 tablet_bootstrap.cc:492] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241: No bootstrap required, opened a new log
I20260709 12:23:03.890107  1693 ts_tablet_manager.cc:1403] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241: Time spent bootstrapping tablet: real 0.037s	user 0.018s	sys 0.016s
I20260709 12:23:03.891017  1699 raft_consensus.cc:493] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:03.891247  1678 tablet.cc:2406] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:23:03.891641  1699 raft_consensus.cc:515] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:03.893198  1696 raft_consensus.cc:359] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:03.894013  1696 raft_consensus.cc:385] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.894332  1696 raft_consensus.cc:740] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.895320  1696 consensus_queue.cc:260] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:03.895562  1693 raft_consensus.cc:359] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:03.897836  1693 raft_consensus.cc:385] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.898221  1693 raft_consensus.cc:740] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.898487  1696 ts_tablet_manager.cc:1434] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:23:03.899140  1693 consensus_queue.cc:260] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:03.899731  1696 tablet_bootstrap.cc:492] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7: Bootstrap starting.
I20260709 12:23:03.900995  1699 leader_election.cc:290] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:03.915115  1694 tablet_bootstrap.cc:654] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.924108  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1d51316b514da6932b968cef61ed95" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
W20260709 12:23:03.926786  1468 leader_election.cc:343] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:03.930461  1696 tablet_bootstrap.cc:654] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.934639  1693 ts_tablet_manager.cc:1434] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241: Time spent starting tablet: real 0.044s	user 0.017s	sys 0.020s
I20260709 12:23:03.936087  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1d51316b514da6932b968cef61ed95" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:03.937237  1652 raft_consensus.cc:2468] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 0.
I20260709 12:23:03.937417  1693 tablet_bootstrap.cc:492] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241: Bootstrap starting.
I20260709 12:23:03.939373  1466 leader_election.cc:304] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241; no voters: 683a2f1018404bbea77e99732b6baeb7
I20260709 12:23:03.941577  1708 raft_consensus.cc:2804] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:03.942170  1708 raft_consensus.cc:493] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.942634  1708 raft_consensus.cc:3060] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:03.944583  1693 tablet_bootstrap.cc:654] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.951289  1694 tablet_bootstrap.cc:492] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444: No bootstrap required, opened a new log
I20260709 12:23:03.951844  1694 ts_tablet_manager.cc:1403] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444: Time spent bootstrapping tablet: real 0.070s	user 0.016s	sys 0.021s
I20260709 12:23:03.952435  1693 tablet_bootstrap.cc:492] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241: No bootstrap required, opened a new log
I20260709 12:23:03.953168  1693 ts_tablet_manager.cc:1403] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 12:23:03.954408  1696 tablet_bootstrap.cc:492] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7: No bootstrap required, opened a new log
I20260709 12:23:03.955082  1696 ts_tablet_manager.cc:1403] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.004s
I20260709 12:23:03.955010  1694 raft_consensus.cc:359] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:03.955937  1694 raft_consensus.cc:385] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.956254  1694 raft_consensus.cc:740] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.956745  1693 raft_consensus.cc:359] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:03.957068  1708 raft_consensus.cc:515] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:03.957577  1693 raft_consensus.cc:385] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.958034  1693 raft_consensus.cc:740] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.958899  1693 consensus_queue.cc:260] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:03.957123  1694 consensus_queue.cc:260] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:03.960299  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1d51316b514da6932b968cef61ed95" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
I20260709 12:23:03.960738  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1d51316b514da6932b968cef61ed95" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:03.961383  1652 raft_consensus.cc:3060] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:03.962852  1694 ts_tablet_manager.cc:1434] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.007s
I20260709 12:23:03.959337  1708 leader_election.cc:290] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 election: Requested vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:03.964007  1694 tablet_bootstrap.cc:492] T e891cda7a3bf4536a9729ebc2669c144 P 5a653ba4e41749d7b863fa58e89f6444: Bootstrap starting.
I20260709 12:23:03.964216  1693 ts_tablet_manager.cc:1434] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:23:03.965454  1693 tablet_bootstrap.cc:492] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241: Bootstrap starting.
I20260709 12:23:03.971536  1694 tablet_bootstrap.cc:654] T e891cda7a3bf4536a9729ebc2669c144 P 5a653ba4e41749d7b863fa58e89f6444: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.972597  1693 tablet_bootstrap.cc:654] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:03.972853  1468 leader_election.cc:343] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:03.958973  1696 raft_consensus.cc:359] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:03.974255  1696 raft_consensus.cc:385] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.974586  1696 raft_consensus.cc:740] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.975634  1696 consensus_queue.cc:260] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
W20260709 12:23:03.973124  1449 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:03.986006  1693 tablet_bootstrap.cc:492] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241: No bootstrap required, opened a new log
I20260709 12:23:03.986738  1693 ts_tablet_manager.cc:1403] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.015s
I20260709 12:23:03.986915  1696 ts_tablet_manager.cc:1434] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7: Time spent starting tablet: real 0.031s	user 0.011s	sys 0.003s
I20260709 12:23:03.988116  1696 tablet_bootstrap.cc:492] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7: Bootstrap starting.
I20260709 12:23:03.970922  1652 raft_consensus.cc:2468] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 1.
I20260709 12:23:03.996104  1696 tablet_bootstrap.cc:654] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.993600  1694 tablet_bootstrap.cc:492] T e891cda7a3bf4536a9729ebc2669c144 P 5a653ba4e41749d7b863fa58e89f6444: No bootstrap required, opened a new log
I20260709 12:23:03.997503  1694 ts_tablet_manager.cc:1403] T e891cda7a3bf4536a9729ebc2669c144 P 5a653ba4e41749d7b863fa58e89f6444: Time spent bootstrapping tablet: real 0.034s	user 0.022s	sys 0.000s
I20260709 12:23:03.998941  1466 leader_election.cc:304] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241; no voters: 683a2f1018404bbea77e99732b6baeb7
I20260709 12:23:03.999893  1708 raft_consensus.cc:2804] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:04.000680  1708 raft_consensus.cc:697] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Becoming Leader. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Running, Role: LEADER
I20260709 12:23:04.000566  1694 raft_consensus.cc:359] T e891cda7a3bf4536a9729ebc2669c144 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.001626  1694 raft_consensus.cc:385] T e891cda7a3bf4536a9729ebc2669c144 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.990100  1693 raft_consensus.cc:359] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.002388  1693 raft_consensus.cc:385] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.002195  1708 consensus_queue.cc:237] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.003589  1693 raft_consensus.cc:740] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.004840  1693 consensus_queue.cc:260] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.001973  1694 raft_consensus.cc:740] T e891cda7a3bf4536a9729ebc2669c144 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.006556  1694 consensus_queue.cc:260] T e891cda7a3bf4536a9729ebc2669c144 P 5a653ba4e41749d7b863fa58e89f6444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.007931  1693 ts_tablet_manager.cc:1434] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 12:23:04.009166  1693 tablet_bootstrap.cc:492] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241: Bootstrap starting.
I20260709 12:23:04.012002  1694 ts_tablet_manager.cc:1434] T e891cda7a3bf4536a9729ebc2669c144 P 5a653ba4e41749d7b863fa58e89f6444: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.005s
I20260709 12:23:04.016081  1694 tablet_bootstrap.cc:492] T 1d6923852b214d25b708fd501a7158fb P 5a653ba4e41749d7b863fa58e89f6444: Bootstrap starting.
I20260709 12:23:04.016381  1693 tablet_bootstrap.cc:654] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.032027  1399 catalog_manager.cc:5697] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7b98485eacd4e838f526f29916c9241 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "f7b98485eacd4e838f526f29916c9241" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:04.037966  1708 raft_consensus.cc:493] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.038652  1708 raft_consensus.cc:515] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } }
I20260709 12:23:04.039865  1694 tablet_bootstrap.cc:654] T 1d6923852b214d25b708fd501a7158fb P 5a653ba4e41749d7b863fa58e89f6444: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.042227  1696 tablet_bootstrap.cc:492] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7: No bootstrap required, opened a new log
I20260709 12:23:04.042085  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f062c725755040f99ed0fef6f284f193" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:04.043057  1696 ts_tablet_manager.cc:1403] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7: Time spent bootstrapping tablet: real 0.055s	user 0.041s	sys 0.010s
W20260709 12:23:04.044080  1466 leader_election.cc:343] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:04.047180  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f062c725755040f99ed0fef6f284f193" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:04.046963  1696 raft_consensus.cc:359] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.047969  1696 raft_consensus.cc:385] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.048358  1696 raft_consensus.cc:740] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Initialized, Role: FOLLOWER
W20260709 12:23:04.048938  1468 leader_election.cc:343] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:04.049479  1468 leader_election.cc:304] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f7b98485eacd4e838f526f29916c9241; no voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7
I20260709 12:23:04.049742  1708 leader_election.cc:290] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:04.049451  1696 consensus_queue.cc:260] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.053838  1696 ts_tablet_manager.cc:1434] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 12:23:04.055056  1696 tablet_bootstrap.cc:492] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7: Bootstrap starting.
I20260709 12:23:04.057178  1699 raft_consensus.cc:2749] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:04.057422  1708 raft_consensus.cc:493] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.058553  1694 tablet_bootstrap.cc:492] T 1d6923852b214d25b708fd501a7158fb P 5a653ba4e41749d7b863fa58e89f6444: No bootstrap required, opened a new log
I20260709 12:23:04.058524  1708 raft_consensus.cc:515] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.059417  1694 ts_tablet_manager.cc:1403] T 1d6923852b214d25b708fd501a7158fb P 5a653ba4e41749d7b863fa58e89f6444: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.010s
I20260709 12:23:04.066054  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6923852b214d25b708fd501a7158fb" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:04.066975  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6923852b214d25b708fd501a7158fb" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:04.067922  1708 leader_election.cc:290] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
W20260709 12:23:04.067838  1468 leader_election.cc:343] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:04.067691  1694 raft_consensus.cc:359] T 1d6923852b214d25b708fd501a7158fb P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.070971  1694 raft_consensus.cc:385] T 1d6923852b214d25b708fd501a7158fb P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.071466  1694 raft_consensus.cc:740] T 1d6923852b214d25b708fd501a7158fb P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.071684  1693 tablet_bootstrap.cc:492] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241: No bootstrap required, opened a new log
I20260709 12:23:04.072505  1693 ts_tablet_manager.cc:1403] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241: Time spent bootstrapping tablet: real 0.064s	user 0.038s	sys 0.014s
I20260709 12:23:04.072701  1694 consensus_queue.cc:260] T 1d6923852b214d25b708fd501a7158fb P 5a653ba4e41749d7b863fa58e89f6444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.074011  1652 raft_consensus.cc:2468] T 1d6923852b214d25b708fd501a7158fb P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 0.
I20260709 12:23:04.074738  1696 tablet_bootstrap.cc:654] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.076469  1693 raft_consensus.cc:359] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.077344  1693 raft_consensus.cc:385] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.077657  1693 raft_consensus.cc:740] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.078073  1466 leader_election.cc:304] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241; no voters: 683a2f1018404bbea77e99732b6baeb7
I20260709 12:23:04.078771  1693 consensus_queue.cc:260] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.079573  1708 raft_consensus.cc:2804] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:04.080008  1708 raft_consensus.cc:493] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.080359  1708 raft_consensus.cc:3060] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.081146  1694 ts_tablet_manager.cc:1434] T 1d6923852b214d25b708fd501a7158fb P 5a653ba4e41749d7b863fa58e89f6444: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.004s
I20260709 12:23:04.081621  1693 ts_tablet_manager.cc:1434] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:23:04.082792  1693 tablet_bootstrap.cc:492] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241: Bootstrap starting.
I20260709 12:23:04.082899  1694 tablet_bootstrap.cc:492] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444: Bootstrap starting.
I20260709 12:23:04.092971  1694 tablet_bootstrap.cc:654] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.093132  1702 raft_consensus.cc:493] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.093760  1702 raft_consensus.cc:515] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.097471  1696 tablet_bootstrap.cc:492] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7: No bootstrap required, opened a new log
I20260709 12:23:04.098181  1696 ts_tablet_manager.cc:1403] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.009s
I20260709 12:23:04.100845  1699 raft_consensus.cc:493] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.101687  1699 raft_consensus.cc:515] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.102142  1696 raft_consensus.cc:359] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } }
I20260709 12:23:04.103132  1696 raft_consensus.cc:385] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.103509  1696 raft_consensus.cc:740] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.104382  1696 consensus_queue.cc:260] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } }
I20260709 12:23:04.106521  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f963b0bc8284494bb00908db689b8a42" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:04.107244  1696 ts_tablet_manager.cc:1434] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:23:04.107632  1578 raft_consensus.cc:2468] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 0.
I20260709 12:23:04.108556  1696 tablet_bootstrap.cc:492] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7: Bootstrap starting.
I20260709 12:23:04.116858  1468 leader_election.cc:304] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 
I20260709 12:23:04.116518  1696 tablet_bootstrap.cc:654] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.121917  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f963b0bc8284494bb00908db689b8a42" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:04.122394  1725 raft_consensus.cc:2804] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:04.123064  1725 raft_consensus.cc:493] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.123464  1725 raft_consensus.cc:3060] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:04.124271  1466 leader_election.cc:343] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:04.126008  1702 leader_election.cc:290] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:04.126200  1708 raft_consensus.cc:515] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.126744  1699 leader_election.cc:290] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:04.130234  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6923852b214d25b708fd501a7158fb" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
W20260709 12:23:04.132359  1468 leader_election.cc:343] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:04.133292  1708 leader_election.cc:290] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 election: Requested vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:04.134123  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6923852b214d25b708fd501a7158fb" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:04.134949  1652 raft_consensus.cc:3060] T 1d6923852b214d25b708fd501a7158fb P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.136722  1696 tablet_bootstrap.cc:492] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7: No bootstrap required, opened a new log
I20260709 12:23:04.137395  1696 ts_tablet_manager.cc:1403] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.003s
I20260709 12:23:04.128288  1702 raft_consensus.cc:493] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.141012  1702 raft_consensus.cc:515] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.144235  1503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aad6b70d2340a0aeda7e4edd7c55d8" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:04.146282  1503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8decea69eec245aba482134428dcbfb9" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:04.146425  1696 raft_consensus.cc:359] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.147313  1696 raft_consensus.cc:385] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.147643  1696 raft_consensus.cc:740] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Initialized, Role: FOLLOWER
W20260709 12:23:04.148196  1616 leader_election.cc:343] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:04.149035  1616 leader_election.cc:343] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:04.149608  1694 tablet_bootstrap.cc:492] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444: No bootstrap required, opened a new log
I20260709 12:23:04.149428  1725 raft_consensus.cc:515] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.150262  1694 ts_tablet_manager.cc:1403] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444: Time spent bootstrapping tablet: real 0.068s	user 0.014s	sys 0.032s
I20260709 12:23:04.152679  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f963b0bc8284494bb00908db689b8a42" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
I20260709 12:23:04.153190  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f963b0bc8284494bb00908db689b8a42" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:04.153367  1578 raft_consensus.cc:3060] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.153031  1696 consensus_queue.cc:260] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.153959  1694 raft_consensus.cc:359] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.154793  1694 raft_consensus.cc:385] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.155121  1694 raft_consensus.cc:740] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.156210  1696 ts_tablet_manager.cc:1434] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:23:04.150131  1702 leader_election.cc:290] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:04.157567  1696 tablet_bootstrap.cc:492] T 30cddd6873234c5f9f6078f1fb193e4a P 683a2f1018404bbea77e99732b6baeb7: Bootstrap starting.
I20260709 12:23:04.153467  1725 leader_election.cc:290] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 election: Requested vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:04.164234  1577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aad6b70d2340a0aeda7e4edd7c55d8" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:04.165977  1577 raft_consensus.cc:2468] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a653ba4e41749d7b863fa58e89f6444 in term 0.
I20260709 12:23:04.166373  1696 tablet_bootstrap.cc:654] T 30cddd6873234c5f9f6078f1fb193e4a P 683a2f1018404bbea77e99732b6baeb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.167599  1617 leader_election.cc:304] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7; no voters: f7b98485eacd4e838f526f29916c9241
I20260709 12:23:04.164587  1694 consensus_queue.cc:260] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.165197  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8decea69eec245aba482134428dcbfb9" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:04.168915  1651 raft_consensus.cc:3060] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.169445  1576 raft_consensus.cc:2468] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a653ba4e41749d7b863fa58e89f6444 in term 0.
I20260709 12:23:04.170903  1617 leader_election.cc:304] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7; no voters: f7b98485eacd4e838f526f29916c9241
I20260709 12:23:04.172312  1702 raft_consensus.cc:2804] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:04.172844  1702 raft_consensus.cc:493] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.173257  1702 raft_consensus.cc:3060] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.178925  1696 tablet_bootstrap.cc:492] T 30cddd6873234c5f9f6078f1fb193e4a P 683a2f1018404bbea77e99732b6baeb7: No bootstrap required, opened a new log
I20260709 12:23:04.179384  1651 raft_consensus.cc:2468] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 1.
I20260709 12:23:04.179618  1696 ts_tablet_manager.cc:1403] T 30cddd6873234c5f9f6078f1fb193e4a P 683a2f1018404bbea77e99732b6baeb7: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.009s
I20260709 12:23:04.181361  1578 raft_consensus.cc:2468] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 1.
I20260709 12:23:04.182420  1729 raft_consensus.cc:2804] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:04.182938  1729 raft_consensus.cc:493] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.183259  1468 leader_election.cc:304] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 
I20260709 12:23:04.093272  1693 tablet_bootstrap.cc:654] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.184286  1725 raft_consensus.cc:2804] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:04.184857  1725 raft_consensus.cc:697] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Becoming Leader. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Running, Role: LEADER
I20260709 12:23:04.185932  1725 consensus_queue.cc:237] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.187598  1694 ts_tablet_manager.cc:1434] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.002s
I20260709 12:23:04.188822  1694 tablet_bootstrap.cc:492] T 30cddd6873234c5f9f6078f1fb193e4a P 5a653ba4e41749d7b863fa58e89f6444: Bootstrap starting.
I20260709 12:23:04.183265  1729 raft_consensus.cc:3060] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.179735  1652 raft_consensus.cc:2468] T 1d6923852b214d25b708fd501a7158fb P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 1.
I20260709 12:23:04.183629  1696 raft_consensus.cc:359] T 30cddd6873234c5f9f6078f1fb193e4a P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.193257  1466 leader_election.cc:304] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241; no voters: 683a2f1018404bbea77e99732b6baeb7
I20260709 12:23:04.194308  1708 raft_consensus.cc:2804] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:04.195052  1708 raft_consensus.cc:697] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Becoming Leader. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Running, Role: LEADER
I20260709 12:23:04.196310  1708 consensus_queue.cc:237] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.193439  1696 raft_consensus.cc:385] T 30cddd6873234c5f9f6078f1fb193e4a P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.203260  1702 raft_consensus.cc:515] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.204030  1696 raft_consensus.cc:740] T 30cddd6873234c5f9f6078f1fb193e4a P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.206807  1696 consensus_queue.cc:260] T 30cddd6873234c5f9f6078f1fb193e4a P 683a2f1018404bbea77e99732b6baeb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.210922  1702 leader_election.cc:290] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:04.212970  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aad6b70d2340a0aeda7e4edd7c55d8" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
I20260709 12:23:04.212970  1503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aad6b70d2340a0aeda7e4edd7c55d8" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241"
W20260709 12:23:04.217363  1616 leader_election.cc:343] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:04.214025  1578 raft_consensus.cc:3060] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.221155  1694 tablet_bootstrap.cc:654] T 30cddd6873234c5f9f6078f1fb193e4a P 5a653ba4e41749d7b863fa58e89f6444: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.222223  1696 ts_tablet_manager.cc:1434] T 30cddd6873234c5f9f6078f1fb193e4a P 683a2f1018404bbea77e99732b6baeb7: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.004s
I20260709 12:23:04.223021  1701 raft_consensus.cc:493] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.223613  1696 tablet_bootstrap.cc:492] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7: Bootstrap starting.
I20260709 12:23:04.223628  1701 raft_consensus.cc:515] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.220009  1729 raft_consensus.cc:515] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.231262  1729 leader_election.cc:290] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:04.231684  1696 tablet_bootstrap.cc:654] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.231599  1503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8decea69eec245aba482134428dcbfb9" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:04.232779  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8decea69eec245aba482134428dcbfb9" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
W20260709 12:23:04.233678  1616 leader_election.cc:343] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:04.233700  1576 raft_consensus.cc:3060] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.221421  1399 catalog_manager.cc:5697] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7b98485eacd4e838f526f29916c9241 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "f7b98485eacd4e838f526f29916c9241" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:04.247138  1701 leader_election.cc:290] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:04.251565  1693 tablet_bootstrap.cc:492] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241: No bootstrap required, opened a new log
I20260709 12:23:04.257006  1693 ts_tablet_manager.cc:1403] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241: Time spent bootstrapping tablet: real 0.174s	user 0.024s	sys 0.015s
I20260709 12:23:04.261647  1693 raft_consensus.cc:359] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.228904  1578 raft_consensus.cc:2468] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a653ba4e41749d7b863fa58e89f6444 in term 1.
I20260709 12:23:04.265049  1617 leader_election.cc:304] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7; no voters: f7b98485eacd4e838f526f29916c9241
I20260709 12:23:04.265368  1696 tablet_bootstrap.cc:492] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7: No bootstrap required, opened a new log
I20260709 12:23:04.265906  1696 ts_tablet_manager.cc:1403] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.030s
I20260709 12:23:04.266336  1729 raft_consensus.cc:2804] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:04.266904  1729 raft_consensus.cc:697] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 LEADER]: Becoming Leader. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Running, Role: LEADER
I20260709 12:23:04.267729  1729 consensus_queue.cc:237] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.268695  1696 raft_consensus.cc:359] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.269387  1696 raft_consensus.cc:385] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.269634  1696 raft_consensus.cc:740] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.270274  1696 consensus_queue.cc:260] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.255748  1576 raft_consensus.cc:2468] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a653ba4e41749d7b863fa58e89f6444 in term 1.
I20260709 12:23:04.272368  1696 ts_tablet_manager.cc:1434] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:04.273155  1617 leader_election.cc:304] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7; no voters: f7b98485eacd4e838f526f29916c9241
I20260709 12:23:04.274077  1702 raft_consensus.cc:2804] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:04.274775  1702 raft_consensus.cc:697] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 LEADER]: Becoming Leader. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Running, Role: LEADER
I20260709 12:23:04.275441  1693 raft_consensus.cc:385] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.275930  1702 consensus_queue.cc:237] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.279917  1693 raft_consensus.cc:740] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.280875  1693 consensus_queue.cc:260] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.277102  1696 tablet_bootstrap.cc:492] T aef1ee0de44340bcac5c557df76496bc P 683a2f1018404bbea77e99732b6baeb7: Bootstrap starting.
I20260709 12:23:04.293785  1693 ts_tablet_manager.cc:1434] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 12:23:04.295536  1693 tablet_bootstrap.cc:492] T e891cda7a3bf4536a9729ebc2669c144 P f7b98485eacd4e838f526f29916c9241: Bootstrap starting.
I20260709 12:23:04.298177  1696 tablet_bootstrap.cc:654] T aef1ee0de44340bcac5c557df76496bc P 683a2f1018404bbea77e99732b6baeb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.301165  1725 raft_consensus.cc:493] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.302124  1725 raft_consensus.cc:515] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.306907  1399 catalog_manager.cc:5697] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7b98485eacd4e838f526f29916c9241 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "f7b98485eacd4e838f526f29916c9241" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:04.310179  1725 leader_election.cc:290] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:04.310499  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cddd6873234c5f9f6078f1fb193e4a" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
W20260709 12:23:04.316840  1466 leader_election.cc:343] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:04.319949  1694 tablet_bootstrap.cc:492] T 30cddd6873234c5f9f6078f1fb193e4a P 5a653ba4e41749d7b863fa58e89f6444: No bootstrap required, opened a new log
I20260709 12:23:04.320701  1694 ts_tablet_manager.cc:1403] T 30cddd6873234c5f9f6078f1fb193e4a P 5a653ba4e41749d7b863fa58e89f6444: Time spent bootstrapping tablet: real 0.132s	user 0.039s	sys 0.044s
I20260709 12:23:04.324126  1694 raft_consensus.cc:359] T 30cddd6873234c5f9f6078f1fb193e4a P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.325034  1694 raft_consensus.cc:385] T 30cddd6873234c5f9f6078f1fb193e4a P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.325357  1694 raft_consensus.cc:740] T 30cddd6873234c5f9f6078f1fb193e4a P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.326025  1701 raft_consensus.cc:493] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.326360  1694 consensus_queue.cc:260] T 30cddd6873234c5f9f6078f1fb193e4a P 5a653ba4e41749d7b863fa58e89f6444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.326653  1701 raft_consensus.cc:515] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.329074  1701 leader_election.cc:290] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:04.329366  1694 ts_tablet_manager.cc:1434] T 30cddd6873234c5f9f6078f1fb193e4a P 5a653ba4e41749d7b863fa58e89f6444: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:23:04.330766  1694 tablet_bootstrap.cc:492] T aef1ee0de44340bcac5c557df76496bc P 5a653ba4e41749d7b863fa58e89f6444: Bootstrap starting.
I20260709 12:23:04.330911  1725 raft_consensus.cc:493] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.331619  1725 raft_consensus.cc:515] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.333076  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cddd6873234c5f9f6078f1fb193e4a" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:04.333858  1576 raft_consensus.cc:2468] T 30cddd6873234c5f9f6078f1fb193e4a P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 0.
I20260709 12:23:04.335078  1468 leader_election.cc:304] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 5a653ba4e41749d7b863fa58e89f6444
I20260709 12:23:04.336494  1708 raft_consensus.cc:2804] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:04.336901  1708 raft_consensus.cc:493] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.337255  1708 raft_consensus.cc:3060] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.337363  1725 leader_election.cc:290] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:04.338671  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef1ee0de44340bcac5c557df76496bc" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:04.338514  1399 catalog_manager.cc:5697] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "5a653ba4e41749d7b863fa58e89f6444" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:04.340534  1466 leader_election.cc:343] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:04.340925  1693 tablet_bootstrap.cc:654] T e891cda7a3bf4536a9729ebc2669c144 P f7b98485eacd4e838f526f29916c9241: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.341142  1694 tablet_bootstrap.cc:654] T aef1ee0de44340bcac5c557df76496bc P 5a653ba4e41749d7b863fa58e89f6444: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.347829  1696 tablet_bootstrap.cc:492] T aef1ee0de44340bcac5c557df76496bc P 683a2f1018404bbea77e99732b6baeb7: No bootstrap required, opened a new log
I20260709 12:23:04.348558  1696 ts_tablet_manager.cc:1403] T aef1ee0de44340bcac5c557df76496bc P 683a2f1018404bbea77e99732b6baeb7: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.014s
I20260709 12:23:04.352674  1696 raft_consensus.cc:359] T aef1ee0de44340bcac5c557df76496bc P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.353474  1696 raft_consensus.cc:385] T aef1ee0de44340bcac5c557df76496bc P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.353777  1696 raft_consensus.cc:740] T aef1ee0de44340bcac5c557df76496bc P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.354318  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef1ee0de44340bcac5c557df76496bc" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:04.354511  1696 consensus_queue.cc:260] T aef1ee0de44340bcac5c557df76496bc P 683a2f1018404bbea77e99732b6baeb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.355583  1576 raft_consensus.cc:2468] T aef1ee0de44340bcac5c557df76496bc P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 0.
I20260709 12:23:04.357048  1696 ts_tablet_manager.cc:1434] T aef1ee0de44340bcac5c557df76496bc P 683a2f1018404bbea77e99732b6baeb7: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:23:04.357318  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e891cda7a3bf4536a9729ebc2669c144" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:04.358016  1651 raft_consensus.cc:2468] T e891cda7a3bf4536a9729ebc2669c144 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 0.
I20260709 12:23:04.359918  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1d51316b514da6932b968cef61ed95" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:04.360729  1651 raft_consensus.cc:2393] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 683a2f1018404bbea77e99732b6baeb7 in current term 1: Already voted for candidate f7b98485eacd4e838f526f29916c9241 in this term.
I20260709 12:23:04.362263  1541 leader_election.cc:304] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7; no voters: 
I20260709 12:23:04.363193  1701 raft_consensus.cc:2804] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:04.363682  1701 raft_consensus.cc:493] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.364732  1701 raft_consensus.cc:3060] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.364362  1693 tablet_bootstrap.cc:492] T e891cda7a3bf4536a9729ebc2669c144 P f7b98485eacd4e838f526f29916c9241: No bootstrap required, opened a new log
I20260709 12:23:04.366355  1693 ts_tablet_manager.cc:1403] T e891cda7a3bf4536a9729ebc2669c144 P f7b98485eacd4e838f526f29916c9241: Time spent bootstrapping tablet: real 0.071s	user 0.013s	sys 0.007s
I20260709 12:23:04.367636  1694 tablet_bootstrap.cc:492] T aef1ee0de44340bcac5c557df76496bc P 5a653ba4e41749d7b863fa58e89f6444: No bootstrap required, opened a new log
I20260709 12:23:04.368273  1694 ts_tablet_manager.cc:1403] T aef1ee0de44340bcac5c557df76496bc P 5a653ba4e41749d7b863fa58e89f6444: Time spent bootstrapping tablet: real 0.038s	user 0.022s	sys 0.005s
I20260709 12:23:04.369709  1693 raft_consensus.cc:359] T e891cda7a3bf4536a9729ebc2669c144 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.371240  1693 raft_consensus.cc:385] T e891cda7a3bf4536a9729ebc2669c144 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.371640  1693 raft_consensus.cc:740] T e891cda7a3bf4536a9729ebc2669c144 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.371400  1694 raft_consensus.cc:359] T aef1ee0de44340bcac5c557df76496bc P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.371945  1468 leader_election.cc:304] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 5a653ba4e41749d7b863fa58e89f6444
I20260709 12:23:04.373027  1725 raft_consensus.cc:2804] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:04.372740  1693 consensus_queue.cc:260] T e891cda7a3bf4536a9729ebc2669c144 P f7b98485eacd4e838f526f29916c9241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.373476  1725 raft_consensus.cc:493] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.373908  1725 raft_consensus.cc:3060] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.373744  1503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e891cda7a3bf4536a9729ebc2669c144" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:04.375087  1503 raft_consensus.cc:2468] T e891cda7a3bf4536a9729ebc2669c144 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 0.
I20260709 12:23:04.375550  1693 ts_tablet_manager.cc:1434] T e891cda7a3bf4536a9729ebc2669c144 P f7b98485eacd4e838f526f29916c9241: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:23:04.376804  1693 tablet_bootstrap.cc:492] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241: Bootstrap starting.
I20260709 12:23:04.373749  1701 raft_consensus.cc:515] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.380121  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e891cda7a3bf4536a9729ebc2669c144" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:04.380882  1651 raft_consensus.cc:3060] T e891cda7a3bf4536a9729ebc2669c144 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.363492  1708 raft_consensus.cc:515] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.384373  1694 raft_consensus.cc:385] T aef1ee0de44340bcac5c557df76496bc P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.384793  1694 raft_consensus.cc:740] T aef1ee0de44340bcac5c557df76496bc P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.385113  1693 tablet_bootstrap.cc:654] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.385895  1503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1d51316b514da6932b968cef61ed95" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:04.386931  1708 leader_election.cc:290] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 election: Requested vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:04.387272  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cddd6873234c5f9f6078f1fb193e4a" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:04.388129  1652 raft_consensus.cc:3060] T 30cddd6873234c5f9f6078f1fb193e4a P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.388955  1694 consensus_queue.cc:260] T aef1ee0de44340bcac5c557df76496bc P 5a653ba4e41749d7b863fa58e89f6444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.390053  1725 raft_consensus.cc:515] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.392426  1401 catalog_manager.cc:5697] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "5a653ba4e41749d7b863fa58e89f6444" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:04.393409  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cddd6873234c5f9f6078f1fb193e4a" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
I20260709 12:23:04.394297  1694 ts_tablet_manager.cc:1434] T aef1ee0de44340bcac5c557df76496bc P 5a653ba4e41749d7b863fa58e89f6444: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.001s
I20260709 12:23:04.394531  1576 raft_consensus.cc:3060] T 30cddd6873234c5f9f6078f1fb193e4a P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.395438  1694 tablet_bootstrap.cc:492] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444: Bootstrap starting.
I20260709 12:23:04.398756  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef1ee0de44340bcac5c557df76496bc" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:04.399501  1650 raft_consensus.cc:3060] T aef1ee0de44340bcac5c557df76496bc P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.401314  1542 leader_election.cc:304] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7; no voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241
I20260709 12:23:04.403231  1503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e891cda7a3bf4536a9729ebc2669c144" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:04.403879  1503 raft_consensus.cc:3060] T e891cda7a3bf4536a9729ebc2669c144 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.404306  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef1ee0de44340bcac5c557df76496bc" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
I20260709 12:23:04.405519  1578 raft_consensus.cc:3060] T aef1ee0de44340bcac5c557df76496bc P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.408388  1725 leader_election.cc:290] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 election: Requested vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:04.409868  1650 raft_consensus.cc:2468] T aef1ee0de44340bcac5c557df76496bc P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 1.
I20260709 12:23:04.411301  1466 leader_election.cc:304] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241; no voters: 
I20260709 12:23:04.412388  1725 raft_consensus.cc:2804] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:04.413188  1725 raft_consensus.cc:697] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Becoming Leader. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Running, Role: LEADER
I20260709 12:23:04.414197  1725 consensus_queue.cc:237] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.418620  1651 raft_consensus.cc:2468] T e891cda7a3bf4536a9729ebc2669c144 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 1.
I20260709 12:23:04.428776  1694 tablet_bootstrap.cc:654] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:04.430419  1701 leader_election.cc:290] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:04.431834  1701 raft_consensus.cc:3060] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.441952  1576 raft_consensus.cc:2468] T 30cddd6873234c5f9f6078f1fb193e4a P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 1.
I20260709 12:23:04.443717  1503 raft_consensus.cc:2468] T e891cda7a3bf4536a9729ebc2669c144 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 1.
I20260709 12:23:04.444602  1652 raft_consensus.cc:2468] T 30cddd6873234c5f9f6078f1fb193e4a P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 1.
I20260709 12:23:04.446614  1541 leader_election.cc:304] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7; no voters: 
I20260709 12:23:04.454336  1694 tablet_bootstrap.cc:492] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444: No bootstrap required, opened a new log
I20260709 12:23:04.455282  1694 ts_tablet_manager.cc:1403] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.002s
I20260709 12:23:04.455555  1468 leader_election.cc:304] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 
I20260709 12:23:04.447237  1708 consensus_queue.cc:1048] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:23:04.458213  1708 raft_consensus.cc:2804] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:04.459236  1708 raft_consensus.cc:697] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Becoming Leader. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Running, Role: LEADER
I20260709 12:23:04.459877  1694 raft_consensus.cc:359] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } }
I20260709 12:23:04.460974  1694 raft_consensus.cc:385] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.460404  1708 consensus_queue.cc:237] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.461300  1694 raft_consensus.cc:740] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.462641  1744 raft_consensus.cc:2804] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:04.462453  1694 consensus_queue.cc:260] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } }
I20260709 12:23:04.464644  1744 raft_consensus.cc:697] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7 [term 1 LEADER]: Becoming Leader. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Running, Role: LEADER
I20260709 12:23:04.465236  1694 ts_tablet_manager.cc:1434] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.002s
I20260709 12:23:04.465720  1744 consensus_queue.cc:237] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.449599  1578 raft_consensus.cc:2468] T aef1ee0de44340bcac5c557df76496bc P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 1.
I20260709 12:23:04.464221  1399 catalog_manager.cc:5697] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7b98485eacd4e838f526f29916c9241 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "f7b98485eacd4e838f526f29916c9241" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:04.479796  1693 tablet_bootstrap.cc:492] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241: No bootstrap required, opened a new log
I20260709 12:23:04.480293  1693 ts_tablet_manager.cc:1403] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241: Time spent bootstrapping tablet: real 0.104s	user 0.037s	sys 0.044s
I20260709 12:23:04.465664  1748 raft_consensus.cc:493] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.493448  1693 raft_consensus.cc:359] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.494455  1747 raft_consensus.cc:493] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.495325  1747 raft_consensus.cc:515] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } }
I20260709 12:23:04.491640  1701 raft_consensus.cc:2749] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:04.500046  1503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f062c725755040f99ed0fef6f284f193" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:04.501008  1503 raft_consensus.cc:2468] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 0.
I20260709 12:23:04.505491  1401 catalog_manager.cc:5697] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "683a2f1018404bbea77e99732b6baeb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:04.509822  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f062c725755040f99ed0fef6f284f193" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:04.510895  1652 raft_consensus.cc:2468] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 0.
I20260709 12:23:04.514213  1542 leader_election.cc:304] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 
I20260709 12:23:04.521744  1744 raft_consensus.cc:2804] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:04.521476  1748 raft_consensus.cc:515] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.494482  1693 raft_consensus.cc:385] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:04.522855  1693 raft_consensus.cc:740] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Initialized, Role: FOLLOWER
I20260709 12:23:04.523649  1747 leader_election.cc:290] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:04.523768  1693 consensus_queue.cc:260] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.530897  1693 ts_tablet_manager.cc:1434] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 12:23:04.532243  1503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6923852b214d25b708fd501a7158fb" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:04.533438  1748 leader_election.cc:290] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:04.522420  1744 raft_consensus.cc:493] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.540227  1744 raft_consensus.cc:3060] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.541690  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6923852b214d25b708fd501a7158fb" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:04.542716  1651 raft_consensus.cc:2393] T 1d6923852b214d25b708fd501a7158fb P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 683a2f1018404bbea77e99732b6baeb7 in current term 1: Already voted for candidate f7b98485eacd4e838f526f29916c9241 in this term.
I20260709 12:23:04.543133  1699 consensus_queue.cc:1048] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:04.544239  1541 leader_election.cc:304] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7; no voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241
I20260709 12:23:04.545363  1748 raft_consensus.cc:3060] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.552086  1401 catalog_manager.cc:5697] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7b98485eacd4e838f526f29916c9241 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "f7b98485eacd4e838f526f29916c9241" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:04.553542  1744 raft_consensus.cc:515] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } }
I20260709 12:23:04.558840  1748 raft_consensus.cc:2749] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:04.559278  1503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f062c725755040f99ed0fef6f284f193" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:04.559986  1503 raft_consensus.cc:3060] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.567422  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f062c725755040f99ed0fef6f284f193" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:04.568194  1651 raft_consensus.cc:3060] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.568849  1503 raft_consensus.cc:2468] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 1.
I20260709 12:23:04.567430  1744 leader_election.cc:290] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:04.571100  1542 leader_election.cc:304] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 
I20260709 12:23:04.572438  1744 raft_consensus.cc:2804] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:04.573228  1744 raft_consensus.cc:697] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 1 LEADER]: Becoming Leader. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Running, Role: LEADER
I20260709 12:23:04.574154  1744 consensus_queue.cc:237] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } }
I20260709 12:23:04.578161  1725 consensus_queue.cc:1048] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:04.581583  1651 raft_consensus.cc:2468] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 1.
I20260709 12:23:04.586169  1400 catalog_manager.cc:5697] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "683a2f1018404bbea77e99732b6baeb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:04.592530  1699 consensus_queue.cc:1048] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:04.597522  1699 raft_consensus.cc:493] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.598062  1699 raft_consensus.cc:515] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.601636  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aad6b70d2340a0aeda7e4edd7c55d8" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:04.602550  1576 raft_consensus.cc:2393] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f7b98485eacd4e838f526f29916c9241 in current term 1: Already voted for candidate 5a653ba4e41749d7b863fa58e89f6444 in this term.
I20260709 12:23:04.605738  1699 leader_election.cc:290] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:04.606415  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aad6b70d2340a0aeda7e4edd7c55d8" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:04.607813  1466 leader_election.cc:304] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f7b98485eacd4e838f526f29916c9241; no voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7
I20260709 12:23:04.608768  1699 raft_consensus.cc:3060] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.614909  1699 raft_consensus.cc:2749] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:04.644518  1578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f062c725755040f99ed0fef6f284f193"
dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
mode: GRACEFUL
new_leader_uuid: "f7b98485eacd4e838f526f29916c9241"
 from {username='slave'} at 127.0.0.1:36484
I20260709 12:23:04.645380  1578 raft_consensus.cc:606] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 1 LEADER]: Received request to transfer leadership to TS f7b98485eacd4e838f526f29916c9241
I20260709 12:23:04.660091  1699 consensus_queue.cc:1048] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:04.664364  1652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3aad6b70d2340a0aeda7e4edd7c55d8"
dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
mode: GRACEFUL
new_leader_uuid: "f7b98485eacd4e838f526f29916c9241"
 from {username='slave'} at 127.0.0.1:40566
I20260709 12:23:04.665145  1652 raft_consensus.cc:606] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 LEADER]: Received request to transfer leadership to TS f7b98485eacd4e838f526f29916c9241
I20260709 12:23:04.682258  1729 consensus_queue.cc:1048] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:04.686280  1725 consensus_queue.cc:1048] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:04.697386  1502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f963b0bc8284494bb00908db689b8a42"
dest_uuid: "f7b98485eacd4e838f526f29916c9241"
mode: GRACEFUL
new_leader_uuid: "683a2f1018404bbea77e99732b6baeb7"
 from {username='slave'} at 127.0.0.1:34816
I20260709 12:23:04.698375  1502 raft_consensus.cc:606] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Received request to transfer leadership to TS 683a2f1018404bbea77e99732b6baeb7
I20260709 12:23:04.708132  1730 raft_consensus.cc:993] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444: : Instructing follower f7b98485eacd4e838f526f29916c9241 to start an election
I20260709 12:23:04.708671  1730 raft_consensus.cc:1081] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 LEADER]: Signalling peer f7b98485eacd4e838f526f29916c9241 to start an election
I20260709 12:23:04.710964  1502 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3aad6b70d2340a0aeda7e4edd7c55d8"
dest_uuid: "f7b98485eacd4e838f526f29916c9241"
 from {username='slave'} at 127.0.0.1:34800
I20260709 12:23:04.711079  1501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d6923852b214d25b708fd501a7158fb"
dest_uuid: "f7b98485eacd4e838f526f29916c9241"
mode: GRACEFUL
new_leader_uuid: "683a2f1018404bbea77e99732b6baeb7"
 from {username='slave'} at 127.0.0.1:34816
I20260709 12:23:04.711704  1502 raft_consensus.cc:493] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:04.711949  1501 raft_consensus.cc:606] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Received request to transfer leadership to TS 683a2f1018404bbea77e99732b6baeb7
I20260709 12:23:04.712299  1502 raft_consensus.cc:3060] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.717087  1702 consensus_queue.cc:1048] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [LEADER]: Connected to new peer: Peer: permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:04.720949  1502 raft_consensus.cc:515] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.724707  1652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8decea69eec245aba482134428dcbfb9"
dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
mode: GRACEFUL
new_leader_uuid: "683a2f1018404bbea77e99732b6baeb7"
 from {username='slave'} at 127.0.0.1:40566
I20260709 12:23:04.725190  1503 raft_consensus.cc:1240] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Rejecting Update request from peer 5a653ba4e41749d7b863fa58e89f6444 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:04.725508  1652 raft_consensus.cc:606] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 LEADER]: Received request to transfer leadership to TS 683a2f1018404bbea77e99732b6baeb7
I20260709 12:23:04.726807  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aad6b70d2340a0aeda7e4edd7c55d8" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
I20260709 12:23:04.728983  1702 consensus_queue.cc:1059] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:04.729797  1502 leader_election.cc:290] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 2 election: Requested vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:04.730022  1702 raft_consensus.cc:3055] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:04.730470  1702 raft_consensus.cc:740] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Running, Role: LEADER
I20260709 12:23:04.731292  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aad6b70d2340a0aeda7e4edd7c55d8" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:04.731408  1702 consensus_queue.cc:260] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.732796  1702 raft_consensus.cc:3060] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.734717  1502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aef1ee0de44340bcac5c557df76496bc"
dest_uuid: "f7b98485eacd4e838f526f29916c9241"
mode: GRACEFUL
new_leader_uuid: "5a653ba4e41749d7b863fa58e89f6444"
 from {username='slave'} at 127.0.0.1:34816
I20260709 12:23:04.735463  1502 raft_consensus.cc:606] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Received request to transfer leadership to TS 5a653ba4e41749d7b863fa58e89f6444
I20260709 12:23:04.748400  1652 raft_consensus.cc:2468] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 2.
I20260709 12:23:04.750540  1466 leader_election.cc:304] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241; no voters: 683a2f1018404bbea77e99732b6baeb7
I20260709 12:23:04.751317  1725 raft_consensus.cc:2804] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:04.751780  1725 raft_consensus.cc:697] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [term 2 LEADER]: Becoming Leader. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Running, Role: LEADER
I20260709 12:23:04.752667  1725 consensus_queue.cc:237] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.759775  1399 catalog_manager.cc:5697] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 reported cstate change: term changed from 1 to 2, leader changed from 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195) to f7b98485eacd4e838f526f29916c9241 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "f7b98485eacd4e838f526f29916c9241" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:04.794206  1725 raft_consensus.cc:493] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.794900  1725 raft_consensus.cc:515] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.797024  1725 leader_election.cc:290] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:04.797937  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8decea69eec245aba482134428dcbfb9" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:04.798228  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8decea69eec245aba482134428dcbfb9" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:04.798911  1578 raft_consensus.cc:2393] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f7b98485eacd4e838f526f29916c9241 in current term 1: Already voted for candidate 5a653ba4e41749d7b863fa58e89f6444 in this term.
I20260709 12:23:04.800060  1468 leader_election.cc:304] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f7b98485eacd4e838f526f29916c9241; no voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7
I20260709 12:23:04.800890  1725 raft_consensus.cc:3060] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:04.807220  1725 raft_consensus.cc:2749] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:04.810160  1702 consensus_queue.cc:1048] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:04.813763  1761 consensus_queue.cc:1048] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:04.823189  1730 consensus_queue.cc:1048] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [LEADER]: Connected to new peer: Peer: permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:04.828389  1725 raft_consensus.cc:993] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241: : Instructing follower 5a653ba4e41749d7b863fa58e89f6444 to start an election
I20260709 12:23:04.829054  1725 raft_consensus.cc:1081] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Signalling peer 5a653ba4e41749d7b863fa58e89f6444 to start an election
I20260709 12:23:04.836436  1761 consensus_queue.cc:1048] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:04.841765  1767 raft_consensus.cc:993] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444: : Instructing follower 683a2f1018404bbea77e99732b6baeb7 to start an election
I20260709 12:23:04.842299  1767 raft_consensus.cc:1081] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 LEADER]: Signalling peer 683a2f1018404bbea77e99732b6baeb7 to start an election
I20260709 12:23:04.844389  1578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8decea69eec245aba482134428dcbfb9"
dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
 from {username='slave'} at 127.0.0.1:36480
I20260709 12:23:04.845019  1578 raft_consensus.cc:493] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:04.845395  1578 raft_consensus.cc:3060] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.848094  1652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aef1ee0de44340bcac5c557df76496bc"
dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
 from {username='slave'} at 127.0.0.1:40548
I20260709 12:23:04.848804  1652 raft_consensus.cc:493] T aef1ee0de44340bcac5c557df76496bc P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:04.849167  1652 raft_consensus.cc:3060] T aef1ee0de44340bcac5c557df76496bc P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.854053  1578 raft_consensus.cc:515] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.856585  1578 leader_election.cc:290] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 2 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:04.858423  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8decea69eec245aba482134428dcbfb9" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:04.859033  1651 raft_consensus.cc:3055] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:04.858790  1652 raft_consensus.cc:515] T aef1ee0de44340bcac5c557df76496bc P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.859449  1651 raft_consensus.cc:740] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Running, Role: LEADER
I20260709 12:23:04.860389  1651 consensus_queue.cc:260] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.861121  1502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8decea69eec245aba482134428dcbfb9" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:04.861426  1652 leader_election.cc:290] T aef1ee0de44340bcac5c557df76496bc P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 2 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:04.861824  1502 raft_consensus.cc:3060] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.863005  1503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef1ee0de44340bcac5c557df76496bc" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:04.863508  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef1ee0de44340bcac5c557df76496bc" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
I20260709 12:23:04.863672  1503 raft_consensus.cc:3055] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:04.865366  1503 raft_consensus.cc:740] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Running, Role: LEADER
I20260709 12:23:04.864279  1578 raft_consensus.cc:3060] T aef1ee0de44340bcac5c557df76496bc P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.866245  1503 consensus_queue.cc:260] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.866247  1651 raft_consensus.cc:3060] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.867801  1503 raft_consensus.cc:3060] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.870956  1502 raft_consensus.cc:2468] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 2.
I20260709 12:23:04.872419  1542 leader_election.cc:304] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 
I20260709 12:23:04.873273  1748 raft_consensus.cc:2804] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:04.873734  1748 raft_consensus.cc:697] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [term 2 LEADER]: Becoming Leader. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Running, Role: LEADER
I20260709 12:23:04.874594  1748 consensus_queue.cc:237] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.874814  1747 consensus_queue.cc:1048] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:04.874871  1578 raft_consensus.cc:2468] T aef1ee0de44340bcac5c557df76496bc P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a653ba4e41749d7b863fa58e89f6444 in term 2.
I20260709 12:23:04.876765  1617 leader_election.cc:304] T aef1ee0de44340bcac5c557df76496bc P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7; no voters: 
I20260709 12:23:04.877678  1730 raft_consensus.cc:2804] T aef1ee0de44340bcac5c557df76496bc P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:04.878223  1730 raft_consensus.cc:697] T aef1ee0de44340bcac5c557df76496bc P 5a653ba4e41749d7b863fa58e89f6444 [term 2 LEADER]: Becoming Leader. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Running, Role: LEADER
I20260709 12:23:04.879069  1730 consensus_queue.cc:237] T aef1ee0de44340bcac5c557df76496bc P 5a653ba4e41749d7b863fa58e89f6444 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:04.882098  1503 raft_consensus.cc:2468] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a653ba4e41749d7b863fa58e89f6444 in term 2.
I20260709 12:23:04.878913  1651 raft_consensus.cc:2468] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 2.
I20260709 12:23:04.887368  1400 catalog_manager.cc:5697] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 reported cstate change: term changed from 1 to 2, leader changed from 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195) to 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194). New cstate: current_term: 2 leader_uuid: "683a2f1018404bbea77e99732b6baeb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:04.893136  1399 catalog_manager.cc:5697] T aef1ee0de44340bcac5c557df76496bc P 5a653ba4e41749d7b863fa58e89f6444 reported cstate change: term changed from 1 to 2, leader changed from f7b98485eacd4e838f526f29916c9241 (127.22.155.193) to 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195). New cstate: current_term: 2 leader_uuid: "5a653ba4e41749d7b863fa58e89f6444" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:04.895260  1747 consensus_queue.cc:1048] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:04.977588  1744 consensus_queue.cc:1048] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:04.986101  1747 raft_consensus.cc:993] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7: : Instructing follower f7b98485eacd4e838f526f29916c9241 to start an election
I20260709 12:23:04.986683  1748 raft_consensus.cc:1081] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 1 LEADER]: Signalling peer f7b98485eacd4e838f526f29916c9241 to start an election
I20260709 12:23:04.989828  1503 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f062c725755040f99ed0fef6f284f193"
dest_uuid: "f7b98485eacd4e838f526f29916c9241"
 from {username='slave'} at 127.0.0.1:34814
I20260709 12:23:04.990491  1503 raft_consensus.cc:493] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:04.990865  1503 raft_consensus.cc:3060] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.996438  1701 consensus_queue.cc:1048] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:05.000510  1503 raft_consensus.cc:515] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } }
I20260709 12:23:05.004549  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f062c725755040f99ed0fef6f284f193" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:05.004814  1503 leader_election.cc:290] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 2 election: Requested vote from peers 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:05.005478  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f062c725755040f99ed0fef6f284f193" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
I20260709 12:23:05.006228  1578 raft_consensus.cc:3055] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:05.006541  1578 raft_consensus.cc:740] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Running, Role: LEADER
I20260709 12:23:05.007416  1578 consensus_queue.cc:260] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } }
W20260709 12:23:05.008394  1701 consensus_queue.cc:1175] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5a653ba4e41749d7b863fa58e89f6444" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:23:05.009517  1578 raft_consensus.cc:3060] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.016551  1578 raft_consensus.cc:2468] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 2.
I20260709 12:23:05.017848  1468 leader_election.cc:304] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 5a653ba4e41749d7b863fa58e89f6444
I20260709 12:23:05.018692  1761 raft_consensus.cc:2804] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:05.019179  1761 raft_consensus.cc:697] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 2 LEADER]: Becoming Leader. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Running, Role: LEADER
I20260709 12:23:05.019955  1761 consensus_queue.cc:237] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } }
I20260709 12:23:05.027415  1401 catalog_manager.cc:5697] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 reported cstate change: term changed from 1 to 2, leader changed from 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194) to f7b98485eacd4e838f526f29916c9241 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "f7b98485eacd4e838f526f29916c9241" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:05.031665  1761 consensus_queue.cc:1048] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:05.046056  1708 consensus_queue.cc:1048] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:05.065230  1725 raft_consensus.cc:993] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241: : Instructing follower 683a2f1018404bbea77e99732b6baeb7 to start an election
I20260709 12:23:05.065783  1761 raft_consensus.cc:1081] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Signalling peer 683a2f1018404bbea77e99732b6baeb7 to start an election
I20260709 12:23:05.067520  1578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f963b0bc8284494bb00908db689b8a42"
dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
 from {username='slave'} at 127.0.0.1:36476
I20260709 12:23:05.068209  1578 raft_consensus.cc:493] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:05.068610  1578 raft_consensus.cc:3060] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.074873  1578 raft_consensus.cc:515] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:05.076692  1578 leader_election.cc:290] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 2 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:05.077915  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f963b0bc8284494bb00908db689b8a42" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:05.077945  1503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f963b0bc8284494bb00908db689b8a42" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:05.078912  1652 raft_consensus.cc:3060] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.078961  1503 raft_consensus.cc:3055] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:05.079521  1503 raft_consensus.cc:740] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Running, Role: LEADER
I20260709 12:23:05.080417  1503 consensus_queue.cc:260] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:05.081751  1503 raft_consensus.cc:3060] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.087126  1652 raft_consensus.cc:2468] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 2.
I20260709 12:23:05.088738  1541 leader_election.cc:304] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7; no voters: 
I20260709 12:23:05.089273  1503 raft_consensus.cc:2468] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 2.
I20260709 12:23:05.089823  1701 raft_consensus.cc:2804] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:05.090461  1701 raft_consensus.cc:697] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 [term 2 LEADER]: Becoming Leader. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Running, Role: LEADER
I20260709 12:23:05.091328  1701 consensus_queue.cc:237] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:05.098400  1401 catalog_manager.cc:5697] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 reported cstate change: term changed from 1 to 2, leader changed from f7b98485eacd4e838f526f29916c9241 (127.22.155.193) to 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194). New cstate: current_term: 2 leader_uuid: "683a2f1018404bbea77e99732b6baeb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:05.296936  1725 raft_consensus.cc:993] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241: : Instructing follower 683a2f1018404bbea77e99732b6baeb7 to start an election
I20260709 12:23:05.297474  1761 raft_consensus.cc:1081] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Signalling peer 683a2f1018404bbea77e99732b6baeb7 to start an election
I20260709 12:23:05.299233  1578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d6923852b214d25b708fd501a7158fb"
dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
 from {username='slave'} at 127.0.0.1:36476
I20260709 12:23:05.299762  1578 raft_consensus.cc:493] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:05.300036  1578 raft_consensus.cc:3060] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.306303  1578 raft_consensus.cc:515] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:05.308131  1578 leader_election.cc:290] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 2 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:05.309258  1503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6923852b214d25b708fd501a7158fb" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:05.309413  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6923852b214d25b708fd501a7158fb" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:05.310221  1503 raft_consensus.cc:3055] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:05.310371  1652 raft_consensus.cc:3060] T 1d6923852b214d25b708fd501a7158fb P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.310580  1503 raft_consensus.cc:740] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Running, Role: LEADER
I20260709 12:23:05.311553  1503 consensus_queue.cc:260] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:05.312594  1503 raft_consensus.cc:3060] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.320466  1503 raft_consensus.cc:2468] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 2.
I20260709 12:23:05.319079  1652 raft_consensus.cc:2468] T 1d6923852b214d25b708fd501a7158fb P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 2.
I20260709 12:23:05.322100  1541 leader_election.cc:304] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7; no voters: 
I20260709 12:23:05.322587  1652 raft_consensus.cc:1275] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Refusing update from remote peer f7b98485eacd4e838f526f29916c9241: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:05.322805  1503 raft_consensus.cc:1275] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Refusing update from remote peer 683a2f1018404bbea77e99732b6baeb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:05.323403  1701 raft_consensus.cc:2804] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:05.324021  1701 raft_consensus.cc:697] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7 [term 2 LEADER]: Becoming Leader. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Running, Role: LEADER
I20260709 12:23:05.324208  1761 consensus_queue.cc:1048] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:05.325023  1744 consensus_queue.cc:1048] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:05.325006  1701 consensus_queue.cc:237] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:05.341006  1578 raft_consensus.cc:3060] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.340848  1400 catalog_manager.cc:5697] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7 reported cstate change: term changed from 1 to 2, leader changed from f7b98485eacd4e838f526f29916c9241 (127.22.155.193) to 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194). New cstate: current_term: 2 leader_uuid: "683a2f1018404bbea77e99732b6baeb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:05.345074  1652 raft_consensus.cc:1275] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Refusing update from remote peer 683a2f1018404bbea77e99732b6baeb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:05.346985  1701 consensus_queue.cc:1048] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:05.357883  1578 raft_consensus.cc:1275] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Refusing update from remote peer f7b98485eacd4e838f526f29916c9241: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:05.359689  1761 consensus_queue.cc:1048] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:05.463599  1578 raft_consensus.cc:1275] T aef1ee0de44340bcac5c557df76496bc P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Refusing update from remote peer 5a653ba4e41749d7b863fa58e89f6444: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:05.465543  1767 consensus_queue.cc:1048] T aef1ee0de44340bcac5c557df76496bc P 5a653ba4e41749d7b863fa58e89f6444 [LEADER]: Connected to new peer: Peer: permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:05.466974  1652 raft_consensus.cc:3060] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.486927  1652 raft_consensus.cc:1275] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Refusing update from remote peer f7b98485eacd4e838f526f29916c9241: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:05.488736  1503 raft_consensus.cc:1275] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Refusing update from remote peer 5a653ba4e41749d7b863fa58e89f6444: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:05.488678  1708 consensus_queue.cc:1048] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:05.490774  1777 consensus_queue.cc:1048] T aef1ee0de44340bcac5c557df76496bc P 5a653ba4e41749d7b863fa58e89f6444 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:05.503468  1578 raft_consensus.cc:1275] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Refusing update from remote peer f7b98485eacd4e838f526f29916c9241: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:05.505455  1761 consensus_queue.cc:1048] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:06.362820  1503 raft_consensus.cc:1275] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Refusing update from remote peer 683a2f1018404bbea77e99732b6baeb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:06.366947  1747 consensus_queue.cc:1048] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:06.371533  1652 raft_consensus.cc:1275] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Refusing update from remote peer 683a2f1018404bbea77e99732b6baeb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:06.384034  1501 raft_consensus.cc:1275] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Refusing update from remote peer 683a2f1018404bbea77e99732b6baeb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:06.387312  1650 raft_consensus.cc:1275] T 1d6923852b214d25b708fd501a7158fb P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Refusing update from remote peer 683a2f1018404bbea77e99732b6baeb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:06.389400  1747 consensus_queue.cc:1048] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:06.401829  1780 consensus_queue.cc:1048] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:06.403874  1747 consensus_queue.cc:1048] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:23:06.575752  1432 debug-util.cc:398] Leaking SignalData structure 0x7b0800062ea0 after lost signal to thread 23154
W20260709 12:23:06.577327  1432 debug-util.cc:398] Leaking SignalData structure 0x7b08001b9b00 after lost signal to thread 1435
W20260709 12:23:06.578761  1432 debug-util.cc:398] Leaking SignalData structure 0x7b08003f8920 after lost signal to thread 1527
W20260709 12:23:06.579982  1432 debug-util.cc:398] Leaking SignalData structure 0x7b080018b1c0 after lost signal to thread 1602
W20260709 12:23:06.581245  1432 debug-util.cc:398] Leaking SignalData structure 0x7b08001e8fa0 after lost signal to thread 1676
I20260709 12:23:07.817020  1400 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52836:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:07.819867  1400 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:07.890558  1486 tablet_service.cc:1511] Processing CreateTablet for tablet 10b22316e72c423aaa1015d8467cbc19 (DEFAULT_TABLE table=soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:07.892138  1486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10b22316e72c423aaa1015d8467cbc19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.892117  1560 tablet_service.cc:1511] Processing CreateTablet for tablet 10b22316e72c423aaa1015d8467cbc19 (DEFAULT_TABLE table=soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:07.893680  1560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10b22316e72c423aaa1015d8467cbc19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.905117  1487 tablet_service.cc:1511] Processing CreateTablet for tablet 540df58a2d224bb3b7f8f7874b9f60a1 (DEFAULT_TABLE table=soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:07.906739  1487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 540df58a2d224bb3b7f8f7874b9f60a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.910315  1642 tablet_service.cc:1511] Processing CreateTablet for tablet 10b22316e72c423aaa1015d8467cbc19 (DEFAULT_TABLE table=soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:07.911764  1642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10b22316e72c423aaa1015d8467cbc19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.922544  1563 tablet_service.cc:1511] Processing CreateTablet for tablet 540df58a2d224bb3b7f8f7874b9f60a1 (DEFAULT_TABLE table=soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:07.924162  1563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 540df58a2d224bb3b7f8f7874b9f60a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.926451  1634 tablet_service.cc:1511] Processing CreateTablet for tablet 540df58a2d224bb3b7f8f7874b9f60a1 (DEFAULT_TABLE table=soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:07.927973  1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 540df58a2d224bb3b7f8f7874b9f60a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.949416  1491 tablet_service.cc:1511] Processing CreateTablet for tablet 3114e99a2f114bd7bce9dc356e645b2a (DEFAULT_TABLE table=soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:07.951081  1491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3114e99a2f114bd7bce9dc356e645b2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.951485  1566 tablet_service.cc:1511] Processing CreateTablet for tablet 3114e99a2f114bd7bce9dc356e645b2a (DEFAULT_TABLE table=soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:07.953176  1566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3114e99a2f114bd7bce9dc356e645b2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.954082  1639 tablet_service.cc:1511] Processing CreateTablet for tablet 3114e99a2f114bd7bce9dc356e645b2a (DEFAULT_TABLE table=soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:07.955708  1639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3114e99a2f114bd7bce9dc356e645b2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.957384  1565 tablet_service.cc:1511] Processing CreateTablet for tablet 607b48f8b7484b12badcd4e0b7d2dd03 (DEFAULT_TABLE table=soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:07.958868  1565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 607b48f8b7484b12badcd4e0b7d2dd03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.967422  1490 tablet_service.cc:1511] Processing CreateTablet for tablet 64dcc964d9d14290995ebc0c51528cc3 (DEFAULT_TABLE table=soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:07.969014  1490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64dcc964d9d14290995ebc0c51528cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.969724  1638 tablet_service.cc:1511] Processing CreateTablet for tablet 607b48f8b7484b12badcd4e0b7d2dd03 (DEFAULT_TABLE table=soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:07.971261  1638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 607b48f8b7484b12badcd4e0b7d2dd03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.973721  1809 tablet_bootstrap.cc:492] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7: Bootstrap starting.
I20260709 12:23:07.967298  1489 tablet_service.cc:1511] Processing CreateTablet for tablet 607b48f8b7484b12badcd4e0b7d2dd03 (DEFAULT_TABLE table=soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:07.979176  1489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 607b48f8b7484b12badcd4e0b7d2dd03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.989701  1568 tablet_service.cc:1511] Processing CreateTablet for tablet 64dcc964d9d14290995ebc0c51528cc3 (DEFAULT_TABLE table=soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:07.991318  1568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64dcc964d9d14290995ebc0c51528cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.992442  1809 tablet_bootstrap.cc:654] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.008771  1637 tablet_service.cc:1511] Processing CreateTablet for tablet 64dcc964d9d14290995ebc0c51528cc3 (DEFAULT_TABLE table=soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:08.010442  1637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64dcc964d9d14290995ebc0c51528cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.031693  1560 tablet_service.cc:1511] Processing CreateTablet for tablet 35e2641f47dc49c082348e450e31911d (DEFAULT_TABLE table=soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:08.033819  1560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e2641f47dc49c082348e450e31911d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.044945  1635 tablet_service.cc:1511] Processing CreateTablet for tablet 35e2641f47dc49c082348e450e31911d (DEFAULT_TABLE table=soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:08.046597  1635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e2641f47dc49c082348e450e31911d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.076299  1566 tablet_service.cc:1511] Processing CreateTablet for tablet d3609d2ce60d4f1ab2c819c3b4c9c833 (DEFAULT_TABLE table=soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:08.085964  1636 tablet_service.cc:1511] Processing CreateTablet for tablet d3609d2ce60d4f1ab2c819c3b4c9c833 (DEFAULT_TABLE table=soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:08.087884  1636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3609d2ce60d4f1ab2c819c3b4c9c833. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:08.090379  1466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:40949, user_credentials={real_user=slave}} blocked reactor thread for 115831us
I20260709 12:23:08.093835  1485 tablet_service.cc:1511] Processing CreateTablet for tablet 35e2641f47dc49c082348e450e31911d (DEFAULT_TABLE table=soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:08.095448  1485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e2641f47dc49c082348e450e31911d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.102397  1488 tablet_service.cc:1511] Processing CreateTablet for tablet d3609d2ce60d4f1ab2c819c3b4c9c833 (DEFAULT_TABLE table=soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:08.104009  1488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3609d2ce60d4f1ab2c819c3b4c9c833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.125444  1562 tablet_service.cc:1511] Processing CreateTablet for tablet cf0e85dd20554395a1b734ec51f4acfb (DEFAULT_TABLE table=soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:08.126286  1493 tablet_service.cc:1511] Processing CreateTablet for tablet cf0e85dd20554395a1b734ec51f4acfb (DEFAULT_TABLE table=soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:08.128301  1493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf0e85dd20554395a1b734ec51f4acfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.134881  1562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf0e85dd20554395a1b734ec51f4acfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.135713  1566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3609d2ce60d4f1ab2c819c3b4c9c833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.141255  1640 tablet_service.cc:1511] Processing CreateTablet for tablet cf0e85dd20554395a1b734ec51f4acfb (DEFAULT_TABLE table=soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:08.143395  1640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf0e85dd20554395a1b734ec51f4acfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.180401  1492 tablet_service.cc:1511] Processing CreateTablet for tablet b80a9fff62da4ffe823fb144a2300b05 (DEFAULT_TABLE table=soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:08.181959  1492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b80a9fff62da4ffe823fb144a2300b05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.190587  1562 tablet_service.cc:1511] Processing CreateTablet for tablet b80a9fff62da4ffe823fb144a2300b05 (DEFAULT_TABLE table=soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:08.192091  1562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b80a9fff62da4ffe823fb144a2300b05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.201074  1641 tablet_service.cc:1511] Processing CreateTablet for tablet b80a9fff62da4ffe823fb144a2300b05 (DEFAULT_TABLE table=soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:08.202649  1641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b80a9fff62da4ffe823fb144a2300b05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.281407  1808 tablet_bootstrap.cc:492] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241: Bootstrap starting.
I20260709 12:23:08.285043  1809 tablet_bootstrap.cc:492] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7: No bootstrap required, opened a new log
I20260709 12:23:08.288919  1809 ts_tablet_manager.cc:1403] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7: Time spent bootstrapping tablet: real 0.316s	user 0.047s	sys 0.092s
I20260709 12:23:08.299376  1813 tablet_bootstrap.cc:492] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444: Bootstrap starting.
I20260709 12:23:08.301640  1808 tablet_bootstrap.cc:654] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.302961  1809 raft_consensus.cc:359] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.304068  1809 raft_consensus.cc:385] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.304452  1809 raft_consensus.cc:740] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.305565  1809 consensus_queue.cc:260] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.310935  1813 tablet_bootstrap.cc:654] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.313454  1809 ts_tablet_manager.cc:1434] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:23:08.315620  1809 tablet_bootstrap.cc:492] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7: Bootstrap starting.
I20260709 12:23:08.316474  1808 tablet_bootstrap.cc:492] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241: No bootstrap required, opened a new log
I20260709 12:23:08.317378  1808 ts_tablet_manager.cc:1403] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.009s
I20260709 12:23:08.324246  1809 tablet_bootstrap.cc:654] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.328099  1808 raft_consensus.cc:359] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.332804  1808 raft_consensus.cc:385] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.333177  1808 raft_consensus.cc:740] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.334766  1808 consensus_queue.cc:260] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.337633  1813 tablet_bootstrap.cc:492] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444: No bootstrap required, opened a new log
I20260709 12:23:08.338748  1813 ts_tablet_manager.cc:1403] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.011s
I20260709 12:23:08.346122  1813 raft_consensus.cc:359] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.347174  1813 raft_consensus.cc:385] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.347476  1813 raft_consensus.cc:740] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.351017  1808 ts_tablet_manager.cc:1434] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 12:23:08.354027  1808 tablet_bootstrap.cc:492] T 64dcc964d9d14290995ebc0c51528cc3 P f7b98485eacd4e838f526f29916c9241: Bootstrap starting.
I20260709 12:23:08.354769  1809 tablet_bootstrap.cc:492] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7: No bootstrap required, opened a new log
I20260709 12:23:08.355537  1809 ts_tablet_manager.cc:1403] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7: Time spent bootstrapping tablet: real 0.040s	user 0.020s	sys 0.009s
I20260709 12:23:08.348235  1813 consensus_queue.cc:260] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.360046  1813 ts_tablet_manager.cc:1434] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:23:08.361555  1813 tablet_bootstrap.cc:492] T 35e2641f47dc49c082348e450e31911d P 5a653ba4e41749d7b863fa58e89f6444: Bootstrap starting.
I20260709 12:23:08.362206  1808 tablet_bootstrap.cc:654] T 64dcc964d9d14290995ebc0c51528cc3 P f7b98485eacd4e838f526f29916c9241: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.368441  1809 raft_consensus.cc:359] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.369240  1813 tablet_bootstrap.cc:654] T 35e2641f47dc49c082348e450e31911d P 5a653ba4e41749d7b863fa58e89f6444: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.369561  1809 raft_consensus.cc:385] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.369944  1809 raft_consensus.cc:740] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.371070  1809 consensus_queue.cc:260] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.379962  1808 tablet_bootstrap.cc:492] T 64dcc964d9d14290995ebc0c51528cc3 P f7b98485eacd4e838f526f29916c9241: No bootstrap required, opened a new log
I20260709 12:23:08.380788  1808 ts_tablet_manager.cc:1403] T 64dcc964d9d14290995ebc0c51528cc3 P f7b98485eacd4e838f526f29916c9241: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.000s
I20260709 12:23:08.381618  1809 ts_tablet_manager.cc:1434] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.002s
I20260709 12:23:08.382622  1813 tablet_bootstrap.cc:492] T 35e2641f47dc49c082348e450e31911d P 5a653ba4e41749d7b863fa58e89f6444: No bootstrap required, opened a new log
I20260709 12:23:08.383774  1813 ts_tablet_manager.cc:1403] T 35e2641f47dc49c082348e450e31911d P 5a653ba4e41749d7b863fa58e89f6444: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.009s
I20260709 12:23:08.384469  1808 raft_consensus.cc:359] T 64dcc964d9d14290995ebc0c51528cc3 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.385706  1808 raft_consensus.cc:385] T 64dcc964d9d14290995ebc0c51528cc3 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.386114  1808 raft_consensus.cc:740] T 64dcc964d9d14290995ebc0c51528cc3 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.387220  1808 consensus_queue.cc:260] T 64dcc964d9d14290995ebc0c51528cc3 P f7b98485eacd4e838f526f29916c9241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.387910  1813 raft_consensus.cc:359] T 35e2641f47dc49c082348e450e31911d P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.389256  1813 raft_consensus.cc:385] T 35e2641f47dc49c082348e450e31911d P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.389637  1813 raft_consensus.cc:740] T 35e2641f47dc49c082348e450e31911d P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.390214  1808 ts_tablet_manager.cc:1434] T 64dcc964d9d14290995ebc0c51528cc3 P f7b98485eacd4e838f526f29916c9241: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:23:08.390506  1813 consensus_queue.cc:260] T 35e2641f47dc49c082348e450e31911d P 5a653ba4e41749d7b863fa58e89f6444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.393566  1813 ts_tablet_manager.cc:1434] T 35e2641f47dc49c082348e450e31911d P 5a653ba4e41749d7b863fa58e89f6444: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:23:08.394773  1813 tablet_bootstrap.cc:492] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444: Bootstrap starting.
I20260709 12:23:08.396898  1808 tablet_bootstrap.cc:492] T d3609d2ce60d4f1ab2c819c3b4c9c833 P f7b98485eacd4e838f526f29916c9241: Bootstrap starting.
I20260709 12:23:08.397497  1809 tablet_bootstrap.cc:492] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7: Bootstrap starting.
I20260709 12:23:08.402367  1813 tablet_bootstrap.cc:654] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.406915  1809 tablet_bootstrap.cc:654] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.409650  1808 tablet_bootstrap.cc:654] T d3609d2ce60d4f1ab2c819c3b4c9c833 P f7b98485eacd4e838f526f29916c9241: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.416592  1813 tablet_bootstrap.cc:492] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444: No bootstrap required, opened a new log
I20260709 12:23:08.417730  1813 ts_tablet_manager.cc:1403] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.008s
I20260709 12:23:08.422683  1813 raft_consensus.cc:359] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.429875  1808 tablet_bootstrap.cc:492] T d3609d2ce60d4f1ab2c819c3b4c9c833 P f7b98485eacd4e838f526f29916c9241: No bootstrap required, opened a new log
I20260709 12:23:08.430476  1813 raft_consensus.cc:385] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.431000  1808 ts_tablet_manager.cc:1403] T d3609d2ce60d4f1ab2c819c3b4c9c833 P f7b98485eacd4e838f526f29916c9241: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.011s
I20260709 12:23:08.431986  1809 tablet_bootstrap.cc:492] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7: No bootstrap required, opened a new log
I20260709 12:23:08.432739  1809 ts_tablet_manager.cc:1403] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.015s
I20260709 12:23:08.430990  1813 raft_consensus.cc:740] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.434633  1813 consensus_queue.cc:260] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.437304  1813 ts_tablet_manager.cc:1434] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.005s
I20260709 12:23:08.438879  1813 tablet_bootstrap.cc:492] T 540df58a2d224bb3b7f8f7874b9f60a1 P 5a653ba4e41749d7b863fa58e89f6444: Bootstrap starting.
I20260709 12:23:08.441659  1808 raft_consensus.cc:359] T d3609d2ce60d4f1ab2c819c3b4c9c833 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.442127  1809 raft_consensus.cc:359] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.444464  1808 raft_consensus.cc:385] T d3609d2ce60d4f1ab2c819c3b4c9c833 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.445534  1813 tablet_bootstrap.cc:654] T 540df58a2d224bb3b7f8f7874b9f60a1 P 5a653ba4e41749d7b863fa58e89f6444: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.445597  1808 raft_consensus.cc:740] T d3609d2ce60d4f1ab2c819c3b4c9c833 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.447964  1808 consensus_queue.cc:260] T d3609d2ce60d4f1ab2c819c3b4c9c833 P f7b98485eacd4e838f526f29916c9241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.444701  1809 raft_consensus.cc:385] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.450763  1809 raft_consensus.cc:740] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.451709  1809 consensus_queue.cc:260] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
W20260709 12:23:08.455420  1449 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:08.457055  1808 ts_tablet_manager.cc:1434] T d3609d2ce60d4f1ab2c819c3b4c9c833 P f7b98485eacd4e838f526f29916c9241: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.002s
I20260709 12:23:08.458654  1808 tablet_bootstrap.cc:492] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241: Bootstrap starting.
I20260709 12:23:08.461349  1813 tablet_bootstrap.cc:492] T 540df58a2d224bb3b7f8f7874b9f60a1 P 5a653ba4e41749d7b863fa58e89f6444: No bootstrap required, opened a new log
I20260709 12:23:08.462131  1813 ts_tablet_manager.cc:1403] T 540df58a2d224bb3b7f8f7874b9f60a1 P 5a653ba4e41749d7b863fa58e89f6444: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.006s
I20260709 12:23:08.465529  1812 raft_consensus.cc:493] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.466224  1812 raft_consensus.cc:515] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.466799  1809 ts_tablet_manager.cc:1434] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.003s
I20260709 12:23:08.467000  1781 raft_consensus.cc:493] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.467653  1781 raft_consensus.cc:515] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.468583  1812 leader_election.cc:290] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:08.471617  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b22316e72c423aaa1015d8467cbc19" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:08.471205  1781 leader_election.cc:290] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:08.470091  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b22316e72c423aaa1015d8467cbc19" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:08.471762  1808 tablet_bootstrap.cc:654] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.473007  1576 raft_consensus.cc:2468] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 0.
I20260709 12:23:08.473217  1503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b22316e72c423aaa1015d8467cbc19" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:08.473888  1503 raft_consensus.cc:2468] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a653ba4e41749d7b863fa58e89f6444 in term 0.
I20260709 12:23:08.474951  1468 leader_election.cc:304] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 
I20260709 12:23:08.475407  1616 leader_election.cc:304] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241; no voters: 
I20260709 12:23:08.475941  1699 raft_consensus.cc:2804] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:08.476358  1699 raft_consensus.cc:493] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.476432  1822 raft_consensus.cc:493] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.476843  1699 raft_consensus.cc:3060] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.477001  1822 raft_consensus.cc:515] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.480921  1781 raft_consensus.cc:2804] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:08.471349  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b22316e72c423aaa1015d8467cbc19" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:08.481745  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3609d2ce60d4f1ab2c819c3b4c9c833" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:08.482467  1781 raft_consensus.cc:493] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.483048  1781 raft_consensus.cc:3060] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:08.483490  1617 leader_election.cc:343] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.484130  1822 leader_election.cc:290] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:08.484933  1503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3609d2ce60d4f1ab2c819c3b4c9c833" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:08.485626  1503 raft_consensus.cc:2468] T d3609d2ce60d4f1ab2c819c3b4c9c833 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a653ba4e41749d7b863fa58e89f6444 in term 0.
I20260709 12:23:08.486420  1808 tablet_bootstrap.cc:492] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241: No bootstrap required, opened a new log
I20260709 12:23:08.486893  1616 leader_election.cc:304] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241; no voters: 683a2f1018404bbea77e99732b6baeb7
I20260709 12:23:08.487246  1808 ts_tablet_manager.cc:1403] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.000s
I20260709 12:23:08.489648  1822 raft_consensus.cc:2804] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:08.490067  1822 raft_consensus.cc:493] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.490432  1822 raft_consensus.cc:3060] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.491211  1808 raft_consensus.cc:359] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.492167  1808 raft_consensus.cc:385] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.492511  1808 raft_consensus.cc:740] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.492972  1578 raft_consensus.cc:2468] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a653ba4e41749d7b863fa58e89f6444 in term 0.
I20260709 12:23:08.493556  1808 consensus_queue.cc:260] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.496836  1808 ts_tablet_manager.cc:1434] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.007s
I20260709 12:23:08.498118  1808 tablet_bootstrap.cc:492] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241: Bootstrap starting.
I20260709 12:23:08.501348  1699 raft_consensus.cc:515] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.505623  1808 tablet_bootstrap.cc:654] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.502971  1813 raft_consensus.cc:359] T 540df58a2d224bb3b7f8f7874b9f60a1 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.516777  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b22316e72c423aaa1015d8467cbc19" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
I20260709 12:23:08.517457  1578 raft_consensus.cc:3060] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.518949  1822 raft_consensus.cc:515] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.522166  1503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3609d2ce60d4f1ab2c819c3b4c9c833" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:08.522804  1503 raft_consensus.cc:3060] T d3609d2ce60d4f1ab2c819c3b4c9c833 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.526355  1578 raft_consensus.cc:2468] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 1.
I20260709 12:23:08.527853  1468 leader_election.cc:304] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 
I20260709 12:23:08.528946  1812 raft_consensus.cc:2804] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:08.529445  1812 raft_consensus.cc:697] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Becoming Leader. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Running, Role: LEADER
I20260709 12:23:08.530530  1812 consensus_queue.cc:237] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.535147  1813 raft_consensus.cc:385] T 540df58a2d224bb3b7f8f7874b9f60a1 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.535264  1503 raft_consensus.cc:2468] T d3609d2ce60d4f1ab2c819c3b4c9c833 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a653ba4e41749d7b863fa58e89f6444 in term 1.
I20260709 12:23:08.535588  1813 raft_consensus.cc:740] T 540df58a2d224bb3b7f8f7874b9f60a1 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.536919  1616 leader_election.cc:304] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241; no voters: 
I20260709 12:23:08.513265  1781 raft_consensus.cc:515] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.546733  1650 raft_consensus.cc:2393] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f7b98485eacd4e838f526f29916c9241 in current term 1: Already voted for candidate 5a653ba4e41749d7b863fa58e89f6444 in this term.
I20260709 12:23:08.549079  1781 leader_election.cc:290] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:08.549860  1781 raft_consensus.cc:2804] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:08.550413  1781 raft_consensus.cc:697] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 LEADER]: Becoming Leader. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Running, Role: LEADER
I20260709 12:23:08.551532  1781 consensus_queue.cc:237] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.513264  1809 tablet_bootstrap.cc:492] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7: Bootstrap starting.
I20260709 12:23:08.553316  1501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b22316e72c423aaa1015d8467cbc19" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:08.559226  1400 catalog_manager.cc:5697] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7b98485eacd4e838f526f29916c9241 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "f7b98485eacd4e838f526f29916c9241" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:08.561338  1828 raft_consensus.cc:493] T 35e2641f47dc49c082348e450e31911d P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.553929  1699 leader_election.cc:290] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 election: Requested vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:08.536643  1813 consensus_queue.cc:260] T 540df58a2d224bb3b7f8f7874b9f60a1 P 5a653ba4e41749d7b863fa58e89f6444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.554179  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b22316e72c423aaa1015d8467cbc19" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:08.562805  1651 raft_consensus.cc:2393] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f7b98485eacd4e838f526f29916c9241 in current term 1: Already voted for candidate 5a653ba4e41749d7b863fa58e89f6444 in this term.
I20260709 12:23:08.564285  1813 ts_tablet_manager.cc:1434] T 540df58a2d224bb3b7f8f7874b9f60a1 P 5a653ba4e41749d7b863fa58e89f6444: Time spent starting tablet: real 0.102s	user 0.007s	sys 0.000s
I20260709 12:23:08.561990  1828 raft_consensus.cc:515] T 35e2641f47dc49c082348e450e31911d P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.565860  1813 tablet_bootstrap.cc:492] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444: Bootstrap starting.
I20260709 12:23:08.572965  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3609d2ce60d4f1ab2c819c3b4c9c833" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
I20260709 12:23:08.570134  1503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e2641f47dc49c082348e450e31911d" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:08.572230  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b22316e72c423aaa1015d8467cbc19" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
W20260709 12:23:08.577356  1617 leader_election.cc:343] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.578181  1578 raft_consensus.cc:2393] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a653ba4e41749d7b863fa58e89f6444 in current term 1: Already voted for candidate f7b98485eacd4e838f526f29916c9241 in this term.
I20260709 12:23:08.564774  1822 leader_election.cc:290] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
W20260709 12:23:08.581195  1616 leader_election.cc:343] T 35e2641f47dc49c082348e450e31911d P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.583209  1828 leader_election.cc:290] T 35e2641f47dc49c082348e450e31911d P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:08.579610  1809 tablet_bootstrap.cc:654] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.580045  1617 leader_election.cc:304] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444; no voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241
I20260709 12:23:08.586776  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e2641f47dc49c082348e450e31911d" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
W20260709 12:23:08.588245  1617 leader_election.cc:343] T 35e2641f47dc49c082348e450e31911d P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.588750  1617 leader_election.cc:304] T 35e2641f47dc49c082348e450e31911d P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444; no voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241
I20260709 12:23:08.590082  1822 raft_consensus.cc:2749] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:08.590759  1822 raft_consensus.cc:2749] T 35e2641f47dc49c082348e450e31911d P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:08.596072  1813 tablet_bootstrap.cc:654] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.598012  1808 tablet_bootstrap.cc:492] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241: No bootstrap required, opened a new log
I20260709 12:23:08.598785  1808 ts_tablet_manager.cc:1403] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241: Time spent bootstrapping tablet: real 0.101s	user 0.036s	sys 0.034s
I20260709 12:23:08.602397  1780 raft_consensus.cc:493] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.602248  1808 raft_consensus.cc:359] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.603266  1808 raft_consensus.cc:385] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.603112  1780 raft_consensus.cc:515] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.603767  1808 raft_consensus.cc:740] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.604430  1809 tablet_bootstrap.cc:492] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7: No bootstrap required, opened a new log
I20260709 12:23:08.605063  1809 ts_tablet_manager.cc:1403] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7: Time spent bootstrapping tablet: real 0.092s	user 0.011s	sys 0.003s
I20260709 12:23:08.604945  1808 consensus_queue.cc:260] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.607923  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dcc964d9d14290995ebc0c51528cc3" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:08.608723  1808 ts_tablet_manager.cc:1434] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241: Time spent starting tablet: real 0.010s	user 0.012s	sys 0.000s
I20260709 12:23:08.609457  1503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dcc964d9d14290995ebc0c51528cc3" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:08.610285  1503 raft_consensus.cc:2468] T 64dcc964d9d14290995ebc0c51528cc3 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 0.
I20260709 12:23:08.610438  1808 tablet_bootstrap.cc:492] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241: Bootstrap starting.
I20260709 12:23:08.611856  1542 leader_election.cc:304] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 
W20260709 12:23:08.613333  1541 leader_election.cc:343] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.614435  1780 leader_election.cc:290] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:08.615017  1780 raft_consensus.cc:2804] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:08.615391  1780 raft_consensus.cc:493] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.616020  1399 catalog_manager.cc:5697] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "5a653ba4e41749d7b863fa58e89f6444" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:08.619520  1808 tablet_bootstrap.cc:654] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.608886  1809 raft_consensus.cc:359] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.627002  1809 raft_consensus.cc:385] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.627405  1809 raft_consensus.cc:740] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.615734  1780 raft_consensus.cc:3060] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.632849  1809 consensus_queue.cc:260] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.635622  1809 ts_tablet_manager.cc:1434] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:23:08.637482  1836 raft_consensus.cc:493] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.637964  1836 raft_consensus.cc:515] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.642769  1503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf0e85dd20554395a1b734ec51f4acfb" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:08.646229  1836 leader_election.cc:290] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:08.646287  1808 tablet_bootstrap.cc:492] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241: No bootstrap required, opened a new log
I20260709 12:23:08.647257  1808 ts_tablet_manager.cc:1403] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.016s
I20260709 12:23:08.648902  1809 tablet_bootstrap.cc:492] T b80a9fff62da4ffe823fb144a2300b05 P 683a2f1018404bbea77e99732b6baeb7: Bootstrap starting.
I20260709 12:23:08.650776  1808 raft_consensus.cc:359] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.651616  1808 raft_consensus.cc:385] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.651901  1808 raft_consensus.cc:740] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.652873  1808 consensus_queue.cc:260] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.655052  1808 ts_tablet_manager.cc:1434] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:08.656188  1808 tablet_bootstrap.cc:492] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241: Bootstrap starting.
I20260709 12:23:08.657114  1809 tablet_bootstrap.cc:654] T b80a9fff62da4ffe823fb144a2300b05 P 683a2f1018404bbea77e99732b6baeb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.657234  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf0e85dd20554395a1b734ec51f4acfb" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
W20260709 12:23:08.659220  1541 leader_election.cc:343] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:08.660130  1542 leader_election.cc:343] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.665400  1542 leader_election.cc:304] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7; no voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241
I20260709 12:23:08.667080  1836 raft_consensus.cc:2749] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:08.670413  1808 tablet_bootstrap.cc:654] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.676879  1780 raft_consensus.cc:515] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.680483  1813 tablet_bootstrap.cc:492] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444: No bootstrap required, opened a new log
I20260709 12:23:08.683634  1813 ts_tablet_manager.cc:1403] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444: Time spent bootstrapping tablet: real 0.118s	user 0.014s	sys 0.018s
I20260709 12:23:08.685773  1503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dcc964d9d14290995ebc0c51528cc3" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:08.686815  1503 raft_consensus.cc:3060] T 64dcc964d9d14290995ebc0c51528cc3 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.687791  1813 raft_consensus.cc:359] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.688745  1813 raft_consensus.cc:385] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.689069  1813 raft_consensus.cc:740] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.690109  1813 consensus_queue.cc:260] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.693310  1813 ts_tablet_manager.cc:1434] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 12:23:08.694835  1813 tablet_bootstrap.cc:492] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444: Bootstrap starting.
I20260709 12:23:08.701258  1836 raft_consensus.cc:493] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.702159  1836 raft_consensus.cc:515] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.706615  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3114e99a2f114bd7bce9dc356e645b2a" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
W20260709 12:23:08.708268  1541 leader_election.cc:343] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.711102  1502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3114e99a2f114bd7bce9dc356e645b2a" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:08.712179  1502 raft_consensus.cc:2468] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 0.
I20260709 12:23:08.713919  1542 leader_election.cc:304] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 5a653ba4e41749d7b863fa58e89f6444
I20260709 12:23:08.715297  1836 leader_election.cc:290] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:08.715958  1836 raft_consensus.cc:2804] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:08.716346  1836 raft_consensus.cc:493] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.716707  1836 raft_consensus.cc:3060] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.725801  1780 leader_election.cc:290] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:08.729692  1503 raft_consensus.cc:2468] T 64dcc964d9d14290995ebc0c51528cc3 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 1.
I20260709 12:23:08.731266  1813 tablet_bootstrap.cc:654] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.731585  1542 leader_election.cc:304] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 
I20260709 12:23:08.733794  1781 raft_consensus.cc:493] T 540df58a2d224bb3b7f8f7874b9f60a1 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.734674  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dcc964d9d14290995ebc0c51528cc3" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:08.734361  1781 raft_consensus.cc:515] T 540df58a2d224bb3b7f8f7874b9f60a1 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
W20260709 12:23:08.736527  1541 leader_election.cc:343] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.739038  1781 leader_election.cc:290] T 540df58a2d224bb3b7f8f7874b9f60a1 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:08.739981  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540df58a2d224bb3b7f8f7874b9f60a1" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:08.739825  1836 raft_consensus.cc:515] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.740453  1809 tablet_bootstrap.cc:492] T b80a9fff62da4ffe823fb144a2300b05 P 683a2f1018404bbea77e99732b6baeb7: No bootstrap required, opened a new log
I20260709 12:23:08.739715  1842 raft_consensus.cc:2804] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:08.741277  1809 ts_tablet_manager.cc:1403] T b80a9fff62da4ffe823fb144a2300b05 P 683a2f1018404bbea77e99732b6baeb7: Time spent bootstrapping tablet: real 0.105s	user 0.025s	sys 0.038s
I20260709 12:23:08.741760  1842 raft_consensus.cc:697] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7 [term 1 LEADER]: Becoming Leader. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Running, Role: LEADER
W20260709 12:23:08.741844  1617 leader_election.cc:343] T 540df58a2d224bb3b7f8f7874b9f60a1 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.743136  1808 tablet_bootstrap.cc:492] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241: No bootstrap required, opened a new log
I20260709 12:23:08.742918  1502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540df58a2d224bb3b7f8f7874b9f60a1" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:08.742758  1842 consensus_queue.cc:237] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.743710  1808 ts_tablet_manager.cc:1403] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.015s
W20260709 12:23:08.744726  1616 leader_election.cc:343] T 540df58a2d224bb3b7f8f7874b9f60a1 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.745257  1616 leader_election.cc:304] T 540df58a2d224bb3b7f8f7874b9f60a1 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444; no voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241
I20260709 12:23:08.747035  1781 raft_consensus.cc:2749] T 540df58a2d224bb3b7f8f7874b9f60a1 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:08.747267  1808 raft_consensus.cc:359] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.748358  1808 raft_consensus.cc:385] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.745217  1809 raft_consensus.cc:359] T b80a9fff62da4ffe823fb144a2300b05 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.749053  1808 raft_consensus.cc:740] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.749251  1699 raft_consensus.cc:493] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.749472  1809 raft_consensus.cc:385] T b80a9fff62da4ffe823fb144a2300b05 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.749920  1699 raft_consensus.cc:515] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.749941  1809 raft_consensus.cc:740] T b80a9fff62da4ffe823fb144a2300b05 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.753818  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e2641f47dc49c082348e450e31911d" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:08.754273  1836 leader_election.cc:290] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:08.754006  1502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3114e99a2f114bd7bce9dc356e645b2a" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:08.753993  1809 consensus_queue.cc:260] T b80a9fff62da4ffe823fb144a2300b05 P 683a2f1018404bbea77e99732b6baeb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.755031  1502 raft_consensus.cc:3060] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.755227  1808 consensus_queue.cc:260] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.756312  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3114e99a2f114bd7bce9dc356e645b2a" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:08.757200  1809 ts_tablet_manager.cc:1434] T b80a9fff62da4ffe823fb144a2300b05 P 683a2f1018404bbea77e99732b6baeb7: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
W20260709 12:23:08.758025  1468 leader_election.cc:343] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.758423  1808 ts_tablet_manager.cc:1434] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 12:23:08.758440  1809 tablet_bootstrap.cc:492] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7: Bootstrap starting.
W20260709 12:23:08.758891  1541 leader_election.cc:343] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.759819  1808 tablet_bootstrap.cc:492] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241: Bootstrap starting.
I20260709 12:23:08.759935  1699 leader_election.cc:290] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:08.761129  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e2641f47dc49c082348e450e31911d" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:08.761811  1651 raft_consensus.cc:2468] T 35e2641f47dc49c082348e450e31911d P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 0.
I20260709 12:23:08.763144  1466 leader_election.cc:304] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241; no voters: 683a2f1018404bbea77e99732b6baeb7
I20260709 12:23:08.765558  1699 raft_consensus.cc:2804] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:08.766335  1699 raft_consensus.cc:493] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.766790  1699 raft_consensus.cc:3060] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.767531  1808 tablet_bootstrap.cc:654] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.777153  1813 tablet_bootstrap.cc:492] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444: No bootstrap required, opened a new log
I20260709 12:23:08.778124  1813 ts_tablet_manager.cc:1403] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444: Time spent bootstrapping tablet: real 0.084s	user 0.006s	sys 0.009s
I20260709 12:23:08.782379  1502 raft_consensus.cc:2468] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 1.
I20260709 12:23:08.781877  1401 catalog_manager.cc:5697] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "683a2f1018404bbea77e99732b6baeb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:08.784818  1813 raft_consensus.cc:359] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.785763  1813 raft_consensus.cc:385] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.786170  1813 raft_consensus.cc:740] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.787212  1813 consensus_queue.cc:260] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.788925  1809 tablet_bootstrap.cc:654] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.793028  1808 tablet_bootstrap.cc:492] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241: No bootstrap required, opened a new log
I20260709 12:23:08.798354  1808 ts_tablet_manager.cc:1403] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.000s
I20260709 12:23:08.801772  1808 raft_consensus.cc:359] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.802506  1808 raft_consensus.cc:385] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.802799  1808 raft_consensus.cc:740] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.803565  1808 consensus_queue.cc:260] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.782611  1699 raft_consensus.cc:515] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.805864  1808 ts_tablet_manager.cc:1434] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:08.790913  1813 ts_tablet_manager.cc:1434] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.006s
I20260709 12:23:08.806001  1542 leader_election.cc:304] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 5a653ba4e41749d7b863fa58e89f6444
I20260709 12:23:08.807614  1842 raft_consensus.cc:2804] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:08.808142  1842 raft_consensus.cc:697] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [term 1 LEADER]: Becoming Leader. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Running, Role: LEADER
I20260709 12:23:08.808322  1699 leader_election.cc:290] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 election: Requested vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:08.809513  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e2641f47dc49c082348e450e31911d" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:08.810191  1650 raft_consensus.cc:3060] T 35e2641f47dc49c082348e450e31911d P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.810587  1813 tablet_bootstrap.cc:492] T 3114e99a2f114bd7bce9dc356e645b2a P 5a653ba4e41749d7b863fa58e89f6444: Bootstrap starting.
I20260709 12:23:08.813561  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e2641f47dc49c082348e450e31911d" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
W20260709 12:23:08.815749  1468 leader_election.cc:343] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.815819  1808 tablet_bootstrap.cc:492] T b80a9fff62da4ffe823fb144a2300b05 P f7b98485eacd4e838f526f29916c9241: Bootstrap starting.
I20260709 12:23:08.821341  1842 consensus_queue.cc:237] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.829377  1813 tablet_bootstrap.cc:654] T 3114e99a2f114bd7bce9dc356e645b2a P 5a653ba4e41749d7b863fa58e89f6444: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.831862  1808 tablet_bootstrap.cc:654] T b80a9fff62da4ffe823fb144a2300b05 P f7b98485eacd4e838f526f29916c9241: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.828554  1650 raft_consensus.cc:2468] T 35e2641f47dc49c082348e450e31911d P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 1.
I20260709 12:23:08.834164  1466 leader_election.cc:304] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241; no voters: 683a2f1018404bbea77e99732b6baeb7
I20260709 12:23:08.835654  1699 raft_consensus.cc:2804] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:08.836408  1699 raft_consensus.cc:697] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Becoming Leader. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Running, Role: LEADER
I20260709 12:23:08.837646  1699 consensus_queue.cc:237] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.847967  1808 tablet_bootstrap.cc:492] T b80a9fff62da4ffe823fb144a2300b05 P f7b98485eacd4e838f526f29916c9241: No bootstrap required, opened a new log
I20260709 12:23:08.848865  1808 ts_tablet_manager.cc:1403] T b80a9fff62da4ffe823fb144a2300b05 P f7b98485eacd4e838f526f29916c9241: Time spent bootstrapping tablet: real 0.033s	user 0.022s	sys 0.003s
I20260709 12:23:08.847883  1401 catalog_manager.cc:5697] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "683a2f1018404bbea77e99732b6baeb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:08.851070  1813 tablet_bootstrap.cc:492] T 3114e99a2f114bd7bce9dc356e645b2a P 5a653ba4e41749d7b863fa58e89f6444: No bootstrap required, opened a new log
I20260709 12:23:08.851713  1813 ts_tablet_manager.cc:1403] T 3114e99a2f114bd7bce9dc356e645b2a P 5a653ba4e41749d7b863fa58e89f6444: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.006s
I20260709 12:23:08.853140  1808 raft_consensus.cc:359] T b80a9fff62da4ffe823fb144a2300b05 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.853964  1808 raft_consensus.cc:385] T b80a9fff62da4ffe823fb144a2300b05 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.854233  1808 raft_consensus.cc:740] T b80a9fff62da4ffe823fb144a2300b05 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.854992  1808 consensus_queue.cc:260] T b80a9fff62da4ffe823fb144a2300b05 P f7b98485eacd4e838f526f29916c9241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.855020  1813 raft_consensus.cc:359] T 3114e99a2f114bd7bce9dc356e645b2a P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.857764  1813 raft_consensus.cc:385] T 3114e99a2f114bd7bce9dc356e645b2a P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.858062  1808 ts_tablet_manager.cc:1434] T b80a9fff62da4ffe823fb144a2300b05 P f7b98485eacd4e838f526f29916c9241: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:23:08.858111  1813 raft_consensus.cc:740] T 3114e99a2f114bd7bce9dc356e645b2a P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.859922  1813 consensus_queue.cc:260] T 3114e99a2f114bd7bce9dc356e645b2a P 5a653ba4e41749d7b863fa58e89f6444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.862493  1813 ts_tablet_manager.cc:1434] T 3114e99a2f114bd7bce9dc356e645b2a P 5a653ba4e41749d7b863fa58e89f6444: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:23:08.862318  1399 catalog_manager.cc:5697] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7b98485eacd4e838f526f29916c9241 (127.22.155.193). New cstate: current_term: 1 leader_uuid: "f7b98485eacd4e838f526f29916c9241" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:08.863927  1813 tablet_bootstrap.cc:492] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444: Bootstrap starting.
I20260709 12:23:08.871922  1813 tablet_bootstrap.cc:654] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.877418  1813 tablet_bootstrap.cc:492] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444: No bootstrap required, opened a new log
I20260709 12:23:08.877946  1813 ts_tablet_manager.cc:1403] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.008s
I20260709 12:23:08.878309  1809 tablet_bootstrap.cc:492] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7: No bootstrap required, opened a new log
I20260709 12:23:08.880949  1813 raft_consensus.cc:359] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.881846  1813 raft_consensus.cc:385] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.882128  1813 raft_consensus.cc:740] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.883490  1813 consensus_queue.cc:260] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.885219  1813 ts_tablet_manager.cc:1434] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:08.886289  1813 tablet_bootstrap.cc:492] T 64dcc964d9d14290995ebc0c51528cc3 P 5a653ba4e41749d7b863fa58e89f6444: Bootstrap starting.
I20260709 12:23:08.887603  1809 ts_tablet_manager.cc:1403] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7: Time spent bootstrapping tablet: real 0.129s	user 0.011s	sys 0.009s
I20260709 12:23:08.891256  1809 raft_consensus.cc:359] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.891981  1813 tablet_bootstrap.cc:654] T 64dcc964d9d14290995ebc0c51528cc3 P 5a653ba4e41749d7b863fa58e89f6444: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.892091  1809 raft_consensus.cc:385] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.893611  1809 raft_consensus.cc:740] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.894639  1809 consensus_queue.cc:260] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.898397  1809 ts_tablet_manager.cc:1434] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:23:08.899976  1809 tablet_bootstrap.cc:492] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7: Bootstrap starting.
I20260709 12:23:08.912812  1809 tablet_bootstrap.cc:654] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.936462  1813 tablet_bootstrap.cc:492] T 64dcc964d9d14290995ebc0c51528cc3 P 5a653ba4e41749d7b863fa58e89f6444: No bootstrap required, opened a new log
I20260709 12:23:08.937003  1842 raft_consensus.cc:493] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.937166  1813 ts_tablet_manager.cc:1403] T 64dcc964d9d14290995ebc0c51528cc3 P 5a653ba4e41749d7b863fa58e89f6444: Time spent bootstrapping tablet: real 0.051s	user 0.029s	sys 0.017s
I20260709 12:23:08.937745  1842 raft_consensus.cc:515] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.938782  1809 tablet_bootstrap.cc:492] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7: No bootstrap required, opened a new log
I20260709 12:23:08.939448  1809 ts_tablet_manager.cc:1403] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.018s
I20260709 12:23:08.940887  1842 leader_election.cc:290] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:08.941100  1813 raft_consensus.cc:359] T 64dcc964d9d14290995ebc0c51528cc3 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.942024  1813 raft_consensus.cc:385] T 64dcc964d9d14290995ebc0c51528cc3 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.941962  1502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540df58a2d224bb3b7f8f7874b9f60a1" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:08.942582  1813 raft_consensus.cc:740] T 64dcc964d9d14290995ebc0c51528cc3 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.942924  1502 raft_consensus.cc:2468] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 0.
I20260709 12:23:08.943500  1813 consensus_queue.cc:260] T 64dcc964d9d14290995ebc0c51528cc3 P 5a653ba4e41749d7b863fa58e89f6444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.944146  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540df58a2d224bb3b7f8f7874b9f60a1" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:08.944506  1542 leader_election.cc:304] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 
I20260709 12:23:08.944886  1650 raft_consensus.cc:2468] T 540df58a2d224bb3b7f8f7874b9f60a1 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 0.
I20260709 12:23:08.945788  1842 raft_consensus.cc:2804] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:08.946200  1813 ts_tablet_manager.cc:1434] T 64dcc964d9d14290995ebc0c51528cc3 P 5a653ba4e41749d7b863fa58e89f6444: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:08.946290  1842 raft_consensus.cc:493] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.947069  1842 raft_consensus.cc:3060] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.955328  1809 raft_consensus.cc:359] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.956350  1809 raft_consensus.cc:385] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.956715  1809 raft_consensus.cc:740] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.957238  1842 raft_consensus.cc:515] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.957670  1809 consensus_queue.cc:260] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.960805  1809 ts_tablet_manager.cc:1434] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.004s
I20260709 12:23:08.960886  1502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540df58a2d224bb3b7f8f7874b9f60a1" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:08.961608  1502 raft_consensus.cc:3060] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.962136  1809 tablet_bootstrap.cc:492] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7: Bootstrap starting.
I20260709 12:23:08.961992  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540df58a2d224bb3b7f8f7874b9f60a1" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:08.962965  1651 raft_consensus.cc:3060] T 540df58a2d224bb3b7f8f7874b9f60a1 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.970714  1809 tablet_bootstrap.cc:654] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.978622  1699 raft_consensus.cc:493] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.979460  1836 raft_consensus.cc:493] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.979347  1699 raft_consensus.cc:515] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.980098  1836 raft_consensus.cc:515] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.982647  1836 leader_election.cc:290] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:08.983523  1503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3609d2ce60d4f1ab2c819c3b4c9c833" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:08.984493  1503 raft_consensus.cc:2393] T d3609d2ce60d4f1ab2c819c3b4c9c833 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 683a2f1018404bbea77e99732b6baeb7 in current term 1: Already voted for candidate 5a653ba4e41749d7b863fa58e89f6444 in this term.
I20260709 12:23:08.986910  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b48f8b7484b12badcd4e0b7d2dd03" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:08.987301  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3609d2ce60d4f1ab2c819c3b4c9c833" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:08.988152  1502 raft_consensus.cc:2468] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 1.
I20260709 12:23:08.990340  1699 leader_election.cc:290] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:08.990923  1542 leader_election.cc:304] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 
I20260709 12:23:08.992025  1836 raft_consensus.cc:2804] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:08.992555  1836 raft_consensus.cc:697] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [term 1 LEADER]: Becoming Leader. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Running, Role: LEADER
I20260709 12:23:08.992878  1809 tablet_bootstrap.cc:492] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7: No bootstrap required, opened a new log
I20260709 12:23:08.993472  1809 ts_tablet_manager.cc:1403] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.007s
I20260709 12:23:08.994531  1541 leader_election.cc:304] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7; no voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241
I20260709 12:23:08.995924  1841 raft_consensus.cc:3060] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.996322  1651 raft_consensus.cc:2468] T 540df58a2d224bb3b7f8f7874b9f60a1 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 1.
I20260709 12:23:08.996722  1809 raft_consensus.cc:359] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.997561  1809 raft_consensus.cc:385] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.997848  1809 raft_consensus.cc:740] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.998016  1781 raft_consensus.cc:493] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.998553  1781 raft_consensus.cc:515] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:08.998647  1809 consensus_queue.cc:260] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:09.001405  1809 ts_tablet_manager.cc:1434] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:23:09.002596  1809 tablet_bootstrap.cc:492] T 35e2641f47dc49c082348e450e31911d P 683a2f1018404bbea77e99732b6baeb7: Bootstrap starting.
W20260709 12:23:09.004101  1468 leader_election.cc:343] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.993485  1836 consensus_queue.cc:237] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:09.005548  1781 leader_election.cc:290] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:09.009050  1503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80a9fff62da4ffe823fb144a2300b05" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:09.009927  1503 raft_consensus.cc:2468] T b80a9fff62da4ffe823fb144a2300b05 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a653ba4e41749d7b863fa58e89f6444 in term 0.
I20260709 12:23:09.011061  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80a9fff62da4ffe823fb144a2300b05" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:09.011793  1578 raft_consensus.cc:2468] T b80a9fff62da4ffe823fb144a2300b05 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a653ba4e41749d7b863fa58e89f6444 in term 0.
I20260709 12:23:09.013981  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b48f8b7484b12badcd4e0b7d2dd03" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:09.128293  1650 raft_consensus.cc:2468] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 0.
I20260709 12:23:09.129863  1617 leader_election.cc:304] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7; no voters: 
I20260709 12:23:09.134472  1841 raft_consensus.cc:2749] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:08.990988  1842 leader_election.cc:290] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:09.169904  1829 raft_consensus.cc:493] T 64dcc964d9d14290995ebc0c51528cc3 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.168761  1822 raft_consensus.cc:493] T 3114e99a2f114bd7bce9dc356e645b2a P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.169173  1825 raft_consensus.cc:493] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.169951  1828 raft_consensus.cc:2804] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.188905  1828 raft_consensus.cc:493] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.189489  1828 raft_consensus.cc:3060] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.192909  1825 raft_consensus.cc:515] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:09.196762  1822 raft_consensus.cc:515] T 3114e99a2f114bd7bce9dc356e645b2a P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:09.199608  1822 leader_election.cc:290] T 3114e99a2f114bd7bce9dc356e645b2a P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:09.200516  1829 raft_consensus.cc:515] T 64dcc964d9d14290995ebc0c51528cc3 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:09.203524  1829 leader_election.cc:290] T 64dcc964d9d14290995ebc0c51528cc3 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:09.204123  1829 raft_consensus.cc:493] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.235635  1825 leader_election.cc:290] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:09.270980  1829 raft_consensus.cc:515] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:09.565960  1841 raft_consensus.cc:493] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.566918  1841 raft_consensus.cc:515] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:09.569811  1841 leader_election.cc:290] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:09.573726  1829 leader_election.cc:290] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:10.345254  1829 raft_consensus.cc:493] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 683a2f1018404bbea77e99732b6baeb7)
I20260709 12:23:10.346082  1829 raft_consensus.cc:515] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
W20260709 12:23:10.141891  1541 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.904s	user 0.002s	sys 0.012s
W20260709 12:23:10.349015  1541 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.111s	user 0.003s	sys 0.013s
I20260709 12:23:10.220712  1466 leader_election.cc:304] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241; no voters: 683a2f1018404bbea77e99732b6baeb7
I20260709 12:23:10.225636  1861 raft_consensus.cc:493] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 683a2f1018404bbea77e99732b6baeb7)
I20260709 12:23:10.245972  1860 raft_consensus.cc:493] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.353904  1651 raft_consensus.cc:3060] T 64dcc964d9d14290995ebc0c51528cc3 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.354142  1649 raft_consensus.cc:3060] T 3114e99a2f114bd7bce9dc356e645b2a P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.353014  1780 raft_consensus.cc:493] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f7b98485eacd4e838f526f29916c9241)
I20260709 12:23:10.355624  1860 raft_consensus.cc:515] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.356532  1780 raft_consensus.cc:515] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.246464  1862 raft_consensus.cc:493] T e891cda7a3bf4536a9729ebc2669c144 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 683a2f1018404bbea77e99732b6baeb7)
I20260709 12:23:10.358377  1862 raft_consensus.cc:515] T e891cda7a3bf4536a9729ebc2669c144 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.353003  1861 raft_consensus.cc:515] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.259013  1857 raft_consensus.cc:493] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f7b98485eacd4e838f526f29916c9241)
I20260709 12:23:10.360414  1857 raft_consensus.cc:515] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } }
I20260709 12:23:10.361083  1841 raft_consensus.cc:493] T 30cddd6873234c5f9f6078f1fb193e4a P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f7b98485eacd4e838f526f29916c9241)
I20260709 12:23:10.274128  1858 raft_consensus.cc:493] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f7b98485eacd4e838f526f29916c9241)
I20260709 12:23:10.361747  1841 raft_consensus.cc:515] T 30cddd6873234c5f9f6078f1fb193e4a P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.362182  1858 raft_consensus.cc:515] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.275820  1501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b48f8b7484b12badcd4e0b7d2dd03" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:10.364029  1501 raft_consensus.cc:2468] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 0.
I20260709 12:23:10.367501  1542 leader_election.cc:304] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 
I20260709 12:23:10.369517  1842 raft_consensus.cc:2804] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.370064  1842 raft_consensus.cc:493] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.370467  1842 raft_consensus.cc:3060] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:10.370610  1544 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.130s	user 0.010s	sys 0.009s
W20260709 12:23:10.371052  1544 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.130s	user 0.010s	sys 0.009s
W20260709 12:23:10.374593  1449 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:10.375074  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b48f8b7484b12badcd4e0b7d2dd03" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:10.375808  1650 raft_consensus.cc:2468] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 0.
I20260709 12:23:10.384562  1399 catalog_manager.cc:5697] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241 reported cstate change: term changed from 0 to 1, leader changed from <none> to 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194). New cstate: current_term: 1 leader_uuid: "683a2f1018404bbea77e99732b6baeb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } } }
I20260709 12:23:10.386471  1857 leader_election.cc:290] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:10.388077  1860 leader_election.cc:290] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:10.279567  1856 raft_consensus.cc:493] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f7b98485eacd4e838f526f29916c9241)
I20260709 12:23:10.392647  1495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1d51316b514da6932b968cef61ed95" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:10.393348  1856 raft_consensus.cc:515] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } }
I20260709 12:23:10.285233  1864 raft_consensus.cc:493] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a653ba4e41749d7b863fa58e89f6444)
I20260709 12:23:10.395131  1503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f062c725755040f99ed0fef6f284f193" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:10.276818  1863 consensus_queue.cc:1048] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:10.290014  1859 raft_consensus.cc:493] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 683a2f1018404bbea77e99732b6baeb7)
I20260709 12:23:10.291000  1500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b48f8b7484b12badcd4e0b7d2dd03" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:10.396603  1495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aad6b70d2340a0aeda7e4edd7c55d8" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:10.397029  1500 raft_consensus.cc:2468] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a653ba4e41749d7b863fa58e89f6444 in term 0.
I20260709 12:23:10.293108  1496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf0e85dd20554395a1b734ec51f4acfb" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:10.397672  1856 leader_election.cc:290] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:10.398155  1496 raft_consensus.cc:2468] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a653ba4e41749d7b863fa58e89f6444 in term 0.
I20260709 12:23:10.295334  1855 consensus_queue.cc:1048] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:10.389665  1862 leader_election.cc:290] T e891cda7a3bf4536a9729ebc2669c144 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:10.399924  1862 raft_consensus.cc:2804] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.400301  1862 raft_consensus.cc:493] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.400697  1859 raft_consensus.cc:515] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.401628  1616 leader_election.cc:304] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241; no voters: 
I20260709 12:23:10.402865  1616 leader_election.cc:304] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241; no voters: 
I20260709 12:23:10.403277  1859 leader_election.cc:290] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:10.403887  1856 raft_consensus.cc:2804] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.404387  1856 raft_consensus.cc:493] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.404788  1856 raft_consensus.cc:3060] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.405212  1855 raft_consensus.cc:2804] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.405714  1855 raft_consensus.cc:493] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.406072  1855 raft_consensus.cc:3060] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.406327  1577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf0e85dd20554395a1b734ec51f4acfb" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:10.407225  1577 raft_consensus.cc:2468] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 0.
I20260709 12:23:10.407841  1496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f062c725755040f99ed0fef6f284f193" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:10.411958  1829 leader_election.cc:290] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
W20260709 12:23:10.304798  1617 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.131s	user 0.010s	sys 0.007s
W20260709 12:23:10.412899  1617 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.241s	user 0.010s	sys 0.007s
I20260709 12:23:10.413101  1841 leader_election.cc:290] T 30cddd6873234c5f9f6078f1fb193e4a P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:10.413455  1861 leader_election.cc:290] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:10.417971  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf0e85dd20554395a1b734ec51f4acfb" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:10.418912  1574 raft_consensus.cc:2468] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a653ba4e41749d7b863fa58e89f6444 in term 0.
I20260709 12:23:10.420192  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f062c725755040f99ed0fef6f284f193" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:10.420668  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1d51316b514da6932b968cef61ed95" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
W20260709 12:23:10.313966  1618 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.117s	user 0.006s	sys 0.012s
I20260709 12:23:10.421284  1829 raft_consensus.cc:493] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:10.421676  1618 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.225s	user 0.007s	sys 0.012s
I20260709 12:23:10.421890  1829 raft_consensus.cc:515] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.314847  1809 tablet_bootstrap.cc:654] T 35e2641f47dc49c082348e450e31911d P 683a2f1018404bbea77e99732b6baeb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.317307  1498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dcc964d9d14290995ebc0c51528cc3" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:10.423414  1498 raft_consensus.cc:2393] T 64dcc964d9d14290995ebc0c51528cc3 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a653ba4e41749d7b863fa58e89f6444 in current term 1: Already voted for candidate 683a2f1018404bbea77e99732b6baeb7 in this term.
I20260709 12:23:10.329571  1866 raft_consensus.cc:493] T 30cddd6873234c5f9f6078f1fb193e4a P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f7b98485eacd4e838f526f29916c9241)
I20260709 12:23:10.424775  1866 raft_consensus.cc:515] T 30cddd6873234c5f9f6078f1fb193e4a P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.425741  1860 consensus_queue.cc:1048] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:10.427963  1866 leader_election.cc:290] T 30cddd6873234c5f9f6078f1fb193e4a P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:10.429358  1866 raft_consensus.cc:493] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 683a2f1018404bbea77e99732b6baeb7)
I20260709 12:23:10.430006  1468 leader_election.cc:304] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 
I20260709 12:23:10.429900  1866 raft_consensus.cc:515] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.432451  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8decea69eec245aba482134428dcbfb9" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:10.433175  1502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8decea69eec245aba482134428dcbfb9" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
W20260709 12:23:10.433737  1468 consensus_peers.cc:597] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 -> Peer 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903): Couldn't send request to peer 683a2f1018404bbea77e99732b6baeb7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:10.435997  1577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dcc964d9d14290995ebc0c51528cc3" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:10.436435  1866 leader_election.cc:290] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:10.440311  1866 consensus_queue.cc:1048] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [LEADER]: Connected to new peer: Peer: permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:23:10.337661  1828 consensus_meta.cc:287] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444: Time spent flushing consensus metadata: real 1.148s	user 0.020s	sys 0.004s
I20260709 12:23:10.451227  1828 raft_consensus.cc:515] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.451589  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b22316e72c423aaa1015d8467cbc19" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:10.374230  1501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cddd6873234c5f9f6078f1fb193e4a" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:10.453770  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e891cda7a3bf4536a9729ebc2669c144" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:10.454984  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f963b0bc8284494bb00908db689b8a42" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:10.452451  1575 raft_consensus.cc:2468] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a653ba4e41749d7b863fa58e89f6444 in term 1.
I20260709 12:23:10.456030  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f963b0bc8284494bb00908db689b8a42" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:10.389665  1780 leader_election.cc:290] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:10.390470  1858 leader_election.cc:290] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:10.395653  1864 raft_consensus.cc:515] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.456892  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cddd6873234c5f9f6078f1fb193e4a" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:10.459233  1864 leader_election.cc:290] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:10.288949  1499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3114e99a2f114bd7bce9dc356e645b2a" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:10.460618  1499 raft_consensus.cc:2393] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a653ba4e41749d7b863fa58e89f6444 in current term 1: Already voted for candidate 683a2f1018404bbea77e99732b6baeb7 in this term.
I20260709 12:23:10.461814  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3114e99a2f114bd7bce9dc356e645b2a" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:10.465471  1828 leader_election.cc:290] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:10.400763  1862 raft_consensus.cc:3060] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.474382  1497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cddd6873234c5f9f6078f1fb193e4a" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:10.485430  1617 leader_election.cc:304] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7; no voters: 
I20260709 12:23:10.475149  1857 consensus_queue.cc:1048] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:23:10.441331  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f062c725755040f99ed0fef6f284f193" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:10.442034  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aad6b70d2340a0aeda7e4edd7c55d8" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:10.491156  1648 raft_consensus.cc:2468] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 2.
I20260709 12:23:10.492254  1650 raft_consensus.cc:2468] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 2.
I20260709 12:23:10.443941  1502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b22316e72c423aaa1015d8467cbc19" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:10.424384  1829 leader_election.cc:290] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:10.494366  1829 raft_consensus.cc:2804] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:10.494833  1829 raft_consensus.cc:493] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.495183  1829 raft_consensus.cc:3060] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:10.333781  1867 raft_consensus.cc:493] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f7b98485eacd4e838f526f29916c9241)
I20260709 12:23:10.496973  1867 raft_consensus.cc:515] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.498172  1652 raft_consensus.cc:2468] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 1.
I20260709 12:23:10.450347  1577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8decea69eec245aba482134428dcbfb9" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:10.486994  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef1ee0de44340bcac5c557df76496bc" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:10.488071  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80a9fff62da4ffe823fb144a2300b05" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
I20260709 12:23:10.442950  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b48f8b7484b12badcd4e0b7d2dd03" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:10.501816  1842 raft_consensus.cc:515] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.502936  1578 raft_consensus.cc:3060] T b80a9fff62da4ffe823fb144a2300b05 P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.503316  1576 raft_consensus.cc:2393] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a653ba4e41749d7b863fa58e89f6444 in current term 1: Already voted for candidate 683a2f1018404bbea77e99732b6baeb7 in this term.
I20260709 12:23:10.510730  1855 raft_consensus.cc:515] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.441394  1860 raft_consensus.cc:2804] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.513634  1860 raft_consensus.cc:493] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.514190  1860 raft_consensus.cc:3060] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.519816  1497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f963b0bc8284494bb00908db689b8a42" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:10.522891  1616 leader_election.cc:304] T 64dcc964d9d14290995ebc0c51528cc3 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444; no voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241
W20260709 12:23:10.524919  1466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:40949, user_credentials={real_user=slave}} blocked reactor thread for 304334us
I20260709 12:23:10.527591  1809 tablet_bootstrap.cc:492] T 35e2641f47dc49c082348e450e31911d P 683a2f1018404bbea77e99732b6baeb7: No bootstrap required, opened a new log
I20260709 12:23:10.511273  1867 leader_election.cc:290] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:10.532569  1855 leader_election.cc:290] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:10.536451  1578 raft_consensus.cc:2468] T b80a9fff62da4ffe823fb144a2300b05 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a653ba4e41749d7b863fa58e89f6444 in term 1.
I20260709 12:23:10.549057  1809 ts_tablet_manager.cc:1403] T 35e2641f47dc49c082348e450e31911d P 683a2f1018404bbea77e99732b6baeb7: Time spent bootstrapping tablet: real 1.547s	user 0.019s	sys 0.014s
I20260709 12:23:10.549503  1616 leader_election.cc:304] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444; no voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241
I20260709 12:23:10.549917  1499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b48f8b7484b12badcd4e0b7d2dd03" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:10.550738  1862 raft_consensus.cc:515] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.543692  1866 raft_consensus.cc:2749] T 64dcc964d9d14290995ebc0c51528cc3 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:10.562549  1855 raft_consensus.cc:2749] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:10.565347  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1d51316b514da6932b968cef61ed95" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:10.562875  1842 leader_election.cc:290] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:10.567704  1617 leader_election.cc:304] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7; no voters: 
I20260709 12:23:10.569454  1616 leader_election.cc:304] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444; no voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241
I20260709 12:23:10.570152  1855 raft_consensus.cc:2804] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.570533  1809 raft_consensus.cc:359] T 35e2641f47dc49c082348e450e31911d P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.571554  1809 raft_consensus.cc:385] T 35e2641f47dc49c082348e450e31911d P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.572866  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf0e85dd20554395a1b734ec51f4acfb" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
I20260709 12:23:10.573611  1573 raft_consensus.cc:3060] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.543298  1856 raft_consensus.cc:515] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.571888  1809 raft_consensus.cc:740] T 35e2641f47dc49c082348e450e31911d P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.577478  1809 consensus_queue.cc:260] T 35e2641f47dc49c082348e450e31911d P 683a2f1018404bbea77e99732b6baeb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.578352  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b48f8b7484b12badcd4e0b7d2dd03" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
I20260709 12:23:10.578634  1829 raft_consensus.cc:515] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.579622  1578 raft_consensus.cc:2393] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a653ba4e41749d7b863fa58e89f6444 in current term 1: Already voted for candidate 683a2f1018404bbea77e99732b6baeb7 in this term.
I20260709 12:23:10.581076  1868 raft_consensus.cc:2749] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:10.581948  1855 raft_consensus.cc:697] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 LEADER]: Becoming Leader. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Running, Role: LEADER
I20260709 12:23:10.582669  1499 raft_consensus.cc:2393] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 683a2f1018404bbea77e99732b6baeb7 in current term 1: Already voted for candidate f7b98485eacd4e838f526f29916c9241 in this term.
I20260709 12:23:10.583048  1855 consensus_queue.cc:237] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.583747  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b48f8b7484b12badcd4e0b7d2dd03" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
I20260709 12:23:10.585155  1578 raft_consensus.cc:2393] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f7b98485eacd4e838f526f29916c9241 in current term 1: Already voted for candidate 683a2f1018404bbea77e99732b6baeb7 in this term.
I20260709 12:23:10.580250  1809 ts_tablet_manager.cc:1434] T 35e2641f47dc49c082348e450e31911d P 683a2f1018404bbea77e99732b6baeb7: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 12:23:10.591935  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b22316e72c423aaa1015d8467cbc19" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
I20260709 12:23:10.596463  1616 leader_election.cc:304] T 3114e99a2f114bd7bce9dc356e645b2a P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444; no voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241
I20260709 12:23:10.598652  1868 raft_consensus.cc:2749] T 3114e99a2f114bd7bce9dc356e645b2a P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:10.600534  1652 raft_consensus.cc:1240] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Rejecting Update request from peer f7b98485eacd4e838f526f29916c9241 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:10.600684  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf0e85dd20554395a1b734ec51f4acfb" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:10.601809  1650 raft_consensus.cc:2393] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f7b98485eacd4e838f526f29916c9241 in current term 1: Already voted for candidate 5a653ba4e41749d7b863fa58e89f6444 in this term.
I20260709 12:23:10.602035  1578 raft_consensus.cc:3060] T 35e2641f47dc49c082348e450e31911d P 683a2f1018404bbea77e99732b6baeb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.589247  1856 leader_election.cc:290] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
W20260709 12:23:10.606891  1872 log.cc:927] Time spent T d3609d2ce60d4f1ab2c819c3b4c9c833 P f7b98485eacd4e838f526f29916c9241: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:23:10.602391  1829 leader_election.cc:290] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 2 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:10.611325  1862 leader_election.cc:290] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 election: Requested vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:10.612663  1860 raft_consensus.cc:515] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.614128  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e891cda7a3bf4536a9729ebc2669c144" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:10.614683  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f963b0bc8284494bb00908db689b8a42" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:10.614939  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8decea69eec245aba482134428dcbfb9" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:10.619462  1651 raft_consensus.cc:2468] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 2.
I20260709 12:23:10.615752  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef1ee0de44340bcac5c557df76496bc" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:10.615859  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b48f8b7484b12badcd4e0b7d2dd03" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:10.620967  1648 raft_consensus.cc:2393] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f7b98485eacd4e838f526f29916c9241 in current term 1: Already voted for candidate 5a653ba4e41749d7b863fa58e89f6444 in this term.
I20260709 12:23:10.622385  1861 consensus_queue.cc:1059] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:10.623672  1859 raft_consensus.cc:3055] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:10.624181  1859 raft_consensus.cc:740] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Running, Role: LEADER
I20260709 12:23:10.602156  1616 leader_election.cc:304] T 30cddd6873234c5f9f6078f1fb193e4a P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444; no voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241
I20260709 12:23:10.625164  1859 consensus_queue.cc:260] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.618827  1652 raft_consensus.cc:2468] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 2.
I20260709 12:23:10.625994  1829 raft_consensus.cc:2749] T 30cddd6873234c5f9f6078f1fb193e4a P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:10.617019  1862 consensus_queue.cc:1048] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:10.627897  1466 leader_election.cc:304] T e891cda7a3bf4536a9729ebc2669c144 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f7b98485eacd4e838f526f29916c9241; no voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7
I20260709 12:23:10.628434  1859 raft_consensus.cc:3060] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:10.626533  1616 leader_election.cc:304] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444; no voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241
I20260709 12:23:10.645984  1860 leader_election.cc:290] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 election: Requested vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:10.647059  1401 catalog_manager.cc:5697] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "5a653ba4e41749d7b863fa58e89f6444" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.648779  1856 raft_consensus.cc:2749] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:10.649083  1466 leader_election.cc:304] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241; no voters: 683a2f1018404bbea77e99732b6baeb7
I20260709 12:23:10.629035  1862 raft_consensus.cc:2749] T e891cda7a3bf4536a9729ebc2669c144 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:10.646925  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf0e85dd20554395a1b734ec51f4acfb" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
I20260709 12:23:10.658100  1466 leader_election.cc:304] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f7b98485eacd4e838f526f29916c9241; no voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7
I20260709 12:23:10.659263  1861 raft_consensus.cc:2749] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:10.659969  1466 leader_election.cc:304] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f7b98485eacd4e838f526f29916c9241; no voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7
I20260709 12:23:10.653880  1860 raft_consensus.cc:2804] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:10.664660  1573 raft_consensus.cc:2468] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a653ba4e41749d7b863fa58e89f6444 in term 1.
I20260709 12:23:10.666275  1617 leader_election.cc:304] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7; no voters: 
I20260709 12:23:10.667253  1856 raft_consensus.cc:2804] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.667775  1856 raft_consensus.cc:697] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [term 1 LEADER]: Becoming Leader. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Running, Role: LEADER
I20260709 12:23:10.672465  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cddd6873234c5f9f6078f1fb193e4a" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:10.672600  1856 consensus_queue.cc:237] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.664062  1860 raft_consensus.cc:493] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 683a2f1018404bbea77e99732b6baeb7)
I20260709 12:23:10.670425  1861 raft_consensus.cc:2749] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:10.677541  1860 raft_consensus.cc:3060] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:10.690361  1502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80a9fff62da4ffe823fb144a2300b05" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:10.691308  1502 raft_consensus.cc:3060] T b80a9fff62da4ffe823fb144a2300b05 P f7b98485eacd4e838f526f29916c9241 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.690439  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b48f8b7484b12badcd4e0b7d2dd03" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:10.693746  1652 raft_consensus.cc:2393] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 683a2f1018404bbea77e99732b6baeb7 in current term 1: Already voted for candidate 5a653ba4e41749d7b863fa58e89f6444 in this term.
I20260709 12:23:10.701941  1541 leader_election.cc:304] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7; no voters: f7b98485eacd4e838f526f29916c9241
I20260709 12:23:10.686216  1466 leader_election.cc:304] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241; no voters: 683a2f1018404bbea77e99732b6baeb7
I20260709 12:23:10.703153  1842 raft_consensus.cc:2804] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:10.703634  1842 raft_consensus.cc:493] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f7b98485eacd4e838f526f29916c9241)
I20260709 12:23:10.703828  1861 raft_consensus.cc:2804] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:10.704041  1842 raft_consensus.cc:3060] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:10.704314  1861 raft_consensus.cc:493] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 683a2f1018404bbea77e99732b6baeb7)
I20260709 12:23:10.704752  1861 raft_consensus.cc:3060] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:10.704442  1541 leader_election.cc:304] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7; no voters: f7b98485eacd4e838f526f29916c9241
I20260709 12:23:10.705962  1857 raft_consensus.cc:2804] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:10.706308  1857 raft_consensus.cc:493] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f7b98485eacd4e838f526f29916c9241)
I20260709 12:23:10.706634  1857 raft_consensus.cc:3060] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:10.713099  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf0e85dd20554395a1b734ec51f4acfb" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:10.713375  1780 consensus_queue.cc:1048] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:10.714136  1500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1d51316b514da6932b968cef61ed95" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:10.715719  1541 leader_election.cc:304] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7; no voters: f7b98485eacd4e838f526f29916c9241
I20260709 12:23:10.718088  1780 raft_consensus.cc:2804] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:10.718019  1499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf0e85dd20554395a1b734ec51f4acfb" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:10.718842  1780 raft_consensus.cc:493] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f7b98485eacd4e838f526f29916c9241)
I20260709 12:23:10.719486  1780 raft_consensus.cc:3060] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:10.719635  1499 raft_consensus.cc:2393] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a653ba4e41749d7b863fa58e89f6444 in current term 1: Already voted for candidate f7b98485eacd4e838f526f29916c9241 in this term.
I20260709 12:23:10.722412  1499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b48f8b7484b12badcd4e0b7d2dd03" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:10.723477  1499 raft_consensus.cc:2393] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a653ba4e41749d7b863fa58e89f6444 in current term 1: Already voted for candidate f7b98485eacd4e838f526f29916c9241 in this term.
I20260709 12:23:10.729351  1836 consensus_queue.cc:1048] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:10.733287  1860 raft_consensus.cc:515] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.736663  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8decea69eec245aba482134428dcbfb9" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
I20260709 12:23:10.744972  1780 raft_consensus.cc:515] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.746241  1573 raft_consensus.cc:1240] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Rejecting Update request from peer f7b98485eacd4e838f526f29916c9241 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:10.755519  1541 leader_election.cc:304] T 30cddd6873234c5f9f6078f1fb193e4a P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7; no voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241
I20260709 12:23:10.756392  1616 leader_election.cc:304] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444; no voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241
I20260709 12:23:10.756788  1858 raft_consensus.cc:2749] T 30cddd6873234c5f9f6078f1fb193e4a P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:10.758020  1502 raft_consensus.cc:2468] T b80a9fff62da4ffe823fb144a2300b05 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a653ba4e41749d7b863fa58e89f6444 in term 1.
I20260709 12:23:10.758800  1855 raft_consensus.cc:2749] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:10.768759  1842 raft_consensus.cc:515] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.751361  1466 leader_election.cc:304] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f7b98485eacd4e838f526f29916c9241; no voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7
I20260709 12:23:10.785982  1864 raft_consensus.cc:2749] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:23:10.786172  1466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.155.195:40949, user_credentials={real_user=slave}} blocked reactor thread for 58613.4us
I20260709 12:23:10.773279  1616 leader_election.cc:304] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444; no voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241
I20260709 12:23:10.761631  1859 consensus_queue.cc:1059] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:23:10.778118  1857 raft_consensus.cc:515] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } }
I20260709 12:23:10.779125  1500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b22316e72c423aaa1015d8467cbc19" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:10.780977  1780 leader_election.cc:290] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 2 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:10.782225  1502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1d51316b514da6932b968cef61ed95" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:10.784469  1861 raft_consensus.cc:515] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.790983  1499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aad6b70d2340a0aeda7e4edd7c55d8" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:10.792582  1856 raft_consensus.cc:2749] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:10.793882  1500 raft_consensus.cc:2410] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a653ba4e41749d7b863fa58e89f6444 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:23:10.790606  1842 leader_election.cc:290] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 3 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:10.810566  1857 leader_election.cc:290] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 3 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:10.818289  1499 raft_consensus.cc:1240] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Rejecting Update request from peer 683a2f1018404bbea77e99732b6baeb7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:10.818559  1401 catalog_manager.cc:5697] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195). New cstate: current_term: 1 leader_uuid: "5a653ba4e41749d7b863fa58e89f6444" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.803701  1860 leader_election.cc:290] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 3 election: Requested vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:10.830315  1862 raft_consensus.cc:3055] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:10.830852  1862 raft_consensus.cc:740] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Running, Role: LEADER
I20260709 12:23:10.820851  1500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f062c725755040f99ed0fef6f284f193" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:10.831705  1862 consensus_queue.cc:260] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.833280  1541 leader_election.cc:304] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7; no voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241
I20260709 12:23:10.830304  1861 leader_election.cc:290] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 3 election: Requested vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:10.835778  1858 consensus_queue.cc:1059] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:10.837129  1858 raft_consensus.cc:2749] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:10.837296  1857 raft_consensus.cc:3055] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:10.837929  1857 raft_consensus.cc:740] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Running, Role: LEADER
I20260709 12:23:10.842032  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aad6b70d2340a0aeda7e4edd7c55d8" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:10.841845  1842 consensus_queue.cc:1048] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:10.846899  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1d51316b514da6932b968cef61ed95" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:10.853474  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f062c725755040f99ed0fef6f284f193" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:10.835851  1862 raft_consensus.cc:3060] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:10.858832  1573 raft_consensus.cc:1240] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 3 FOLLOWER]: Rejecting Update request from peer f7b98485eacd4e838f526f29916c9241 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:10.860349  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f963b0bc8284494bb00908db689b8a42" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
I20260709 12:23:10.839061  1857 consensus_queue.cc:260] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.866842  1857 raft_consensus.cc:3060] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:10.870970  1500 raft_consensus.cc:1240] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Rejecting Update request from peer 683a2f1018404bbea77e99732b6baeb7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:10.876685  1858 consensus_queue.cc:1059] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:10.878496  1842 raft_consensus.cc:3055] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:10.878816  1859 consensus_queue.cc:1059] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:10.879073  1842 raft_consensus.cc:740] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Running, Role: LEADER
I20260709 12:23:10.881668  1842 consensus_queue.cc:260] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:10.883596  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f963b0bc8284494bb00908db689b8a42" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:10.885445  1616 leader_election.cc:304] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444; no voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241
I20260709 12:23:10.886523  1856 raft_consensus.cc:2749] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:10.886885  1899 raft_consensus.cc:3055] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:10.887322  1899 raft_consensus.cc:740] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Running, Role: LEADER
I20260709 12:23:10.881691  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8decea69eec245aba482134428dcbfb9" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:10.891476  1541 leader_election.cc:304] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7; no voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241
I20260709 12:23:10.892452  1858 raft_consensus.cc:2749] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:10.883625  1842 raft_consensus.cc:3060] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:10.893453  1541 leader_election.cc:304] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7; no voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241
I20260709 12:23:10.895016  1863 raft_consensus.cc:2749] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:10.897372  1541 leader_election.cc:304] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7; no voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241
I20260709 12:23:10.899696  1858 raft_consensus.cc:2749] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:10.901186  1466 leader_election.cc:304] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f7b98485eacd4e838f526f29916c9241; no voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7
I20260709 12:23:10.902166  1899 consensus_queue.cc:260] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } }
I20260709 12:23:10.903733  1899 raft_consensus.cc:3060] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:10.904803  1864 raft_consensus.cc:2749] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:10.906134  1466 leader_election.cc:304] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f7b98485eacd4e838f526f29916c9241; no voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7
I20260709 12:23:10.907212  1864 raft_consensus.cc:2749] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:23:10.963717  1599 debug-util.cc:398] Leaking SignalData structure 0x7b08000e6260 after lost signal to thread 23154
W20260709 12:23:10.965225  1599 debug-util.cc:398] Leaking SignalData structure 0x7b08000e2400 after lost signal to thread 1435
W20260709 12:23:10.966854  1599 debug-util.cc:398] Leaking SignalData structure 0x7b0800169c20 after lost signal to thread 1527
W20260709 12:23:10.968281  1599 debug-util.cc:398] Leaking SignalData structure 0x7b08002d69c0 after lost signal to thread 1602
W20260709 12:23:10.969760  1599 debug-util.cc:398] Leaking SignalData structure 0x7b08003f3200 after lost signal to thread 1676
I20260709 12:23:11.068822  1856 consensus_queue.cc:1048] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444 [LEADER]: Connected to new peer: Peer: permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:11.100786  1856 consensus_queue.cc:1048] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:23:11.210068  1868 consensus_queue.cc:1048] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.227356  1868 consensus_queue.cc:1048] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [LEADER]: Connected to new peer: Peer: permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.281826  1573 raft_consensus.cc:1240] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [term 3 FOLLOWER]: Rejecting Update request from peer f7b98485eacd4e838f526f29916c9241 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:11.290596  1899 consensus_queue.cc:1059] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:11.291970  1896 raft_consensus.cc:3055] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:11.292407  1896 raft_consensus.cc:740] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Running, Role: LEADER
I20260709 12:23:11.293426  1896 consensus_queue.cc:260] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:11.299225  1896 raft_consensus.cc:3060] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:11.380985  1449 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:11.992444  1842 raft_consensus.cc:493] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f7b98485eacd4e838f526f29916c9241)
I20260709 12:23:11.994239  1842 raft_consensus.cc:515] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:11.999766  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b22316e72c423aaa1015d8467cbc19" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:11.999683  1502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b22316e72c423aaa1015d8467cbc19" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:12.001348  1652 raft_consensus.cc:2393] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 683a2f1018404bbea77e99732b6baeb7 in current term 2: Already voted for candidate 5a653ba4e41749d7b863fa58e89f6444 in this term.
I20260709 12:23:12.001659  1502 raft_consensus.cc:2468] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 2.
I20260709 12:23:12.003724  1842 leader_election.cc:290] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:12.004742  1542 leader_election.cc:304] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 5a653ba4e41749d7b863fa58e89f6444
I20260709 12:23:12.006016  1842 raft_consensus.cc:2804] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:12.006451  1842 raft_consensus.cc:493] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f7b98485eacd4e838f526f29916c9241)
I20260709 12:23:12.006863  1842 raft_consensus.cc:3060] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:12.022322  1842 raft_consensus.cc:515] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:12.025223  1842 leader_election.cc:290] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 2 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:12.026806  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b22316e72c423aaa1015d8467cbc19" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:12.027088  1502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b22316e72c423aaa1015d8467cbc19" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:12.027804  1652 raft_consensus.cc:2393] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 683a2f1018404bbea77e99732b6baeb7 in current term 2: Already voted for candidate 5a653ba4e41749d7b863fa58e89f6444 in this term.
I20260709 12:23:12.041308  1502 raft_consensus.cc:2468] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 2.
I20260709 12:23:12.043915  1542 leader_election.cc:304] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 5a653ba4e41749d7b863fa58e89f6444
I20260709 12:23:12.045128  1842 raft_consensus.cc:2804] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:12.045897  1842 raft_consensus.cc:697] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [term 2 LEADER]: Becoming Leader. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Running, Role: LEADER
I20260709 12:23:12.047664  1842 consensus_queue.cc:237] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:12.070140  1401 catalog_manager.cc:5697] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 reported cstate change: term changed from 1 to 2, leader changed from f7b98485eacd4e838f526f29916c9241 (127.22.155.193) to 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194). New cstate: current_term: 2 leader_uuid: "683a2f1018404bbea77e99732b6baeb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.166076  1896 raft_consensus.cc:493] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.167071  1896 raft_consensus.cc:515] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } }
I20260709 12:23:12.171423  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f062c725755040f99ed0fef6f284f193" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:12.174284  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f062c725755040f99ed0fef6f284f193" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:12.175135  1578 raft_consensus.cc:2468] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 3.
I20260709 12:23:12.176569  1896 leader_election.cc:290] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:12.177991  1468 leader_election.cc:304] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 5a653ba4e41749d7b863fa58e89f6444
I20260709 12:23:12.181783  1896 raft_consensus.cc:2804] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:12.182302  1896 raft_consensus.cc:493] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.183188  1896 raft_consensus.cc:3060] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:12.178066  1829 raft_consensus.cc:493] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 683a2f1018404bbea77e99732b6baeb7)
I20260709 12:23:12.184689  1856 raft_consensus.cc:493] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 683a2f1018404bbea77e99732b6baeb7)
I20260709 12:23:12.185528  1856 raft_consensus.cc:515] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:12.186036  1829 raft_consensus.cc:515] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:12.197208  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f963b0bc8284494bb00908db689b8a42" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:12.197696  1500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8decea69eec245aba482134428dcbfb9" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:12.198287  1578 raft_consensus.cc:2468] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a653ba4e41749d7b863fa58e89f6444 in term 3.
I20260709 12:23:12.199148  1500 raft_consensus.cc:2393] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a653ba4e41749d7b863fa58e89f6444 in current term 3: Already voted for candidate f7b98485eacd4e838f526f29916c9241 in this term.
I20260709 12:23:12.199977  1617 leader_election.cc:304] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7; no voters: 
I20260709 12:23:12.188351  1856 leader_election.cc:290] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:12.201608  1856 raft_consensus.cc:2804] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:12.201994  1856 raft_consensus.cc:493] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 683a2f1018404bbea77e99732b6baeb7)
I20260709 12:23:12.202075  1829 leader_election.cc:290] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:12.202422  1856 raft_consensus.cc:3060] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:12.204497  1502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f963b0bc8284494bb00908db689b8a42" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:12.205669  1502 raft_consensus.cc:2393] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a653ba4e41749d7b863fa58e89f6444 in current term 3: Already voted for candidate f7b98485eacd4e838f526f29916c9241 in this term.
I20260709 12:23:12.211382  1896 raft_consensus.cc:515] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } }
I20260709 12:23:12.215148  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f062c725755040f99ed0fef6f284f193" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:12.218024  1829 raft_consensus.cc:493] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f7b98485eacd4e838f526f29916c9241)
I20260709 12:23:12.218847  1829 raft_consensus.cc:515] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } }
I20260709 12:23:12.219874  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8decea69eec245aba482134428dcbfb9" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:12.220875  1578 raft_consensus.cc:2468] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a653ba4e41749d7b863fa58e89f6444 in term 3.
I20260709 12:23:12.222752  1502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f062c725755040f99ed0fef6f284f193" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:12.223148  1829 leader_election.cc:290] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:12.223629  1502 raft_consensus.cc:2368] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a653ba4e41749d7b863fa58e89f6444 for earlier term 3. Current term is 4.
I20260709 12:23:12.225589  1616 leader_election.cc:400] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 3 pre-election: Vote denied by peer f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841) with higher term. Message: Invalid argument: T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a653ba4e41749d7b863fa58e89f6444 for earlier term 3. Current term is 4.
I20260709 12:23:12.226075  1616 leader_election.cc:403] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:12.225757  1578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f062c725755040f99ed0fef6f284f193" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
I20260709 12:23:12.226866  1578 raft_consensus.cc:3060] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:12.227118  1829 raft_consensus.cc:3060] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:23:12.230957  1896 leader_election.cc:290] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 4 election: Requested vote from peers 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:12.233057  1617 leader_election.cc:304] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7; no voters: f7b98485eacd4e838f526f29916c9241
I20260709 12:23:12.236039  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f062c725755040f99ed0fef6f284f193" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:12.241420  1856 raft_consensus.cc:515] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:12.243166  1578 raft_consensus.cc:2468] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 4.
I20260709 12:23:12.244858  1502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f963b0bc8284494bb00908db689b8a42" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:12.245039  1468 leader_election.cc:304] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 5a653ba4e41749d7b863fa58e89f6444
I20260709 12:23:12.245814  1502 raft_consensus.cc:2393] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a653ba4e41749d7b863fa58e89f6444 in current term 3: Already voted for candidate f7b98485eacd4e838f526f29916c9241 in this term.
I20260709 12:23:12.246582  1896 raft_consensus.cc:2804] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:12.247231  1896 raft_consensus.cc:697] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 4 LEADER]: Becoming Leader. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Running, Role: LEADER
I20260709 12:23:12.248521  1896 consensus_queue.cc:237] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } }
I20260709 12:23:12.258966  1915 raft_consensus.cc:2804] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:12.260613  1915 raft_consensus.cc:493] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 683a2f1018404bbea77e99732b6baeb7)
I20260709 12:23:12.261032  1915 raft_consensus.cc:3060] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:12.284165  1856 leader_election.cc:290] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 3 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:12.287972  1401 catalog_manager.cc:5697] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f7b98485eacd4e838f526f29916c9241" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.305006  1829 raft_consensus.cc:2749] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841) with higher term. Message: Invalid argument: T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a653ba4e41749d7b863fa58e89f6444 for earlier term 3. Current term is 4.
I20260709 12:23:12.307545  1915 raft_consensus.cc:515] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:12.318768  1915 leader_election.cc:290] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 3 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:12.325078  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f963b0bc8284494bb00908db689b8a42" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
I20260709 12:23:12.319725  1502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8decea69eec245aba482134428dcbfb9" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:12.327389  1502 raft_consensus.cc:2393] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a653ba4e41749d7b863fa58e89f6444 in current term 3: Already voted for candidate f7b98485eacd4e838f526f29916c9241 in this term.
I20260709 12:23:12.331780  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8decea69eec245aba482134428dcbfb9" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
I20260709 12:23:12.343549  1573 raft_consensus.cc:2468] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a653ba4e41749d7b863fa58e89f6444 in term 3.
I20260709 12:23:12.343741  1576 raft_consensus.cc:2468] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a653ba4e41749d7b863fa58e89f6444 in term 3.
I20260709 12:23:12.347935  1617 leader_election.cc:304] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7; no voters: f7b98485eacd4e838f526f29916c9241
I20260709 12:23:12.349104  1921 raft_consensus.cc:2804] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:12.349368  1617 leader_election.cc:304] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7; no voters: f7b98485eacd4e838f526f29916c9241
I20260709 12:23:12.349768  1921 raft_consensus.cc:697] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [term 3 LEADER]: Becoming Leader. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Running, Role: LEADER
I20260709 12:23:12.352754  1921 consensus_queue.cc:237] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:12.354574  1915 raft_consensus.cc:2804] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:12.355154  1915 raft_consensus.cc:697] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 3 LEADER]: Becoming Leader. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Running, Role: LEADER
I20260709 12:23:12.353554  1829 raft_consensus.cc:493] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f7b98485eacd4e838f526f29916c9241)
I20260709 12:23:12.356559  1915 consensus_queue.cc:237] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:12.356993  1829 raft_consensus.cc:515] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:12.359649  1829 leader_election.cc:290] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:12.361698  1502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1d51316b514da6932b968cef61ed95" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:12.362612  1502 raft_consensus.cc:2468] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a653ba4e41749d7b863fa58e89f6444 in term 2.
I20260709 12:23:12.364471  1616 leader_election.cc:304] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241; no voters: 
I20260709 12:23:12.365427  1829 raft_consensus.cc:2804] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:12.365867  1829 raft_consensus.cc:493] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f7b98485eacd4e838f526f29916c9241)
I20260709 12:23:12.366273  1829 raft_consensus.cc:3060] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:12.370136  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1d51316b514da6932b968cef61ed95" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:12.371405  1573 raft_consensus.cc:2393] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a653ba4e41749d7b863fa58e89f6444 in current term 2: Already voted for candidate 683a2f1018404bbea77e99732b6baeb7 in this term.
I20260709 12:23:12.387727  1829 raft_consensus.cc:515] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
W20260709 12:23:12.388818  1449 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:12.394873  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1d51316b514da6932b968cef61ed95" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
I20260709 12:23:12.395931  1576 raft_consensus.cc:2393] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a653ba4e41749d7b863fa58e89f6444 in current term 2: Already voted for candidate 683a2f1018404bbea77e99732b6baeb7 in this term.
I20260709 12:23:12.390933  1829 leader_election.cc:290] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 2 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:12.391170  1502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1d51316b514da6932b968cef61ed95" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:12.397110  1401 catalog_manager.cc:5697] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 reported cstate change: term changed from 2 to 3, leader changed from 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194) to 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195). New cstate: current_term: 3 leader_uuid: "5a653ba4e41749d7b863fa58e89f6444" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:12.407766  1502 raft_consensus.cc:2468] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a653ba4e41749d7b863fa58e89f6444 in term 2.
I20260709 12:23:12.409307  1616 leader_election.cc:304] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241; no voters: 683a2f1018404bbea77e99732b6baeb7
I20260709 12:23:12.410878  1829 raft_consensus.cc:2804] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:12.413596  1829 raft_consensus.cc:697] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 LEADER]: Becoming Leader. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Running, Role: LEADER
I20260709 12:23:12.414821  1829 consensus_queue.cc:237] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:12.417578  1399 catalog_manager.cc:5697] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 reported cstate change: term changed from 2 to 3, leader changed from 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194) to 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195). New cstate: current_term: 3 leader_uuid: "5a653ba4e41749d7b863fa58e89f6444" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:12.431283  1842 raft_consensus.cc:493] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.431936  1842 raft_consensus.cc:515] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:12.436058  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1d51316b514da6932b968cef61ed95" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:12.438127  1502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1d51316b514da6932b968cef61ed95" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:12.439008  1502 raft_consensus.cc:2468] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 2.
I20260709 12:23:12.440514  1542 leader_election.cc:304] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 5a653ba4e41749d7b863fa58e89f6444
I20260709 12:23:12.441681  1909 raft_consensus.cc:2804] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:12.442090  1909 raft_consensus.cc:493] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.442438  1909 raft_consensus.cc:3060] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:12.450071  1399 catalog_manager.cc:5697] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 reported cstate change: term changed from 1 to 2, leader changed from f7b98485eacd4e838f526f29916c9241 (127.22.155.193) to 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195). New cstate: current_term: 2 leader_uuid: "5a653ba4e41749d7b863fa58e89f6444" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:12.438218  1842 leader_election.cc:290] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:12.452251  1909 raft_consensus.cc:515] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:12.456794  1502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1d51316b514da6932b968cef61ed95" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:12.457430  1502 raft_consensus.cc:3060] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:12.460526  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1d51316b514da6932b968cef61ed95" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:12.462714  1909 leader_election.cc:290] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 3 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:12.472249  1502 raft_consensus.cc:2468] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 3.
I20260709 12:23:12.475240  1542 leader_election.cc:304] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 5a653ba4e41749d7b863fa58e89f6444
I20260709 12:23:12.476907  1909 raft_consensus.cc:2804] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:12.477523  1909 raft_consensus.cc:697] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [term 3 LEADER]: Becoming Leader. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Running, Role: LEADER
I20260709 12:23:12.478955  1909 consensus_queue.cc:237] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:12.491662  1399 catalog_manager.cc:5697] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 reported cstate change: term changed from 2 to 3, leader changed from 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195) to 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194). New cstate: current_term: 3 leader_uuid: "683a2f1018404bbea77e99732b6baeb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.512122  1502 raft_consensus.cc:1275] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Refusing update from remote peer 683a2f1018404bbea77e99732b6baeb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:12.513777  1909 consensus_queue.cc:1048] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:12.529258  1896 raft_consensus.cc:493] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.530108  1896 raft_consensus.cc:515] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:12.533877  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b48f8b7484b12badcd4e0b7d2dd03" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:12.534648  1576 raft_consensus.cc:2468] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 1.
I20260709 12:23:12.535995  1468 leader_election.cc:304] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 
I20260709 12:23:12.537029  1908 raft_consensus.cc:2804] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:12.537387  1908 raft_consensus.cc:493] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.537699  1908 raft_consensus.cc:3060] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:12.537918  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b48f8b7484b12badcd4e0b7d2dd03" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:12.538714  1652 raft_consensus.cc:2468] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 1.
I20260709 12:23:12.540300  1896 leader_election.cc:290] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:12.567273  1908 raft_consensus.cc:515] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:12.569200  1896 raft_consensus.cc:493] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.570145  1896 raft_consensus.cc:515] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:12.572538  1896 leader_election.cc:290] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:12.573664  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aad6b70d2340a0aeda7e4edd7c55d8" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444" is_pre_election: true
I20260709 12:23:12.581785  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aad6b70d2340a0aeda7e4edd7c55d8" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:12.582707  1576 raft_consensus.cc:2468] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 3.
I20260709 12:23:12.584350  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b48f8b7484b12badcd4e0b7d2dd03" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
I20260709 12:23:12.584998  1576 raft_consensus.cc:3060] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:12.597232  1468 leader_election.cc:304] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 5a653ba4e41749d7b863fa58e89f6444
I20260709 12:23:12.598816  1896 raft_consensus.cc:2804] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:12.599392  1896 raft_consensus.cc:493] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.599735  1896 raft_consensus.cc:3060] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:12.600775  1652 raft_consensus.cc:1275] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Refusing update from remote peer 683a2f1018404bbea77e99732b6baeb7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:12.603535  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b48f8b7484b12badcd4e0b7d2dd03" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:12.604260  1652 raft_consensus.cc:3060] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:12.598749  1576 raft_consensus.cc:2468] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 2.
I20260709 12:23:12.608485  1896 raft_consensus.cc:515] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:12.612648  1896 leader_election.cc:290] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 4 election: Requested vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:12.614689  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aad6b70d2340a0aeda7e4edd7c55d8" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:12.617556  1908 leader_election.cc:290] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 2 election: Requested vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:12.619669  1909 consensus_queue.cc:1048] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:12.621138  1468 leader_election.cc:304] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 
I20260709 12:23:12.622092  1908 raft_consensus.cc:2804] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:12.622733  1908 raft_consensus.cc:697] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [term 2 LEADER]: Becoming Leader. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Running, Role: LEADER
I20260709 12:23:12.624873  1908 consensus_queue.cc:237] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:12.623013  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aad6b70d2340a0aeda7e4edd7c55d8" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
I20260709 12:23:12.629065  1576 raft_consensus.cc:3060] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:12.635929  1652 raft_consensus.cc:2468] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 2.
I20260709 12:23:12.646360  1399 catalog_manager.cc:5697] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 reported cstate change: term changed from 0 to 2, leader changed from <none> to f7b98485eacd4e838f526f29916c9241 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "f7b98485eacd4e838f526f29916c9241" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.650416  1576 raft_consensus.cc:2468] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 4.
I20260709 12:23:12.652144  1468 leader_election.cc:304] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 5a653ba4e41749d7b863fa58e89f6444
I20260709 12:23:12.653687  1908 raft_consensus.cc:2804] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:12.654207  1908 raft_consensus.cc:697] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [term 4 LEADER]: Becoming Leader. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Running, Role: LEADER
I20260709 12:23:12.655674  1908 consensus_queue.cc:237] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:12.692133  1401 catalog_manager.cc:5697] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f7b98485eacd4e838f526f29916c9241" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.707724  1576 raft_consensus.cc:1275] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 4 FOLLOWER]: Refusing update from remote peer f7b98485eacd4e838f526f29916c9241: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:12.709880  1908 consensus_queue.cc:1048] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:12.733891  1829 raft_consensus.cc:493] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f7b98485eacd4e838f526f29916c9241)
I20260709 12:23:12.734623  1829 raft_consensus.cc:515] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:12.738107  1500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aad6b70d2340a0aeda7e4edd7c55d8" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f7b98485eacd4e838f526f29916c9241" is_pre_election: true
I20260709 12:23:12.743052  1649 raft_consensus.cc:1275] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444 [term 4 FOLLOWER]: Refusing update from remote peer f7b98485eacd4e838f526f29916c9241: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:12.747193  1829 leader_election.cc:290] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903)
I20260709 12:23:12.750110  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aad6b70d2340a0aeda7e4edd7c55d8" candidate_uuid: "5a653ba4e41749d7b863fa58e89f6444" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "683a2f1018404bbea77e99732b6baeb7" is_pre_election: true
I20260709 12:23:12.751180  1573 raft_consensus.cc:2368] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a653ba4e41749d7b863fa58e89f6444 for earlier term 3. Current term is 4.
I20260709 12:23:12.753219  1617 leader_election.cc:400] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903) with higher term. Message: Invalid argument: T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a653ba4e41749d7b863fa58e89f6444 for earlier term 3. Current term is 4.
I20260709 12:23:12.753564  1617 leader_election.cc:403] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:12.755255  1921 raft_consensus.cc:3060] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:23:12.758208  1908 consensus_queue.cc:1048] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:23:12.776932  1921 raft_consensus.cc:2749] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903) with higher term. Message: Invalid argument: T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a653ba4e41749d7b863fa58e89f6444 for earlier term 3. Current term is 4.
W20260709 12:23:12.797274  1466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:40949, user_credentials={real_user=slave}} blocked reactor thread for 52417.5us
I20260709 12:23:12.842447  1576 raft_consensus.cc:1275] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 [term 3 FOLLOWER]: Refusing update from remote peer 5a653ba4e41749d7b863fa58e89f6444: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:12.844161  1921 consensus_queue.cc:1048] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [LEADER]: Connected to new peer: Peer: permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:12.856287  1500 raft_consensus.cc:1275] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Refusing update from remote peer 5a653ba4e41749d7b863fa58e89f6444: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:12.860666  1915 consensus_queue.cc:1048] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:12.860883  1500 raft_consensus.cc:1275] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Refusing update from remote peer 5a653ba4e41749d7b863fa58e89f6444: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:12.868409  1915 consensus_queue.cc:1048] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:12.898002  1576 raft_consensus.cc:1275] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [term 3 FOLLOWER]: Refusing update from remote peer 5a653ba4e41749d7b863fa58e89f6444: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:12.901229  1915 consensus_queue.cc:1048] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [LEADER]: Connected to new peer: Peer: permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:12.986389  1502 raft_consensus.cc:1240] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Rejecting Update request from peer 5a653ba4e41749d7b863fa58e89f6444 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:12.987969  1921 consensus_queue.cc:1059] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:12.989002  1915 raft_consensus.cc:3055] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:12.989359  1915 raft_consensus.cc:740] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Running, Role: LEADER
I20260709 12:23:12.990257  1915 consensus_queue.cc:260] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:12.991281  1915 raft_consensus.cc:3060] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:12.996212  1502 raft_consensus.cc:1275] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Refusing update from remote peer 683a2f1018404bbea77e99732b6baeb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:12.998078  1909 consensus_queue.cc:1048] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:13.015604  1649 raft_consensus.cc:1275] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [term 3 FOLLOWER]: Refusing update from remote peer 683a2f1018404bbea77e99732b6baeb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:23:13.016062  1649 pending_rounds.cc:85] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444: Aborting all ops after (but not including) 1
I20260709 12:23:13.016336  1649 pending_rounds.cc:107] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:23:13.016644  1649 raft_consensus.cc:2889] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:13.019198  1842 consensus_queue.cc:1048] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:13.028867  1576 raft_consensus.cc:1275] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Refusing update from remote peer f7b98485eacd4e838f526f29916c9241: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:23:13.030544  1908 consensus_queue.cc:1048] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.053083  1649 raft_consensus.cc:1275] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Refusing update from remote peer f7b98485eacd4e838f526f29916c9241: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:23:13.054736  1908 consensus_queue.cc:1048] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.147989  1576 raft_consensus.cc:1275] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [term 4 FOLLOWER]: Refusing update from remote peer f7b98485eacd4e838f526f29916c9241: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:13.149750  1908 consensus_queue.cc:1048] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:13.163169  1652 raft_consensus.cc:1275] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [term 4 FOLLOWER]: Refusing update from remote peer f7b98485eacd4e838f526f29916c9241: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:13.165045  1908 consensus_queue.cc:1048] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:13.392481  1576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10b22316e72c423aaa1015d8467cbc19"
dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
mode: GRACEFUL
new_leader_uuid: "f7b98485eacd4e838f526f29916c9241"
 from {username='slave'} at 127.0.0.1:36484
I20260709 12:23:13.393481  1576 raft_consensus.cc:606] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [term 2 LEADER]: Received request to transfer leadership to TS f7b98485eacd4e838f526f29916c9241
I20260709 12:23:13.401947  1576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "540df58a2d224bb3b7f8f7874b9f60a1"
dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
mode: GRACEFUL
new_leader_uuid: "f7b98485eacd4e838f526f29916c9241"
 from {username='slave'} at 127.0.0.1:36484
I20260709 12:23:13.402848  1576 raft_consensus.cc:606] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [term 1 LEADER]: Received request to transfer leadership to TS f7b98485eacd4e838f526f29916c9241
I20260709 12:23:13.410492  1576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3114e99a2f114bd7bce9dc356e645b2a"
dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
mode: GRACEFUL
new_leader_uuid: "f7b98485eacd4e838f526f29916c9241"
 from {username='slave'} at 127.0.0.1:36484
I20260709 12:23:13.411284  1576 raft_consensus.cc:606] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [term 1 LEADER]: Received request to transfer leadership to TS f7b98485eacd4e838f526f29916c9241
I20260709 12:23:13.426889  1502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35e2641f47dc49c082348e450e31911d"
dest_uuid: "f7b98485eacd4e838f526f29916c9241"
mode: GRACEFUL
new_leader_uuid: "683a2f1018404bbea77e99732b6baeb7"
 from {username='slave'} at 127.0.0.1:34816
I20260709 12:23:13.427558  1502 raft_consensus.cc:606] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Received request to transfer leadership to TS 683a2f1018404bbea77e99732b6baeb7
I20260709 12:23:13.434258  1652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3609d2ce60d4f1ab2c819c3b4c9c833"
dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
mode: GRACEFUL
new_leader_uuid: "683a2f1018404bbea77e99732b6baeb7"
 from {username='slave'} at 127.0.0.1:40566
I20260709 12:23:13.434940  1652 raft_consensus.cc:606] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 LEADER]: Received request to transfer leadership to TS 683a2f1018404bbea77e99732b6baeb7
I20260709 12:23:13.442164  1652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf0e85dd20554395a1b734ec51f4acfb"
dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
mode: GRACEFUL
new_leader_uuid: "683a2f1018404bbea77e99732b6baeb7"
 from {username='slave'} at 127.0.0.1:40566
I20260709 12:23:13.442816  1652 raft_consensus.cc:606] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [term 1 LEADER]: Received request to transfer leadership to TS 683a2f1018404bbea77e99732b6baeb7
I20260709 12:23:13.504381  1842 raft_consensus.cc:993] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7: : Instructing follower f7b98485eacd4e838f526f29916c9241 to start an election
I20260709 12:23:13.505023  1909 raft_consensus.cc:1081] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [term 1 LEADER]: Signalling peer f7b98485eacd4e838f526f29916c9241 to start an election
I20260709 12:23:13.507200  1499 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "540df58a2d224bb3b7f8f7874b9f60a1"
dest_uuid: "f7b98485eacd4e838f526f29916c9241"
 from {username='slave'} at 127.0.0.1:34814
I20260709 12:23:13.507983  1499 raft_consensus.cc:493] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:13.508368  1499 raft_consensus.cc:3060] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.510579  1842 raft_consensus.cc:993] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7: : Instructing follower f7b98485eacd4e838f526f29916c9241 to start an election
I20260709 12:23:13.511286  1909 raft_consensus.cc:1081] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [term 1 LEADER]: Signalling peer f7b98485eacd4e838f526f29916c9241 to start an election
I20260709 12:23:13.513404  1502 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3114e99a2f114bd7bce9dc356e645b2a"
dest_uuid: "f7b98485eacd4e838f526f29916c9241"
 from {username='slave'} at 127.0.0.1:34814
I20260709 12:23:13.514034  1502 raft_consensus.cc:493] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:13.514381  1502 raft_consensus.cc:3060] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.516770  1499 raft_consensus.cc:515] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:13.519035  1499 leader_election.cc:290] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 2 election: Requested vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:13.519958  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540df58a2d224bb3b7f8f7874b9f60a1" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
I20260709 12:23:13.520476  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540df58a2d224bb3b7f8f7874b9f60a1" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:13.520730  1576 raft_consensus.cc:3055] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:13.521090  1652 raft_consensus.cc:3060] T 540df58a2d224bb3b7f8f7874b9f60a1 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.521121  1576 raft_consensus.cc:740] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Running, Role: LEADER
I20260709 12:23:13.522305  1576 consensus_queue.cc:260] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:13.523648  1576 raft_consensus.cc:3060] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.529781  1502 raft_consensus.cc:515] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:13.530454  1652 raft_consensus.cc:2468] T 540df58a2d224bb3b7f8f7874b9f60a1 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 2.
I20260709 12:23:13.532011  1466 leader_election.cc:304] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241; no voters: 
I20260709 12:23:13.533123  1937 raft_consensus.cc:2804] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:13.533672  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3114e99a2f114bd7bce9dc356e645b2a" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
I20260709 12:23:13.533679  1937 raft_consensus.cc:697] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241 [term 2 LEADER]: Becoming Leader. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Running, Role: LEADER
I20260709 12:23:13.534489  1573 raft_consensus.cc:3055] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:13.534864  1573 raft_consensus.cc:740] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Running, Role: LEADER
I20260709 12:23:13.535230  1937 consensus_queue.cc:237] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:13.535897  1573 consensus_queue.cc:260] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:13.537427  1573 raft_consensus.cc:3060] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.534025  1576 raft_consensus.cc:2468] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 2.
I20260709 12:23:13.543843  1842 raft_consensus.cc:993] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7: : Instructing follower f7b98485eacd4e838f526f29916c9241 to start an election
I20260709 12:23:13.544348  1842 raft_consensus.cc:1081] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [term 2 LEADER]: Signalling peer f7b98485eacd4e838f526f29916c9241 to start an election
I20260709 12:23:13.546397  1652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3114e99a2f114bd7bce9dc356e645b2a" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:13.546519  1573 raft_consensus.cc:2468] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 2.
I20260709 12:23:13.547310  1652 raft_consensus.cc:3060] T 3114e99a2f114bd7bce9dc356e645b2a P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.549224  1468 leader_election.cc:304] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 
I20260709 12:23:13.550336  1908 raft_consensus.cc:2804] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:13.550822  1908 raft_consensus.cc:697] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241 [term 2 LEADER]: Becoming Leader. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Running, Role: LEADER
I20260709 12:23:13.551559  1499 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10b22316e72c423aaa1015d8467cbc19"
dest_uuid: "f7b98485eacd4e838f526f29916c9241"
 from {username='slave'} at 127.0.0.1:34814
I20260709 12:23:13.551806  1908 consensus_queue.cc:237] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:13.552378  1499 raft_consensus.cc:493] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:13.552894  1499 raft_consensus.cc:3060] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:13.553297  1502 leader_election.cc:290] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 2 election: Requested vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:13.563807  1652 raft_consensus.cc:2468] T 3114e99a2f114bd7bce9dc356e645b2a P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 2.
I20260709 12:23:13.560125  1399 catalog_manager.cc:5697] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241 reported cstate change: term changed from 1 to 2, leader changed from 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194) to f7b98485eacd4e838f526f29916c9241 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "f7b98485eacd4e838f526f29916c9241" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.571050  1499 raft_consensus.cc:515] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:13.575073  1499 leader_election.cc:290] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 3 election: Requested vote from peers 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:13.576886  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b22316e72c423aaa1015d8467cbc19" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:13.578078  1649 raft_consensus.cc:3060] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:13.588748  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b22316e72c423aaa1015d8467cbc19" candidate_uuid: "f7b98485eacd4e838f526f29916c9241" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
I20260709 12:23:13.589846  1573 raft_consensus.cc:3055] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:13.590299  1573 raft_consensus.cc:740] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Running, Role: LEADER
I20260709 12:23:13.597062  1573 consensus_queue.cc:260] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:13.598764  1573 raft_consensus.cc:3060] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:13.607038  1649 raft_consensus.cc:2468] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 3.
I20260709 12:23:13.608644  1466 leader_election.cc:304] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, f7b98485eacd4e838f526f29916c9241; no voters: 
I20260709 12:23:13.609629  1908 raft_consensus.cc:2804] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:13.617480  1908 raft_consensus.cc:697] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [term 3 LEADER]: Becoming Leader. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Running, Role: LEADER
I20260709 12:23:13.617578  1573 raft_consensus.cc:2468] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7b98485eacd4e838f526f29916c9241 in term 3.
I20260709 12:23:13.618775  1908 consensus_queue.cc:237] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:13.630465  1399 catalog_manager.cc:5697] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241 reported cstate change: term changed from 1 to 2, leader changed from 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194) to f7b98485eacd4e838f526f29916c9241 (127.22.155.193). New cstate: current_term: 2 leader_uuid: "f7b98485eacd4e838f526f29916c9241" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.632557  1399 catalog_manager.cc:5697] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 reported cstate change: term changed from 2 to 3, leader changed from 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194) to f7b98485eacd4e838f526f29916c9241 (127.22.155.193). New cstate: current_term: 3 leader_uuid: "f7b98485eacd4e838f526f29916c9241" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.712677  1915 raft_consensus.cc:993] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444: : Instructing follower 683a2f1018404bbea77e99732b6baeb7 to start an election
I20260709 12:23:13.713271  1921 raft_consensus.cc:1081] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [term 1 LEADER]: Signalling peer 683a2f1018404bbea77e99732b6baeb7 to start an election
I20260709 12:23:13.715250  1573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf0e85dd20554395a1b734ec51f4acfb"
dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
 from {username='slave'} at 127.0.0.1:36480
I20260709 12:23:13.715866  1573 raft_consensus.cc:493] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:13.716271  1573 raft_consensus.cc:3060] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.725090  1573 raft_consensus.cc:515] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:13.727890  1573 leader_election.cc:290] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 2 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:13.729077  1500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf0e85dd20554395a1b734ec51f4acfb" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:13.729892  1500 raft_consensus.cc:3060] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.733139  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf0e85dd20554395a1b734ec51f4acfb" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:13.733994  1649 raft_consensus.cc:3055] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:13.734367  1649 raft_consensus.cc:740] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Running, Role: LEADER
I20260709 12:23:13.735337  1649 consensus_queue.cc:260] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:13.736881  1649 raft_consensus.cc:3060] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.739760  1500 raft_consensus.cc:2468] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 2.
I20260709 12:23:13.741384  1542 leader_election.cc:304] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 
I20260709 12:23:13.742688  1909 raft_consensus.cc:2804] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:13.743327  1909 raft_consensus.cc:697] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 [term 2 LEADER]: Becoming Leader. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Running, Role: LEADER
I20260709 12:23:13.744555  1909 consensus_queue.cc:237] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:13.745678  1649 raft_consensus.cc:2468] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 2.
I20260709 12:23:13.754221  1399 catalog_manager.cc:5697] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 reported cstate change: term changed from 1 to 2, leader changed from 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195) to 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194). New cstate: current_term: 2 leader_uuid: "683a2f1018404bbea77e99732b6baeb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.779667  1915 raft_consensus.cc:993] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444: : Instructing follower 683a2f1018404bbea77e99732b6baeb7 to start an election
I20260709 12:23:13.780239  1921 raft_consensus.cc:1081] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 LEADER]: Signalling peer 683a2f1018404bbea77e99732b6baeb7 to start an election
I20260709 12:23:13.782284  1573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3609d2ce60d4f1ab2c819c3b4c9c833"
dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
 from {username='slave'} at 127.0.0.1:36480
I20260709 12:23:13.782913  1573 raft_consensus.cc:493] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:13.783321  1573 raft_consensus.cc:3060] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.790007  1573 raft_consensus.cc:515] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:13.791781  1573 leader_election.cc:290] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 2 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:13.793068  1500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3609d2ce60d4f1ab2c819c3b4c9c833" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:13.793071  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3609d2ce60d4f1ab2c819c3b4c9c833" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:13.794050  1500 raft_consensus.cc:3060] T d3609d2ce60d4f1ab2c819c3b4c9c833 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.794142  1649 raft_consensus.cc:3055] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:13.794690  1649 raft_consensus.cc:740] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a653ba4e41749d7b863fa58e89f6444, State: Running, Role: LEADER
I20260709 12:23:13.795702  1649 consensus_queue.cc:260] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:13.797272  1649 raft_consensus.cc:3060] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.803205  1500 raft_consensus.cc:2468] T d3609d2ce60d4f1ab2c819c3b4c9c833 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 2.
I20260709 12:23:13.804852  1649 raft_consensus.cc:2468] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 2.
I20260709 12:23:13.804813  1542 leader_election.cc:304] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 683a2f1018404bbea77e99732b6baeb7, f7b98485eacd4e838f526f29916c9241; no voters: 
I20260709 12:23:13.806092  1909 raft_consensus.cc:2804] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:13.806567  1909 raft_consensus.cc:697] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7 [term 2 LEADER]: Becoming Leader. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Running, Role: LEADER
I20260709 12:23:13.807579  1909 consensus_queue.cc:237] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:13.816802  1399 catalog_manager.cc:5697] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7 reported cstate change: term changed from 1 to 2, leader changed from 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195) to 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194). New cstate: current_term: 2 leader_uuid: "683a2f1018404bbea77e99732b6baeb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.962567  1896 raft_consensus.cc:993] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241: : Instructing follower 683a2f1018404bbea77e99732b6baeb7 to start an election
I20260709 12:23:13.963155  1908 raft_consensus.cc:1081] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Signalling peer 683a2f1018404bbea77e99732b6baeb7 to start an election
I20260709 12:23:13.965423  1573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35e2641f47dc49c082348e450e31911d"
dest_uuid: "683a2f1018404bbea77e99732b6baeb7"
 from {username='slave'} at 127.0.0.1:36476
I20260709 12:23:13.966043  1573 raft_consensus.cc:493] T 35e2641f47dc49c082348e450e31911d P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:13.966403  1573 raft_consensus.cc:3060] T 35e2641f47dc49c082348e450e31911d P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.973064  1573 raft_consensus.cc:515] T 35e2641f47dc49c082348e450e31911d P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:13.974910  1573 leader_election.cc:290] T 35e2641f47dc49c082348e450e31911d P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 2 election: Requested vote from peers f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841), 5a653ba4e41749d7b863fa58e89f6444 (127.22.155.195:40949)
I20260709 12:23:13.976222  1500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e2641f47dc49c082348e450e31911d" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7b98485eacd4e838f526f29916c9241"
I20260709 12:23:13.976541  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e2641f47dc49c082348e450e31911d" candidate_uuid: "683a2f1018404bbea77e99732b6baeb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a653ba4e41749d7b863fa58e89f6444"
I20260709 12:23:13.977169  1500 raft_consensus.cc:3055] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:13.977362  1649 raft_consensus.cc:3060] T 35e2641f47dc49c082348e450e31911d P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.977708  1500 raft_consensus.cc:740] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7b98485eacd4e838f526f29916c9241, State: Running, Role: LEADER
I20260709 12:23:13.978899  1652 raft_consensus.cc:1275] T 3114e99a2f114bd7bce9dc356e645b2a P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Refusing update from remote peer f7b98485eacd4e838f526f29916c9241: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:13.979022  1500 consensus_queue.cc:260] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:13.980943  1908 consensus_queue.cc:1048] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:13.981403  1500 raft_consensus.cc:3060] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:14.003638  1649 raft_consensus.cc:2468] T 35e2641f47dc49c082348e450e31911d P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 2.
I20260709 12:23:14.009316  1541 leader_election.cc:304] T 35e2641f47dc49c082348e450e31911d P 683a2f1018404bbea77e99732b6baeb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a653ba4e41749d7b863fa58e89f6444, 683a2f1018404bbea77e99732b6baeb7; no voters: 
I20260709 12:23:14.011405  1573 raft_consensus.cc:1275] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Refusing update from remote peer f7b98485eacd4e838f526f29916c9241: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:14.013325  1842 raft_consensus.cc:2804] T 35e2641f47dc49c082348e450e31911d P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:14.016757  1908 consensus_queue.cc:1048] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:14.021732  1500 raft_consensus.cc:2468] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 683a2f1018404bbea77e99732b6baeb7 in term 2.
I20260709 12:23:14.027607  1842 raft_consensus.cc:697] T 35e2641f47dc49c082348e450e31911d P 683a2f1018404bbea77e99732b6baeb7 [term 2 LEADER]: Becoming Leader. State: Replica: 683a2f1018404bbea77e99732b6baeb7, State: Running, Role: LEADER
I20260709 12:23:14.028960  1842 consensus_queue.cc:237] T 35e2641f47dc49c082348e450e31911d P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } }
I20260709 12:23:14.038667  1401 catalog_manager.cc:5697] T 35e2641f47dc49c082348e450e31911d P 683a2f1018404bbea77e99732b6baeb7 reported cstate change: term changed from 1 to 2, leader changed from f7b98485eacd4e838f526f29916c9241 (127.22.155.193) to 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194). New cstate: current_term: 2 leader_uuid: "683a2f1018404bbea77e99732b6baeb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:14.080031  1649 raft_consensus.cc:1275] T 540df58a2d224bb3b7f8f7874b9f60a1 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Refusing update from remote peer f7b98485eacd4e838f526f29916c9241: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:14.081887  1908 consensus_queue.cc:1048] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:14.085470  1652 raft_consensus.cc:1275] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 3 FOLLOWER]: Refusing update from remote peer f7b98485eacd4e838f526f29916c9241: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:14.087395  1937 consensus_queue.cc:1048] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:14.105042  1573 raft_consensus.cc:1275] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [term 3 FOLLOWER]: Refusing update from remote peer f7b98485eacd4e838f526f29916c9241: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:14.107982  1908 consensus_queue.cc:1048] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:14.121665  1576 raft_consensus.cc:1275] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Refusing update from remote peer f7b98485eacd4e838f526f29916c9241: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:14.123356  1896 consensus_queue.cc:1048] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "683a2f1018404bbea77e99732b6baeb7" member_type: VOTER last_known_addr { host: "127.22.155.194" port: 35903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:14.169250  1652 raft_consensus.cc:1275] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Refusing update from remote peer 683a2f1018404bbea77e99732b6baeb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:14.173451  1842 consensus_queue.cc:1048] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:14.193250  1500 raft_consensus.cc:1275] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Refusing update from remote peer 683a2f1018404bbea77e99732b6baeb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:14.197258  1959 consensus_queue.cc:1048] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:14.375442  1650 raft_consensus.cc:1275] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Refusing update from remote peer 683a2f1018404bbea77e99732b6baeb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:14.377281  1909 consensus_queue.cc:1048] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:14.390106  1500 raft_consensus.cc:1275] T d3609d2ce60d4f1ab2c819c3b4c9c833 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Refusing update from remote peer 683a2f1018404bbea77e99732b6baeb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:14.391809  1909 consensus_queue.cc:1048] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:14.447543  1500 raft_consensus.cc:1275] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Refusing update from remote peer 683a2f1018404bbea77e99732b6baeb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:14.448904  1959 consensus_queue.cc:1048] T 35e2641f47dc49c082348e450e31911d P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7b98485eacd4e838f526f29916c9241" member_type: VOTER last_known_addr { host: "127.22.155.193" port: 41841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:14.472450  1652 raft_consensus.cc:1275] T 35e2641f47dc49c082348e450e31911d P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Refusing update from remote peer 683a2f1018404bbea77e99732b6baeb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:14.476927  1842 consensus_queue.cc:1048] T 35e2641f47dc49c082348e450e31911d P 683a2f1018404bbea77e99732b6baeb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a653ba4e41749d7b863fa58e89f6444" member_type: VOTER last_known_addr { host: "127.22.155.195" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:16.453323  1398 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52836:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:23:16.484395  1398 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52836:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:23:16.545605 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:16.574373 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:16.576346 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:23:16.605537  1996 log.cc:927] Time spent T 35e2641f47dc49c082348e450e31911d P 683a2f1018404bbea77e99732b6baeb7: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 12:23:16.745247  1992 log.cc:927] Time spent T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 12:23:16.884936  2021 log.cc:927] Time spent T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7: Append to log took a long time: real 0.093s	user 0.005s	sys 0.000s
I20260709 12:23:16.904915  2030 tablet.cc:1724] T 35e2641f47dc49c082348e450e31911d P 683a2f1018404bbea77e99732b6baeb7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:23:16.987840  2010 log.cc:927] Time spent T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444: Append to log took a long time: real 0.089s	user 0.005s	sys 0.000s
W20260709 12:23:16.993587  2025 log.cc:927] Time spent T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444: Append to log took a long time: real 0.087s	user 0.003s	sys 0.000s
I20260709 12:23:16.973758  2034 tablet.cc:1724] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:23:16.996223  2028 log.cc:927] Time spent T b80a9fff62da4ffe823fb144a2300b05 P 683a2f1018404bbea77e99732b6baeb7: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:23:16.965094  2031 tablet.cc:1724] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:23:17.053035  1466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.195:40949, user_credentials={real_user=slave}} blocked reactor thread for 116089us
W20260709 12:23:17.043028  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35903, user_credentials={real_user=slave}} blocked reactor thread for 49205us
W20260709 12:23:17.061084  1468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.155.194:35903, user_credentials={real_user=slave}} blocked reactor thread for 143215us
I20260709 12:23:17.077777  2043 tablet.cc:1724] T 540df58a2d224bb3b7f8f7874b9f60a1 P 5a653ba4e41749d7b863fa58e89f6444: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:17.115197  2052 tablet.cc:1724] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:17.127425  2045 tablet.cc:1724] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:23:17.133406  2042 log.cc:927] Time spent T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:23:17.124320  2037 tablet.cc:1724] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:17.136861  2038 tablet.cc:1724] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:17.182494  2034 tablet.cc:1724] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:17.197543  2034 tablet.cc:1724] T b80a9fff62da4ffe823fb144a2300b05 P f7b98485eacd4e838f526f29916c9241: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:17.200209  2049 tablet.cc:1724] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:17.202924  2051 tablet.cc:1724] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:17.198319  2038 tablet.cc:1724] T 64dcc964d9d14290995ebc0c51528cc3 P f7b98485eacd4e838f526f29916c9241: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:17.220079  2053 tablet.cc:1724] T 35e2641f47dc49c082348e450e31911d P 5a653ba4e41749d7b863fa58e89f6444: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:17.221819  2037 tablet.cc:1724] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:17.222121  2031 tablet.cc:1724] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:17.224382  2034 tablet.cc:1724] T d3609d2ce60d4f1ab2c819c3b4c9c833 P f7b98485eacd4e838f526f29916c9241: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:17.151998  2030 tablet.cc:1724] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:17.233523  2054 tablet.cc:1724] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:17.237816  2031 tablet.cc:1724] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:17.227608  2043 tablet.cc:1724] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:17.252947  2031 tablet.cc:1724] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:17.258198  2052 tablet.cc:1724] T b80a9fff62da4ffe823fb144a2300b05 P 683a2f1018404bbea77e99732b6baeb7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:17.282435  2045 tablet.cc:1724] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:17.301337  2053 tablet.cc:1724] T 64dcc964d9d14290995ebc0c51528cc3 P 5a653ba4e41749d7b863fa58e89f6444: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:17.301541  2054 tablet.cc:1724] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:17.292325  2043 tablet.cc:1724] T 3114e99a2f114bd7bce9dc356e645b2a P 5a653ba4e41749d7b863fa58e89f6444: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:17.347270  1401 catalog_manager.cc:6242] T 00000000000000000000000000000000 P d1f480894fd94fb4b03b592b62dad15e: soft_deleted_table [id=09b69cbea1c94e93a441be87450f99de] alter complete (version 1)
I20260709 12:23:17.583343 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:17.588900 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:17.589414 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:18.590585 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:18.596233 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:18.596705 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:19.597893 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:19.603435 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:19.603982 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:20.605257 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:20.611274 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:20.611814 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:21.613485 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:21.620432 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:21.620967 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:22.622345 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:22.629668 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:22.630276 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:23.631551 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:23.637614 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:23.638096 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:24.639195 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:24.648581 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:24.649261 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:25.650508 23151 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:25.657470 23151 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:25.657985 23151 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:26.728683 23151 tablet_server.cc:179] TabletServer@127.22.155.193:0 shutting down...
I20260709 12:23:26.784222 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:26.785524 23151 tablet_replica.cc:333] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241: stopping tablet replica
I20260709 12:23:26.787045 23151 raft_consensus.cc:2243] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:26.788105 23151 raft_consensus.cc:2272] T cf0e85dd20554395a1b734ec51f4acfb P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.793107 23151 tablet_replica.cc:333] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241: stopping tablet replica
I20260709 12:23:26.794315 23151 raft_consensus.cc:2243] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:26.795285 23151 raft_consensus.cc:2272] T 35e2641f47dc49c082348e450e31911d P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.799062 23151 tablet_replica.cc:333] T d3609d2ce60d4f1ab2c819c3b4c9c833 P f7b98485eacd4e838f526f29916c9241: stopping tablet replica
I20260709 12:23:26.799830 23151 raft_consensus.cc:2243] T d3609d2ce60d4f1ab2c819c3b4c9c833 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:26.800511 23151 raft_consensus.cc:2272] T d3609d2ce60d4f1ab2c819c3b4c9c833 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.803402 23151 tablet_replica.cc:333] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241: stopping tablet replica
I20260709 12:23:26.804062 23151 raft_consensus.cc:2243] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:26.804622 23151 raft_consensus.cc:2272] T 8decea69eec245aba482134428dcbfb9 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:26.807948  1616 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 15 similar messages]
I20260709 12:23:26.808748 23151 tablet_replica.cc:333] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241: stopping tablet replica
I20260709 12:23:26.809728 23151 raft_consensus.cc:2243] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:26.811185 23151 raft_consensus.cc:2272] T 10b22316e72c423aaa1015d8467cbc19 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:26.812206  1616 consensus_peers.cc:597] T aef1ee0de44340bcac5c557df76496bc P 5a653ba4e41749d7b863fa58e89f6444 -> Peer f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841): Couldn't send request to peer f7b98485eacd4e838f526f29916c9241. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:26.814764 23151 tablet_replica.cc:333] T e891cda7a3bf4536a9729ebc2669c144 P f7b98485eacd4e838f526f29916c9241: stopping tablet replica
I20260709 12:23:26.815615 23151 raft_consensus.cc:2243] T e891cda7a3bf4536a9729ebc2669c144 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:26.816208 23151 raft_consensus.cc:2272] T e891cda7a3bf4536a9729ebc2669c144 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.819211 23151 tablet_replica.cc:333] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241: stopping tablet replica
I20260709 12:23:26.819880 23151 raft_consensus.cc:2243] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:23:26.820988 23151 raft_consensus.cc:2272] T d3aad6b70d2340a0aeda7e4edd7c55d8 P f7b98485eacd4e838f526f29916c9241 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.824162 23151 tablet_replica.cc:333] T b80a9fff62da4ffe823fb144a2300b05 P f7b98485eacd4e838f526f29916c9241: stopping tablet replica
I20260709 12:23:26.824841 23151 raft_consensus.cc:2243] T b80a9fff62da4ffe823fb144a2300b05 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:26.825505 23151 raft_consensus.cc:2272] T b80a9fff62da4ffe823fb144a2300b05 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.829259 23151 tablet_replica.cc:333] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241: stopping tablet replica
I20260709 12:23:26.830323 23151 raft_consensus.cc:2243] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:26.831071 23151 raft_consensus.cc:2272] T f963b0bc8284494bb00908db689b8a42 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:26.832798  1542 consensus_peers.cc:597] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 -> Peer f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841): Couldn't send request to peer f7b98485eacd4e838f526f29916c9241. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:26.834560 23151 tablet_replica.cc:333] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241: stopping tablet replica
I20260709 12:23:26.835654 23151 raft_consensus.cc:2243] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:26.837071 23151 raft_consensus.cc:2272] T 3114e99a2f114bd7bce9dc356e645b2a P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:26.838366  1542 consensus_peers.cc:597] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7 -> Peer f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841): Couldn't send request to peer f7b98485eacd4e838f526f29916c9241. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:26.840407 23151 tablet_replica.cc:333] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241: stopping tablet replica
I20260709 12:23:26.841188 23151 raft_consensus.cc:2243] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:26.842121 23151 raft_consensus.cc:2272] T 30cddd6873234c5f9f6078f1fb193e4a P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.844760 23151 tablet_replica.cc:333] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241: stopping tablet replica
I20260709 12:23:26.845323 23151 raft_consensus.cc:2243] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:26.845826 23151 raft_consensus.cc:2272] T aef1ee0de44340bcac5c557df76496bc P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.848639 23151 tablet_replica.cc:333] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241: stopping tablet replica
I20260709 12:23:26.849320 23151 raft_consensus.cc:2243] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:26.849812 23151 raft_consensus.cc:2272] T 1d6923852b214d25b708fd501a7158fb P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.852345 23151 tablet_replica.cc:333] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241: stopping tablet replica
I20260709 12:23:26.852933 23151 raft_consensus.cc:2243] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:26.853412 23151 raft_consensus.cc:2272] T 2f1d51316b514da6932b968cef61ed95 P f7b98485eacd4e838f526f29916c9241 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.856173 23151 tablet_replica.cc:333] T 64dcc964d9d14290995ebc0c51528cc3 P f7b98485eacd4e838f526f29916c9241: stopping tablet replica
I20260709 12:23:26.856931 23151 raft_consensus.cc:2243] T 64dcc964d9d14290995ebc0c51528cc3 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:26.857515 23151 raft_consensus.cc:2272] T 64dcc964d9d14290995ebc0c51528cc3 P f7b98485eacd4e838f526f29916c9241 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.860185 23151 tablet_replica.cc:333] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241: stopping tablet replica
I20260709 12:23:26.860795 23151 raft_consensus.cc:2243] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:26.861835 23151 raft_consensus.cc:2272] T 540df58a2d224bb3b7f8f7874b9f60a1 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.864460 23151 tablet_replica.cc:333] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241: stopping tablet replica
I20260709 12:23:26.865097 23151 raft_consensus.cc:2243] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:26.866117 23151 raft_consensus.cc:2272] T 607b48f8b7484b12badcd4e0b7d2dd03 P f7b98485eacd4e838f526f29916c9241 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.869024 23151 tablet_replica.cc:333] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241: stopping tablet replica
I20260709 12:23:26.869606 23151 raft_consensus.cc:2243] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:23:26.870751 23151 raft_consensus.cc:2272] T f062c725755040f99ed0fef6f284f193 P f7b98485eacd4e838f526f29916c9241 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:26.879142  1542 consensus_peers.cc:597] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 -> Peer f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841): Couldn't send request to peer f7b98485eacd4e838f526f29916c9241. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:26.894212  1616 consensus_peers.cc:597] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 -> Peer f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841): Couldn't send request to peer f7b98485eacd4e838f526f29916c9241. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:26.902151  1542 consensus_peers.cc:597] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7 -> Peer f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841): Couldn't send request to peer f7b98485eacd4e838f526f29916c9241. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:26.933342 23151 tablet_server.cc:196] TabletServer@127.22.155.193:0 shutdown complete.
I20260709 12:23:26.989852 23151 tablet_server.cc:179] TabletServer@127.22.155.194:0 shutting down...
W20260709 12:23:27.018360  1616 consensus_peers.cc:597] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444 -> Peer f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841): Couldn't send request to peer f7b98485eacd4e838f526f29916c9241. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:41841: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:27.024010  1542 consensus_peers.cc:597] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7 -> Peer f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841): Couldn't send request to peer f7b98485eacd4e838f526f29916c9241. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:41841: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:27.042145 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:27.043203 23151 tablet_replica.cc:333] T 35e2641f47dc49c082348e450e31911d P 683a2f1018404bbea77e99732b6baeb7: stopping tablet replica
I20260709 12:23:27.044405 23151 raft_consensus.cc:2243] T 35e2641f47dc49c082348e450e31911d P 683a2f1018404bbea77e99732b6baeb7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:27.045459 23151 raft_consensus.cc:2272] T 35e2641f47dc49c082348e450e31911d P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.048079 23151 tablet_replica.cc:333] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7: stopping tablet replica
I20260709 12:23:27.048884 23151 raft_consensus.cc:2243] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:27.049824 23151 raft_consensus.cc:2272] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.052263 23151 tablet_replica.cc:333] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7: stopping tablet replica
I20260709 12:23:27.053023 23151 raft_consensus.cc:2243] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:27.053923 23151 raft_consensus.cc:2272] T cf0e85dd20554395a1b734ec51f4acfb P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.056250 23151 tablet_replica.cc:333] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7: stopping tablet replica
I20260709 12:23:27.056993 23151 raft_consensus.cc:2243] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:27.058101 23151 raft_consensus.cc:2272] T 64dcc964d9d14290995ebc0c51528cc3 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.060753 23151 tablet_replica.cc:333] T aef1ee0de44340bcac5c557df76496bc P 683a2f1018404bbea77e99732b6baeb7: stopping tablet replica
I20260709 12:23:27.061367 23151 raft_consensus.cc:2243] T aef1ee0de44340bcac5c557df76496bc P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.061897 23151 raft_consensus.cc:2272] T aef1ee0de44340bcac5c557df76496bc P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.064355 23151 tablet_replica.cc:333] T 30cddd6873234c5f9f6078f1fb193e4a P 683a2f1018404bbea77e99732b6baeb7: stopping tablet replica
I20260709 12:23:27.065044 23151 raft_consensus.cc:2243] T 30cddd6873234c5f9f6078f1fb193e4a P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.065511 23151 raft_consensus.cc:2272] T 30cddd6873234c5f9f6078f1fb193e4a P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.067881 23151 tablet_replica.cc:333] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7: stopping tablet replica
I20260709 12:23:27.068465 23151 raft_consensus.cc:2243] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.068998 23151 raft_consensus.cc:2272] T 3114e99a2f114bd7bce9dc356e645b2a P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.072469 23151 tablet_replica.cc:333] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7: stopping tablet replica
I20260709 12:23:27.073274 23151 raft_consensus.cc:2243] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:27.074404 23151 raft_consensus.cc:2272] T 1d6923852b214d25b708fd501a7158fb P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.076864 23151 tablet_replica.cc:333] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7: stopping tablet replica
I20260709 12:23:27.077442 23151 raft_consensus.cc:2243] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.077953 23151 raft_consensus.cc:2272] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 683a2f1018404bbea77e99732b6baeb7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.080201 23151 tablet_replica.cc:333] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7: stopping tablet replica
I20260709 12:23:27.080785 23151 raft_consensus.cc:2243] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.081342 23151 raft_consensus.cc:2272] T 607b48f8b7484b12badcd4e0b7d2dd03 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.083446 23151 tablet_replica.cc:333] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7: stopping tablet replica
I20260709 12:23:27.084004 23151 raft_consensus.cc:2243] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.084553 23151 raft_consensus.cc:2272] T 540df58a2d224bb3b7f8f7874b9f60a1 P 683a2f1018404bbea77e99732b6baeb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.086721 23151 tablet_replica.cc:333] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7: stopping tablet replica
I20260709 12:23:27.087303 23151 raft_consensus.cc:2243] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.087877 23151 raft_consensus.cc:2272] T f062c725755040f99ed0fef6f284f193 P 683a2f1018404bbea77e99732b6baeb7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.090267 23151 tablet_replica.cc:333] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7: stopping tablet replica
I20260709 12:23:27.090891 23151 raft_consensus.cc:2243] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.091416 23151 raft_consensus.cc:2272] T 8decea69eec245aba482134428dcbfb9 P 683a2f1018404bbea77e99732b6baeb7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.093914 23151 tablet_replica.cc:333] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7: stopping tablet replica
I20260709 12:23:27.094487 23151 raft_consensus.cc:2243] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:27.095433 23151 raft_consensus.cc:2272] T 2f1d51316b514da6932b968cef61ed95 P 683a2f1018404bbea77e99732b6baeb7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.098039 23151 tablet_replica.cc:333] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7: stopping tablet replica
I20260709 12:23:27.098610 23151 raft_consensus.cc:2243] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:27.099678 23151 raft_consensus.cc:2272] T e891cda7a3bf4536a9729ebc2669c144 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.103570 23151 tablet_replica.cc:333] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7: stopping tablet replica
I20260709 12:23:27.104189 23151 raft_consensus.cc:2243] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.105048 23151 raft_consensus.cc:2272] T 10b22316e72c423aaa1015d8467cbc19 P 683a2f1018404bbea77e99732b6baeb7 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:27.105074  1617 consensus_peers.cc:597] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 -> Peer 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903): Couldn't send request to peer 683a2f1018404bbea77e99732b6baeb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:27.107586 23151 tablet_replica.cc:333] T b80a9fff62da4ffe823fb144a2300b05 P 683a2f1018404bbea77e99732b6baeb7: stopping tablet replica
I20260709 12:23:27.108124 23151 raft_consensus.cc:2243] T b80a9fff62da4ffe823fb144a2300b05 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.108692 23151 raft_consensus.cc:2272] T b80a9fff62da4ffe823fb144a2300b05 P 683a2f1018404bbea77e99732b6baeb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.110971 23151 tablet_replica.cc:333] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7: stopping tablet replica
I20260709 12:23:27.111462 23151 raft_consensus.cc:2243] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.111903 23151 raft_consensus.cc:2272] T f963b0bc8284494bb00908db689b8a42 P 683a2f1018404bbea77e99732b6baeb7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.187484 23151 tablet_server.cc:196] TabletServer@127.22.155.194:0 shutdown complete.
I20260709 12:23:27.230880 23151 tablet_server.cc:179] TabletServer@127.22.155.195:0 shutting down...
W20260709 12:23:27.244529  1616 consensus_peers.cc:597] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 -> Peer f7b98485eacd4e838f526f29916c9241 (127.22.155.193:41841): Couldn't send request to peer f7b98485eacd4e838f526f29916c9241. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.193:41841: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:27.276377 23151 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:27.277406 23151 tablet_replica.cc:333] T 64dcc964d9d14290995ebc0c51528cc3 P 5a653ba4e41749d7b863fa58e89f6444: stopping tablet replica
I20260709 12:23:27.278486 23151 raft_consensus.cc:2243] T 64dcc964d9d14290995ebc0c51528cc3 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.279161 23151 raft_consensus.cc:2272] T 64dcc964d9d14290995ebc0c51528cc3 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.282483 23151 tablet_replica.cc:333] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444: stopping tablet replica
I20260709 12:23:27.283339 23151 raft_consensus.cc:2243] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.284201 23151 raft_consensus.cc:2272] T cf0e85dd20554395a1b734ec51f4acfb P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:27.285317  1617 consensus_peers.cc:597] T aef1ee0de44340bcac5c557df76496bc P 5a653ba4e41749d7b863fa58e89f6444 -> Peer 683a2f1018404bbea77e99732b6baeb7 (127.22.155.194:35903): Couldn't send request to peer 683a2f1018404bbea77e99732b6baeb7. Status: Network error: Client connection negotiation failed: client connection to 127.22.155.194:35903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:27.287062 23151 tablet_replica.cc:333] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444: stopping tablet replica
I20260709 12:23:27.287883 23151 raft_consensus.cc:2243] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.288473 23151 raft_consensus.cc:2272] T 607b48f8b7484b12badcd4e0b7d2dd03 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.291136 23151 tablet_replica.cc:333] T 540df58a2d224bb3b7f8f7874b9f60a1 P 5a653ba4e41749d7b863fa58e89f6444: stopping tablet replica
I20260709 12:23:27.291810 23151 raft_consensus.cc:2243] T 540df58a2d224bb3b7f8f7874b9f60a1 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.292404 23151 raft_consensus.cc:2272] T 540df58a2d224bb3b7f8f7874b9f60a1 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.294965 23151 tablet_replica.cc:333] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444: stopping tablet replica
I20260709 12:23:27.295672 23151 raft_consensus.cc:2243] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.296217 23151 raft_consensus.cc:2272] T f062c725755040f99ed0fef6f284f193 P 5a653ba4e41749d7b863fa58e89f6444 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.298983 23151 tablet_replica.cc:333] T aef1ee0de44340bcac5c557df76496bc P 5a653ba4e41749d7b863fa58e89f6444: stopping tablet replica
I20260709 12:23:27.299715 23151 raft_consensus.cc:2243] T aef1ee0de44340bcac5c557df76496bc P 5a653ba4e41749d7b863fa58e89f6444 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:27.301216 23151 raft_consensus.cc:2272] T aef1ee0de44340bcac5c557df76496bc P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.303826 23151 tablet_replica.cc:333] T 3114e99a2f114bd7bce9dc356e645b2a P 5a653ba4e41749d7b863fa58e89f6444: stopping tablet replica
I20260709 12:23:27.304689 23151 raft_consensus.cc:2243] T 3114e99a2f114bd7bce9dc356e645b2a P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.305253 23151 raft_consensus.cc:2272] T 3114e99a2f114bd7bce9dc356e645b2a P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.307765 23151 tablet_replica.cc:333] T 30cddd6873234c5f9f6078f1fb193e4a P 5a653ba4e41749d7b863fa58e89f6444: stopping tablet replica
I20260709 12:23:27.308429 23151 raft_consensus.cc:2243] T 30cddd6873234c5f9f6078f1fb193e4a P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.308972 23151 raft_consensus.cc:2272] T 30cddd6873234c5f9f6078f1fb193e4a P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.311429 23151 tablet_replica.cc:333] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444: stopping tablet replica
I20260709 12:23:27.312096 23151 raft_consensus.cc:2243] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:27.313086 23151 raft_consensus.cc:2272] T b80a9fff62da4ffe823fb144a2300b05 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.315459 23151 tablet_replica.cc:333] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444: stopping tablet replica
I20260709 12:23:27.316093 23151 raft_consensus.cc:2243] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:27.317137 23151 raft_consensus.cc:2272] T f963b0bc8284494bb00908db689b8a42 P 5a653ba4e41749d7b863fa58e89f6444 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.319653 23151 tablet_replica.cc:333] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444: stopping tablet replica
I20260709 12:23:27.320274 23151 raft_consensus.cc:2243] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.320855 23151 raft_consensus.cc:2272] T 10b22316e72c423aaa1015d8467cbc19 P 5a653ba4e41749d7b863fa58e89f6444 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.323148 23151 tablet_replica.cc:333] T e891cda7a3bf4536a9729ebc2669c144 P 5a653ba4e41749d7b863fa58e89f6444: stopping tablet replica
I20260709 12:23:27.323729 23151 raft_consensus.cc:2243] T e891cda7a3bf4536a9729ebc2669c144 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.324311 23151 raft_consensus.cc:2272] T e891cda7a3bf4536a9729ebc2669c144 P 5a653ba4e41749d7b863fa58e89f6444 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.326829 23151 tablet_replica.cc:333] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444: stopping tablet replica
I20260709 12:23:27.327445 23151 raft_consensus.cc:2243] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:27.328425 23151 raft_consensus.cc:2272] T 8decea69eec245aba482134428dcbfb9 P 5a653ba4e41749d7b863fa58e89f6444 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.330901 23151 tablet_replica.cc:333] T 1d6923852b214d25b708fd501a7158fb P 5a653ba4e41749d7b863fa58e89f6444: stopping tablet replica
I20260709 12:23:27.331566 23151 raft_consensus.cc:2243] T 1d6923852b214d25b708fd501a7158fb P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.332118 23151 raft_consensus.cc:2272] T 1d6923852b214d25b708fd501a7158fb P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.334506 23151 tablet_replica.cc:333] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444: stopping tablet replica
I20260709 12:23:27.335095 23151 raft_consensus.cc:2243] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.335669 23151 raft_consensus.cc:2272] T d3609d2ce60d4f1ab2c819c3b4c9c833 P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.338129 23151 tablet_replica.cc:333] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444: stopping tablet replica
I20260709 12:23:27.338685 23151 raft_consensus.cc:2243] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.339274 23151 raft_consensus.cc:2272] T d3aad6b70d2340a0aeda7e4edd7c55d8 P 5a653ba4e41749d7b863fa58e89f6444 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.341609 23151 tablet_replica.cc:333] T 35e2641f47dc49c082348e450e31911d P 5a653ba4e41749d7b863fa58e89f6444: stopping tablet replica
I20260709 12:23:27.342126 23151 raft_consensus.cc:2243] T 35e2641f47dc49c082348e450e31911d P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.342655 23151 raft_consensus.cc:2272] T 35e2641f47dc49c082348e450e31911d P 5a653ba4e41749d7b863fa58e89f6444 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.345000 23151 tablet_replica.cc:333] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444: stopping tablet replica
I20260709 12:23:27.345492 23151 raft_consensus.cc:2243] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.346019 23151 raft_consensus.cc:2272] T 2f1d51316b514da6932b968cef61ed95 P 5a653ba4e41749d7b863fa58e89f6444 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.393447 23151 tablet_server.cc:196] TabletServer@127.22.155.195:0 shutdown complete.
I20260709 12:23:27.439623 23151 master.cc:562] Master@127.22.155.254:35515 shutting down...
I20260709 12:23:27.472101 23151 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d1f480894fd94fb4b03b592b62dad15e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:27.472826 23151 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d1f480894fd94fb4b03b592b62dad15e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.473172 23151 tablet_replica.cc:333] T 00000000000000000000000000000000 P d1f480894fd94fb4b03b592b62dad15e: stopping tablet replica
I20260709 12:23:27.525763 23151 master.cc:584] Master@127.22.155.254:35515 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (24762 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (46267 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (407148 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 12:23:27.591910 23151 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2186 messages since previous log ~36 seconds ago
I20260709 12:23:27.592242 23151 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2186 messages since previous log ~36 seconds ago
I20260709 12:23:27.592429 23151 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2176 messages since previous log ~36 seconds ago
I20260709 12:23:27.592759 23151 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~54 seconds ago
I20260709 12:23:27.592978 23151 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~54 seconds ago
I20260709 12:23:27.593211 23151 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 1 messages since previous log ~120 seconds ago
I20260709 12:23:27.593442 23151 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 7 messages since previous log ~182 seconds ago
I20260709 12:23:27.593716 23151 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 4 messages since previous log ~198 seconds ago
I20260709 12:23:27.594061 23151 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20260709 12:23:27.594446 23151 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~23 seconds ago
